摘要
集成学习已经成为机器学习的研究方向之一,它可以显著地提高分类器的泛化性能.本文分析了Bag-ging及AdaBoost集成方法,指出了这两种方法的缺陷;然后提出了一种新的基于神经网络的分类器集成方法DBNNE,该方法通过生成差异数据增加集成的差异性;另外,当生成一个分类器后,采用了测试方法确保分类器集成的正确率;最后针对十个标准数据集进行了实验研究,结果表明集成算法DBNNE在小规模数据集上优于Bagging及AdaBoost集成方法,而在较大数据集上也不逊色于这两种集成方法.
Ensemble learning has become one of research fields of machine learning, it dramatically improves generalization performance of classifier.After analyzing ensemble approach to both Bagging and Adaboost, we point out their some flaws. Then we present a novel approach to neural network ensemble,called DBNNE below. In this method,a diverse data set is generated to increase ensemble diversity. Moreover, to ensure high accuracy of ensemble, we test performanee of ensemble when a classifier is added to ensemble . Finally, we experiment on ten representative data sets. The results show that DBNNE achieves higher predictive aceuracy than Bagging and AdaBoost on small data sets and comparable performance on larger data sets.
出处
《电子学报》
EI
CAS
CSCD
北大核心
2005年第8期1387-1390,共4页
Acta Electronica Sinica
基金
国家"十五"重点科技攻关项目(No.2002BA407B)
国家自然科学基金(No.60443003)
关键词
神经网络
集成
小规模数据集
差异性
泛化
neural network
ensemble
small data sets
diversity
generalization
