摘要
目前的迁移学习方法多针对单一迁移类型,使用低级特征空间,并且源集比目标集复杂耗力。针对这些问题,综合考虑特征表示迁移、参数迁移和实例迁移,提出迁移度量学习的通用框架。首先,基于属性相似性空间和类别相似性空间,利用层次K-均值聚类获取相似性;然后,利用信任评估框架和去相关归一化转换方法消除源集中的相关关系来抑制负迁移作用;最后,改进信息理论度量学习方法(ITML)进行相似性度量学习。对三种不同复杂度数据集进行实验,结果表明,提出方法的迁移学习性能较传统方法明显提高,且对负迁移影响具有更好的鲁棒性;提出的方法可应用于源集比目标集简单的情况,评估结果表明,即使源集知识有限,也可以得到较好的迁移学习效果。
Now most of transfer learning methods suffer from the problems that transfer types are separately analyzed,low level feature space are used,and the source data set is more diverse and complex than the target set. For these problems,this paper proposed a novel general transfer metric learning framework with comprehensive consideration of feature representation transfer,parameter transfer and instance transfer. Initially,it used hierarchical K-means clustering to get the similarity based on the semantic similarity space and category similarity space. Then,it utilized the trust evaluation framework and de-correlated normalized space to eliminate the correlation learned in the source domain,and restrained the negative transfer. Finally,it modified the information theoretic metric learning to precede similarity metric learning. The experiment results show that the transfer learning performance of the proposed method has improved greatly with more robust to negative transfer effect comparing with the traditional methods in three data sets with different complexity. Furthermore,the proposed method could be applied in the situation that the source data set was simpler than the target set. The results reveal that even when the knowledge source is limited,transfer learning can still be beneficial.
出处
《计算机应用研究》
CSCD
北大核心
2017年第12期3552-3555,3572,共5页
Application Research of Computers
基金
国家自然科学基金资助项目(61202143)
广西自然科学基金资助项目(2014GXNSFAA118027)
关键词
迁移度量学习
层次K-均值聚类
相似性空间
信任评估框架
去相关归一化空间
信息理论度量学习
transfer metric learning
hierarchical K-means clustering
similarity space
trust evaluation framework
de-correlated normalized space
information theoretic metric learning(ITML)
