摘要
随着信息化技术的不断提升,各类社交平台上带有倾向性的图文数据量快速增长,图文融合的情感分析受到广泛关注,单一的情感分析方法不再能够满足多模态数据的需求。针对图文情感特征提取与融合的技术难题,首先,列举了目前应用较广的图文情感分析数据集,介绍了文本特征和图片特征的提取方式;然后,重点研究了当前图文特征融合方式,简述了在图文情感分析过程中存在的问题;最后,针对未来情感分析的研究方向进行了总结与展望。为深入了解图文融合技术,采用文献调研方法对图文情感分析的研究进行综述,有助于比较不同融合方法之间的区别,发现更具价值的研究方案。
With the continuous improvement of information technology,the amount of image-text data with orientation on various social platforms is growing rapidly,and the sentiment analysis with image and text fusion is widely concerned.The single sentiment analysis method can no longer meet the demand of multi-modal data.Aiming at the technical problems of image and text sentiment feature extraction and fusion,firstly,the widely used image and text emotional analysis datasets were listed,and the extraction methods of text features and image features were introduced.Then,the current fusion modes of image features and text features were focused on and the problems existing in the process of image-text sentiment analysis were briefly described.Finally,the research directions of sentiment analysis in the future were summarized and prospected for.In order to have a deeper understanding of image-text fusion technology,literature research method was adopted to review the study of image-text sentiment analysis,which is helpful to compare the differences between different fusion methods and find more valuable research schemes.
作者
孟祥瑞
杨文忠
王婷
MENG Xiangrui;YANG Wenzhong;WANG Ting(College of Information Science and Engineering,Xinjiang University,Urumqi Xinjiang 830046,China;School of Software,Xinjiang University,Urumqi Xinjiang 830046,China)
出处
《计算机应用》
CSCD
北大核心
2021年第2期307-317,共11页
journal of Computer Applications
基金
国家自然科学基金重点项目(U1435215)
国家自然科学基金资助项目(U1603115)
国家重点研发计划项目(2017YFC0820702-3)
四川省科技计划项目(WA2018-YY007)。
关键词
图文融合
情感分析
特征融合
机器学习
社交媒体
image and text fusion
sentiment analysis
feature fusion
machine learning
social media
