期刊文献+

基于用户日志的查询扩展统计模型 被引量:61

A Statistical Query Expansion Model Based on Query Logs
下载PDF
导出
摘要 信息检索长期存在着用词歧义性问题,在Web搜索上的表现更加突出.提出了一种基于用户查询日志的查询扩展统计模型,将用户查询中使用的词或短语与文档中出现的相应词或短语以条件概率的形式连接,利用贝叶斯公式挑选出文档中与该查询关联最紧密的词加入原查询,以达到扩展优化的目的.实验结果表明,该方法更适宜改进Web上的信息检索,相对传统的查询扩展算法可以大幅度提高查询精度. Ambiguity of query terms has been a long-standing problem in information retrieval field, which becomes more serious in Web searching. A method for automatic query expansion based on query logs obtained from users?daily usage is suggested. This model establishes probabilistic relationship between terms in documents and in user queries through statistical learning from the log, and selects high-related expansion terms based on Bayesian theory. These expansion terms are added into the original query to formulate a new one in order to improve the effectiveness of retrieval. Experimental results show that this technique is more adaptive to Web searching, and can improve the precision of document retrieval markedly compared with conventional ones.
出处 《软件学报》 EI CSCD 北大核心 2003年第9期1593-1599,共7页 Journal of Software
基金 国家自然科学基金~~
关键词 信息检索 查询扩展 用户日志 日志挖掘 information retrieval query expansion user log log mining
  • 相关文献

参考文献10

  • 1Furnas GW, Landauer TK, Gomez LM, Dumais ST. The vocabulary problem in human-system communication. Communication of ACM, 1987,30(11):964~971.
  • 2Wen JR, Nie JY, Zhang HJ. Clustering user queries of a search engine. In: Proceedings of the 10th International World Wide Web Conference (WWW10). New York: ACM Press, 2001. 162~168.
  • 3Xu JX, Croft WB. Query expansion using local and global document analysis. In: Frei HP, Harman D, Schauble P, Wilkinson R,eds. Proceedings of the 19th Annual International SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press, 1996. 4~11.
  • 4Xu JX, Croft WB. Improving the effectiveness of information retrieval with local context analysis. ACM Transactions on Information Systems, 2000,18(1):79~112.
  • 5Deerwester S, Dumai ST, Furnas GW, Landauer TK, Harshman R. Indexing by latent semantic analysis. Journal of ACM Transactions on Information Systems, 2000,18(1):79~112.
  • 6Qiu Y, Frei H. Concept based query expansion. In: Korfhage R, Rasmussen EM, Willett P, eds. Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press, 1993.160~169.
  • 7Attar R, Fraenkel AS. Local feedback in full-text retrieval systems. Journal of the ACM, 1977,24(3):397~417.
  • 8Buckley C, Salton G, Allan J, Singhal A. Automatic query expansion using SMART. Technical Report, TREC-3, 1995. 69~80.
  • 9Ricardo B-Y, Berthier R-N. Modem Information Retrieval. England: Pearson Education Limited, 1999.
  • 10Hull D. Using statistical testing in the evaluation of retrieval experiments. In: Korfhage R, Rasmussen EM, Willett P, eds.Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.New York: ACM Press, 1993. 329~338.

同被引文献630

引证文献61

二级引证文献328

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部