用户满意度是以用户为中心的搜索引擎性能评价的一个重要分支,区别于传统基于查询与文档相关性的评价方法,基于用户满意度的性能评价能够更加全面、客观地对搜索引擎性能进行评价。该文通过设计搜索实验平台,在尽量不影响用户正常搜索过程的前提下收集用户的搜索行为及其满意度评价,通过用户行为分析的方法挖掘用户群体行为特征与用户查询满意度之间的关联关系。相关结论对提高搜索引擎性能、改善用户查询体验具有一定的参考意义。
Abstract
As an important category of traditional work in search engine evaluation, user satisfaction evaluation has many differences from traditional relevance measurement evaluation. User satisfaction is a more user-centered evaluation, providing a global and systematic evaluation to the performance of search engine. This paper describes the relationship between search engine user behavior and user satisfaction evaluation. We designs an experiment with the premise of avoiding impacting user searching experiences, through which we collected query-level explicit judgments of user satisfaction and user behavior log, then analyzes the collected data to elicit valuable conclusions. The findings provide insights into the improvement of the performance of search engine and the amelioration of user searching experiences.
关键词
搜索引擎 /
用户行为分析 /
用户满意度
{{custom_keyword}} /
Key words
search engine /
user behavior analysis /
user satisfaction
{{custom_keyword}} /
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
参考文献
[1] 中国互联网络信息中心,中国互联网络发展状况统计报告(2013年1月)[DB/OL]. http://www.cnnic.cn/hlwfzyj/hlwxzbg/hlwtjbg/201301/P020130122600399530412.pdf.
[2] 马少平, 刘奕群, 刘健,等. 中文搜索引擎用户行为的演化分析[J],中文信息学报, 2011, 25(6):90-97.
[3] 余慧佳, 刘奕群, 张敏,等. 基于大规模日志分析的网络搜索引擎用户行为研究[J],中文信息学报, 2007, 21(1): 109-114.
[4] 岑荣伟, 刘奕群, 张敏,等. 基于日志挖掘的搜索引擎用户行为分析[J],中文信息学报, 2010, 24(3): 49-54.
[5] Jane R. A task-oriented non-interactive evaluation methodology for information retrieval systems. Information Retrieval[J],2000, 2(1):115-129.
[6] Amanda S. A user-centered approach to evaluating human interaction with web search engines: an exploratory. Process Manage[J], 2002, 38(3):401-406.
[7] Scott B H, Michael H. How well does result relevance predict session satisfaction[C]//Proceedings of SIGIR 2007, 2007, 24(3):567-573.
[8] Ahmed H, Yang S, Li-wei H. A task level metric for measuring web search satisfaction and its application on improving relevance estimation[C]//Proceedings of CIKM 2011, October 24-28, Glasgow, 2011: 125-134.
[9] 王惠. 搜索引擎用户满意度研究[J],图书情报研究, 2009, 4(2):33-37.
[10] 朱彤,刘奕群,张敏,等. 基于用户行为的长查询用户满意度分析[C]. 第六届全国信息检索学术会议论文集,CCIR10. 2010.
[11] Yiqun Liu, Junwei Miao, Min Zhang, et al. How Do Users Describe Their Information Need: Query Recommendation based on Snippet Click Model[J], Expert Systems With Applications, 2011, 38(11): 13847-13856.
[12] Bo Zhou, Min Zhang, Shaoping Ma, et al. Log-Mining Based Query Spelling Correction for Chinese Search Engines[J], Journal of Computational Information Systems, 2009, 5(3): 1225-1234.
[13] Broder A. A taxonomy of Web search[C]//Proceedings of SIGIR Forum 36, 2002: 3-10.
[14] Cohens Kappa. Wikipedia, The Free Encyclopedia[DB/OL]. http://en.wikipedia.org/wiki/Cohens_kappa.
{{custom_fnGroup.title_cn}}
脚注
{{custom_fn.content}}
基金
国家863高科技项目(2011AA01A205),自然科学基金(60903107,61073071)
{{custom_fund}}
PDF(1816 KB)
