刘健,刘奕群,马少平,张敏,茹立云,张阔. 搜索引擎用户行为与用户满意度的关联研究[J]. 中文信息学报, 2014, 28(1): 73-79.
LIU Jian, LIU Yiqun, MA Shaoping, ZHANG Min, RU Liyun, ZHANG Kuo. Analysis into the Relationship Between Search Engine User Behavior and User Satisfaction Evaluation. , 2014, 28(1): 73-79.
Analysis into the Relationship Between Search Engine User Behavior and User Satisfaction Evaluation
LIU Jian, LIU Yiqun, MA Shaoping, ZHANG Min, RU Liyun, ZHANG Kuo
State Key Laboratory of Intelligent Technology and Systems; Tsinghua National Laboratory for Information Science and Technology; Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
Abstract：As an important category of traditional work in search engine evaluation, user satisfaction evaluation has many differences from traditional relevance measurement evaluation. User satisfaction is a more user-centered evaluation, providing a global and systematic evaluation to the performance of search engine. This paper describes the relationship between search engine user behavior and user satisfaction evaluation. We designs an experiment with the premise of avoiding impacting user searching experiences, through which we collected query-level explicit judgments of user satisfaction and user behavior log, then analyzes the collected data to elicit valuable conclusions. The findings provide insights into the improvement of the performance of search engine and the amelioration of user searching experiences.
[1] 中国互联网络信息中心,中国互联网络发展状况统计报告(2013年1月)[DB/OL]. http://www.cnnic.cn/hlwfzyj/hlwxzbg/hlwtjbg/201301/P020130122600399530412.pdf. [2] 马少平, 刘奕群, 刘健,等. 中文搜索引擎用户行为的演化分析[J],中文信息学报, 2011, 25(6):90-97. [3] 余慧佳, 刘奕群, 张敏,等. 基于大规模日志分析的网络搜索引擎用户行为研究[J],中文信息学报, 2007, 21(1): 109-114. [4] 岑荣伟, 刘奕群, 张敏,等. 基于日志挖掘的搜索引擎用户行为分析[J],中文信息学报, 2010, 24(3): 49-54. [5] Jane R. A task-oriented non-interactive evaluation methodology for information retrieval systems. Information Retrieval[J],2000, 2(1):115-129. [6] Amanda S. A user-centered approach to evaluating human interaction with web search engines: an exploratory. Process Manage[J], 2002, 38(3):401-406. [7] Scott B H, Michael H. How well does result relevance predict session satisfaction[C]//Proceedings of SIGIR 2007, 2007, 24(3):567-573. [8] Ahmed H, Yang S, Li-wei H. A task level metric for measuring web search satisfaction and its application on improving relevance estimation[C]//Proceedings of CIKM 2011, October 24-28, Glasgow, 2011: 125-134. [9] 王惠. 搜索引擎用户满意度研究[J],图书情报研究, 2009, 4(2):33-37. [10] 朱彤,刘奕群,张敏,等. 基于用户行为的长查询用户满意度分析[C]. 第六届全国信息检索学术会议论文集,CCIR10. 2010. [11] Yiqun Liu, Junwei Miao, Min Zhang, et al. How Do Users Describe Their Information Need: Query Recommendation based on Snippet Click Model[J], Expert Systems With Applications, 2011, 38(11): 13847-13856. [12] Bo Zhou, Min Zhang, Shaoping Ma, et al. Log-Mining Based Query Spelling Correction for Chinese Search Engines[J], Journal of Computational Information Systems, 2009, 5(3): 1225-1234. [13] Broder A. A taxonomy of Web search[C]//Proceedings of SIGIR Forum 36, 2002: 3-10. [14] Cohens Kappa. Wikipedia, The Free Encyclopedia[DB/OL]. http://en.wikipedia.org/wiki/Cohens_kappa.
2014, Vol. 28 
