「On the Task of Finding One Highly Relevant Document with High Precision」[論文誌Vol.47, No.SIG4(TOD29),

平成18年度論文賞受賞者の紹介

「On the Task of Finding One Highly Relevant Document with High Precision」[論文誌Vol.47, No.SIG4(TOD29),

[論文概要]
 This paper examines the problem of evaluating systems that aim at finding one highly relevant document with high precision. Such a task is important for modern search environments such as the Web where recall is unimportant and/or immeasurable.Reciprocal Rank is a metric designed for finding one relevant document with high precision, but it can only handle binary relevance. We therefore introduce a new metric called O-measure, for high precision, high relevance search, and show (a) How the task of finding one relevant document is different from that of finding as many relevant documents as possible, in both binary and graded relevance settings; and (b) How the task of finding one highly relevant document is different from that of finding any one relevant document. We use four test collections and the corresponding sets of formal runs from the NTCIR-3 Crosslingual Information Retrieval track to compare the tasks and metrics in terms of resemblance, stability and discrimination power in system ranking.

[推薦理由]
 

Tetsuya Sakai 君 1968年生。1993年早稲田大学大学院理工学研究科工業経営学専門分野修士課程修了。同年(株)東芝入社。以来、情報アクセス・言語処理の研究開発に従事。2000年工学博士。2000年~2001年英ケンブリッジ大学客員研究員。2007年より(株)ニューズウォッチ自然言語処理研究室室長。FIT2005論文賞・平成18年度山下記念研究賞受賞。