WEKO3
アイテム
NII Technical Report (NII-2005-014E)：Property of Average Precision and its Generalization: An Examination of Evaluation Indicator for Information Retrieval Experiments
https://doi.org/10.20736/0000000409
https://doi.org/10.20736/0000000409147578bf-02e6-4d41-b10d-7c9855649523
| Item type | レポート / Report(1) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 公開日 | 2005-09-29 | |||||||||
| タイトル | ||||||||||
| タイトル | NII Technical Report (NII-2005-014E)：Property of Average Precision and its Generalization: An Examination of Evaluation Indicator for Information Retrieval Experiments | |||||||||
| 言語 | en | |||||||||
| 言語 | ||||||||||
| 言語 | eng | |||||||||
| キーワード | ||||||||||
| 言語 | ja | |||||||||
| 主題Scheme | Other | |||||||||
| 主題 | テクニカルレポート | |||||||||
| キーワード | ||||||||||
| 言語 | en | |||||||||
| 主題Scheme | Other | |||||||||
| 主題 | Technical Report | |||||||||
| 資源タイプ | ||||||||||
| 資源 | http://purl.org/coar/resource_type/c_6501 | |||||||||
| タイプ | departmental bulletin paper | |||||||||
| ID登録 | ||||||||||
| ID登録 | 10.20736/0000000409 | |||||||||
| ID登録タイプ | JaLC | |||||||||
| 著者 |
岸田, 和明
× 岸田, 和明
|
|||||||||
| 抄録 | ||||||||||
| 内容記述タイプ | Abstract | |||||||||
| 内容記述 | In information retrieval experiments, indicators for measuring effectiveness of the systems or methods are important. Average precision is often used as an indicator for evaluating ranked output of documents in standard retrieval experiments. This report examines some properties of this indicator. First, we clarify mathematically that relevant documents at a higher position in the ranked list contribute much more to increasing the score of average precision. Second, influence of detecting unknown relevant documents on the score is discussed. Third, we examine statistical variation of average precision scores caused by fluctuations of results from relevance judgments. Another issue of this report is to explore evaluation indicators using data of multi-grade relevance. After reviewing indicators proposed by other researchers, i.e., modified sliding ratio, normalized discounted cumulative gain (nDCG), Q-measure and so on, a new indicator, generalized average precision is developed. We compare these indicators empirically using a simple and artificial example. | |||||||||
| 言語 | en | |||||||||
| 書誌情報 |
ja : NIIテクニカル・レポート en : NII Technical Report p. 1-19, 発行日 2005-09-29 |
|||||||||
| 出版者 | ||||||||||
| 出版者 | 国立情報学研究所 | |||||||||
| 言語 | ja | |||||||||
| ISSN | ||||||||||
| 収録物識別子タイプ | ISSN | |||||||||
| 収録物識別子 | 1346-5597 | |||||||||
