Developing a Test Collection for the Evaluation of Integrated Search

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

Marianne Lykke, Birger Larsen, Haakon Lund, Peter Ingwersen

he poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 160,000 papers and journal articles in PDF and 275,000 abstracts with a varied set of metadata and vocabularies from the physics domain, 65 topics based on real work tasks and corresponding graded relevance assessments. The test collection may be used for systems- as well as user-oriented evaluation.
Original languageEnglish
Title of host publicationAdvances in Information Retrieval : 32nd European Conference on IR Research, ECIR 2010, Milton Keynes, UK, March 28-31, 2010, Proceedings
EditorsCathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan Rüger, Keith van Rijsbergen
Volume5993
PublisherSpringer
Publication date2010
Pages627-630
DOIs
Publication statusPublished - 2010
EventEuropean Conference on IR Research - Milton Keynes, United Kingdom
Duration: 28 Mar 201031 May 2010
Conference number: 32

Conference

ConferenceEuropean Conference on IR Research
Nummer32
LandUnited Kingdom
ByMilton Keynes
Periode28/03/201031/05/2010
SeriesLecture notes in computer science
Number5993
ISSN0302-9743

    Research areas

  • Test collection design, Task-based IR, Integrated search

Number of downloads are based on statistics from Google Scholar and www.ku.dk


No data available

ID: 47047675