Export für Ihre Literaturverwaltung

Übernahme per Copy & Paste
Bibtex-Export
Endnote-Export

       

Weiterempfehlen

Bookmark and Share


Implications of inter-rater agreement on a student information retrieval evaluation

[Konferenzbeitrag]

Schaer, Philipp; Mayr, Philipp; Mutschke, Peter

Zitationshinweis

Bitte beziehen Sie sich beim Zitieren dieses Dokumentes immer auf folgenden Persistent Identifier (PID):http://nbn-resolving.de/urn:nbn:de:0168-ssoar-46667-7

Weitere Angaben:
Körperschaftlicher Herausgeber Universität Kassel, Knowledge and Data Engineering Group
Abstract This paper is about an information retrieval evaluation on three different retrieval-supporting services. All three services were designed to compensate typical problems that arise in metadata- driven Digital Libraries, which are not adequately handled by a simple tf-idf based retrieval. The services are: (1) a co-word analysis based query expansion mechanism and re-ranking via (2) Bradfordizing and (3) author centrality. The services are evaluated with relevance assessments conducted by 73 information science students. Since the students are neither information professionals nor domain experts the question of inter-rater agreement is taken into consideration. Two important implications emerge: (1) the inter- rater agreement rates were mainly fair to moderate and (2) after a data-cleaning step which erased the assessments with poor agreement rates the evaluation data shows that the three retrieval services returned disjoint but still relevant result sets. (author's abstract)
Thesaurusschlagwörter information retrieval; information; information management; information system; data bank; library; information capture
Klassifikation Informationswissenschaft; Information und Dokumentation, Bibliotheken, Archive
Freie Schlagwörter Digitale Bibliothek; Digital Library
Titel Sammelwerk, Herausgeber- oder Konferenzband LWA 2010 : Lernen, Wissen & Adaptivität ; workshop proceedings
Herausgeber Atzmüller, Martin; Benz, Dominik; Hotho, Andreas; Stumme, Gerd
Konferenz Lernen, Wissen & Adaptivität (LWA). Kassel, 2010
Sprache Dokument Englisch
Publikationsjahr 2010
Erscheinungsort Kassel
Seitenangabe S. 1-7
Schriftenreihe Kasseler Informatikschriften (KIS), 2010/5
Status Postprint; begutachtet
Lizenz Deposit Licence - Keine Weiterverbreitung, keine Bearbeitung
top