Volltext herunterladen
(371.4 KB)
Zitationshinweis
Bitte beziehen Sie sich beim Zitieren dieses Dokumentes immer auf folgenden Persistent Identifier (PID):
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-46667-7
Export für Ihre Literaturverwaltung
Implications of inter-rater agreement on a student information retrieval evaluation
[Sammelwerksbeitrag]
Körperschaftlicher Herausgeber
Universität Kassel, Knowledge and Data Engineering Group
Abstract This paper is about an information retrieval evaluation on three different retrieval-supporting
services. All three services were designed to
compensate typical problems that arise in metadata-
driven Digital Libraries, which are not adequately
handled by a simple tf-idf based retrieval.
The se... mehr
This paper is about an information retrieval evaluation on three different retrieval-supporting
services. All three services were designed to
compensate typical problems that arise in metadata-
driven Digital Libraries, which are not adequately
handled by a simple tf-idf based retrieval.
The services are: (1) a co-word analysis based
query expansion mechanism and re-ranking via
(2) Bradfordizing and (3) author centrality. The
services are evaluated with relevance assessments
conducted by 73 information science students.
Since the students are neither information
professionals nor domain experts the question of
inter-rater agreement is taken into consideration.
Two important implications emerge: (1) the inter-
rater agreement rates were mainly fair to
moderate and (2) after a data-cleaning step which
erased the assessments with poor agreement rates
the evaluation data shows that the three retrieval
services returned disjoint but still relevant result sets. (author's abstract)... weniger
Thesaurusschlagwörter
Bibliothek; Informationsgewinnung; Informationssystem; Information; Datenbank; information retrieval; Informationsmanagement
Klassifikation
Information und Dokumentation, Bibliotheken, Archive
Informationswissenschaft
Freie Schlagwörter
Digitale Bibliothek; Digital Library
Titel Sammelwerk, Herausgeber- oder Konferenzband
LWA 2010 : Lernen, Wissen & Adaptivität ; workshop proceedings
Herausgeber
Atzmüller, Martin; Benz, Dominik; Hotho, Andreas; Stumme, Gerd
Konferenz
Lernen, Wissen & Adaptivität (LWA). Kassel, 2010
Sprache Dokument
Englisch
Publikationsjahr
2010
Erscheinungsort
Kassel
Seitenangabe
S. 1-7
Schriftenreihe
Kasseler Informatikschriften (KIS), 2010/5
Status
Postprint; begutachtet
Lizenz
Deposit Licence - Keine Weiterverbreitung, keine Bearbeitung