Please use this identifier to cite or link to this item:
Main Title: Overview of CLEF NEWSREEL 2014: news recommendation evaluation labs
Author(s): Kille, Benjamin
Brodt, Torben
Heintz, Tobias
Hopfgartner, Frank
Lommatzsch, Andreas
Seiler, Jonas
Type: Conference Object
Language Code: en
Abstract: This paper summarises objectives, organisation, and results of the first news recommendation evaluation lab (NEWSREEL 2014). NEWSREEL targeted the evaluation of news recommendation algorithms in the form of a campaignstyle evaluation lab. Participants had the chance to apply two types of evaluation schemes. On the one hand, participants could apply their algorithms onto a data set. We refer to this setting as off-line evaluation. On the other hand, participants could deploy their algorithms on a server to interactively receive recommendation requests. We refer to this setting as on-line evaluation. This setting ought to reveal the actual performance of recommendation methods. The competition strived to illustrate differences between evaluation with historical data and actual users. The on-line evaluation does reflect all requirements which active recommender systems face in practise. These requirements include real-time responses and large-scale data volumes. We present the competition’s results and discuss commonalities regarding participants’ approaches.
Issue Date: 2014
Date Available: 4-Jul-2018
DDC Class: 004 Datenverarbeitung; Informatik
Subject(s): recommender systems
online evaluation
living lab
Sponsor/Funder: EC/FP7/610594/EU/Crowd-powered recommendation for continuous digital media access and exchange in social networks/CrowdRec
Proceedings Title: CLEF 2014, CLEF2014 working notes : working notes for CLEF 2014 Conference, Sheffield, UK, September 15-18, 2014
Editor: Cappellato, Linda
Ferro, Nicola
Halvey, Martin
Kraaij, Wessel
Publisher: RWTH
Publisher Place: Aachen
Page Start: 790
Page End: 801
Series: CEUR workshop proceedings
Series Number: 1180
ISSN: 1613-0073
Appears in Collections:FG Agententechnologien in betrieblichen Anwendungen und der Telekommunikation (AOT) » Publications

Files in This Item:
File Description SizeFormat 
CLEF2014wn-Newsreel-Kille2014.pdf784.92 kBAdobe PDFThumbnail

Items in DepositOnce are protected by copyright, with all rights reserved, unless otherwise indicated.