Access the full text.
Sign up today, get DeepDyve free for 14 days.
J. Hanley, B. McNeil (1982)
The meaning and use of the area under a receiver operating characteristic (ROC) curve.Radiology, 143 1
B. Amento, L. Terveen, W. Hill, D. Hix, R. Schulman (2003)
Experiments in social data mining: The TopicShop systemACM Trans. Comput. Hum. Interact., 10
A. Turpin, W. Hersh (2001)
Why batch and user evaluations do not give the same results
Pedro Domingos, Matthew Richardson (2001)
Mining the network value of customers
M. Morita, Y. Shinoda (1994)
Information filtering based on user behavior analysis and best match text retrieval
A. Schein, Alexandrin Popescul, L. Ungar, David Pennock (2001)
Generative Models for Cold-Start Recommendations
Frank Linton, Deborah Joy, H. Schaefer, Andrew Charron (2000)
OWL: A Recommender System for Organization-Wide LearningJ. Educ. Technol. Soc., 3
Yiyu Yao (1995)
Measuring Retrieval Effectiveness Based on User Preference of DocumentsJ. Am. Soc. Inf. Sci., 46
P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom, J. Riedl (1994)
GroupLens: an open architecture for collaborative filtering of netnews
J. Swets (1963)
Information Retrieval Systems.Science, 141 3577
Bradley Miller, I. Albert, S. Lam, J. Konstan, J. Riedl (2003)
MovieLens unplugged: experiences with an occasionally connected recommender system
M. Claypool, David Brown, Phong Le, M. Waseda (2001)
Inferring User InterestIEEE Internet Comput., 5
C. Basu, H. Hirsh, William Cohen (1998)
Recommendation as Classification: Using Social and Content-Based Information in Recommendation
Nathaniel Good, J. Schafer, J. Konstan, Al Borchers, B. Sarwar, Jonathan Herlocker, J. Riedl (1999)
Combining Collaborative Filtering with Personal Agents for Better Recommendations
S. Harter (1996)
Variations in Relevance Assessments and the Measurement of Retrieval EffectivenessJ. Am. Soc. Inf. Sci., 47
S. McNee, I. Albert, D. Cosley, P. Gopalkrishnan, S. Lam, A. Rashid, J. Konstan, J. Riedl (2002)
On the recommending of citations for research papers
J. Canny (2002)
Collaborative filtering with privacy via factor analysis
Ken Goldberg, T. Roeder, Dhruv Gupta, Chris Perkins (2001)
Eigentaste: A Constant Time Collaborative Filtering AlgorithmInformation Retrieval, 4
Jonathan Herlocker, J. Konstan, Al Borchers, J. Riedl (1999)
An algorithmic framework for performing collaborative filtering
C. Aggarwal, J. Wolf, Kun-Lung Wu, Philip Yu (1999)
Horting hatches an egg: a new graph-theoretic approach to collaborative filtering
E. Voorhees, D. Harman (1999)
Overview of the seventh text retrieval conference (trec-7) [on-line]
C. Le, B. Lindgren (1995)
Construction and Comparison of Two Receiver Operating Characteristic Curves Derived from the Same SamplesBiometrical Journal, 37
Jonathan Herlocker, J. Konstan, J. Riedl (2000)
Explaining collaborative filtering recommendations
E. Voorhees (1998)
Overview of the Seventh Text REtrieval Conference
D. Harman (1997)
The TREC Conferences
Bradley Miller, I. Albert, S. Lam, J. Konstan, J. Riedl (2004)
MovieLens Unplugged: Experiences with a Recommender System on Four Mobile Devices
Jonathan Herlocker, J. Konstan, J. Riedl (2002)
An Empirical Analysis of Design Choices in Neighborhood-Based Collaborative Filtering AlgorithmsInformation Retrieval, 5
Stuart Rogers (2001)
Marketing Strategies, Tactics, and Techniques: A Handbook for Practitioners
B. Amento, W. Hill, L. Terveen, D. Hix, Peter Ju (1999)
An empirical evaluation of user interfaces for topic management of Web sites
David Goldberg, D. Nichols, B. Oki, D. Terry (1992)
Using collaborative filtering to weave an information tapestryCommun. ACM, 35
P. Reddy, M. Kitsuregawa, P. Sreekanth, S. Rao (2002)
A Graph Based Approach to Extract a Neighborhood Customer Community for Collaborative Filtering
B. Sarwar, G. Karypis, J. Konstan, J. Riedl (2000)
Application of Dimensionality Reduction in Recommender System - A Case Study
J. Schafer, J. Konstan, J. Riedl (2002)
Meta-recommendation systems: user-controlled integration of diverse recommendations
A. Schein, Alexandrin Popescul, L. Ungar, David Pennock (2002)
Methods and metrics for cold-start recommendations
J. Breese, D. Heckerman, C. Kadie (1998)
Empirical Analysis of Predictive Algorithms for Collaborative Filtering
J. Konstan, Bradley Miller, D. Maltz, Jonathan Herlocker, Lee Gordon, J. Riedl (1997)
GroupLens: applying collaborative filtering to Usenet newsCommun. ACM, 40
D. Cosley, S. Lam, I. Albert, J. Konstan, J. Riedl (2003)
Is seeing believing?: how recommender system interfaces affect users' opinions
B. Bailey, L. Gurak, J. Konstan (2001)
An Examination of Trust Production in Computer-Mediated Exchange
Daniel Billsus, M. Pazzani (1998)
Learning Collaborative Information Filters
D. Egan (1988)
Handbook of Human Computer Interaction
(2004)
ACM Transactions on Information Systems Evaluating Collaborative Filtering Recommender Systems @BULLET
David McDonald (2001)
Evaluating expertise recommendationsProceedings of the 2001 ACM International Conference on Supporting Group Work
B. Sarwar, J. Konstan, Al Borchers, Jonathan Herlocker, Bradley Miller, J. Riedl (1998)
Using filtering agents to improve prediction quality in the GroupLens research collaborative filtering system
A. Rashid, I. Albert, D. Cosley, S. Lam, S. McNee, J. Konstan, J. Riedl (2002)
Getting to know you: learning new user preferences in recommender systems
W. Hill, Larry Stead, Mark Rosenstein, G. Furnas (1995)
Recommending and evaluating choices in a virtual community of use
B. Mobasher, H. Dai, Tao Luo, M. Nakagawa (2001)
Effective personalization based on association rule discovery from web usage data
J. Swets (1969)
Effectiveness of information retrieval methodsAmerican Documentation, 20
(1997)
Recommender Systems. Communications of the ACM
Per user/Overall -Dataset: MovieLens Dataset (100,000 movie ratings from 943 users on 1682 items)
W. Newman (1997)
Better or just different? On the benefits of designing interactive systems in terms of critical parameters
E. Voorhees, D. Harman (1999)
The seventh text REtrieval conference (TREC-7)
C. Cleverdon, M. Keen, Cyri Cleverdon, Wharley Bedford (1966)
ASLIB CRANFIELD RESEARCH PROJECT FACTORS DETERMINING THE PERFORMANCE OF INDEXING SYSTEMS VOLUME 2
B. Sarwar, G. Karypis, J. Konstan, J. Riedl (2000)
Analysis of recommendation algorithms for e-commerce
Alan Wexelblat, P. Maes (1999)
Footprints: history-rich tools for information foraging
D. Heckerman, D. Chickering, Christopher Meek, Robert Rounthwaite, C. Kadie (2001)
Dependency Networks for Inference, Collaborative Filtering, and Data VisualizationJ. Mach. Learn. Res., 1
L. Mui, Peter Szolovits, Cheewee Ang (2001)
Collaborative sanctioning: applications in restaurant recommendations based on reputation
(1998)
Jumpstarting movielens: User benefits of starting a collaborative filtering system with " dead data
Upendra Shardanand, P. Maes (1995)
Social information filtering: algorithms for automating “word of mouth”
C. Cleverdon, J. Mills, M. Keen (1966)
Factors determining the performance of indexing systems
Bradley Miller, J. Riedl, J. Konstan (1997)
Experiences with GroupLens: marking usenet useful again
Kirsten Swearingen, R. Sinha (2001)
Beyond Algorithms: An HCI Perspective on Recommender Systems
(2001)
A Probabilistic Model for Collaborative Sanctioning
R. Sinha, Kirsten Swearingen (2002)
The role of transparency in recommender systemsCHI '02 Extended Abstracts on Human Factors in Computing Systems
B. Sarwar, G. Karypis, J. Konstan, J. Riedl (2001)
Item-based collaborative filtering recommendation algorithms
S. Whittaker, L. Terveen, B. Nardi (2000)
Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCIHuman–Computer Interaction, 15
David Pennock, E. Horvitz, S. Lawrence, C. Giles (2000)
Collaborative Filtering by Personality Diagnosis: A Hybrid Memory and Model-Based ApproachArXiv, abs/1301.3885
M. Balabanovic, Y. Shoham (1997)
Fab: content-based, collaborative recommendationCommun. ACM, 40
Recommender systems have been evaluated in many, often incomparable, ways. In this article, we review the key decisions in evaluating collaborative filtering recommender systems: the user tasks being evaluated, the types of analysis and datasets being used, the ways in which prediction quality is measured, the evaluation of prediction attributes other than quality, and the user-based evaluation of the system as a whole. In addition to reviewing the evaluation strategies used by prior researchers, we present empirical results from the analysis of various accuracy metrics on one content domain where all the tested metrics collapsed roughly into three equivalence classes. Metrics within each equivalency class were strongly correlated, while metrics from different equivalency classes were uncorrelated.
ACM Transactions on Information Systems (TOIS) – Association for Computing Machinery
Published: Jan 1, 2004
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.