Quantitative analysis of Matthew effect and sparsity problem of
recommender systems
release_2jlkacinpjc5xgglkfo43fqui4
by
Hao Wang, Zonghu Wang, Weishi Zhang
2019
Abstract
Recommender systems have received great commercial success. Recommendation
has been used widely in areas such as e-commerce, online music FM, online news
portal, etc. However, several problems related to input data structure pose
serious challenge to recommender system performance. Two of these problems are
Matthew effect and sparsity problem. Matthew effect heavily skews recommender
system output towards popular items. Data sparsity problem directly affects the
coverage of recommendation result. Collaborative filtering is a simple
benchmark ubiquitously adopted in the industry as the baseline for recommender
system design. Understanding the underlying mechanism of collaborative
filtering is crucial for further optimization. In this paper, we do a thorough
quantitative analysis on Matthew effect and sparsity problem in the particular
context setting of collaborative filtering. We compare the underlying mechanism
of user-based and item-based collaborative filtering and give insight to
industrial recommender system builders.
In text/plain
format
Archived Files and Locations
application/pdf 299.9 kB
file_ocvmim5gujcprevd3pe72jkogu
|
arxiv.org (repository) web.archive.org (webarchive) |
1909.12798v1
access all versions, variants, and formats of this works (eg, pre-prints)