Quantitative analysis of Matthew effect and sparsity problem of recommender systems release_2jlkacinpjc5xgglkfo43fqui4

by Hao Wang, Zonghu Wang, Weishi Zhang

Released as a article .

2019  

Abstract

Recommender systems have received great commercial success. Recommendation has been used widely in areas such as e-commerce, online music FM, online news portal, etc. However, several problems related to input data structure pose serious challenge to recommender system performance. Two of these problems are Matthew effect and sparsity problem. Matthew effect heavily skews recommender system output towards popular items. Data sparsity problem directly affects the coverage of recommendation result. Collaborative filtering is a simple benchmark ubiquitously adopted in the industry as the baseline for recommender system design. Understanding the underlying mechanism of collaborative filtering is crucial for further optimization. In this paper, we do a thorough quantitative analysis on Matthew effect and sparsity problem in the particular context setting of collaborative filtering. We compare the underlying mechanism of user-based and item-based collaborative filtering and give insight to industrial recommender system builders.
In text/plain format

Archived Files and Locations

application/pdf  299.9 kB
file_ocvmim5gujcprevd3pe72jkogu
arxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   submitted
Date   2019-09-24
Version   v1
Language   en ?
arXiv  1909.12798v1
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 36641cbc-426e-4f3f-9650-87e4db9f13db
API URL: JSON