Influence of tweets and diversification on serendipitous research paper recommender systems

PeerJ Comput Sci. 2020 May 18:6:e273. doi: 10.7717/peerj-cs.273. eCollection 2020.

Abstract

In recent years, a large body of literature has accumulated around the topic of research paper recommender systems. However, since most studies have focused on the variable of accuracy, they have overlooked the serendipity of recommendations, which is an important determinant of user satisfaction. Serendipity is concerned with the relevance and unexpectedness of recommendations, and so serendipitous items are considered those which positively surprise users. The purpose of this article was to examine two key research questions: firstly, whether a user's Tweets can assist in generating more serendipitous recommendations; and secondly, whether the diversification of a list of recommended items further improves serendipity. To investigate these issues, an online experiment was conducted in the domain of computer science with 22 subjects. As an evaluation metric, we use the serendipity score (SRDP), in which the unexpectedness of recommendations is inferred by using a primitive recommendation strategy. The results indicate that a user's Tweets do not improve serendipity, but they can reflect recent research interests and are typically heterogeneous. Contrastingly, diversification was found to lead to a greater number of serendipitous research paper recommendations.

Keywords: Digital library; Experimental study; Recommender system; Scholarly articles; Serendipity; User study.

Grants and funding

This work was supported by the EU H2020 project MOVING (No. 693092), the JSPS Grant-in-Aidfor Scientific Research (S) (No. 16H06304), and the JSPS Grant-in-Aid for Young Scientists (No. 18K13235). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.