Abstract
As users' preferences shift continuously, recommendation system has to learn quickly from them. It is an interesting online learning problem as recommender does not have any prior knowledge about the distribution of items over the users. In this work, we generate a small recommendation set from a large number of items, with an intention that at least one of recommended items would satisfy the user and thus minimize user abandonment. We used multiarmed bandit algorithm for this purpose and avail multiple instances of Upper Confidence Bound2 (UCB2). Although UCB2 is theoretically proved to have a better regret bound than UCB1, unlike UCB1, it has not been used for parallel execution. We designed an efficient algorithm which runs multiple instances of UCB2 in parallel. Our algorithm suitably handles parameter synchronization, reward update and exploration decisions across multiple instances of UCB2 and ensures that they are capable of covering different types of users. While applied to real data, our method shows comparable performance over a recommendation system that runs multiple instances of UCB1 in parallel. We compared our results with Ranked Bandit Algorithm and Independent Bandit Algorithm.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2015 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 413-416 |
Number of pages | 4 |
Volume | 1 |
ISBN (Electronic) | 9781467396172 |
DOIs | |
State | Published - Feb 2 2016 |
Event | 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015 - Singapore, Singapore Duration: Dec 6 2015 → Dec 9 2015 |
Other
Other | 2015 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology Workshops, WI-IAT Workshops 2015 |
---|---|
Country/Territory | Singapore |
City | Singapore |
Period | 12/6/15 → 12/9/15 |
ASJC Scopus subject areas
- Computer Networks and Communications
- Software