Near-Optimal Regret Bounds for Contextual Combinatorial Semi-Bandits with Linear Payoff Functions

Kei Takemura, Shinji Ito, Daisuke Hatano, Hanna Sumita, Takuro Fukunaga, Naonori Kakimura, Ken Ichi Kawarabayashi

研究成果: Conference contribution

抄録

The contextual combinatorial semi-bandit problem with linear payoff functions is a decision-making problem in which a learner chooses a set of arms with the feature vectors in each round under given constraints so as to maximize the sum of rewards of arms. Several existing algorithms have regret bounds that are optimal with respect to the number of rounds T. However, there is a gap of Õ(max(d, k)) between the current best upper and lower bounds, where d is the dimension of the feature vectors, k is the number of the chosen arms in a round, and Õ(·) ignores the logarithmic factors. The dependence of k and d is of practical importance because k may be larger than T in real-world applications such as recommender systems. In this paper, we fill the gap by improving the upper and lower bounds. More precisely, we show that the C2UCB algorithm proposed by Qin, Chen, and Zhu (2014) has the optimal regret bound Õ(d√kT + dk) for the partition matroid constraints. For general constraints, we propose an algorithm that modifies the reward estimates of arms in the C2UCB algorithm and demonstrate that it enjoys the optimal regret bound for a more general problem that can take into account other objectives simultaneously. We also show that our technique would be applicable to related problems. Numerical experiments support our theoretical results and considerations.

本文言語English
ホスト出版物のタイトル35th AAAI Conference on Artificial Intelligence, AAAI 2021
出版社Association for the Advancement of Artificial Intelligence
ページ9791-9798
ページ数8
ISBN(電子版)9781713835974
出版ステータスPublished - 2021
イベント35th AAAI Conference on Artificial Intelligence, AAAI 2021 - Virtual, Online
継続期間: 2021 2月 22021 2月 9

出版物シリーズ

名前35th AAAI Conference on Artificial Intelligence, AAAI 2021
11A

Conference

Conference35th AAAI Conference on Artificial Intelligence, AAAI 2021
CityVirtual, Online
Period21/2/221/2/9

ASJC Scopus subject areas

  • 人工知能

フィンガープリント

「Near-Optimal Regret Bounds for Contextual Combinatorial Semi-Bandits with Linear Payoff Functions」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル