Model training/prediction cost

[johnantonn]

This seems to be defined in the categories of "Budgeted Bandits" or "Bandits with Knapsacks” and "Pure Exploration". Related work has been found below:

• http://proceedings.mlr.press/v108/cayci20a/cayci20a.pdf
• http://proceedings.mlr.press/v45/Xia15.pdf
• https://semihcayci.github.io/AISTATS-Pres-v2.pdf
• http://home.ustc.edu.cn/~xiayingc/pubs/ijcai_15a.pdf
• http://rcombes.supelec.free.fr/pdf/sigmetrics_2015_budget.pdf
• https://core.ac.uk/download/pdf/191350272.pdf

[johnantonn]

The idea of time budget transformed into time units, comparing with the total available time budget.

[johnantonn]

From the state-of-the-art research, it shows that Bandits with Knapsacks can in fact incorporate extra budgets in the form of constraints.