search

VowpalWabbit / vowpal_wabbit

Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.
https://vowpalwabbit.org
Other
8.49k stars 1.93k forks source link

feat: [LAS] with CCB #4520

Closed olgavrou closed 1 year ago

olgavrou commented 1 year ago

speedup for ccb (200 actions 4 slots):

ccb with LAS with cache 13.7 ms  ccb with LAS without cache 28.8 ms ccb without LAS 10.3 ms

olgavrou commented 1 year ago

Just to clarify, LAS should work out-of-box with CCB, and the action_cache_slack is a separate thing that can be used with both CB and CCB?

Yes exactly

action_cache_slack is mostly useful for CCB where we can have slots so in order to be able to keep the cache while ccb removes actions in each call but it also affects CB and can be changed/turned off for potential debugging purposes

jackgerrits commented 1 year ago

How does the cache work for CCB when each action has the unique slot features added before calling into LAS?

olgavrou commented 1 year ago

How does the cache work for CCB when each action has the unique slot features added before calling into LAS?

Slots are added to the shared example so they are removed along with the shared features

the CCB test added checks this