Question: How does the service deal with delayed or not existing click response (reward has to be set to value 0)

microsoft / mwt-ds

Umbrella repository for projects related to the MWT Decision Service

187 stars 77 forks source link

Question: How does the service deal with delayed or not existing click response (reward has to be set to value 0) #90

Open Rainer-Kempkes opened 7 years ago

Rainer-Kempkes commented 7 years ago

Example:

User A enters the URL, the predicted banner/pic/text is displayed.

a) User A clicks on it after 4 secs -> reward = 1 - OK

b) User A leaves the URL by clicking on another link -> no click - how and when is the reward 0 set?

Is there something like "pending" events with open (not set) rewards - and maybe a timeout after x secs/mins with automatical reward-set to 0?

regards,

Rainer

eisber commented 7 years ago

The Azure Stream Analytics will produce an output event for every impression, regardless of having a click or not, after n-secs (=experimental unit duration).

a) This takes care of (b) – the default reward of 0 is specified in the ASA query (join).

b) We delay training of each example by n-secs to avoid any bias that could be introduced (e.g. certain actions receive feedback earlier than others).