search

SAI990323 / TALLRec

Apache License 2.0
190 stars 31 forks source link

How did you evaluate AUC of OpenAI series models in CTR task? #44

Closed KkEeVvIiNnn closed 7 months ago

KkEeVvIiNnn commented 7 months ago

Thanks very much!

SAI990323 commented 7 months ago

The OpenAI model provides the probabilities of the top five tokens. If both "Yes" and "No" are among these five tokens, we proceed with the computation. However, if one of them is not included, we assume that the probability of the other one is the smallest among these five. Note that, this is not a comprehensive solution, but an estimated solution.

KkEeVvIiNnn commented 7 months ago

Got it! Thank you!