Open vegetax opened 1 year ago
logit_bias={ '32': 100, # 'A' token '33': 100, # 'B' token }, I asked GPT4 this issue, the following is its answer:
Not random! It essentially just excludes any other tokens.
Unlike the explanation in the gpt-4 response, I think as @mshumer already said it just limits the output to either 'A' or 'B'.
logit_bias={ '32': 100, # 'A' token '33': 100, # 'B' token }, I asked GPT4 this issue, the following is its answer: