mshumer / gpt-prompt-engineer

MIT License
9.39k stars 642 forks source link

Does set logit_bias to 100 lead the model choice between 'A' and 'B' essentially random? #14

Open vegetax opened 1 year ago

vegetax commented 1 year ago

logit_bias={ '32': 100, # 'A' token '33': 100, # 'B' token }, I asked GPT4 this issue, the following is its answer:

image
mshumer commented 1 year ago

Not random! It essentially just excludes any other tokens.

Phq-art commented 1 year ago

Unlike the explanation in the gpt-4 response, I think as @mshumer already said it just limits the output to either 'A' or 'B'.