search

kama34 / LLM-Innopolis

Labs for LLM course from innopolis
0 stars 0 forks source link

Outputting and Self-Consistency #1

Open AhmadTaha96 opened 1 month ago

AhmadTaha96 commented 1 month ago

The output of each method is not clear, you arranged them in a table but it's not visible to the reader to understand and to compare, so you need to show real answer and output answer, because the way you are comparing has its downside as well.

another issue with self-consistency, you mentioned you made the model generate many outputs and save the closest one to the correct answer, this is not how this method works, you misunderstood it, think about it again.

kama34 commented 1 month ago

The output of each method is not clear, you arranged them in a table but it's not visible to the reader to understand and to compare, so you need to show real answer and output answer, because the way you are comparing has its downside as well.

another issue with self-consistency, you mentioned you made the model generate many outputs and save the closest one to the correct answer, this is not how this method works, you misunderstood it, think about it again.

Sorry, I upload the wrong file and see this only now. And now I upload right file.