search

lorenzkuhn / semantic_uncertainty

MIT License
144 stars 20 forks source link

Generated samples from LLMs #2

Closed xidulu closed 1 year ago

xidulu commented 1 year ago

Hi

Is it possible to make the samples you acquire from the language models public? i.e. the pkl files. These would be very helpful for reproducing the results.

Thanks

lorenzkuhn commented 1 year ago

Hi Xi,

Thank you for your interest in our work. We're currently working on a simplified version of our implementation of the semantic entropy and we're hoping to release the generations along with the updated implementation.

Best, Lorenz