search

facebookresearch / ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
https://parl.ai
MIT License
10.5k stars 2.09k forks source link

Chat Logs For BlenderBot2? #4363

Closed DNGros closed 2 years ago

DNGros commented 2 years ago

Thanks for sharing your progress on the Blenderbot system!

I was wondering if there existed chat logs for Blenderbot2, similar to what is available for Blenderbot 1 in chatlog_2.7B.json. For example the logs that are the basis of ratings given in the BlenderBot2 results tables.

Do these logs exist in a form that would be easy to share?

cc: @mojtaba-komeili @jxmsML

klshuster commented 2 years ago

Unfortunately, we are unable to share these chat logs

DNGros commented 2 years ago

Hi @klshuster , thanks for your response!

I'll close this for now then. If things change (or someone else stumbles upon this and ends up collecting new human dialogues with the published model) the issue can perhaps be reopened. Dialogue samples could the community understand and compare systems.

I understand though that there can be complications here, and I really appreciate the response, as helps with planning. Thanks!