Closed MGurcan closed 6 months ago
In this part of the project, language models on Huggingface were researched, and models that could be used for the project were identified. This identification process took into account the purposes of use of the models, the number of parameters, the outputs they produce, the languages they were trained on, and the languages they can produce outputs in. This issue covers the work to be done on the Huggingface - Blenderbot model, which is one of the models to be tried in the fine-tuning process. There are evaluations for 2 different versions of this model, which have been fine-tuned with different parameters below.
As a result of this fine tuning, it is expected that the model will learn the personality of the fine tuned character sufficiently and make us feel this in the outputs it produces.
The 227-episode dialogues of Rachel, who starred in the TV series Friends, were used in the model fine tune process. This model has been fine tuned with the parameter values given below and the output values it produces for various inputs are shown.
https://huggingface.co/facebook/blenderbot-1B-distill
Come on Rach, you don't have what, ten minutes?
Rach, are you okay?
Hey uh, Rach, funny story. I ah, bumped into Joanna on the street yesterday.
Rachel always cries!
We were on a break!
Oh, Rachel, actually, y'know what, forget it.
Do you remember the day we had dessert?
The 227-episode dialogues of Rachel, who starred in the TV series Friends, were used in the model fine tune process. This model has been fine tuned with the parameter values given below and the output values it produces for various inputs are shown.
https://huggingface.co/facebook/blenderbot-400M-distill
Two versions of the fine-tuned blenderbot were examined, but it was decided not to use it as the main model in the project because the other models produced more positive results in terms of personalization and the blenderbot fell below the expected output quality.
Model Overview
The Blender chatbot model was proposed in Recipes for building an open-domain chatbot Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston on 30 Apr 2020.
Model URL
https://huggingface.co/docs/transformers/model_doc/blenderbot