Closed t4r7k closed 6 months ago
This part of the project focused on exploring language models available on Huggingface and identifying suitable candidates for our specific use case. The selection criteria included the model's purpose, parameter count, output quality, training languages, and output languages. This report details the fine-tuning process of the meta-llama/Llama-2-7b-chat-hf
model to adopt the personality traits of Rachel Green from the TV series "Friends".
The primary objective was to fine-tune the LLaMA model to capture and reflect the personality of Rachel Green in its responses, thereby enhancing the relatability and authenticity of the generated text.
We utilized dialogues from 227 episodes featuring Rachel for the fine-tuning process. The following sections summarize the parameters used for fine-tuning and showcase the model's performance on selected input sentences.
Prompt: "Come on Rach, you don't have what, ten minutes?"
Prompt: "Rach, are you okay?"
Prompt: "Hey uh, Rach, funny story. I ah, bumped into Joanna on the street yesterday."
Prompt: "Rachel always cries!"
Prompt: "We were on a break!"
Prompt: "Oh, Rachel, actually, y'know what, forget it."
Prompt: "Do you remember the day we had dessert?"
After comparing the fine-tuned LLaMA model with other candidates, it was observed that the LLaMA model provided a promising balance between personalization and output quality, effectively capturing the essence of Rachel Green's character. Despite LLaMA's strengths, the decision was made to use the Mistral model instead. This choice was based on Mistral's superior performance in benchmarks and the assessment that its answers were more suitable for our character's personality.
Model Overview
Llama 2 7B, a state-of-the-art language model, is designed to excel in a variety of natural language processing tasks, including but not limited to text generation, comprehension, and summarization. This model is part of the larger Llama 2 series, which includes versions with varying sizes to cater to different computational needs and application scenarios. The 7B variant offers a balanced compromise between performance and resource efficiency, making it an ideal choice for developers and researchers seeking high-quality language understanding and generation capabilities without the extensive computational overhead of larger models.
The Llama 2 7B model has been trained on a diverse dataset, encompassing a wide range of topics and styles sourced from books, websites, and other text-rich mediums. This extensive training enables the model to understand and generate human-like text across various domains, demonstrating remarkable proficiency in language understanding, creative writing, and informative summarization.
Model URL
https://llama.meta.com