meta-llama / llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
9.95k stars 1.4k forks source link

[OctoAI] Llama-3 based summarization + RAG to power a sales bot #500

Closed tmoreau89 closed 2 weeks ago

tmoreau89 commented 3 weeks ago

What does this PR do?

Introducing a new Llama3 example that is built on top of OctoAI model API provider and Weaviate vector DB to implement a helpful sales bot.

Example interaction:

User: "what is must have accessory for my new electric guitar"

Chatbot:

Congratulations on your new electric guitar! A must-have accessory for your new electric guitar is a good case to protect it from damage and scratches. I highly recommend the Solid Electric Guitar Case with Accessories Compartment. This case provides good protection and has a roomy accessories compartment to store your guitar's accessories. Another great option is the Hard Guitar Case with Accessory Compartments, which is sturdy and has additional compartments for accessories. If you're looking for a more affordable option, the Affordable Solid Body Electric Guitar Case is a great choice. It's well-built, durable, and fits various solid body electric guitars. References: [1] Solid Electric Guitar Case with Accessories Compartment [2] Hard Guitar Case with Accessory Compartments [3] Affordable Solid Body Electric Guitar Case

Feature/Issue validation/testing

Ran on a local jupyter notebook on Macbook M1.

Before submitting

Thanks for contributing 🎉!

tmoreau89 commented 3 weeks ago

CC @HamidShojanazeri

tmoreau89 commented 2 weeks ago

@HamidShojanazeri we're all green here 🙌

tmoreau89 commented 2 weeks ago

Merge conflicts resolved!