CerebriumAI / examples

324 stars 40 forks source link

Fix llama3 model #37

Closed eddieoz closed 1 week ago

eddieoz commented 2 weeks ago

fixing llama3 model on huggingface: meta-llama/Meta-Llama-3-8B-Instruct

milo157 commented 1 week ago

@eddieoz Did you try this? We had this initially but for some reason the bot start speaking with itself and its coming from this model specifically. It was very strange

eddieoz commented 1 week ago

@eddieoz Did you try this? We had this initially but for some reason the bot start speaking with itself and its coming from this model specifically. It was very strange

Yes, I'm actually using this model on cerebrium. I did the change because yesterday the model NousResearch/Meta-Llama-3-8B-Instruct was returning not found.

Since it is the model that appears on the examples of pipecat, I thought someone just forgot it there. But if it is working, don't need to change anything. :)