search

intelligentnode / IntelliNode

Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation
https://show.intellinode.ai
Apache License 2.0
215 stars 14 forks source link

Update the chatbot to support LLama chat v2 #30

Closed Barqawiz closed 11 months ago

Barqawiz commented 11 months ago

Since LLama v2 is free to use many hosts started to provide APIs to access the model.

Replica provides strait-forward access to LLama chat 70B parameter with your own keys.

This required implementing a wrapper to Replica backend and add LLama capability to the chatbot object.