search

FocusedDiversity / synaptiq-hppo

The truth-aware document manager
GNU General Public License v3.0
0 stars 0 forks source link

Integrate chatbot w/ Llama job #20

Open erskine opened 1 year ago

erskine commented 1 year ago

As a developer I want to set up a Databricks model server endpoint So that the chatbot can scaled efficiently

rdmontgomery commented 12 months ago

Pulled llama2 from Meta using my credentials. Ran the chatbot inside a live notebook with the user prompt being fed into the llama2 pipeline and let HiPPO respond using the output.

rdmontgomery commented 11 months ago

The real work is still to figure out how to make our LLM accessible via a Databricks serving endpoint and then spin up a slack bot server someplace cheap that makes the appropriate call to Databricks.

I think it would be really cool if we made our slack bot using bun+typescript and push it to vercel. Would be a combo/mixture of these two