microsoft / lida

Automatic Generation of Visualizations and Infographics using Large Language Models
https://microsoft.github.io/lida/
MIT License
2.57k stars 260 forks source link

alternative of openai #87

Open lawyinking opened 5 months ago

lawyinking commented 5 months ago

Could it be a LIDA's colab tutorial in running it other than the openai API? I have followed all the instructions in the LIDA tutorial code but I get errors when using cohere, hf, etc., and I have googled these problems but have not found a solution.

Also, is there a way to use the local model, not from huggingface but such as model on Desktop, also running LIDA using gguf models with llama.cpp would be great!

Thanks! look forward to hearing the response.

cohere: 截圖 2024-01-17 03 19 52 hf: out of memory error (using 32GB RAM laptop)

lawyinking commented 5 months ago

some add-on: I used A100 in colab with huggingface method but also out of memory error

kishoretvk commented 3 months ago

using mistral 7b we could generate summary, for visualization it does not work ant inputs would be of great healp. can we use any other model for graphs?

kishoretvk commented 3 months ago

for graphs can we use any othe rmodel ? example if summary by llama , can we use different model or llm to generate graphs ?