Open lawyinking opened 5 months ago
some add-on: I used A100 in colab with huggingface method but also out of memory error
using mistral 7b we could generate summary, for visualization it does not work ant inputs would be of great healp. can we use any other model for graphs?
for graphs can we use any othe rmodel ? example if summary by llama , can we use different model or llm to generate graphs ?
Could it be a LIDA's colab tutorial in running it other than the openai API? I have followed all the instructions in the LIDA tutorial code but I get errors when using cohere, hf, etc., and I have googled these problems but have not found a solution.
Also, is there a way to use the local model, not from huggingface but such as model on Desktop, also running LIDA using gguf models with llama.cpp would be great!
Thanks! look forward to hearing the response.
cohere:
hf: out of memory error (using 32GB RAM laptop)