Open rahulgoel opened 1 month ago
If i am trying to chat with a one off github repo, running docker feels a bit heavy. A local python file for embeddings, a local HF model for calculating the vectors might also be a reasonable thing to do.
Great suggestion Rahul! Here are some more detailed instructions for new contributors:
Steps:
Looks like LanceDB also has an in-memory option: https://lancedb.github.io/lancedb/basic/
If i am trying to chat with a one off github repo, running docker feels a bit heavy. A local python file for embeddings, a local HF model for calculating the vectors might also be a reasonable thing to do.