search

digitalfabrik / integreat-chat

Interface to self-hosted large language models and vector databases to provide improved Integreat Chat functionality
https://integreat-app.de
MIT License
1 stars 0 forks source link

Set up inference daemon #19

Closed svenseeberg closed 5 months ago

svenseeberg commented 5 months ago

Set up a small Django daemon for answering chat messages.

dasgoutam commented 5 months ago

Required Python modules (pip)-

  1. langchain
  2. langchain-community
  3. git+https://github.com/huggingface/transformers
  4. huggingface_hub
  5. llama-cpp-python
  6. numpy