A service to chat
Cf. https://pytorch.org/get-started/locally/
For example, with Windows, cuda 12.1:
pip install torch --index-url https://download.pytorch.org/whl/cu121
pip install -r requirements.txt
Under .../chat_service/server/
cp chat_server_config.xml.example chat_server_config.xml
Note that without a GPU, the response may be very slow.
python chat_server.py
Under .../chat_service/chainlit_interface/
cp app_config.xml.example app_config.xml
chainlit run app.py -w