search

kazi92 / oneAPI-AI-and-HPC-DevSummit-2023-workshop

LLM Custom Chatbot development with Huggingface opensource Mistral 7B model with Intel Developer Cloud (IDC)
2 stars 1 forks source link

Step to start app.py #1

Open MrCsabaToth opened 7 months ago

MrCsabaToth commented 7 months ago
  1. Step 3 could be more specific, app.py (so the later missing step can refer to the same file)
  2. Not sure the place (step 5.5?), but sometimes before the Step 6 (ngrok start) and after Step 3, there is a step ptyhon app.py to start the gradio server.
MrCsabaToth commented 7 months ago

BTW I used screen and that proved beneficial because the instance often cut off the SSH connection. That becomes more important once I start the gradio in one screen, so it won't be interrupted, it kinda nohup. I also sourced the miniconda environment to do the pip install and the gradio start, although that could make the workflow more complicated, just like if someone uses localtunnel instead of ngrok.