search

zylon-ai / private-gpt

Interact with your documents using the power of GPT, 100% privately, no data leaks
https://privategpt.dev
Apache License 2.0
54.03k stars 7.26k forks source link

Can I run this on Google COLAB FREE VERSION? That is a Linux environment ? #1651

Open jbdatascience opened 8 months ago

jbdatascience commented 8 months ago

Can I run this on Google COLAB FREE VERSION? That is a Linux environment !

VikramMSingh commented 8 months ago

No - you will need the terminal to clone the repository. The terminal is only offered in the paid version of Google Colaboratory.

SDpedrovilaplana commented 8 months ago

Yes you can , you must find a way to upload the repo to the Colab session folder. You can download the repo folder locally and upload it, or have it in your Google Drive so yo can mount it in Colab. Although the Colab Free version sometimes gives you GPU resources to run local models faster, its not guaranteed. Haven't tried with the OpenAI API, but it should be easier. Its important to mention that if you want to use the GUI you can connect the Colab's localhost port 8001 with pyngrok library, (you must create an account in https://ngrok.com/ , and the free tier has worked for me perfectly. You can try these examples to get familiar with pyngrok with FastAPI and with Colab.

psychopatz commented 7 months ago

I've tried it, the CPU version is painfully slow but if youre in luck to have used the GPU Session, you can run it with ease, @SDpedrovilaplana Explained the steps beautifully.