search

IntelligenzaArtificiale / Free-Auto-GPT

Free Auto GPT with NO paids API is a repository that offers a simple version of Auto GPT, an autonomous AI agent capable of performing tasks independently. Unlike other versions, our implementation does not rely on any paid OpenAI API, making it accessible to anyone.
MIT License
2.43k stars 382 forks source link

Distributed GPU serving API petals.ml integration #128

Closed sapcode closed 1 year ago

sapcode commented 1 year ago

Discussed in https://github.com/IntelligenzaArtificiale/Free-Auto-GPT/discussions/127

Originally posted by **sapcode** May 28, 2023 Thank you very much for your work and publishing!! @IntelligenzaArtificiale could you please look into this http://petals.ml and this example https://github.com/bigscience-workshop/petals/blob/main/examples/prompt-tuning-personachat.ipynb If you can integrate that, it will allow distributed GPU serving community free models without any paid API needs... Here is a how to spawn own GPU swarm https://github.com/bigscience-workshop/petals/wiki/Launch-your-own-swarm
IntelligenzaArtificiale commented 1 year ago

Help us to implement if u want, now we are focus only on big tech for help normal people and business to have free access to they model without pays us ;)