add device argument - Githubissues

pathwaycom / llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

https://pathway.com/developers/templates/

MIT License

4.68k stars 236 forks source link

add device argument #50

Closed mdmalhou closed 1 year ago

mdmalhou commented 1 year ago

Specify what device to run the LLMs on in the local variant.