💾 Internal change: Support local LLMs

StanfordBDHG / HealthGPT

Query your Apple Health data with natural language 💬 🩺

MIT License

1.65k stars 150 forks source link

💾 Internal change: Support local LLMs #38

Closed manmatteo closed 1 month ago

manmatteo commented 3 months ago

Problem

SpeziLLM supports local LLMs. Using a local LLM seems particularly important when dealing with health data.

Solution

I see two possibilities: either allow for on-device LLMs with SpeziLLM, or allow customization of the OpenAI API URL, so that the app can be used with, for example, a local ollama server.

Additional context

No response

Code of Conduct

[X] I agree to follow this project's Code of Conduct and Contributing Guidelines

vishnuravi commented 3 months ago

Thank you for the great suggestion @manmatteo! This feature is currently in progress in the following PR: https://github.com/StanfordBDHG/HealthGPT/pull/39

vishnuravi commented 1 month ago

This issue has been addressed by #39