-
**Overview**
Add support for Ollama to enable users to run open source models locally.
This feature is required for privacy focused users who do not want to share their code with LLM providers.
…
-
The current version uses OPEN AI models to transcribe the audio and OAI LLM to transform the text, it would be great if we can add options to use open source LLM's and transcription models.
-
-
Hi, ST-LLM code is open-source now: https://github.com/ChenxiLiu-HNU/ST-LLM
Thanks!
-
Please create small video to showcase this project functionality so that people can have generally idea of what to do and how to do. There is btw openwebui great open source project so maybe you can t…
-
I will list the test results of various open-source models here. You can refer to these data to select models and configure devices. Of course, the evaluation of LLM is quite subjective. I also sugges…
-
Is there is anyway we can use hugging face model or open source LLM or quantized Open sources LLM for the purpose or we can use gemini free usage quota?
-
## 🐛 Bug
## To Reproduce
Steps to reproduce the behavior:
1. l built Android App from Source refered to official document(https://llm.mlc.ai/docs/deploy/android.html#deploy-android)
2.l …
-
Is it possible to use open source and locally hosted LLMs? I dont have access to comercial hosted LLMs due to 1. not affording to pay for them, 2. not having an acceptable payment method and 3. the co…
ronna updated
9 months ago
-
Hi,
I'm trying to compile a llama-3.2. I have followed the setup instructions but before I can get to running the `mlc_llm compile` command, I am running `./web/prep_emcc_deps.sh` which fails with …