-
Hi, thank you for providing 1.58bit implementation. Nice work! I looked through many bitnet1.58 implementations and noticed that they all use the method suggested in "The Era from 1-bit LLMs: Training…
-
Hi, Is there any roadmap to support other open source LLM's? If there is any documentation already in place, please share.
-
### Enhancement Request - Support for Additional LLM Types
#### Description:
After reviewing the [Mediapipe documentation](https://developers.google.com/mediapipe/solutions/genai/llm_inference) an…
-
This is not an error specific to this project but I have been unable to get the repos on `llama_index` to work on my computer. I have looked around on the llama_index issue forums and the only advice…
-
For every message submitted to the Cat, we can store in working_memory:
- tokens used (input and output)
- prompts used
- replies for each prompt
Info can be sent back to the client in the `why`…
-
This issue tracks the progress of developing the LLM Hyperparameters Tuning API in Katib. The API aims to provide an easy-to-use interface for tuning the hyperparameters of large language models, leve…
-
First of all, thanks. We need more ramps.
I was curious what you think of BitNet, and if llm.c is a place where experimenting with it could be facilitated. The papers were extremely promising and g…
-
Thank you ! Is it suitable for other LLMS?
-
I was trying to migrate from MLC-LLM to onnxruntime to run Phi-3 on an Orange Pi 5 but I realize that among ALL your execution providers there isn't a single one that takes advantage of the GPU or NPU…
-
# Alex Strick van Linschoten - Structured Data Extraction for ISAF Press Releases with Instructor
I used Instructor to understand how well LLMs are at extracting data from the ISAF Press Releases dat…