-
Configure and connect to Granite Code models on using Continue in VSCode.
-
We are able to download the granite model using below command
ilab download --repository instructlab/granite-7b-lab-GGUF --release main --filename granite-7b-lab-Q4_K_M.gguf
ilab generate is worki…
-
Hi team,
Thank you for developing the InstructLab UI! I'm excited to start using it, but I'm currently having trouble getting it up and running. The main issue seems to be understanding and setting…
-
There's no supported model list or requirement in the doc.
e.g.
I downloaded instructlab/granite-7b-lab but can not serve with it.
```
(dlipy3) [root@llm opt]# ls chu/gran…
-
### Your current environment
Using the latest vLLM off of `main`.
### 🐛 Describe the bug
When running the online server with a model with an MLP speculator, sending a request that request prompt lo…
-
How can I quickly sign up for a free tier on Watsonx and start using a Granite Code model?
-
These open source models were just released yesterday at Red Hat Summit.
https://huggingface.co/ibm-granite
https://arxiv.org/abs/2405.04324
If this ends up being a bigger ask than I think it is…
q5sys updated
2 weeks ago
-
**Is your feature request related to a problem? Please describe.**
The taxonomy meetings have had questions/confusion on how to download/use granite models in place of the default model coded into il…
-
orange Tactics
-
capacity Borders