-
### System Info
- `transformers` version: 4.44.2
- Platform: Linux-3.10.0-1160.el7.x86_64-x86_64-with-glibc2.17
- Python version: 3.10.14
- Huggingface_hub version: 0.24.3
- Safetensors version: …
-
Is there a way or tutorial on how to configure ollama litellm to work with skyvern? How can skyvern work with a local llm?
-
### Background
For large document understanding or tasks like code completion, it's often beneficial to have a large context length e.g. > 8K. In order for this to be enabled by default, a model wo…
-
When I try to merge it phi-2 to a MoE I get:
```
$ mergekit-moe phi2_moe2.yml out_phi2_moe
Fetching 10 files: 100%|████████████████████████████████████████████████████████████████████████████████…
-
### What is the issue?
Ollama randomly starts whole prompt re-evaluation ignoring the cache. Normally next message on my system starts in 1-2 seconds, but when it happens i've to wait 7-20 minutes.…
-
Error: Runtime Error Indices should be on the same device or on cpu.
Setup: GPU Server with 3xH100 80 GB
Goal Model inference should be on coda:0,1 and SAE on coda:2. ActivationStore on CPU.
D…
-
Hello all,
Thank you for your great work here. I was completing some testing of the Phi 3 Vision model in mistral.rs, but it appears that the error stems from a linear layer. I have verified that t…
-
Hi Team,
When I set **num_crops=0 I get the error: "ValueError: height and width must be > 0"**. Full error is below....
my images are square and small (less than 336x336) already and I don't want…
hm-ca updated
1 month ago
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
### Description
I'm testing out the experimental "provider registry" and I've found if the model ID has a `:` in it, this package will remove everything before the LAST `:`, which sends the wrong mod…