-
- Laravel-mongodb Version: 4.2.0
- PHP Version: 8.3.4
- Database Driver & Version: php8.3-mongodb latest
### Description:
I have a model with a mysql collection e.g.
$product. with a meta-field…
-
### Your current environment
vllm version: 0.5.4
gpu 24GB memory
### 🐛 Describe the bug
```bash
CUDA_VISIBLE_DEVICES=0 vllm serve mistralai/Mistral-7B-Instruct-v0.3 --api-key yyy --port 1…
-
### What is the issue?
I have tools that automatically update my containers. I use latest with ollama. after latest update to image i cant run any models. I can pull models for example llama3.1 but w…
-
### What is the issue?
I tried running with the 1.7b version, and it ran successfully.
![image](https://github.com/user-attachments/assets/6074c785-cbb2-43e0-b82d-32fe74184840)
However, when runni…
-
### Description
I get an error Method not found: 'Double Microsoft.KernelMemory.AI'
### Reproduction Steps
repeating the example, except replacing the document with text
https://github.com/SciSha…
-
### What is the issue?
I was trying to run the (new) embedding example:
```
curl http://10.0.3.22:11434/api/embed -d '{
"model": "all-minilm",
"input": ["Why is the sky blue?", "Why is the gr…
-
In reference.py, the following fails:
‘’’
from llama_models.llama3_1.api import ModelArgs
‘’’
I aliased api/ in ‘llama3’ to be available in ‘llama3_1’, but that generated an error, which relates t…
-
1. Remove from merged model the original SV and SSH files
2. Add to metadata to merged model X-Amz-Meta-Bamessageid: used structure is based on OPDM file naming.
-
### What is the issue?
Upon running "ollama run gemma:2b" (though this happens for all tested models: llama3, phi, tinyllama), the loading animation appears and after ~5 minutes (estimate, untimed)…
-
Problem Description
We can not use the new llama3.1 models on the groq API.
Proposed Solution
Add the model as an option, and maybe add a custom model name
Additional Context
[Llama 3.1 405B …