-
### System Info
tgi docker image 2.0.4
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] An officially supported command
- [ ] My own modifications
### Reproduction
Passing th…
-
Let's say I wish to merge LLAMA-3-8B with Mistral 7B creating a MOE.
How should I proceed?
Or for example 2 small models (3B/4B) of different architectures.
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue]…
-
### System Info
- transformers version: 4.43.3
- Platform: Linux-5.15.0-113-generic-x86_64-with-glibc2.35
- Python version: 3.11.7
- Huggingface_hub version: 0.24.5
- Safetensors version: 0.4.3…
-
Hi everyone:
To use Groq, just add in **models.py**:
```
url = 'https://api.groq.com/openai/v1/chat/completions'
groq = dict(type=GPTAPI,
model_type='gemma2-9b-it',
k…
-
using offical download.sh but got error message when use this model: could not find model config file at .../Meta-Llama-3-8B-Instruct/config.json
see the files I got:
![error](https://github.com/met…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I have this code:
```
import streamlit as st
from llama_index.llms.azure_openai imp…
-
Hello,
I tried to reproduce the results of the paper, and got similar results for Llama2-7B, 13B, 70B, and Llama-3 8B.
However, when I tested Llama3-70B using the optimized rotation matrix you p…
-
### Organization Name
AI/ML API
### Main office location
Estonia, Talinn
### What regions of the world do you serve?
Global
### Business description
We are an AI API provider, giving many AI mo…
-
### Bug Description
I try to run example https://docs.llamaindex.ai/en/stable/examples/query_engine/sec_tables/tesla_10q_table/ with `OpenAILike`
I cannot run the sync version of code, it errors…