-
```dockerfile
#Base Image
FROM nvcr.io/nvidia/tritonserver:24.04-trtllm-python-py3
USER root
RUN apt update && apt install --no-install-recommends rapidjson-dev python-is-python3 git-lfs curl uuid…
-
Original Repository: https://github.com/ml-explore/mlx-examples/
Listing out examples from there which would be nice to have. We don't expect the models to work out the moment they are translated to …
-
I don't think it matches the signature.
```python
get_gguf_model(
name: str,
label: str,
settings: FuncchainSettings,
) -> Path:
"""
Gather GGUF model from huggingface/TheB…
-
While loading the model "ehartford/dolphin-2.5-mixtral-8x7b" into the Lida llm, I am getting the error shown in the image.
I am loading it in a CPU.
The llama models are loading fine but the new Mi…
-
This issue is used to document the LLM, embedding, reranker, etc. models that need to be integrated with RAGFlow.
- [x] Azure Open AI service
- [x] Google Gemini #1036
- [x] Mixtral AI #433
- […
-
When running the Google Colab notebook, it looks like there is some error when loading the Mixtral Instruct Tokenizer:
```
[/usr/local/lib/python3.10/dist-packages/transformers/tokenization_utils_…
-
Looking forward to supporting Mixtral_8x7b MoE
-
Hello,
I'm looking to reproduce some of the open-source model results from the VWA paper:
(1) Mixtral-8x7B model as the LLM backbone for Caption-augmented model
(2) CogVLM for the Multimodal Mode…
-
**Describe the bug**
While i run data generate using --pipeline full, after process done, file trained result from data generated is empty. this is my command line
`ilab data generate \
--sdg-sc…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related iss…