-
第二段示例代码中的"model_path"为"itpossible/C/Chinese-Mistral-7B-Instruct-v0.1"似乎是一个错误的路径，我到huggingface上找到目录"itpossible/"，并没有名为"C/"的文件夹，我猜示例代码中想说的"model_path"应该是"itpossible/Chinese-Mistral-7B-Instruct-v0.1"
-
### Bug description
steps to reproduce the issue:
1. litgpt chat checkpoints/mistralai/Mistral-7B-Instruct-v0.3 --max_new_tokens 2048
2. enter any prompt
I get answer with no space between word…
-
### Before submitting your bug report
- [ ] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
Attempting to generate with Mistral Small causes this error:
---------------------------------------------------------------------------
RuntimeError Traceback (most r…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports.
###…
-
Description
Hey there 👋 ! I am trying to integrate a router model solution into Braintrust Proxy and I encountered a problem that Perplexity and Mistral models are not working.
Steps to reproduc…
-
### The Feature
there is now: "text-completion-codestral" prefix to use fim/completions
but there is no way to use FIM endpoint: https://api.mistral.ai/v1/fim/completions
proposal: add "text-com…
-
**Describe the bug**
A clear and concise description of what the bug is.
An update to the mistral_int4_optimize.json added an entry to the 'data_configs':
{'name': 'inc_static_quant_data_config',…
-
```
import os
import yaml
from loguru import logger
from langchain_core.language_models.chat_models import BaseChatModel
from langchain_community.chat_models import ChatLiteLLMRouter
import li…
-
### Summary
Expand [auto-tracing integration](https://mlflow.org/docs/latest/llms/tracing/index.html#automatic-tracing) of MLflow Tracing to Mistral SDK. MLflow already supports auto-tracing for Op…