-
### Describe the bug
Let's start by thanking you for this great resource :blue_heart:
The `InferenceClient` supports tool calling, as explained [here](https://huggingface.co/docs/huggingface_hu…
-
### Problem Statement
Add support for https://docs.sentry.io/product/insights/llm-monitoring/ in JavaScript
### Solution Brainstorm
Things we can support:
- https://github.com/getsentry/sentry-jav…
-
when i run the code below
```python
model,tokenizer = load("mistralai/Mistral-7B-Instruct-v0.2")
```
error：
```
GatedRepoError: 401 Client Error. (Request ID: Root=1-66389f5d-0f09a9387397c642253…
-
Is there a way to do so-called legacy completions?
- https://platform.openai.com/docs/guides/text-generation/completions-api
- https://platform.openai.com/docs/api-reference/completions/create
``…
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### W…
-
- [x] This is actually a bug report.
- [x] I am not getting good LLM Results
- [ ] I have tried asking for help in the community on discord or discussions and have not received a response.
- [x] I …
-
Doing pytest parallel attack on vllm with OpenAI client. Running these on A100 each model, 70b and cabybara ares on 4*A100 80GB, Mixtral on 2*A100 80GB.
e.g. for 70b we run:
```
python -m vllm.e…
-
### Python -VV
```shell
Python 3.9.10 | packaged by conda-forge | (main, Feb 1 2022, 21:25:34)
[Clang 11.1.0 ]
```
### Pip Freeze
```shell
annotated-types==0.7.0
anyio==4.4.0
certifi…
-
### Confirm this is an issue with the Python library and not an underlying OpenAI API
- [X] This is an issue with the Python library
### Describe the bug
The issue is that the `base_url` in t…
-
https://github.com/mistralai/client-python