-
Hello,
I am trying to start the container, but I receive the error:
```
Downloading tokenizer mistralai/Mistral-7B-Instruct-v0.2
Traceback (most recent call last):
File "/home/worker/app/…
mdima updated
6 months ago
-
### Model description
I have submit access request to through huggingface and granted me access but not able to run model on inference.
``` Python
import torch
from torch import cuda, bfloat1…
-
[[Open issues - help wanted!]](https://github.com/vllm-project/vllm/issues/4194#issuecomment-2102487467)
**Update [9/8] - We have finished majority of the refactoring and made extensive progress fo…
-
### System Info
```
2024-08-08T07:56:58.379296Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.79.0
Commit sha: db7e043ded45e14ed24188d5a96…
-
Here is the notebook link: https://github.com/KaifAhmad1/code-test/blob/main/Dataset_Creation_using_Distilabel.ipynb
``` Python
class QuestionAnsweringTask(TextGeneration):
def generate_pr…
-
### Description
I was trying to launch example from this page https://sdk.vercel.ai/docs/guides/providers/mistral
But it didn't work for me. The API key is correct but it seems that my POST handler …
-
Steps to reproduce:
1. `git clone https://github.com/modal-labs/llm-finetuning.git`
2. `python3 -m venv env && . env/bin/activate && pip install modal`
3. set up modal token, huggingface token and …
-
- mistralai_client_dart
- [It's pub URL](https://pub.dev/packages/mistralai_client_dart)
- ChatGPT, AI, ML & Game Development -> ChatGPT, LLM & Generative AI
- It is a client for Mistral AI API …
-
Just installed the client. VS Code can't find TS types probably because in `package.json` this field is incorrect: `"types": "src/mistralai.d.ts"` when it should be `"types": "src/client.d.ts"`.
brenc updated
6 months ago
-
### System Info
Tech stack: tgi 2.0.1, A100 GPU 80GB running on Kubernetes.
Model: Mixtral 8x7B-instruct-v0.1
### Information
- [x] Docker
- [ ] The CLI directly
### Tasks
- [x] An officially su…