-
### System Info
python==3.10.15
cuda==11.8-8.8.1
torch==2.4.0
The latest version of code
GPU A100_40G * 8
### Who can help?
@ziyuwan @Gebro13 @
### Information
- [X] The official example scri…
-
I ran the sample code list below using **AWS Neuron SDK 2.16.0**
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/libraries/transformers-neuronx/transformers-neuronx-developer-guide.html#mi…
-
### What is the issue?
My initial goal is to check if specific model is available using Ollama API.
I use OpenAI library `github.com/sashabaranov/go-openai` to do that.
The problem is when I …
-
Using the following code yields a no-support error. Would love to see the model supported since it's currently one of the few Finnish-language LLMs.
```
from unsloth import FastLanguageModel
impo…
-
python -u train_math.py --seed 10 \
--dataset_name "prealgebra" \
--dataset_path "../envs/math/data/math_500.jsonl" \
--model…
-
### Describe the bug
Let's start by thanking you for this great resource :blue_heart:
The `InferenceClient` supports tool calling, as explained [here](https://huggingface.co/docs/huggingface_hu…
-
## Description
Trying to use Cloudflare Workers AI models other then `cf/mistral/mistral-7b-instruct-v0.1`
## Steps to reproduce
For example, use `cf/meta/llama-3-8b-instruct` as `model_name`…
-
I already downloaded phi3 instruct gguf from: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/resolve/main/Phi-3-mini-4k-instruct-q4.gguf
and placed it at: ~/models/
jawad@desktoper:~…
-
Hello.
I don't know if this is a bug or a feature, however I've expected More.
- Software:
-- GPT4All 2.7.1, working on **CPU only**
-- Local Documents collections: none selected
- LLM:
--…
-
**Describe the bug**
Hi, all. Working on a blog article, following a mix of local documentation + Intelligent app workshop, but instead of going Falcon, I've gone with the Mistral 7b model. and at …