search

ollama / ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
https://ollama.com
MIT License
91.86k stars 7.23k forks source link

Mistral-7B instruct v3 FP16 Please #4592

Closed Donno191 closed 4 months ago

Donno191 commented 4 months ago

Mistral-7B instruct v3 FP16 Please - https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3/tree/main

jmorganca commented 4 months ago

Hi @Donno191 . Try this:

ollama run mistral:7b-instruct-v0.3-fp16

https://ollama.com/library/mistral:7b-instruct-v0.3-fp16