original_repo: Qwen/Qwen2-7B-Instruct
mlx-repo: mlx-community/Qwen2-7B-Instruct-8bit
quantize: 8bit
default_language: multi
system_prompt: You are a helpful assistant
Qwen2-7B-Instruct-4bit.yaml
original_repo: Qwen/Qwen2-7B-Instruct
mlx-repo: mlx-community/Qwen2-7B-Instruct-4bit
quantize: 4bit
default_language: multi
system_prompt: You are a helpful assistant
when download from chat-with-mlx UI,model dir name both are chat_with_mlx/models/download/Qwen2-7B-Instruct
can save model dir name to Qwen2-7B-Instruct-8bit and Qwen2-7B-Instruct-4bit ?
i can download different quantize model in different dir first
Qwen2-7B-Instruct-8bit.yaml
Qwen2-7B-Instruct-4bit.yaml
when download from chat-with-mlx UI,model dir name both are chat_with_mlx/models/download/Qwen2-7B-Instruct can save model dir name to Qwen2-7B-Instruct-8bit and Qwen2-7B-Instruct-4bit ? i can download different quantize model in different dir first