-
-
Hey, I am a game developer and just wanted to ask if I can help on this game? I am currently making my own VR game, and I think we could sort of use the best of both worlds to create one magnificent g…
-
Hello, can you provide a minimum configuration for model usage?
macOS 13.4.1 14-inch M1 Pro 16GB
1. [LLaMA](https://github.com/ml-explore/mlx-examples/blob/main/llama). It takes so long time to …
-
### Is your feature request related to a problem? Please describe.
People asked for it on Discord after spending a lot of time trying to make it work with unsupported models.
### Describe the soluti…
-
i finetuned a lora adapter for mistral nemo , i am trying to merge it on the base model and push it to my hub then quantize it (to overcome the disk space issues)
my setup -->
`from unsloth import…
-
I am getting the following error when I run `mergekit-moe config.yml ./output`
```
File "/home/ubuntu/moe_experiments/mergekit/mergekit/options.py", line 58, in wrapper
f(*args, **kwargs)
Fi…
axrwl updated
2 months ago
-
This is my quantize code:
from transformers import AutoTokenizer, TextGenerationPipeline
from auto_gptq import AutoGPTQForCausalLM, BaseQuantizeConfig
import logging
import random
import torch
…
-
### Presentation of the new feature
When using Outlines on various open models available on Huggingface I have often needed to add various chat template tags to the prompt I am passing into a seque…
-
### System Info
- CPU architecture (x86_64)
- GPU name (NVIDIA A10)
- TensorRT-LLM commit (build from tensorrtllm_backend which commit is: 3608b0)
### Who can help?
Hi all,
We use "triton + tens…
-
Hello.
Another long post, but bear with me - the steps-to-reproduce the behavior herein have to be known in detail.
It's about how and what to click on, in order to receive replies based on info i…