-
Can I use huggingface transformers or vllm to load the model generated by Q-SFT and do the inference work?
-
Hello!
FYI we've been using your code in order to offer support for gguf files within the python ecosystem, by offering the ability to load them within `transformers`.
We're doing so here, we'v…
-
The following `torch.xpu` ops are missing (were available for IPEX):
- [ ] `torch.xpu.memory_allocated()`
- [ ] `torch.xpu.max_memory_allocated()`
- [ ] `torch.xpu.reset_peak_memory_stats()`
T…
-
As above ^, I get something about the model not having an `align` method when I try the hugging face transformer.
-
Hello!
I have a project for my own llm that uses sentence-transformers and huggingface_hub which have dependency issues with latest version of nemoguardrails.
System:
MacOS Sonoma 14.2.1
conda e…
-
Great work!
I try to follow your code to reproduce your results. But I encounter some issues with the parallel training. I guess it is related to the version of transformers you use. Could you please…
-
Let's try typing examples below
Transformer Examples :
-
By default classifiers look for `pytorch_model.bin`, which doesn't exist in newer versions of `transformers`:
```
pytorch_model.bin: no such file or directory
```
The trained model is stored usi…
-
Hello!
You did a great work creating this extension. It saved me a lot of time. Thank you very much!
i am using it via [raycast extension](https://github.com/raycast/extensions/tree/de047f2e9ad02d…
somvy updated
1 month ago
-
If I understand properly, these lines:
https://github.com/huggingface/trl/blob/b6af2edc93b275afcee22a3eb71f9a5702ff9fd8/examples/scripts/dpo.py#L111
are because, previously, using cache with gra…