-
It appears to be hanging at 50/1650 smart_blocks and not creating embeddings at all...
After waiting for the process for ages, I checked the '.smart-connections' folder in my system explorer and fo…
-
### System Info
```shell
optimum @ git+https://github.com/huggingface/optimum.git@e156282ffd8587df8422bdf53295880ae881b353
Python: 3.10.4
Platform: Windows 10
Cuda: 11.6
cuDNN: 8.7.0.
```
### W…
-
**Is your feature request related to a problem? Please describe.**
I'm wanting to utilize guidance using a large hugging face hosted model.
I don't see any classes related for Hugging Face specifica…
-
# URL
- https://arxiv.org/abs/1704.06259
# Affiliations
- Ping Chen, N/A
- Fei Wu, N/A
- Tong Wang, N/A
- Wei Ding, N/A
# Abstract
- Many Natural Language Processing and Computational Lingui…
-
### System Info
```Shell
colab
t4
https://huggingface.co/docs/accelerate/concept_guides/
https://huggingface.co/docs/accelerate/concept_guides/big_model_inference
If I have a single 16 G…
-
### 🐛 Describe the bug
Calling `.generate` on a HuggingFace model that has been FSDP wrapped results in an error. I was able to work around this error by summoning full params without recurse, which …
-
I'm trying to use this for PDF files but I don't see any PDF examples.
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
https://virtual2023.aclweb.org/paper_P5680.html
-
**Why**
Would provide users with more control over the inference settings such as "top_k", "min_p", "top_p", "mirostat", etc.
**Concise description**
An advanced settings menu where the requests…