-
### Deep Learning Simplified Repository (Proposing new issue)
:red_circle: **Project Title** : Time Series Model on Counter Strike Market Sale Dataset
:red_circle: **Aim** : To develop a time series…
arpy8 updated
3 weeks ago
-
Appreciate the guide on [Inferencing on custom models](https://github.com/SafeAILab/EAGLE/blob/main/README.md#inference-on-custom-models).
Is there a guide on how I can train my own eagle heads on a …
-
Hi, thank you for the insightful work!
I have some concerns regarding the classifier-free guidance (CFG) in auto-regressive models.
CFG in this work is implemented as follows:
https://github.…
-
This research area is developing very fast in the past two years, which could improve latency significantly with quality on par. Will huggingface team be interested into the implementation of it? Tha…
-
再请教一个问题,训练好的sat模型如何再两张GPU上加载并推理? 我目前只有A100(40G)的版本,有时推理会报内u才能溢出。
请问如何设置多GPU推理?
下面模型加载部分如何设置呢?谢谢
`# load model
model, model_args = AutoModel.from_pretrained(
args.from_pretra…
-
#### Is your feature request related to a problem? Please describe
I've recently come across a situation when I needed to do a lot of AR model searches for a considerable number of samples. There are…
-
## Background
The different models that can be trained in Neural-LAM are currently all sub-classes of `pytorch_lightning.LightningModule`. In particular, much of the functionality sits in the first …
-
Kosmos-2.5 is an relatively small (1.37B params), generative model for machine reading of text-intensive images.
**Details of model being requested**
- Model name: Kosmos-2.5
- Source repo link: …
-
### 🚀 The feature, motivation and pitch
Consistency LLM: https://hao-ai-lab.github.io/blogs/cllm/ claims to speed up inference. I wonder what version of this we can support in vllm?
### Alternatives…
-
Hi y'all, I thought about writing a notebook that showcases how to create a natural language interface for databases using Hugging Face models, Outlines for structured generation and Lark as a parser …