-
Hey! Is it possible to use this repo with https://github.com/huggingface/distil-whisper the new Distill Whisper model?
-
Hello, I try to run and train
`python run.py --from_pretrained google/t5-v1_1-base --dataset cqa --model_type task_prefix --label_type llm --llm palm --alpha 0.5 --batch_size 64`
The google/t5-v1_1-…
-
distill_logits.py script generates cuda oom issue while starting the training.
-
Sorry for my ignorance, i have small question about teacher model.
The teacher model pre-distilled with image dataset makes it smarter when training with other datasets?
Can you share the backgro…
-
It seems like there is a bit of excitement around the article template that Distill offers, e.g. it has been picked up by r markdown: https://rstudio.github.io/distill/.
Would people be interested…
-
### System Info
This is with Transformerrs.js V2
### Environment/Platform
- [X] Website/web-app
- [ ] Browser extension
- [ ] Server-side (e.g., Node.js, Deno, Bun)
- [ ] Desktop app (e.g., Electro…
-
Are you planning a functionary mini using llama 3.1 distilled model `nvidia/Minitron-4B-Base` ?
-
您好,感谢开源您这个精彩的工作,我有如下两个疑问。
请问train_distill.py所需要的./res/grid_sdf/df_nomask.pth可以如何找到,好像并没有在源码及提供的数据中找到。
./res/grid_sdf/df_nomask.pth,./prenet/pre_color_net.pth,./mesh_sdf/doll_sdf_g_30k.ply 这些是如何得到的呢。…
-
ValueError: Cannot load from /ai/dit_dis/transformer because the following keys are missing:
time_extra_emb.style_embedder.weight.
Please make sure to pass `low_cpu_mem_usage=False` and `devi…
-
Thank you for the amazing work on "The Mamba in the Llama: Distilling and Accelerating Hybrid Models." I am particularly interested in the hardware-aware speculative decoding algorithm described in th…