-
We are a team at @microsoft Research that has a fork Metaseq repo with these additional features:
1. New pipeline task to perform Knowledge Distillation via Log Probabilities using a modified Cross…
-
### Model description
MaskCLIP represents a transformative step in the realm of open-vocabulary universal image segmentation. Built upon the robust foundation of pre-trained CLIP models, it negates…
-
where is the distillation code? i dont know
-
- The paper includes two steps of maximum and minimum, and contains two loss functions. So we have to train distillation.py twice?
- What dose Quick start in README try to do?
- And could you pleas…
-
Hello, I follow the configuration of your paper and used GPT-2 (705M, eval_loss: 3.75) and LLaMA (360M, eval_loss: 3.746) to distill babyLLamA (58M), but I get eval_loss: 27.985. The gap is so big. Wh…
-
Is it possible to fine-tune Whisper/Distil-Whisper to achieve mixed speech transcription like Hindi+English in a single sentence which is common in casual conversations. Has anyone tried this before? …
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
I was interested in working on the "Overfitting ability of recurrent networks" project for non-image classification task. However, I noticed on the website that there is someone already working on it.…
-
Thanks for your great work! The method is impressive and the result is amazing. I have a question about the derivation about the partial derivative of loss with respect to x in equation (5)(6) mention…
-
### Before Asking
- [X] I have read the [README](https://github.com/meituan/YOLOv6/blob/main/README.md) carefully. 我已经仔细阅读了README上的操作指引。
- [X] I want to train my custom dataset, and I have read the …