huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
132.03k stars 26.3k forks source link

Add Hiera model #28993

Open p1atdev opened 7 months ago

p1atdev commented 7 months ago

Model description

Hiera is a hierarchical vision transformer that is fast, powerful, and, above all, simple. It outperforms the state-of-the-art across a wide array of image and video tasks while being much faster.

Open source status

Provide useful links for the implementation

GitHub Repo: https://github.com/facebookresearch/hiera/ (but licensed under CC BY-NC 4.0) arXiv: https://arxiv.org/abs/2306.00989

Namangarg110 commented 7 months ago

Can I work on this ?

amyeroberts commented 7 months ago

@Namangarg110 Certainly! Feel free to open a PR when you're ready and ping us for review 🤗. To avoid issues from becoming too stale, we will prioritise the first open PR when reviewing over the first comment on issues.

Namangarg110 commented 7 months ago

Thanks @amyeroberts. This is my first open-source issue. Would it be possible for you to please share any helpful resources or similar PR to understand the code structure?

amyeroberts commented 7 months ago

Sure!

Adding models is quite a big project. If you want to tackle something smaller for your first issue to get used to the workflow of contributing to transformers, resolving a good first issue is a great place to start.

Namangarg110 commented 7 months ago

Thank you for the resources, @amyeroberts.

I've begun the task and have completed 50% of the work.

I recognize that contributing a new model can be exceptionally challenging, but I am eager to give it a try. :)