pytorch / hub

Submission to https://pytorch.org/hub/
1.38k stars 240 forks source link

Add SNNMLP to pytorch-hub #310

Closed Gaffey closed 1 year ago

Gaffey commented 1 year ago

SNNMLP incorporates the mechanism of LIF neurons into the MLP models, to achieve better accuracy without extra FLOPs. We propose a full-precision LIF operation to communicate between patches, including horizontal LIF and vertical LIF in different directions. We also propose to use group LIF to extract better local features. With LIF modules, our SNNMLP model achieves 81.9%, 83.3% and 83.6% top-1 accuracy on ImageNet dataset with only 4.4G, 8.5G and 15.2G FLOPs, respectively.

The corresponding accuracy on ImageNet dataset with pretrained model is listed below.

Model structure #Parameters FLOPs Top-1 acc
SNNMLP Tiny 28M 4.4G 81.88
SNNMLP Small 50M 8.5G 83.30
SNNMLP Base 88M 15.2G 85.59

The full paper could be found at this link.

facebook-github-bot commented 1 year ago

Hi @Gaffey!

Thank you for your pull request and welcome to our community.

Action Required

In order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@fb.com. Thanks!

netlify[bot] commented 1 year ago

Deploy Preview for pytorch-hub-preview ready!

Name Link
Latest commit e3333aa5538217ced136b587f413c6ed26245af2
Latest deploy log https://app.netlify.com/sites/pytorch-hub-preview/deploys/63248c7e62fea6000901b010
Deploy Preview https://deploy-preview-310--pytorch-hub-preview.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

facebook-github-bot commented 1 year ago

Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks!

Gaffey commented 1 year ago

LGTM, just a couple of minor changes and we're good to go. Thanks a million for contributing!

Thanks. Changes have been made. Please check it again. @vmoens