Example with pytorch lightning

luyug / GradCache

Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint

Apache License 2.0

327 stars 19 forks source link

Open shaileshj2803 opened 2 years ago

shaileshj2803 commented 2 years ago

Do you have example of this with pytorch lightning by any chance? Thanks for the beautiful work.

luyug commented 2 years ago

I'm glad you like this work!

Unfortunately, I have not worked with pytorch lightning before. I can probably offer some suggestions if you run into some more concrete problems.

aaprasad commented 1 year ago

hi @shaileshj2803 did you end up integrating this with lightning? Would love to see an example as well!

yang-su2000 commented 4 months ago

hi @aaprasad, you can look into my recent PR for reference.