Open ethanwharris opened 2 years ago
@ethanwharris, I can take a look if this is open. Seems interesting that there is such a bottleneck. Could you give me a bit more details ?
Maybe we can test this on a smaller dataset like CIFAR and see if that's the case.
Hey @Atharva-Phatak thanks for the offer! Please feel free to take a look 😃 I think a great starting point would be to have a model in Flash (trained on e.g. CIFAR-10 as you suggested) and the equivalent model just using Lightning to see if the maximum batch size you can get is different on each. If it is different then that would confirm we have a leak
@ethanwharris Sorry, I was busy with college and working on a PR for bolts. I will look at this week and let's where we can go from here :)
@Atharva-Phatak that would be great is you can still have look at it... :rabbit:
Discussed in https://github.com/Lightning-AI/lightning-flash/discussions/1442