Open ZaberKo opened 5 months ago
Hi
Thanks for your interest. The reason is that torch lightning calculates the accuracy in batch, see https://lightning.ai/docs/pytorch/stable/notebooks/lightning_examples/cifar10-baseline.html, where the acc has more than 4 decimal
Best regards
Dear researchers, I am really impressed by your work on it. I have a few questions that I hope you could help clarify for me. I find the data for an architecture is organized like this:
Obviously, the accuracy for one seed (representing one trained weight?) is not precisely a four-decimal number since the test set is 10k images, so are there multiple evaluations for the same weight, and are the mean values reported?