Closed sayakpaul closed 10 months ago
Absolutely! This will be fantastic. Ideally, our scripts will autogenerate all of these metrics and export them to either JSON, markdown, some other format! Then, keras.io can automatically load these at compile time and generate a nice leaderboard
For deriving the number of parameters, FLOPs, and throughput we could set up a job or a script for encouraging reproducibility.
Having tools for this in Keras It is one of the most popular FR of the last years: https://github.com/tensorflow/tensorflow/issues/32809
I think we should start picking this up in early Jan 2023
954
yes pretty much this describes the idea
moving to kaggle, so closing this.
Once we have a collection of pre-trained models we can start preparing a Markdown page including the following details for each model:
(Note that I'm only assuming image classification models for now but these details could be amended to accommodate detection, and segmentation models too):
For deriving the number of parameters, FLOPs, and throughput we could set up a job or a script for encouraging reproducibility.
Cc: @LukeWood