google-research / tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.
Other
26.29k stars 2.18k forks source link

Delphi process #20

Closed alexkarargyris closed 5 months ago

alexkarargyris commented 1 year ago

Great starting document. I highly recommend that a Delphi process (https://en.wikipedia.org/wiki/Delphi_method) with the larger ML community should be pursued. See example here: https://arxiv.org/pdf/2206.01653.pdf

varungodbole commented 5 months ago

Thanks for the pointer! We won't have the bandwidth to pursue this for the foreseeable future. But you're welcome to pursue it and create a fork of our repository as necessary!