iai-group / guidelines

IAI Style Guide
7 stars 4 forks source link

IAI Group level policy for tracking ML training #34

Open IKostric opened 2 years ago

IKostric commented 2 years ago

Compare tensorboard, W&B, ...

vinaysetty commented 2 years ago

My recommendation:

  1. While training use Weights and Biases https://wandb.ai/site to track the hyperparameters and logs
  2. Use dataset version control (DVC) https://dvc.org to track datasets used and models trained for the experiments in a GitHub repository and a remote storage like dropbox or even ssh store like on gustav1. Here is the quick start guide https://dvc.org/doc/start/data-and-model-versioning
kbalog commented 2 years ago

Let's try these for TREC CAsT

kbalog commented 1 year ago

Just go with the wandb suggestion for now