stanford-crfm / levanter

Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
https://levanter.readthedocs.io/en/latest/
Apache License 2.0
494 stars 78 forks source link

Automatically set up wandb workspace for people #741

Open dlwh opened 2 hours ago

dlwh commented 2 hours ago

Levanter logs a lot, and the default grouping in WandB is really very unhelpful.

It would be nice if we could automatically configure the workspace for people the way I like it (which is obviously the correct and best way. 😉 )

https://docs.wandb.ai/tutorials/workspaces/

This is what I see:

image

This is the default view:

image

Horrible.

dlwh commented 2 hours ago

Until we make this change:

in wandb to order by “group first prefix” (… -> sections -> unlock -> group first prefix). After that I just make some log/log plots and smooth things a bit.