wandb downloads should be cached - Githubissues

JasonGross / guarantees-based-mechanistic-interpretability

MIT License

7 stars 2 forks source link

wandb downloads should be cached #23

Open JasonGross opened 7 months ago

JasonGross commented 7 months ago

https://github.com/JasonGross/guarantees-based-mechanistic-interpretability/blob/d0cf2510be626fa9ebc022009d28f715646762cf/notebooks_jason/max_of_2_grokking.py#L126-L128 re-downloads the artifacts from wandb every time it is run. It'd be nice to cache them on disk somehow. (Does wandb support this?)

JasonGross commented 6 months ago

Alternatively (perhaps better) we need to convince someone to fix https://github.com/wandb/wandb/issues/7006