fastai / fastai2

Temporary home for fastai v2 while it's being developed
https://dev.fast.ai
Apache License 2.0
645 stars 235 forks source link

feat(wandb): use artifacts to track datasets #523

Closed borisdayma closed 4 years ago

borisdayma commented 4 years ago

Datasets can now be tracked by using WandbCallback(dasaset_path='my_data')

It uses W&B artifacts.

See example artifacts on camvid dataset.

The dataset is versioned and has aliases such as latest (custom ones can be used) and will identify any changes of dataset between runs. Different datasets can be used by using different names.

Here is a demo notebook.

TODO in subsequent PR:

review-notebook-app[bot] commented 4 years ago

Check out this pull request on  ReviewNB

Review Jupyter notebook visual diffs & provide feedback on notebooks.


Powered by ReviewNB

borisdayma commented 4 years ago

Note: I'm using master branch of nbdev. Not sure if I should use the last released version instead for CI

jph00 commented 4 years ago

Yes last released version is best - thanks!