search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

cloud versioning #408

Closed dberenbaum closed 3 weeks ago

dberenbaum commented 1 year ago

Add benchmarks for cloud versioning remotes

efiop commented 1 year ago

Might be worth putting these per every plugin (e.g. into dvc-s3 for s3) and test particular functionality (like index building). Testing all clouds in dvc-bench might be an overkill, this didn't work out well with previous version of dvc-bench.

dberenbaum commented 1 year ago

True, that could be nice, but I was thinking of just testing in s3 like we do for regular remotes to make sure the basic workflow has reasonable benchmarks in line with traditional remotes.

dberenbaum commented 1 year ago

Sorry, my mistake here. I guess we don't test s3 for regular remotes with dvc-bench now. So maybe we either need to test on at least one cloud remote or indeed move this to each plugin.

efiop commented 1 year ago

Though we have the infra in dvc-bench for running with different clouds, so maybe should fit in here after all.