search

dandi / dandisets-healthstatus

Healthchecks of dandisets and support libraries (pynwb and matnwb)
0 stars 1 forks source link

Create a new benchmarking run comparing also with as downloaded (e.g. to drogon, same spindles) #89

Open yarikoptic opened 3 weeks ago

yarikoptic commented 3 weeks ago

Continuation to

Would be great to see a comparison on a sample nwb file between

I would like to see benchmarking results on a sample nwb for matnwb test

jwodder commented 3 weeks ago

@yarikoptic

  • (ideally) datalad-fuse with caching cold
  • (ideally) datalad-fuse with caching hot

How am I supposed to achieve these? Are you referring to datalad-fuse's built-in caching or regular disk caching?

jwodder commented 2 weeks ago

@yarikoptic Ping.

yarikoptic commented 2 weeks ago

datalad's fsspec level (so built in I guess) caching. Just to first access without cache, and then access after having already accessed once (so accessed data is cached and present locally)

yarikoptic commented 2 weeks ago

Please also include in the result stat how much of data was fetched -- for fsspec-based cache size, and for davfs sizes of its cache before/after (I think it downloads full file).