Tudyx / ai-dataloader

A rust port of pytorch dataloader
Apache License 2.0
21 stars 1 forks source link

Add proper benchmark #52

Open Tudyx opened 7 months ago

Tudyx commented 7 months ago

Right now we have benchmarks to compare with PyTorch but not really to compare ai-dataloader with itself. It will be very useful to have some, to be able to make choices based on real data. For instance, it would help with https://github.com/Tudyx/ai-dataloader/pull/17, https://github.com/Tudyx/ai-dataloader/issues/13 and https://github.com/Tudyx/ai-dataloader/issues/1

There are some benchmark using the criterion library but, at least on my computer, they are too noisy to be useful. It will be useful to improve them or maybe try a different approach.

The rustls benchmarks seems very qualitative and could be a good source of inspiration.