search

FluxML / FastAI.jl

Repository of best practices for deep learning in Julia, inspired by fastai
https://fluxml.ai/FastAI.jl
MIT License
589 stars 51 forks source link

MLUtils.jl transition #196

Closed lorenzoh closed 2 years ago

lorenzoh commented 2 years ago

In the medium-term, FastAI.jl will move to depend on MLUtils.jl instead of MLDataPattern.jl + LearnBase.jl + DataLoaders.jl.

Data container transformations

groupobs, joinobs and the likes in transformations.jl. These have already been copied over to MLUtils.jl in https://github.com/JuliaML/MLUtils.jl/pull/21. Functions here can be removed once FastAI.jl depends on MLUtils.jl.

DataLoader

Path to replace dependency on DataLoaders.jl. Support for parallel data iterators has been merged into MLUtils.jl (https://github.com/JuliaML/MLUtils.jl/pull/33), but is not released (yet) and since it uses a different task scheduler than DataLoaders.jl, possible performance regressions on full training workloads still need to be benchmarked.

If that is not an issue and MLUtils.jl releases a stable DataLoader with feature parity of DataLoaders.jl, the dependency on DataLoaders.jl will be dropped.