JuliaML / MLDataUtils.jl

Utility package for generating, loading, splitting, and processing Machine Learning datasets
http://mldatautilsjl.readthedocs.io/
Other
102 stars 20 forks source link

Split package into multiple and make this a Meta package #29

Open Evizero opened 7 years ago

Evizero commented 7 years ago

This package has come a long way, but at the moment it feels a bit like the package equivalent of a blob design. I am very happy with MLLabelUtils because it is a single concern kinda package, which makes it easier (and more fun) to design and flesh out.

I think it would make sense to make this package a convenience collection package that reexports data related ML packages.

Last but not least it could offer some glue code. For example if MLDataUtils is the meta package it could define the needed interface for DataFrame and friends, so they just work out of the box.

Evizero commented 7 years ago

parts of the current documentation should probably be moved to the JuliaML website instead

Evizero commented 7 years ago

As a side note, I will remove precompilation from MLDataUtils, once the code move to MLDataPattern is complete. This is because I will add a Requires.jl dependency here, so that we can have default support for all kinds of different data sources, such as DataFrame and DataTable