maet3608 / nuts-ml

Flow-based data pre-processing for deep learning
Other
31 stars 10 forks source link
data-preprocessing data-science deep-learning deep-learning-framework deep-learning-library

.. image:: pics/nutsml_logo.gif :align: center

nuts-ml is a data pre-processing library for GPU based deep learning that provides common pre-processing functions as independent, reusable units. These so called 'nuts' can be freely arranged to build data flows that are efficient, easy to read and modify.

The following example gives a taste of a nuts-ml data-flow that trains a network on image data and prints training loss and accuracy

.. code:: python

(train_samples >> Stratify(1) >> read_image >> transform >> augment >> Shuffle(100) >> build_batch >> network.train() >>
Print('train loss:{} acc:{}') >> Consume())

nuts-ml is based on nuts-flow <https://github.com/maet3608/nuts-flow>, which is described here <https://maet3608.github.io/nuts-flow/>.

.. image:: https://badge.fury.io/py/nutsml.svg :target: https://badge.fury.io/py/nutsml

.. image:: https://img.shields.io/pypi/pyversions/nutsml.svg :target: https://pypi.python.org/pypi/nutsml/

.. image:: https://travis-ci.org/maet3608/nuts-ml.svg?branch=master :target: https://travis-ci.org/maet3608/nuts-ml

.. image:: https://coveralls.io/repos/github/maet3608/nuts-ml/badge.png?branch=master :target: https://coveralls.io/github/maet3608/nuts-ml?branch=master

.. image:: https://img.shields.io/github/issues/maet3608/nuts-ml.svg :target: https://github.com/maet3608/nuts-ml/issues

.. image:: https://img.shields.io/badge/license-Apache%202-blue.svg :target: https://github.com/maet3608/nuts-ml/blob/master/LICENSE