search

fhswf / MLPro

MLPro - The Integrative Middleware Framework for Standardized Machine Learning in Python
https://mlpro.readthedocs.io/
Apache License 2.0
13 stars 5 forks source link

BF-Streams: Support Big Data Files #736

Open steveyuwono opened 1 year ago

steveyuwono commented 1 year ago

Motivation As discussed in #716 and others, it makes sense to analyse the current data-storing functionalities and processes in MLPro to be compatible with big data files, especially for data storing and loading, bf-streams, computer vision, supervised learning, and many more.

For big data, we don't need to buffer every single data, but maybe on-demand per stream

Benefit ...

Are the proposed changes backward compatible?

Related development objects

detlefarend commented 1 year ago

A separate review team call is needed...