There isn't a way to load training data one item at a time.

[kristoffzoghbi]

All training data must be loaded at once in a 2D array. This causes memory problems if the training set and inputs count are large.

[jeroldhaas]

Support for Lazy<T> might help in this arena, however I think that might call for some pretty hefty refactoring. Thoughts?