search

NervanaSystems / neon

Intel® Nervana™ reference deep learning framework committed to best performance on all hardware
http://neon.nervanasys.com/docs/latest
Apache License 2.0
3.87k stars 811 forks source link

ArrayIterator and 3D numpy array #384

Closed elena-orlova closed 7 years ago

elena-orlova commented 7 years ago

Hello!

We are working on GAN for particle simulation. Firstly, I want to understand how the model works in a simple case, so I created my own dataset as numpy arrays, "images" 25 x 25 x 25 and some labels (0 or 1). In fact, our dataset for further work is a big set of 252525 images. But I faced with some problems: there are some errors when I use ArrayIterator. My code https://github.com/elena-orlova/CERN-Project/blob/master/gan3D.py Data generation: https://github.com/elena-orlova/CERN-Project/blob/master/gen_data.py Error message:

Traceback (most recent call last): File "gan3D.py", line 26, in train_set = ArrayIterator(X=train_data, y=data_y) File "//anaconda/envs/neon/lib/python3.6/site-packages/neon-2.0.0-py3.6.egg/neon/data/dataiterator.py", line 109, in init assert self.ndata >= self.be.bsz AttributeError: 'NoneType' object has no attribute 'bsz'

As I see ArrayIterator works with numpy arrays, so what could cause the problem?

Thanks in advance!

elena-orlova commented 7 years ago

I've found the solution https://github.com/NervanaSystems/neon/issues/142

Thank you anyway!