search

apple / turicreate

Turi Create simplifies the development of custom machine learning models.
BSD 3-Clause "New" or "Revised" License
11.2k stars 1.14k forks source link

OSError: basic_ios::clear: iostream error in turicreate sframe groupby #3401

Open rahulkr01 opened 3 years ago

rahulkr01 commented 3 years ago

Getting following error while doing groupby operation on a sframe with millions of rows -

File "/opt/conda/lib/python3.6/site-packages/turicreate/data_structures/sframe.py", line 4465, in groupby ║ ║ key_columns_array, group_columns, group_output_columns, group_ops ║ ║ File "/opt/conda/lib/python3.6/site-packages/turicreate/_cython/context.py", line 50, in exit ║ ║ raise exc_type(exc_value) ║ ║ OSError: basic_ios::clear: iostream error

I am using turicreate version 6.4. It is failing here probably -https://github.com/apple/turicreate/blob/master/src/python/turicreate/data_structures/sframe.py#L4462

What could be the possible reason for this error? Is this error appearing because of data corruption in sframe? This error message isn't very informative. I am new to C and cython.

TobyRoseman commented 3 years ago

TuriCreate is a Python package which wraps C++ code. The line number you share is simply the group_by entry point into C++. So knowing that it fails there isn't very helpful. Since basically all that tell us is it failed somewhere in the C++ code.

In order to help you, I'm going to have to be able reproduce this issue. That means we'll need three things: 1 - What is the code like? What's the SFrame groupby call that is causing this issue? 2 - What is your data like? If you can share the actual data, that's the easiest option. If not, please share as many details about it as possible. How many rows? How many columns? What are the column types? 3 - What is your environment like? What version of Python are you using? What operating system are you using?

Another question - does this happen every time your try or only once?