search

HuyinDong / google-refine

Automatically exported from code.google.com/p/google-refine
0 stars 0 forks source link

Refine Error During Import of 260 MB csv file on Macbook Pro 2.7/8gb ram running OS X Lion via Chrome #581

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
Everytime I try and import this file from Google Cloud Storage (260MB csv) it 
freezes or I get the error screen attached.  I have allocated 4,096MB to Refine 
and am running it via Chrome... Any ideas?

Macbook Pro Early 2011 2.7ghz 8mb ram
Mac OS X Lion most recent upated
Up to date Java 64-bit
Chrome Browser (latest version)

Original issue reported on code.google.com by glit...@perpetuales.com on 1 Jun 2012 at 4:05

Attachments:

GoogleCodeExporter commented 8 years ago 
Sorry to hear about the problem.  On the surface, that file sounds like it 
shouldn't be too big, although it depends to some degree on the number of cells 
and type of data.

It almost sounds as if the browser itself is crashing which makes me wonder if 
there's something unexpected about the data.  Are there a large number of rows 
with blank cells in the first column?  That could make Refine think they form 
pseudo-records causing it to attempt to display a large number of rows at once 
in the browser.  If this is the case, you should be able to import the file as 
plain text, switch to row display mode (record mode is the default), split the 
text lines into columns and move a different column to the first (leftmost) 
position to prevent this from happening.

If that's not the problem, can you try opening a Terminal window and running 
the Refine server there to see if there are any error messages on the console 
when the import fails?

Original comment by tfmorris on 1 Jun 2012 at 2:18

GoogleCodeExporter commented 8 years ago 
The first column does not have blanks... there are a lot of blanks throughout 
the table... How do I run using Terminal?

Original comment by glit...@perpetuales.com on 1 Jun 2012 at 3:47