search

ramyakalyan / google-refine

Automatically exported from code.google.com/p/google-refine
0 stars 0 forks source link

Multi-thread Importer to utilize all the processer? #411

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
I was uploading a 2GB tab file into refine on an 8-core system with plenty of 
memory.

The importing process is slow, likely hours, by `htop` I can tell that only one 
core is been used. 

What do you guys think about make it mutli-thread for speed up?

Original issue reported on code.google.com by chen...@gmail.com on 14 Jun 2011 at 1:24

GoogleCodeExporter commented 8 years ago 
As discussed on the mailing list, the fact that the importer is single threaded 
is unlikely to have anything to do with your problem.

Original comment by tfmorris on 14 Jun 2011 at 5:04