marcelotto / spread2rdf

DSL-based converter for spreadsheets to RDF
http://rubygems.org/gems/spread2rdf
MIT License
4 stars 2 forks source link

Performance issues #10

Open GitHubber1 opened 9 years ago

GitHubber1 commented 9 years ago

Hi Marcel, in our use case I face serious performance issues. Converting a spread sheet with 2,5k rows takes more than 2:40h whereas converting a spread sheet with 04,k rows takes less than 3 minutes. I've run the transformation on different machines, Ruby versions (1.9.3 / 2.0.0) and operating systems (Windows 7 / Ubuntu Linux) with different run times but same relative increasing of elapsed time. Is there anything I can do to speed up the transformation procedure? Thank you, Andy

GitHubber1 commented 9 years ago

I even tried different GC configurations[1][2] but runtime only changed slightly.

[1] http://snaprails.tumblr.com/post/241746095/rubys-gc-configuration [2] http://stackoverflow.com/questions/16299419/garbage-collector-tuning-in-ruby-2-0