search

rufuspollock-okfn / reconcile-csv

A simple OpenRefine reconciliation service that runs on top of a CSV file
BSD 2-Clause "Simplified" License
117 stars 28 forks source link

Get Java heap space error trying to use csv with around 300000 rows #7

Closed noelmas closed 9 years ago

noelmas commented 10 years ago

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2882) at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100) at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572) at java.lang.StringBuilder.append(StringBuilder.java:203) at clojure.core$slurp.doInvoke(core.clj:6283) at clojure.lang.RestFn.invoke(RestFn.java:410) at reconcile_csv.core$_main$fn__78.invoke(core.clj:225) at clojure.lang.Atom.swap(Atom.java:51) at clojure.core$swapBANG.invoke(core.clj:2161) at reconcile_csv.core$_main.invoke(core.clj:225) at clojure.lang.AFn.applyToHelper(AFn.java:167) at clojure.lang.AFn.applyTo(AFn.java:151) at reconcile_csv.core.main(Unknown Source)

noelmas commented 10 years ago

Apologies set -Xmx2g and all sorted. Perhaps update docs as noobs like me might run into this too...

mihi-tr commented 10 years ago

@noelmas thanks for posting this - have not experienced this. Will change the documentation accordingly