rawgraphs / rawgraphs-app

A web interface to create custom vector-based visualizations on top of RAWGraphs core
https://rawgraphs.io
Apache License 2.0
8.66k stars 1.84k forks source link

Scatterplot with 155 000 rows caused crashes #218

Closed mglantz closed 3 years ago

mglantz commented 3 years ago

I'm not sure what went wrong, as I couldn't see any error messages output from http.server. But, when creating a scatter plot with 4 columns of data and 155 000 rows, the web page gave out an 500 error message and stopped processing. No further clues in the stdout of http.server. When the data had more columns (20 columns with 155 000 rows) the page did not get to the stage where it says it starts to process the uploaded file. 6 columns with 155 000 rows seems to be max to get the file to get processed at all.

Strangly enough when I changed to Firefox, the graph was created (4 columns and 155 000 rows), even though it took approx. 1 hour on a 8 core, 32 GB ram computer.

I did notice that Chrome did multi threading and Firefox did not. Perhaps related?

uf0 commented 3 years ago

rawgraphs is client side app and charts are rendered in svg. with large dataset do expect different behaviors based on the your machine and the browser used.

try the new version released today.