zgrossbart / jdd

A semantic JSON compare tool
http://www.jsondiff.com
Apache License 2.0
1.03k stars 180 forks source link

Improve responsiveness with big JSON files #12

Closed bjesuiter closed 6 years ago

bjesuiter commented 6 years ago

I have fairly big Json Files with a lot of sensor measurement data , that i need to compare.

Unfortunately, the comparison blocks the main thread for so long, that chrome thinks, the website has crashed.

2 Solutions:

bjesuiter commented 6 years ago

With a WebWorker, you could even give some progress response. At least you can show, that the site is working, at best you could show a progress bar! 🥇

zgrossbart commented 6 years ago

Thank you for the suggestion. I have looked into web workers, but I don't think they would offer much improvement on the overall performance and they would complicate the application.

JSONDiff is a browser based tool and all of the compare runs in the browser. The advantages are a very fast load time and a super fast compare for smaller documents. The disadvantage is that there's a size limit to the types of compare we can do.

The best solution for this is probably to create a NodeJS based version of this tool. That would make it possible to take advantage of a faster runtime environment and better threading support.

I don't have time for that project right now, but you're welcome to take a look.

Thanks, Zack