woutslabbinck / SolidEventSourcing

A pipeline to transform location data (gpx file format) to RDF data and publish them as an Event Source on Solid
MIT License
2 stars 2 forks source link

Cannot process more than a specific amount of resources. #6

Open argahsuknesib opened 1 year ago

argahsuknesib commented 1 year ago

I have data files with more than 100k observations. Using the library, when I specify more than 2000 resources; the program along with the file based solid server crashes as the naive algorithm tries to make all the resources in one container and then rebalances it. Generating files for multiple resources crashes.

image