search

danibram / mocker-data-generator

A simplified way to generate masive mock data based on a schema, you can use the awesome fake/random data generators like (FakerJs, ChanceJs, CasualJs and RandExpJs)
https://danibram.github.io/mocker-data-generator/
MIT License
426 stars 45 forks source link

build doesn't finish #1

Closed peerbolte closed 8 years ago

peerbolte commented 8 years ago

First of all, thanks much for building this data generator. I'm using it to populate my mongodb to stress test aggregates on large amount of documents.

When I generate large amount of objects, the application doesn't finish running. When i generate smaller chunks and run the application multiple times, all goes well. Is there a possible issue with larger object arrays? Maybe something with node memory limits / node array memory limit?

Thanks much

peerbolte commented 8 years ago

Ok the runtime increased exponentially. 1000 objects had a runtime of 47 seconds. 10000 objects had a runtime of 1026 seconds.

danibram commented 8 years ago

Hi!Maybe in the future i will add a progress bar, because right now sometimes you dont know if the process are doing or not. You really generate a big amopunt of data, in the past, posts like this helps me to do big migrations in mongo. Im happy that you resolve your issue.

danibram commented 8 years ago

I also release the 1.0.3 version, and i review the code and change the for loop of the iterator by a map, this should give more speed.