RobinCK / typeorm-fixtures

:pill: Fixtures loader for typeorm 🇺🇦
https://robinck.github.io/typeorm-fixtures/
MIT License
566 stars 45 forks source link

Large datasets times scaling exponential #109

Closed spech66 closed 4 years ago

spech66 commented 4 years ago

I tried to create several datasets for testing our application. Starting with 100 base objects 4 sub objects + a few thousand additional entities. Takes ~1 min 1000 4 + x thousand. Takes ~4min 10000 * 4 + x thousand. Crashes after 4+ hours.

Debug output

Connection to database...
Database is connected
Loading fixtureConfigs
Resolving fixtureConfigs

Node Profiling of first 5minutes. image Looks like most time is spend in the resolver at resolveDeepDependencies(item) {

RobinCK commented 4 years ago

Welcome to PR