Closed mindaugasdirg closed 1 year ago
is this still WIP as marked in the title? If so can you mark it as a draft?
@MichaelBelousov, sorry forgot to remove WIP from the title. PR is ready for review.
I've also updated pipeline since tests were facing SegFault issue mentioned here: https://github.com/iTwin/itwinjs-core/issues/5663#issuecomment-1600764489
thinking about this some more, instead of keeping the pending references in memory and only updating them, can we just keep the id of the incomplete element, and after all have been inserted, re-transform all incomplete elements from scratch? So same as what we do now, but rather than update elements as soon as we find their references, wait until the end when everything is inserted, and batch update them.
If element is not exported all pending references are left in memory until transformation completes. This causes memory issues when a lot of elements are not exported. To reduce memory usage transformer can resolve pending references as soon as it knows that element won't be exported.