Aam-Digital / ndb-core

Easy-to-use case management web app for NGOs anywhere in the world.
http://www.aam-digital.com
GNU General Public License v3.0
55 stars 18 forks source link

Import: optimize performance of entity reference lookup/mapping #2430

Open sleidig opened 3 months ago

sleidig commented 3 months ago

During import the system can map an id value to an existing entity in the database to import such a reference field. However, for large databases (and large import files) this takes a very long time to process, as the EntityDatatype's importMapping function is one by one loading the whole array of entities for that type for every row of the import.