the-qa-company / WikibaseSync

Library to copy entities from one Wikibase to another and to keep them in sync
MIT License
30 stars 9 forks source link

performance problems #16

Open D063520 opened 2 years ago

D063520 commented 2 years ago

The newest version of Wikibase sync privilages local changes: 1) local additions will not be deleted 2) local deletion will not be added to achieve this the revision history must be analyzed which can be time consuming. This is the case currently when: 1) many statements are added or removed 2) the entity has many statements 3) the revision histroy is long One needs to optimize the code. One option is to not scan the whole revision history but do this in a tree search manner