search

hbz / lobid-organisations

Transformation, web frontend, and API for lobid-organisations
http://lobid.org/organisations
Eclipse Public License 2.0
13 stars 3 forks source link

Identify the several libraries and ZDB-packages that are more in test #479

Closed TobiasNx closed 1 year ago

TobiasNx commented 1 year ago

I assume that they are missing libraries from DBS:

http://test.lobid.org/organisations/DBS-SJ425

TobiasNx commented 1 year ago

On Prod: 21239 On Test: 21255

Multiple libraries are deleted on test, therfore there are more than 16

TobiasNx commented 1 year ago

Gemeindebücherei Lauben: http://lobid.org/organisations/DE%5F4050#!: http://test.lobid.org/organisations/search?q=GX708&location= Dubletter Eintrag in Prod und halbfalscher Eintrag in Test http://lobid.org/organisations/DE_4050#! http://lobid.org/organisations/DE-MUS-15052#! - Existiert nicht in Test, aber auch nicht mehr im Sigel-Verzeichnis: DE-MUS-15052 http://lobid.org/organisations/DE-Test4#! - Existiert nicht in Test, da Test http://lobid.org/organisations/ISILDE-MUS-161828#! Existiert nicht in Test, aber auch nicht mehr im Sigel-Verzeichnis: DE-MUS-15052 http://lobid.org/organisations/ZDB-2-CMPH#! - Existiert nicht in Test, da überschriebene ISIL http://lobid.org/organisations/ZDB-2-RMBE#! - Existiert nicht in Test, da überschriebene ISIL http://lobid.org/organisations/ZDB-2-RMED#! - Existiert nicht in Test, da überschriebene ISIL http://lobid.org/organisations/ZDB-2-RMEE#! - Existiert nicht in Test, da überschriebene ISIL http://lobid.org/organisations/ZDB-2-RMH#! - Existiert nicht in Test, da überschriebene ISIL http://lobid.org/organisations/ZDB-Test2#! - Existiert nicht in Test, da Test http://lobid.org/organisations/ZDB-Test2a#! - Existiert nicht in Test, da Test http://lobid.org/organisations/ZDB-Test3#! - Existiert nicht in Test, da Test

acka47 commented 1 year ago

Could it be that libraries that have been removed from DBS have not been deleted in lobid-organisations?

TobiasNx commented 1 year ago

I don't know about the update routine? Do we still get new DBS-Data (dbs.csv) and rebuild lobid-organisations: https://github.com/hbz/lobid-organisations/issues/94

I don't know how old the dbs.csv is that I have. The "problem" seems to be only with test. So either the file is old OR the old morph skipped these records because of some mapping errors.

acka47 commented 1 year ago

I don't know about the update routine? Do we still get new DBS-Data (dbs.csv) and rebuild lobid-organisations:

In 2018 we implemented regular DBS updates, see #94. (Edit: Ah, sorry, you already referenced that issue, @TobiasNx . I should read more carefully...)

TobiasNx commented 1 year ago

Need to have another look. It seems that the total hits are still deviating.

TobiasNx commented 1 year ago

The difference consists mainly of DBS records that were not indexed in prod. Related to #475 Some updates of deleted records in Sigil that are not fetched via OAI-PMH. Related to #487 Deleted test files and errors from prod, that are fixed and not provided anymore in test.