search

hbz / lobid

Linking Open Bibliographic Data
https://lobid.org/
Eclipse Public License 2.0
15 stars 4 forks source link

Missing resources #301

Closed fsteeg closed 8 years ago

fsteeg commented 8 years ago

Reported by @aquast.

These resources, cataloged on 20160411, are missing:

http://lobid.org/resource?id=HT018937520 http://lobid.org/resource?id=HT018937543 http://lobid.org/resource?id=HT018937743 http://lobid.org/resource?id=HT018938105

Also missing in data 2.0:

http://lobid.org/resources/HT018937520 http://lobid.org/resources/HT018937543 http://lobid.org/resources/HT018937743 http://lobid.org/resources/HT018938105

But present in mabxml (so issue is not in the export files):

http://lobid.org/hbz01/HT018937520 http://lobid.org/hbz01/HT018937543 http://lobid.org/hbz01/HT018937743 http://lobid.org/hbz01/HT018938105

fsteeg commented 8 years ago

Indexed updates from 20160411 into staging:

hduser@weywot1:/home/hduser/git/lodmill/lodmill-rd/doc/scripts/hbz01$ bash -x startHbz01ToLobidResources.sh master /files/open_data/open/DE-605/mabxml/DE-605-aleph-update-marcxchange-20160411-20160412.tar.gz lobid-resources-staging NOALIAS quaoar2.hbz-nrw.de quaoar exact

Resources now available in staging:

http://test.lobid.org/resource?id=HT018937520 http://test.lobid.org/resource?id=HT018937543 http://test.lobid.org/resource?id=HT018937743 http://test.lobid.org/resource?id=HT018938105

Now indexing into production.

fsteeg commented 8 years ago

Fixed in production:

http://lobid.org/resource?id=HT018937520 http://lobid.org/resource?id=HT018937543 http://lobid.org/resource?id=HT018937743 http://lobid.org/resource?id=HT018938105

Was caused by a single missing entry for the updates on 20160411 in hduser@weywot1:/home/hduser/git/lodmill/lodmill-rd/doc/scripts/hbz01/toBeUpdateFilesXmlClobs_afterBasedump.txt, probably caused by the recent changes in the crontab setup, see https://github.com/hbz/mabxml-elasticsearch/issues/20#issuecomment-208767747.

Remaining task here: index 20160411 updates in data 2.0.

fsteeg commented 8 years ago

Indexed missing updates into data 2.0:

hduser@gaia:/opt/hadoop/git/lobid-resources bash -x startHbz01ToLobidResources.sh master /files/open_data/open/DE-605/mabxml/DE-605-aleph-update-marcxchange-20160411-20160412.tar.gz resources NOALIAS gaia.hbz-nrw.de lobid-gaia exact

Resources now available in data 2.0:

http://lobid.org/resources/HT018937520 http://lobid.org/resources/HT018937543 http://lobid.org/resources/HT018937743 http://lobid.org/resources/HT018938105