srophe / syriaca-data

Repository for Syriaca.org TEI data, used by srophe-eXist-app.
4 stars 16 forks source link

Bibl records missing from CBSS #1186

Closed wlpotter closed 3 months ago

wlpotter commented 3 months ago

@wsalesky I'm opening this issue for tracking down why we only ended up with 1,008 records from CBSS after the zotero to tei transform. There should be 27,545 items.

We do have all the JSON data that you downloaded via API -- I have a version that you sent via dropbox or box that has everything.

I think the TEI files were added with this commit, and it seems there are only the 1,008 records there. I think maybe we just need to re-run the transform on the JSON and make sure all the records get added?

Maybe on Tuesday we can talk through how to run the transform? (I'm assuming it can run on a local eXist instance?)

wsalesky commented 3 months ago

Yes, lets figure it out on Tuesday.

wsalesky commented 3 months ago

@wlpotter Can you send me a zotero id for a note (I lost it after our meeting yesterday!) thanks

wsalesky commented 3 months ago

Also, here is a version without the parentItem filter: https://github.com/srophe/syriaca-data/tree/cbssDataDump6-19-24

It has 27800 records

wlpotter commented 3 months ago

Here is an id for a note: DPTBW6NN (cf. https://api.zotero.org/groups/4861694/items/DPTBW6NN).

Also I'm only seeing 6,669 TEI records on https://github.com/srophe/syriaca-data/tree/cbssDataDump6-19-24 ?

wsalesky commented 3 months ago

@wlpotter I will re-push it today, must not all have copied over to the right directory.

wsalesky commented 3 months ago

See: https://github.com/srophe/syriaca-data/pull/1190

wlpotter commented 3 months ago

@wsalesky This looks like all of them! But we want to pull into development right?

wsalesky commented 3 months ago

@wlpotter Yes, sorry about that!