UUDigitalHumanitieslab / EDPOP

A virtual research environment (VRE) that lets you collect, align and annotate bibliographical and biographical records from several online catalogs.
BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

Catalogue fetching app #148

Closed tijmenbaarda closed 6 months ago

tijmenbaarda commented 8 months ago

Add a catalog app that is responsible for fetching from catalogues and transforming these into graphs. The following API URLs are now implemented:

Example:

curl "http://localhost:8000/catalogs/search/?catalog=https://edpop.hum.uu.nl/readers/hpb&query=gruninger&start=0"

The code seems to work with all catalogues implemented in the explorer, but it currently works very inefficiently with catalogues that get all results at once (such as STCN), because we cannot reuse Reader instances between requests. We will have discuss how we want to solve this problem.

The returned graphs are not completely according to our collection ontology, because I did not completely understand how it was supposed to work, so I suggest we look at it together.

I changed the minimum Python version to 3.9, because our server will have RHEL 9 with Python 3.9.