Add Direct Lookup for Getty Vocabs

[sfolsom]

To get back RDF from Getty's APIs, it seems like we need to use their SPARQL API, but SPARQL may not be great for generic keyword searching.

Samvera code base has Getty lookups, maybe this is something we can turn on:

• https://github.com/samvera/questioning_authority/wiki/Connecting-to-Getty
• https://github.com/samvera/questioning_authority/tree/main/lib/qa/authorities/getty

[chrisrlc]

Current attempt at creating a linked data authority config for getty is deployed to: https://lookup-int.ld4l.org/

There is currently one getty_direct endpoint, with aat, tgn and ulan as required subauthorities to be specified in the url. For example:

• Retrieval by term id:
  • aat: https://lookup-int.ld4l.org/authorities/show/linked_data/getty_direct/aat/300264973
  • tgn: https://lookup-int.ld4l.org/authorities/show/linked_data/getty_direct/tgn/2188773
  • ulan: https://lookup-int.ld4l.org/authorities/show/linked_data/getty_direct/ulan/500304715
• Search:
  • aat: https://lookup-int.ld4l.org/authorities/search/linked_data/getty_direct/aat?q=amphora
  • tgn: https://lookup-int.ld4l.org/authorities/search/linked_data/getty_direct/tgn?q=Gouverneur
  • ulan: https://lookup-int.ld4l.org/authorities/search/linked_data/getty_direct/ulan?q=chicago%20library

To review all current testing scenarios and figure out which changes we're okay with vs which ones we need to try to handle better: https://lookup-int.ld4l.org/check_status?utf8=%E2%9C%93&authority=GETTY_DIRECT&compare_with=&validation_type=accuracy

• All test terms, queries, and expected positions were copied from the getty ld4 cached lookup scenarios, except I used the singular form of "serpentiforme" and "residuo tóxico".
• 3 test cases fail (expected term not found in results) because the full query isn't found in the prefLabel:
  • "gestabiliseerd": returns only "gestabiliseerd zand", not the expected nl-alt label form of "stabilizing"
  • "Boulder, CO": a search for just "Boulder" will retrieve the expected term
  • "Paris, France": interestingly, a search in getty vocab's UI doesn't return the expected term either, but a search for just "Paris" includes the expected term in results.
• An example SPARQL for search: query=amphora, subauth=aat
  • Extra context if you're interested: I'm using some hacks to try to preprocess the user query for search. Part of this is a workaround for ensuring that we can pull non-english/non-latin script results as expected, despite the fact that getty wants different query handling for different languages. We can try to keep tweaking this query, but if we get to a point where we're still not getting the results we need, we may have to see if we get better results by extending the alternative non-linked data parsing endpoint from the samvera qa gem: https://lookup-int.ld4l.org/authorities/search/getty/aat?q=amphora (note: we would still have to tweak the sparql query used in this endpoint, as you can see from the lack of results for "Paris, France": https://lookup-int.ld4l.org/authorities/search/getty/tgn?q=Paris,%20France).

Sorting is currently ascending by prefLabel and can be tweaked in the sparql query.

[sfolsom]

Looks good in Sinopia as-is. We can reopen if something comes up.