David/use dependency injection

recalcitrantsupplant commented 11 months ago

See last commit only, others are from other open PR.

Abstracts queries to use Repos/FastAPI's Dependency injection. Three kinds have initially been implemented; remote SPARQL endpoints using httpx, local Pyoxigraph stores, and local RDFLib Oxrdflib stores. The Oxrdflib store has not been extensively tested.
Switches to using pyoxigraph for testing. Oxrdflib was attempted however adds (not incorrectly) xsd:string datatypes to literals, where Fuseki/Pyoxigraph do not, which means all of the reference responses would need to be updated.
Pyoxigraph appears to have issues with Count queries - a few queries in the VocPrez implementation have been xfailed due to this
- in future I would recommend we run an in memory Fuseki instance for tests + automating this in the GH action, as it is most likely to adhere to SPARQL 1.1
Adds caching for prez:link and prez:identifier to assist with immediate performance problems where responses contain a large number of URIs.
@edmondchuc there's an issue w/ the SPARQL query in get_concept_scheme_top_concepts_query - it appears to be creating top concept triples where they don't exist if run on the second test case in test_concept_scheme_top_concepts. This is also a test that is failing (additionally) due to an incorrect count when Pyoxigraph runs the query, so it is xfailed at present.

edmondchuc commented 11 months ago

I think it'll be easier to review if we just target the merge into https://github.com/RDFLib/prez/pull/164 instead of main.

Can we change the merge target into https://github.com/RDFLib/prez/pull/164 instead of main? This already includes the content of the other PR, if we target that PR, we will get a clean diff here and be able to review it as normal.

recalcitrantsupplant commented 11 months ago

@edmondchuc I've changed the target

edmondchuc commented 11 months ago

Perfect thanks, I'll take a look at it now!

recalcitrantsupplant commented 11 months ago

@edmondchuc Thanks for the layout feedback - I've known it needs a refactor for some time but haven't looked at any reference implementations so that will be helpful, would be good to add to the wiki/documentation if it's online now

edmondchuc commented 11 months ago

@recalcitrantsupplant - great! Good idea with adding the design patterns into the wiki.

RDFLib / prez

David/use dependency injection #168