First pass at crawling one Spektrix customer

culturecreates / artsdata-planet-spektrix

0 stars 0 forks source link

First pass at crawling one Spektrix customer #1

Closed saumier closed 2 months ago

saumier commented 3 months ago

Run a first test using one of their Canadian clients (8 hrs) Decide how to represent the data in Artsdata: as an Event, as an Offer or both? parts: mapping the data , OntoRefine configuration to convert the json data to rdf, creating a repository and workflow, testing (16 hr)

dev-aravind commented 3 months ago

@troughc and me had a discussion today regarding this issue, @saumier the workflow is up right now, but the repository needs access to the organization secret 'PUBLISHER_URI_GREGORY' to run.

saumier commented 3 months ago

@dev-aravind I assigned the organization secret 'PUBLISHER_URI_GREGORY' to be visible to all Culture Creates public repos. It should now work for Spektrix and future ones we create within Culture Creates org.

I transfered this issue to the spektrix repo so we can open new issues as needed instead of creating new issues buried deep in this issue.

Let me know if you have any specific questions about the mapping etc.

After you load the first pass into Artsdata, please start on the next issue https://github.com/culturecreates/artsdata-planet-spektrix/issues/2 which is to create a report on the mapping and issues you came across so I can review it. Thx.

dev-aravind commented 2 months ago

@saumier The data is up in artsdata right now, but the UI seems a bit off. Can you check this and let me know?

saumier commented 2 months ago

@dev-aravind Great progress.

To do to complete first pass:

[x] For the UI issue, please strip out all the<div xxx> </div> in the descriptions or else switch to the description instead of htmlDescription.
[x] The events from kaymeekcentre are appearing in terrabrucemajestic and should be removed from terrabrucemajestic.
[x] Add the ability to run Ontorefine locally using my run_ontorefine.sh script (add 2 files like this: docker-compose.yml and run_ontorefine.sh ) and add a sample dump of one of the API response to the dump repo. This allows any developer to edit the ontoRefine configuration.

Then we can consider this first pass completed.

dev-aravind commented 2 months ago

@saumier All these issues are resolved as of now, please review this and let me know if you need any other changes.

saumier commented 2 months ago

Great