culturecreates / footlight-aggregator

A tool to inject entities from Artsdata to footlight
0 stars 0 forks source link

Load 2 websites from Console to CMS #119

Closed tammy-culture closed 3 months ago

tammy-culture commented 7 months ago

Load the following 2 websites from Footlight Console into Production CMS:

  1. https://www.culture3r.com/ (culture3r-com)

    • [x] Artsdata: automatic minting of events
    • [x] Aggregator: load into CMS
    • [x] Aggregator: set schedule for repeat loads
  2. https://www.complexeculturelfelixleclerc.com/ (complexeculturelfelixleclerc-com)

    • [x] Artsdata: automatic minting of events
    • [x] Aggregator: load into CMS
    • [x] Aggregator: set schedule for repeat loads
saumier commented 7 months ago

culture3r-com https://console.footlight.io/events?seedurl=culture3r-com

complexeculturelfelixleclerc-com https://console.footlight.io/events?seedurl=complexeculturelfelixleclerc-com

saumier commented 7 months ago

First step is to add "startDate" to the reconciliation properties. This is a pre-requisite for automatically minting. Second step is to code automatic minting of events for these 2 website. Third step is to load into CMS with Aggregator.

saumier commented 7 months ago

@sahalali Please read carefully my status Status Mar 2, 2024 in https://docs.google.com/document/d/16OmxVUiwQsv6JrL_PuloKIjfkSdiJb8fyCMVcpccf_Q/edit#heading=h.shuzy3ds9r6j

I think should be unblocked, and you can continue with the next steps.

tammy-culture commented 6 months ago

@sahalali I notice that Event Types for both 3R and Felix-Leclerc are missing in the Production CMS and I know that they are available in the Footlight Console.

Here is the event type vocabulary mapping for reference.

tammy-culture commented 6 months ago

@sahalali Also for many of the events the "Performing group/artist/event animator" is available in the Console as well. It would be great if this information could follow into the Production CMS.

Let me know if you need any screen shots.

Many thanks.

sahalali commented 6 months ago

@saumier

  1. The event types (additional type) are missing in the API response.

Here is the API used to fetch the list of events.

https://api.artsdata.ca/query?sparql=query_footlight_events&frame=event_footlight&format=json&source=http://kg.artsdata.ca/culture-creates/footlight/culture3r-com&limit=10&offset=0

saumier commented 6 months ago

@SuhailAliyar Good find. And thanks for the API link. It really makes it faster to look into the issue :-)

In the API response you can see the SPARQL, and it only returns keywords which we don't have for these 2 sites. I can add additionalType. Is there a JSON schema that you would like?

saumier commented 6 months ago

I propose the following

"additionalType": ["http://kg.artsdata.ca/resource/ComedyPerformance"]
sahalali commented 6 months ago

I've updated the "sparql": "https://github.com/culturecreates/artsdata-api/tree/main/app/services/sparqls/query_footlight_events.sparql",to return additionalType. I can then see the SPARQL is returning the events with additionalType. However, the API response still does not contain the additionalType. So I then tried updating the "frame": "https://github.com/culturecreates/artsdata-api/tree/main/app/services/frames/event_footlight.jsonld", however, it fails.

@saumier I will need your help to fix this.

saumier commented 6 months ago

@sahalali Hi. The changes you made were perfect. But those sparqls and frames were not deployed to the Artsdata server. So I ran git push production main and it looks good now.

sahalali commented 6 months ago

@tammy-culture The mapping file for culture-mauricie is missing some event types. Can you add them?

  1. http://kg.artsdata.ca/resource/Conference
  2. http://kg.artsdata.ca/resource/ChildrensEvent

Mapping file: https://docs.google.com/spreadsheets/d/1t7mQMtuslOZs61MkiA7GzRH84aYuXJRtmUENyQqBlf0/edit#gid=560375554

tammy-culture commented 6 months ago

@sahalali I checked in the mapping file and I see that everything is complete.

  1. Conference is already mapped in the file.
  2. Culture Mauricie does not have ChildrensEvent so any ChildrensEvent will be mapped to Indéterminé in Culture Maurice.

FYI, Indéterminé. menas unknown in French.

I hope this helps.

tammy-culture commented 6 months ago

@sahalali I understand that Culture3R and Felix-Leclerc are aggregated on the following schedule:

Can we aggregate these sources twice a week, Monday and Thursday?

That would be great.

Thanks.

sahalali commented 6 months ago

Scheduled the 3R and Felix aggregation every Monday and Thursday.

tammy-culture commented 6 months ago

@sahalali The client changed their mind and requested that Culture3R and Felix-Leclerc be aggregated on a daily basis.

dev-aravind commented 6 months ago

@tammy-culture I've updated both the workflows to be run daily.