cern-sis / Library-Notifications-Service

0 stars 1 forks source link

BI-OA: Open Access KPI #7

Open ErnestaP opened 2 months ago

ErnestaP commented 2 months ago

Collect all needed queries from Anne for collecting needed data, google doc:

  1. After collecting the feedback from Anne, we found out that initial query was not fully correct, however, Anne is not sure how the wanted query should look like. S̶h̶e̶ ̶c̶o̶n̶t̶a̶c̶t̶e̶d̶ ̶C̶D̶S̶.̶ ̶I̶f̶ ̶t̶h̶e̶y̶ ̶a̶r̶e̶n̶'̶t̶ ̶b̶e̶ ̶a̶b̶l̶e̶ ̶t̶o̶ ̶p̶r̶o̶v̶i̶d̶e̶ ̶t̶h̶e̶ ̶q̶u̶e̶r̶y̶ ̶w̶e̶ ̶n̶e̶e̶d̶,̶ ̶w̶i̶l̶l̶ ̶n̶e̶e̶d̶ ̶t̶o̶ ̶w̶r̶i̶t̶e̶ ̶t̶h̶e̶ ̶p̶a̶r̶s̶e̶r̶ ̶w̶h̶i̶c̶h̶ ̶w̶i̶l̶l̶ ̶h̶e̶l̶p̶ ̶t̶o̶ ̶g̶e̶t̶ ̶d̶a̶t̶a̶ ̶w̶e̶ ̶n̶e̶e̶d̶. We need to write a parser. In this case: green_open_access = these_articles - overlapping gold_open_access_article

Setup Airflow workflow:


DB


Feedback regarding results


Colors

Anne wants to have specific colors for the pie chart pieces:

closed_access -> 🔵 green_open_access -> 🟤 bronze_open_access -> 🟢 gold_open_access -> 🟡

However, we have limitations on the superset side. Most likely we will need to add config on Kubernetes side: chat


Deploy

ErnestaP commented 1 week ago

In the end, we did not get data from CDS as we wanted, by using queries. We came up with the idea to parse a bigger set and extract green and golden access from it. PR: https://github.com/cern-sis/bi-dags/pull/28 Ticket: https://cern.service-now.com/service-portal?id=ticket&table=u_request_fulfillment&n=RQF2650918