To get this data Anne before she was generating csv files manually from each publisher. However, there is an API she suggested we can use to harvest this data, it's called SUSHI.
We need to pass:
Client key (we will get it from Anne)
Publisher name
Example: (Anne will provide one soon)
Some information can be found here. However, is not full yet. We decided to move to analyze the next source after we finished the previous one (in this case after CDS)
Setup Airflow workflow:
[ ] Add tables migration
[ ] Write a DAG for data harvesting
DB
[ ] Connect Airflow workflow to DB tables
[ ] Connect Supserset BI to DB tables
Feedback regarding results
[ ] Ask Salome, Paulina, Lydia for feedback regarding the results we are getting from ILS. Adjust if needed
More information can be found here.
To get this data Anne before she was generating csv files manually from each publisher. However, there is an API she suggested we can use to harvest this data, it's called SUSHI. We need to pass:
Example: (Anne will provide one soon)
Some information can be found here. However, is not full yet. We decided to move to analyze the next source after we finished the previous one (in this case after CDS)
Setup Airflow workflow:
DB
Feedback regarding results
Deploy