Job
Our detailed course info from SIS takes a long time to scrape, so it would be good to use RPI's Catalog API to speed this process up.
Describe a possible solution
We have a file that does this, we just need to adapt that into our new scraping method, and we need to only take the data we know is good. The Catalog is generally inconsistent in terms of quality but the descriptions it provides seem good. There might be other data we can adapt for other things, so a good solution might be to generate a csv of all of the data from the Catalog API and figure out what we want later.
Job Our detailed course info from SIS takes a long time to scrape, so it would be good to use RPI's Catalog API to speed this process up.
Describe a possible solution We have a file that does this, we just need to adapt that into our new scraping method, and we need to only take the data we know is good. The Catalog is generally inconsistent in terms of quality but the descriptions it provides seem good. There might be other data we can adapt for other things, so a good solution might be to generate a csv of all of the data from the Catalog API and figure out what we want later.
Context