CredentialEngine / ai-course-crawler

Apache License 2.0
1 stars 0 forks source link

Weber University catalogues #49

Open rvilsack opened 2 months ago

rvilsack commented 2 months ago

I'm testing a new catalog vendor and have 2 failed extractions:

Weber State University: https://master.ai-course-crawler.development.c66.me/catalogues/31 *I tried 2 recipes with different URLs **AI Course Crawler failed to detect a valid configuration for this recipe.

Illinois Center College: https://master.ai-course-crawler.development.c66.me/catalogues/31/recipes/70 *AI Course Crawler failed to detect a valid configuration for this recipe.

Is there something with these URLs that make them not a good candidate for extraction?

rsaksida commented 2 months ago

For Weber, I managed to create a recipe and extract data using this URL:

https://catalog.weber.edu/content.php?catoid=23&navoid=8649

I understand they have multiple catalogues. The other one (WSU Online) will not work with our system unless we build specific support.

WSU Online is a similar problem to #51 but I think they're not actually using CourseDog. It's a different system, maybe something they built in-house.