Suggestion : Add a scrapper for websites using workday (workday.com)

[Erim32]

Idea, create a scraper or an extendable scrapper interface to scrap websites using workday solution for job posting.

[cullenwatson]

I have it created but we would need all the workday links. Would you just pass all the workday links you want scraped to the bot or how are you envisioning this?

[Erim32]

Great, no i didn't have a list of workday links, but base/root url of workday website could be pass as itemps in the list site_name argument, the mapper need to be updated and if site_name didn't match with existing others mapper, could be workday website. To validate this before run the scrap process, we can imagine a boolean static funciton in WorkdayScrapper to check if the website (site_name) is a workday_website or not ( just check if "window.workday" value exist in the source de of the destination page), after that we will sure if thats a workday website or not before scraping process with the good scrapper instance.

@cullenwatson : What do you think of this approach ?

[Erim32]

Or maybe can you share your workday.com scrapper code in a new branch ?

[cullenwatson]

yea, not a bad idea. just wondering if there's much demand. will leave it open to see

[Erim32]

Yes, probably depends on whether users want to spy on job boards by domain or by company. Especially if you've already created it, it would add extra functionality and new use cases to JobSpy.

To simplify the integration, you could potentially create a branch with the code you've already created and I'll look at how to modify it to make it flexible, then propose a PR.

[cullenwatson]

closing as I prefer this repo to be major job boards. there's like 50 ATS if you wanted to get serious with it