tBaxter / DSCovery

Tool to find civic tech jobs with Digital Services Coalition firms.
7 stars 1 forks source link

Blue Tiger job posts don't show up #7

Open khandelwal opened 1 day ago

khandelwal commented 1 day ago

We have two new jobs listed here:

https://www.bluetiger.digital/careers

That don't show up in the DSCovery listing.

tBaxter commented 1 day ago

Thanks! You all are using workable for your ATS?

tBaxter commented 9 hours ago

OK, I've made a go at importing workable a few times now and have failed. I'm hoping maybe you have some ideas.

Everyone using workable (Blue Tiger, Friends from the City, Pixel Creative, that I know of) has a page like https://apply.workable.com/your-key where "your-key" is unique to the org. That's good. Unfortunately, that page is hydrated via react, so BeautifulSoup fails to see the elements.

And I can't find the data source it's hydrated from, which is what I do for other client-side-rendered systems.

The other workable folks don't have it, but you have the link posted above. I can get the elements from that, but they don't come over clean. The HTML is kinda wonky.

I could scape linkedin, but I don't love that idea and LI doesn't love it either.

I could drag out selenium, but that seems heavyweight.

Any ideas?