search

Bunsly / JobSpy

Jobs scraper library for LinkedIn, Indeed, Glassdoor & ZipRecruiter
https://usejobspy.com
MIT License
780 stars 143 forks source link

ZipRecruiter - HTML variant #45

Closed cullenwatson closed 12 months ago

cullenwatson commented 1 year ago

There's a rare bug where they send you a different html page that isn't supported by the bot. Have not received the page enough due to probability to debug it properly

fred2026 commented 1 year ago

The job description get by process_job_javascript in ZipRecruiter is just the start of the full description in the get_description. So I'd like to use get_description within process_job_javascript.

cullenwatson commented 1 year ago

works for me, are you setting this value to None?

image

fred2026 commented 1 year ago

works for me, are you setting this value to None?

image

2023-09-09_06-04 Like this, the description is truncated.

cullenwatson commented 1 year ago

If it can't fetch the full description, it uses a truncated version. Try a few queries; they shouldn't all be shortened

fred2026 commented 12 months ago

Sorry for my late reply, I got the full description after switching to a better proxy. process_job_javascript works great. Thank you for your great work.