Bunsly / JobSpy

Jobs scraper library for LinkedIn, Indeed, Glassdoor & ZipRecruiter
https://usejobspy.com
MIT License
561 stars 109 forks source link

Get full indeed description #70

Closed vinceyyy closed 7 months ago

vinceyyy commented 7 months ago

Hi, I really appreciate you for creating this library. It helped me a lot.

One issue I encountered: it never returns the full job description from Indeed. I looked into it and found that the job data url (something like https://www.indeed.com/viewjob?jk=c59d048ac135ae9b&spa=1) returns JSON directly instead of HTML content, therefore bs4 does not handle it and it always falls back to the truncated description.

This PR is a simple patch that parses the JSON instead of using bs4.