Bunsly / JobSpy

Jobs scraper library for LinkedIn, Indeed, Glassdoor & ZipRecruiter
https://usejobspy.com
MIT License
555 stars 109 forks source link

Please help with scraping linkedin job_url_direct #142

Closed amanag13 closed 2 months ago

cullenwatson commented 2 months ago
pip install -U python-jobspy
import csv
from jobspy import scrape_jobs

jobs = scrape_jobs(
    site_name="linkedin",
    search_term="software engineer",
    location="Bangalore",
    results_wanted=20,
    linkedin_fetch_description=True
)
print(f"Found {len(jobs)} jobs")
print(jobs.head())
jobs.to_csv("jobs.csv", quoting=csv.QUOTE_NONNUMERIC, escapechar="\\", index=False) # to_xlsx
amanag13 commented 2 months ago

"job_url_direct" is returning null for linkedin

cullenwatson commented 2 months ago

can you share your code? and what version are you using?

pip show python-jobspy
amanag13 commented 2 months ago

Version: 1.1.51

jobs = scrape_jobs( site_name=["linkedin"], search_term="Microsoft", location="India", results_wanted=100, linkedin_fetch_description=True, description_format="html", job_url_direct=True, hours_old=24, # (only Linkedin/Indeed is hour specific, others round up to days old) )

cullenwatson commented 2 months ago

current version is 1.1.52

amanag13 commented 2 months ago

Thanks for prompt response. Appreciate it!