search

UTSAVS26 / PyVerse

PyVerse is an open-source collection of diverse Python projects, tools, and scripts, ranging from beginner to advanced, across various domains like machine learning, web development, and automation.
https://sites.google.com/view/pyverse-python-universe/
MIT License
59 stars 157 forks source link

[Code Addition Request]: LinkedIn Job scraper- Job data extraction tool from the web using Scrapy #375 #682

Open Niraj1608 opened 1 day ago

Niraj1608 commented 1 day ago

Have you completed your first issue?

Guidelines

Latest Merged PR Link

N/A

Project Description

The LinkedIn Job Scraper is a Python-based web scraping tool that uses Scrapy, a powerful web crawling framework, to extract job listings from LinkedIn. The tool is designed to circumvent common anti-scraping mechanisms like IP blocking by integrating proxy rotation, which ensures that the scraper can maintain a steady scraping speed while avoiding detection or throttling.

Key Features:

Scrapes job listings (job title, company, location, posting date, and description). Uses proxies for IP rotation to avoid detection. Allows the user to filter job results by keywords, locations, and other criteria. Stores the scraped data in a structured format (e.g., CSV, JSON)

Full Name

Parmar Niraj Jagdishbhai

Participant Role

GSSOC

github-actions[bot] commented 1 day ago

🙌 Thank you for bringing this issue to our attention! We appreciate your input and will investigate it as soon as possible.

Feel free to join our community on Discord to discuss more!

Niraj1608 commented 1 day ago

@UTSAVS26 assign me