ArshKA / LinkedIn-Job-Scraper

LinkedIn scraper to retrieve and store a live stream of job postings
66 stars 20 forks source link

Support for Multiple Job Posting Websites #7

Open Aska0526 opened 4 months ago

Aska0526 commented 4 months ago

Hi,

First of all truly amazing work, thanks for sharing!

Was wondering if you plan to support for multiple job listings website (e.g. indeed, glassdoor)? I am doing a company name matching research and would be very intrested in the potential of creating a real dataset using natural name variations in different websites, which can be mapped using job descriptions

Thx.

AndhikaWB commented 3 months ago

From my perspective it would be too broad to support multiple job sites, since the current scraper uses Voyager API (which is exclusive to LinkedIn).

It would be easier to make another scraper for specific website (separate repo), then compare the result. There are some scrapers for Indeed already, modifying it for your needs shouldn't be too hard.

Though I'm not ArshKA and he is the one to decide.