Scrape data off job postings

[Victor-Buendia]

What

• Scrape data off a job posting.

Input are URLs:

https://boards.greenhouse.io/placerlabs/jobs/5889594003
https://boards.greenhouse.io/correlationone/jobs/5067265004
https://boards.greenhouse.io/nimblegravity/jobs/4365784005
https://boards.greenhouse.io/securityscorecard/jobs/2201043
https://boards.greenhouse.io/moovx/jobs/4366290005;
https://boards.greenhouse.io/okta/jobs/5849882
https://boards.greenhouse.io/astropay/jobs/4147625007
https://boards.greenhouse.io/integraladscience/jobs/5328370
https://boards.greenhouse.io/yalochatinc/jobs/5773977003
https://boards.greenhouse.io/bitcoincom/jobs/4388949005
https://boards.greenhouse.io/launchpadtechnologiesinc/jobs/4336338006
https://boards.greenhouse.io/truelogic/jobs/7309055002
https://boards.greenhouse.io/truelogic/jobs/7307936002
https://boards.greenhouse.io/truelogic/jobs/7274188002
https://boards.greenhouse.io/truelogic/jobs/7297301002
https://boards.greenhouse.io/moovx/jobs/4034377005;

Using:

• Regex, LLM api calls, or any other method.

Why

• We need information out of active job postings

DoD

• List of dicts containing information regarding a particular job posting, given its url.

[Victor-Buendia]

job_postings

{'url': 'https://boards.greenhouse.io/launchpadtechnologiesinc/jobs/4336338006',
 'category': 'job_posting',
 'match' : 'direct_match',
 'target_name': 'greenhouse',
 'company_name': 'launchpadtechnologiesinc',
 'job_id': '4336338006',
 'scraped_at'
 'processed_at': 
 'status ',

 'llm_generated_summary',
 'raw_html_content',
 'country',
 'location',
 'company_location',
 }

lista jobs insere no banco

query no banco tipo "select * where processed_at >= last_checkpoint" extrai informações dos jobs insere updates no banco