All of our scraping configurations are defined in the data/companies folder in JSON files. Each company has its own scraping config (which we have defined here). Some companies have a scrape: null key-value mapping; this means that we have not defined a scraping config for that company's job board yet, but are planning to.
[x] Look at a specific company configuration, go to the link property, open Chrome dev tools, and use the Chrome element inspector debugger to look at the scraping properties and what is being scraped (i.e. look at the xpath property and match it with the web element/text /header that you see on the company job board in your web browser)
Context
All of our scraping configurations are defined in the
data/companies
folder in JSON files. Each company has its own scraping config (which we have defined here). Some companies have ascrape: null
key-value mapping; this means that we have not defined a scraping config for that company's job board yet, but are planning to.TODO
link
property, open Chrome dev tools, and use the Chrome element inspector debugger to look at the scraping properties and what is being scraped (i.e. look at thexpath
property and match it with the web element/text /header that you see on the company job board in your web browser)Notes