realCalvin / CmpEndium

https://cmpendium.herokuapp.com/
2 stars 0 forks source link

Querying Jobs from MongoDB #29

Closed realCalvin closed 3 years ago

realCalvin commented 3 years ago

Backend part of issue #28 . Filter all jobs with the location first. Then filter all jobs that contain the keyword (e.g. in the title and the description.

Note: our approach to get jobs is going to be different. We will run weekly CRON job on TheMuse API to get and store jobs to our database. When a user queries a job, (e.g. software engineer san jose), we will webscrape the first few pages from Indeed and SimplyHired, and then query some jobs from our database. Hybrid approach since we cannot mass-webscrape these job websites without captcha