Since we've recently added a tags field that contains comma-separated tags (or job "keywords") to our Job database table, we should actually analyze the description text using Natural Language Processing (NLP) to find keywords of relevant interest. These tags will be displayed on the frontend and will be searchable.
TODO
[ ] Analyze the job description text using NLP and frequency analysis to find relevant keywords relating to the job. This is done as the scraper is running/waiting for a crawl delay (it shouldn't take too long- the crawl delay likely takes more time)
[ ] Add comma-separated tags to the tags field in the Job database (e.g. c++,internship,software development)
Context
Since we've recently added a
tagsfield that contains comma-separated tags (or job "keywords") to ourJobdatabase table, we should actually analyze the description text using Natural Language Processing (NLP) to find keywords of relevant interest. These tags will be displayed on the frontend and will be searchable.TODO
tagsfield in theJobdatabase (e.g.c++,internship,software development)Notes