nicobrenner / commandjobs

Command Jobs uses AI to help software engineers find the best jobs
Apache License 2.0
146 stars 12 forks source link

Add additional sources (comment here to suggest another source) #23

Open nicobrenner opened 3 months ago

nicobrenner commented 3 months ago

========

Idea: create a p2p network of jobs - anyone in the network can post a job, the rest of the network gets the job listing and processes/matches it locally

This would allow that anyone that runs a scraper, can add listings to the network. How do we prevent it from getting flooded by a malicious actor (someone who wants to spam the network)? How do we curate the listings?

One way would be for the local nodes are responsible for filtering the things they receive. There could be filtering nodes as well, that individual nodes could subscribe to

What would be the incentive to post a job? Well all companies want to post job, so they would do it for free probably

What would be the incentive to filter the jobs? For the individual is easy, they don't want to get spammed with jobs

How about for the filtering nodes that want to act as a sort of aggregator and curator? Why would they do it?

That could also be LLM-based, but it would have a cost. Unless for example, the individuals contribute back their own filtered jobs

Maybe the nodes could signal to the network that their node made a match with the post, thus validating the usefulness of the post

Users could mark posts as spam, that would filter out that job, it would add the job to a list of spam that could help an LLM-filter, and it would also mark the poster node as spamming (black list it)

nicobrenner commented 3 months ago

As suggested here: https://news.ycombinator.com/item?id=39624542 and here: https://news.ycombinator.com/item?id=39692590

Add support for scraping workdays' career portals, eg (from: https://news.ycombinator.com/item?id=39692590) Here's some with tech jobs listed: https://workday.wd5.myworkdayjobs.com/Workday https://shipt.wd1.myworkdayjobs.com/en-US/Shipt_External It doesn't seem like there's a global listing across myworkdayjobs.com sites - each company using it has its own sub-domain. Which sort of makes sense - Workday is an internal HR/employee portal tool licensed to companies.

mbafford commented 3 months ago

Another is greenhouse.io:

https://boards.greenhouse.io/remotecom https://boards.greenhouse.io/notion

Same as workday, there doesn't seem to be a public master list - each company lists their own jobs on their own sub-folder.

nicobrenner commented 2 weeks ago

@christosgousis and @GiorgosPapageorgiou contributed a new source, workatastartup.com/jobs in this excellent PR: https://github.com/nicobrenner/commandjobs/pull/66

It's a good example for adding new sources. I'm also realizing a whole "sources" section might be necessary in the future