slurpcode / slurp

One repo to rule them all !!?!?!! 🤓 😎
https://slurp.rtfd.io/
GNU General Public License v3.0
53 stars 76 forks source link

Create new seek "lite" version -> no "salary" or "content" columns; don't open and crawl the full job ad #2794

Closed jbampton closed 1 month ago

jbampton commented 1 month ago

We already have a lite version so now we need to enhance it.

Lite version should not contain "salary" or "content".

So don't open the full job ad; Move the "check for lite logic" higher up, outside and above: ad = agent.get(url)

https://github.com/slurpcode/slurp/blob/e4813ef8a7f9c0cf1a944f17782a289a295f9f87/seek/seek.rb#L276

This will make the lite version faster to crawl

jbampton commented 1 month ago

Hey @Dxuian are you interested in this issue ?

Dxuian commented 1 month ago

Hey @Dxuian are you interested in this issue ?

on it

jbampton commented 1 month ago

Hey @Dxuian you are now assigned :+1:

Dxuian commented 1 month ago

@jbampton please review #2799