search

PaulMcInnis / JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.
MIT License
1.81k stars 212 forks source link

Cannot open shared object #92

Closed Pittsie72 closed 3 years ago

Pittsie72 commented 4 years ago

Issue Template

Description

When I run any funnel command (--help, -s) I get the following errors:

Traceback (most recent call last): File "/home/pi/.local/bin/funnel", line 6, in from jobfunnel.main import main File "/home/pi/.local/lib/python3.7/site-packages/jobfunnel/main.py", line 11, in from .jobfunnel import JobFunnel File "/home/pi/.local/lib/python3.7/site-packages/jobfunnel/jobfunnel.py", line 20, in from .tools.delay import delay_alg File "/home/pi/.local/lib/python3.7/site-packages/jobfunnel/tools/delay.py", line 9, in from scipy.special import expit File "/home/pi/.local/lib/python3.7/site-packages/scipy/special/init.py", line 633, in from . import _ufuncs ImportError: libf77blas.so.3: cannot open shared object file: No such file or directory

Environment

Raspbian OS Raspberry Pi 4

PaulMcInnis commented 4 years ago

Chances are you are missing a dependency

sudo apt-get install libatlas-base-dev

Give that a shot and then run it again.

Pittsie72 commented 4 years ago

Worked perfect thanks!

Other question though what would the cronjob command be to run this?

PaulMcInnis commented 4 years ago

no problem :+1:

We have documented it over here: https://github.com/PaulMcInnis/JobFunnel/tree/master/docs/crontab

PaulMcInnis commented 4 years ago

Looks like this was resolved

Pittsie72 commented 4 years ago

Different issues but wanted to email rather than post. Glassdoor both static and dynamic give me an error of 'NoneType' object has no attribute Static has no attribute 'text' Dynamic has no attribute 'get'

Also if I change the status at all I get the following error.

jobfunnel initialized at 2020-09-04 Traceback (most recent call last): File "/home/pi/.local/bin/funnel", line 10, in sys.exit(main()) File "/home/pi/.local/lib/python3.7/site-packages/jobfunnel/main.py", line 41, in main jf.update_filterjson() File "/home/pi/.local/lib/python3.7/site-packages/jobfunnel/jobfunnel.py", line 243, in update_filterjson if job['status'] in REMOVE_STATUSES: KeyError: 'status'

On Fri, Sep 4, 2020, 5:57 PM Paul McInnis notifications@github.com wrote:

Closed #92 https://github.com/PaulMcInnis/JobFunnel/issues/92.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#event-3731795379, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZXLME7Y6REPF56H4H3SEFPEDANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

Can you please try out the branch ABCJobFunnel and see if that works better?

This is currently making it's way into a release but I did fix some issues with the scrapers on that branch as well.

Pittsie72 commented 4 years ago

Sure can. I'll let you know what goes on

On Fri, Sep 4, 2020, 7:38 PM Paul McInnis notifications@github.com wrote:

Can you please try out the branch ABCJobFunnel and see if that works better?

This is currently making it's way into a release but I did fix some issues with the scrapers on that branch as well.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687471074, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZSFCCNZ6YSLI5NTHBTSEF3ALANCNFSM4QWZ5WOQ .

Pittsie72 commented 4 years ago

I apologise for the stupidity but I rarely use got. What's the code to install from that branch?

On Fri, Sep 4, 2020, 7:38 PM Paul McInnis notifications@github.com wrote:

Can you please try out the branch ABCJobFunnel and see if that works better?

This is currently making it's way into a release but I did fix some issues with the scrapers on that branch as well.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687471074, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZSFCCNZ6YSLI5NTHBTSEF3ALANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

No worries, heres how to do it:

  1. Clone this repo into JobFunnel folder
  2. Cd into the folder
  3. Run ‘git checkout ABCJobFunnel’
  4. Go back up a dir (cd ../)
  5. Run ‘pip install -e JobFunnel‘

You may need to uninstall ur current jobfunnel first as well.

Pittsie72 commented 4 years ago

Got it all installed!

I am noticing even though I have my locale set to USA_ENGLISH the local providers are MonsterSrcaperCANEng and IndeedScraperCANEng

Is that just a bug or?

On Fri, Sep 4, 2020, 10:14 PM Paul McInnis notifications@github.com wrote:

No worries, heres how to do it:

  1. Clone this repo into JobFunnel folder
  2. Cd into the folder
  3. Run ‘git checkout ABCJobFunnel’
  4. Go back up a dir (cd ../)
  5. Run ‘pip install -e JobFunnel‘

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687524135, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZV62KMOIY6PEVQD5ITSEGNILANCNFSM4QWZ5WOQ .

Pittsie72 commented 4 years ago

Update realized even when using my own custom yaml it runs the default one

On Fri, Sep 4, 2020, 11:33 PM Shane Pitts spittsie72@gmail.com wrote:

Got it all installed!

I am noticing even though I have my locale set to USA_ENGLISH the local providers are MonsterSrcaperCANEng and IndeedScraperCANEng

Is that just a bug or?

On Fri, Sep 4, 2020, 10:14 PM Paul McInnis notifications@github.com wrote:

No worries, heres how to do it:

  1. Clone this repo into JobFunnel folder
  2. Cd into the folder
  3. Run ‘git checkout ABCJobFunnel’
  4. Go back up a dir (cd ../)
  5. Run ‘pip install -e JobFunnel‘

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687524135, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZV62KMOIY6PEVQD5ITSEGNILANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

Thanks for the feedback, I have some bugs i need to fix!

You should see some quality improvements v soon, but im glad to hear you got it functional, maybe stick to CLI for now.

Pittsie72 commented 4 years ago

I just ended up changing the defaults and ran into a different bug. I'll post that one in a bit. Was something like couldn't find an argument. Cli also keep giving me errors and wouldn't let me run as shown

On Sat, Sep 5, 2020, 12:02 PM Paul McInnis notifications@github.com wrote:

Thanks for the feedback, I have some bugs i need to fix!

You should see some quality improvements v soon, but im glad to hear you got it functional, maybe stick to CLI for now.

On Sat, Sep 5, 2020 at 12:03 AM Pittsie72 notifications@github.com wrote:

Update realized even when using my own custom yaml it runs the default one

On Fri, Sep 4, 2020, 11:33 PM Shane Pitts spittsie72@gmail.com wrote:

Got it all installed!

I am noticing even though I have my locale set to USA_ENGLISH the local

providers are MonsterSrcaperCANEng and IndeedScraperCANEng

Is that just a bug or?

On Fri, Sep 4, 2020, 10:14 PM Paul McInnis notifications@github.com

wrote:

No worries, heres how to do it:

  1. Clone this repo into JobFunnel folder

  2. Cd into the folder

  3. Run ‘git checkout ABCJobFunnel’

  4. Go back up a dir (cd ../)

  5. Run ‘pip install -e JobFunnel‘

—

You are receiving this because you authored the thread.

Reply to this email directly, view it on GitHub

<

https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687524135

,

or unsubscribe

<

https://github.com/notifications/unsubscribe-auth/ANAJFZV62KMOIY6PEVQD5ITSEGNILANCNFSM4QWZ5WOQ

.

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub < https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687544016 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAYKY2LINACI5UQNIIRQNMLSEGZ7XANCNFSM4QWZ5WOQ

.

--

  • Paul McInnis

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687629531, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZV7W6C7SXHNS5K475DSEJOJVANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

weird ask, but were you able to run with all the arguments passed as flags?

Pittsie72 commented 4 years ago

Nope that's where I kept getting caught up. It kept asking me for more flags. I got down to the level and it just kept saying error need that argument. I can grab the output if you want

On Sat, Sep 5, 2020, 12:52 PM Paul McInnis notifications@github.com wrote:

weird ask, but were you able to run with all the arguments passed as flags?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687635049, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZRFPAOYAQZIMREWNYDSEJUFBANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

ouch. OK. I will fix this ASAP. I want my PR branch in a more usable state than this. Hold tight

Pittsie72 commented 4 years ago

Sounds good man. I can try to help some but it'll take me some time to get up to speed and my python is fairly basic. Use pandas for data science stuff and that's really it

On Sat, Sep 5, 2020, 1:01 PM Paul McInnis notifications@github.com wrote:

ouch. OK. I will fix this ASAP. I want my PR branch in a more usable state than this. Hold tight

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/PaulMcInnis/JobFunnel/issues/92#issuecomment-687636124, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANAJFZQXXRK2RXTEFRJKZXDSEJVG3ANCNFSM4QWZ5WOQ .

PaulMcInnis commented 4 years ago

OK I believe I have fixed this for passing yaml only (args still broken)

Please do the following:

  1. cd back into the folder JobFunnel
  2. git pull
  3. you should now be able to pass -s settings YAML
PaulMcInnis commented 3 years ago

Closing this for now, Feel free to chime in on PR thread if you have further issues with ABCJobFunnel branch.