search

digininja / CeWL

CeWL is a Custom Word List Generator
2.01k stars 262 forks source link

Can't run CeWL due to Nokogiri gem missing #89

Closed ret2c closed 2 years ago

ret2c commented 2 years ago

Hi, I've tried to build CeWL from the repo, but after running gem install bundler and bundle install, the Nokogiri gem seems to not be integrated. Here's some recreation:

- GitHub/CeWL [master●] » sudo ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems

- GitHub/CeWL [master●] » bundle install
Using bundler 2.3.11
Using mime 0.4.4
Following files may not be writable, so sudo is needed:
  /Library/Ruby/Gems/2.6.0
  /Library/Ruby/Gems/2.6.0/build_info
  /Library/Ruby/Gems/2.6.0/cache
  /Library/Ruby/Gems/2.6.0/doc
  /Library/Ruby/Gems/2.6.0/extensions
  /Library/Ruby/Gems/2.6.0/gems
  /Library/Ruby/Gems/2.6.0/specifications
Using mime-types-data 3.2022.0105
Using mime-types 3.4.1
Using mini_exiftool 2.10.2
Using racc 1.6.0
+ Using nokogiri 1.13.4 (arm64-darwin)
+ Using nokogiri 1.13.4 (x86_64-darwin)
Using rexml 3.2.5
Using rubyzip 2.3.2
Using spider 0.5.4
Bundle complete! 7 Gemfile dependencies, 11 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
- GitHub/CeWL [master●] » sudo gem install nokogiri
Successfully installed nokogiri-1.13.4-x86_64-darwin
Parsing documentation for nokogiri-1.13.4-x86_64-darwin
Done installing documentation for nokogiri after 0 seconds
1 gem installed
- GitHub/CeWL [master●] » gem info nokogiri

LOCAL GEMS

nokogiri (1.13.4, 1.10.1)
    Platforms:
        1.10.1: ruby
        1.13.4: arm64-darwin, x86_64-darwin
    Authors: Mike Dalessio, Aaron Patterson, Yoko Harada, Akinori MUSHA,
    John Shahid, Karol Bucek, Sam Ruby, Craig Barnes, Stephen Checkoway,
    Lars Kanis, Sergio Arbeo, Timothy Elliott, Nobuyoshi Nakada
    Homepage: https://nokogiri.org
    License: MIT
    Installed at (1.13.4): /Library/Ruby/Gems/2.6.0
                 (1.10.1): /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/gems/2.6.0

    Nokogiri (鋸) makes it easy and painless to work with XML and HTML
    from Ruby.
- GitHub/CeWL [master●] » sudo ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems

Added diff syntax highlighting to clear some things up. Didn't see any reference into Nokogiri in any open/closed issues here. Thank you!

digininja commented 2 years ago

Can you try manually installing Nokogiri with

gem install nokogiri

I'll check the gem list later. I have a vague memory of spotting it was missing, wondering how I'd managed that without everyone shouting, and fixing it, but I'll have to look.

On Sun, 17 Apr 2022, 05:36 connor, @.***> wrote:

Hi, I've tried to build CeWL from the repo, but after running gem install bundler and bundle install, the Nokogiri gem seems to not be integrated. Here's some recreation:

  • GitHub/CeWL [master●] » sudo ./cewl.rb

CeWL 5.5.2 (Grouping) Robin Wood @.***) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed

Run 'bundle install' to install all the required gems
  • GitHub/CeWL [master●] » bundle install

Using bundler 2.3.11

Using mime 0.4.4

Following files may not be writable, so sudo is needed:

/Library/Ruby/Gems/2.6.0

/Library/Ruby/Gems/2.6.0/build_info

/Library/Ruby/Gems/2.6.0/cache

/Library/Ruby/Gems/2.6.0/doc

/Library/Ruby/Gems/2.6.0/extensions

/Library/Ruby/Gems/2.6.0/gems

/Library/Ruby/Gems/2.6.0/specifications

Using mime-types-data 3.2022.0105

Using mime-types 3.4.1

Using mini_exiftool 2.10.2

Using racc 1.6.0

  • Using nokogiri 1.13.4 (arm64-darwin)
  • Using nokogiri 1.13.4 (x86_64-darwin)

Using rexml 3.2.5

Using rubyzip 2.3.2

Using spider 0.5.4

Bundle complete! 7 Gemfile dependencies, 11 gems now installed.

Use bundle info [gemname] to see where a bundled gem is installed.

  • GitHub/CeWL [master●] » sudo gem install nokogiri

Successfully installed nokogiri-1.13.4-x86_64-darwin

Parsing documentation for nokogiri-1.13.4-x86_64-darwin

Done installing documentation for nokogiri after 0 seconds

1 gem installed

  • GitHub/CeWL [master●] » gem info nokogiri

LOCAL GEMS

nokogiri (1.13.4, 1.10.1)

Platforms:

    1.10.1: ruby

    1.13.4: arm64-darwin, x86_64-darwin

Authors: Mike Dalessio, Aaron Patterson, Yoko Harada, Akinori MUSHA,

John Shahid, Karol Bucek, Sam Ruby, Craig Barnes, Stephen Checkoway,

Lars Kanis, Sergio Arbeo, Timothy Elliott, Nobuyoshi Nakada

Homepage: https://nokogiri.org

License: MIT

Installed at (1.13.4): /Library/Ruby/Gems/2.6.0

             (1.10.1): /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/gems/2.6.0

Nokogiri (鋸) makes it easy and painless to work with XML and HTML

from Ruby.
  • GitHub/CeWL [master●] » sudo ./cewl.rb

CeWL 5.5.2 (Grouping) Robin Wood @.***) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed

Run 'bundle install' to install all the required gems

Added diff syntax highlighting to clear some things up. Didn't see any reference into Nokogiri in any open/closed issues here. Thank you!

— Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/89, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWLZNOEGCSIPPFY5ZT3VFOIMTANCNFSM5TTKDCHA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

ret2c commented 2 years ago

Sadly I already tried that, but let me know when you have a chance to look into the gems. Thank you!

- GitHub/CeWL [master●] » sudo gem install nokogiri
Password:
Successfully installed nokogiri-1.13.4-x86_64-darwin
Parsing documentation for nokogiri-1.13.4-x86_64-darwin
Done installing documentation for nokogiri after 1 seconds
1 gem installed
- GitHub/CeWL [master●] » sudo ./cewl.rb 
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems

- GitHub/CeWL [master●] »
digininja commented 2 years ago

I've just tried this on a clean install and it worked fine. Nokogiri is in the Gemfile and is installed by your bundle install.

Is there any reason you are running cewl with sudo? Try it without sudo and this doesn't work, run:

gem list | grep noko

You should see:

nokogiri (1.13.4 x86_64-linux)
ret2c commented 2 years ago

Hmm, that's odd. Nokogiri is still on my gem list yet I'm getting the error:

- GitHub/CeWL [master●] » ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems

- GitHub/CeWL [master●] » gem list | grep noko
nokogiri (1.13.4 arm64-darwin x86_64-darwin, 1.10.1)

#####################################################################

- GitHub/CeWL [master●] » bundle install
Using bundler 2.3.11
Using mime 0.4.4
Following files may not be writable, so sudo is needed:
  /Library/Ruby/Gems/2.6.0
  /Library/Ruby/Gems/2.6.0/build_info
  /Library/Ruby/Gems/2.6.0/cache
  /Library/Ruby/Gems/2.6.0/doc
  /Library/Ruby/Gems/2.6.0/extensions
  /Library/Ruby/Gems/2.6.0/gems
  /Library/Ruby/Gems/2.6.0/specifications
Using mime-types-data 3.2022.0105
Using mime-types 3.4.1
Using mini_exiftool 2.10.2
Using racc 1.6.0
+ Using nokogiri 1.13.4 (arm64-darwin)
+ Using nokogiri 1.13.4 (x86_64-darwin)
Using rexml 3.2.5
Using rubyzip 2.3.2
Using spider 0.5.4
+ Bundle complete! 7 Gemfile dependencies, 11 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
- GitHub/CeWL [master●] » ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems
digininja commented 2 years ago

Are you using rvm?

On Sun, 17 Apr 2022, 21:09 connor, @.***> wrote:

Hmm, that's odd. Nokogiri is still on my gem list yet I'm getting the error:

  • GitHub/CeWL [master●] » ./cewl.rb

CeWL 5.5.2 (Grouping) Robin Wood @.***) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed

Run 'bundle install' to install all the required gems
  • GitHub/CeWL [master●] » gem list | grep noko

nokogiri (1.13.4 arm64-darwin x86_64-darwin, 1.10.1)

#####################################################################

  • GitHub/CeWL [master●] » bundle install

Using bundler 2.3.11

Using mime 0.4.4

Following files may not be writable, so sudo is needed:

/Library/Ruby/Gems/2.6.0

/Library/Ruby/Gems/2.6.0/build_info

/Library/Ruby/Gems/2.6.0/cache

/Library/Ruby/Gems/2.6.0/doc

/Library/Ruby/Gems/2.6.0/extensions

/Library/Ruby/Gems/2.6.0/gems

/Library/Ruby/Gems/2.6.0/specifications

Using mime-types-data 3.2022.0105

Using mime-types 3.4.1

Using mini_exiftool 2.10.2

Using racc 1.6.0

  • Using nokogiri 1.13.4 (arm64-darwin)
  • Using nokogiri 1.13.4 (x86_64-darwin)

Using rexml 3.2.5

Using rubyzip 2.3.2

Using spider 0.5.4

  • Bundle complete! 7 Gemfile dependencies, 11 gems now installed.

Use bundle info [gemname] to see where a bundled gem is installed.

  • GitHub/CeWL [master●] » ./cewl.rb

CeWL 5.5.2 (Grouping) Robin Wood @.***) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed

Run 'bundle install' to install all the required gems

— Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/89#issuecomment-1100942171, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWM474VVOO7BQ2XFOKLVFRVWNANCNFSM5TTKDCHA . You are receiving this because you commented.Message ID: @.***>

ret2c commented 2 years ago

I am not, this is probably the only Ruby application I've used on this Mac as far as I know

digininja commented 2 years ago

Can you try this:

$ irb
irb(main):001:0> require "nokogiri"
=> true

See if that will load nokogiri.

ret2c commented 2 years ago

That didn't seem to work

- GitHub/CeWL [master●] » irb

WARNING: This version of ruby is included in macOS for compatibility with legacy software. 
In future versions of macOS the ruby runtime will not be available by 
default, and may require you to install an additional package.

irb(main):001:0> require "nokogiri"
=> true
irb(main):002:0> exit
- GitHub/CeWL [master●] » ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Error: nokogiri/nokogiri gem not installed
    Run 'bundle install' to install all the required gems

- GitHub/CeWL [master●] »

Could this just be some weird OSX issue?

ret2c commented 2 years ago

Got it to work 🥳, I had to uninstall nokogiri and rebuild it with system libraries and then specify a version number.

Working command: sudo gem install nokogiri -v 1.6.5 -- --use-system-libraries

Here is the full list of commands I ran:

- GitHub/CeWL [master●] » sudo gem uninstall nokogiri
Successfully uninstalled nokogiri-1.6.2.1

Select gem to uninstall:
 1. nokogiri-1.13.4-x86_64-darwin
 2. nokogiri-1.13.4-arm64-darwin
 3. All versions
> 3
Successfully uninstalled nokogiri-1.13.4-x86_64-darwin
Successfully uninstalled nokogiri-1.13.4-arm64-darwin
- GitHub/CeWL [master●] » sudo gem install nokogiri -v 1.6.5 -- --use-system-libraries
Fetching nokogiri-1.6.5.gem
Building native extensions with: '--use-system-libraries'
This could take a while...
Successfully installed nokogiri-1.6.5
Parsing documentation for nokogiri-1.6.5
Installing ri documentation for nokogiri-1.6.5
Done installing documentation for nokogiri after 1 seconds
1 gem installed
- GitHub/CeWL [master●] » ./cewl.rb
CeWL 5.5.2 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/)

Missing URL argument (try --help)

- GitHub/CeWL [master●] »
digininja commented 2 years ago

Glad you fixed it, it was an odd one. It looks like you had two copies of the same version installed from when you uninstalled it.

The irb command did work, it successfully loaded the library so showed that it could be loaded and it wasn't something corrupt with the library files.

On Mon, 18 Apr 2022, 02:04 connor, @.***> wrote:

Got it to work 🥳, I had to uninstall nokogiri and rebuilt it with system libraries & specifying a version number. Here are the commands I ran:

  • GitHub/CeWL [master●] » sudo gem uninstall nokogiri

Successfully uninstalled nokogiri-1.6.2.1

Select gem to uninstall:

  1. nokogiri-1.13.4-x86_64-darwin

  2. nokogiri-1.13.4-arm64-darwin

  3. All versions

    3

Successfully uninstalled nokogiri-1.13.4-x86_64-darwin

Successfully uninstalled nokogiri-1.13.4-arm64-darwin

  • GitHub/CeWL [master●] » sudo gem install nokogiri -v 1.6.5 -- --use-system-libraries

Fetching nokogiri-1.6.5.gem

Building native extensions with: '--use-system-libraries'

This could take a while...

Successfully installed nokogiri-1.6.5

Parsing documentation for nokogiri-1.6.5

Installing ri documentation for nokogiri-1.6.5

Done installing documentation for nokogiri after 1 seconds

1 gem installed

  • GitHub/CeWL [master●] » ./cewl.rb

CeWL 5.5.2 (Grouping) Robin Wood @.***) (https://digi.ninja/)

Missing URL argument (try --help)

  • GitHub/CeWL [master●] »

— Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/89#issuecomment-1100994526, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWPN5W64N3RDE3CNULTVFSYJZANCNFSM5TTKDCHA . You are receiving this because you commented.Message ID: @.***>