search

infochimps-labs / wukong-hadoop

Execute Wukong code within the Hadoop framework.
Other
13 stars 6 forks source link

word_count example not working #4

Open EvanZ opened 11 years ago

EvanZ commented 11 years ago

Tried running: $ wu-hadoop examples/word_count.rb --mode=local --input=examples/sonnet_18.txt

Gives the following error: /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/hanuman/stage.rb:50:in handle_extra_attributes': undefined methodmerge!' for nil:NilClass (NoMethodError) from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/gorillib-0.5.0/lib/gorillib/model/base.rb:82:in receive!' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/gorillib-0.5.0/lib/gorillib/model/base.rb:23:ininitialize' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/hanuman/stage.rb:8:in new' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/hanuman/stage.rb:8:inbuilder' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/hanuman/stage.rb:18:in register' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong/widget/processors.rb:55:inclass:Logger' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong/widget/processors.rb:24:in <class:Processor>' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong/widget/processors.rb:4:inmodule:Wukong' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong/widget/processors.rb:3:in <top (required)>' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:inrequire' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:in require' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong/widgets.rb:1:in<top (required)>' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong.rb:44:in require_relative' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-3.0.1/lib/wukong.rb:44:in<top (required)>' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:in require' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:inrequire' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-hadoop-0.1.1/lib/wukong-hadoop.rb:1:in <top (required)>' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:inrequire' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/site_ruby/2.0.0/rubygems/core_ext/kernel_require.rb:51:in require' from /Users/evanzamir/.rvm/gems/ruby-2.0.0-p247/gems/wukong-hadoop-0.1.1/bin/wu-hadoop:3:in<top (required)>' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/bin/wu-hadoop:23:in load' from /Users/evanzamir/.rvm/rubies/ruby-2.0.0-p247/bin/wu-hadoop:23:in

'

ccbcreg commented 10 years ago

I'm having the same problem. I'm using rvm and created a gemset with only wukong-hadoop and it's dependencies installed. The first test from the readme fails. There appears to be a problem reading the args from the command line. Do you think this is because of using rvm? Any assistance would be greatly appreciated, I'm ready to start using this library ASAP. 

$ wu-hadoop examples/word_count.rb --mode=local --input=examples/sonnet_18.txt
/Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/hanuman/stage.rb:78:in `handle_extra_attributes': undefined method `merge!' for nil:NilClass (NoMethodError)
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/gorillib-0.6.0/lib/gorillib/model/base.rb:82:in `receive!'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/gorillib-0.6.0/lib/gorillib/model/base.rb:23:in `initialize'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/hanuman/stage.rb:26:in `new'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/hanuman/stage.rb:26:in `builder'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/hanuman/stage.rb:36:in `register'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong/widget/filters.rb:42:in `<class:Filter>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong/widget/filters.rb:6:in `<class:Processor>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong/widget/filters.rb:2:in `<module:Wukong>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong/widget/filters.rb:1:in `<top (required)>'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong/widgets.rb:1:in `<top (required)>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong.rb:47:in `require_relative'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-4.0.0/lib/wukong.rb:47:in `<top (required)>'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-hadoop-0.2.0/lib/wukong-hadoop.rb:1:in `<top (required)>'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/gems/wukong-hadoop-0.2.0/bin/wu-hadoop:3:in `<top (required)>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/bin/wu-hadoop:23:in `load'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/bin/wu-hadoop:23:in `<main>'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/bin/ruby_executable_hooks:15:in `eval'
from /Users/nbrowning/.rvm/gems/ruby-2.1.1@wukong/bin/ruby_executable_hooks:15:in `<main>'
ccbcreg commented 10 years ago

BTW, I got to work on a different machine and this is working fine. I'm pretty sure it has to do with a malformed rvm installation or my shell not being setup correctly. If I determine what the cause of the fault was I will report here.

ccbcreg commented 10 years ago

I found the reason this error apparently occurs. It appears it was a rubygems problem. Rubygems v1.8.10 works fine, rubygems version 2.2.2 doesn't. I hope this helps someone.