IanMadlenya / ultra-finance

Automatically exported from code.google.com/p/ultra-finance
0 stars 0 forks source link

hbase configuration #10

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago
What steps will reproduce the problem?

1. Installed hadoop
2. Installed ultrafinace

I want to use hbase as storage.

My question now is: how do I configure this for the usage of hadopp ? (if 
possible at all)
I think sqllite might not scale well enough ..

When trying to do so by :

python fundamentalCrawler.py -f test.ini -o hbase
Traceback (most recent call last):
  File "fundamentalCrawler.py", line 141, in <module>
    crawler.getOptions()
  File "fundamentalCrawler.py", line 73, in getOptions
    self.outputDAM = DAMFactory.createDAM(options.outputDAM, setting)
UnboundLocalError: local variable 'setting' referenced before assignment

[19:17:45] [ennopommerening@localhost ../ultra-finance/examples]$ 

What is the expected output? What do you see instead?
Is hbase access already finished kind of working ?
cheers, Enno

What version of the product are you using?:-> 1.01 
On what operating system? MAC OS 10.8

Please provide any additional information below.

Hadoop seems to run:

jps
13272 SecondaryNameNode
13440 TaskTracker
13767 Jps
13173 DataNode
13069 NameNode
13344 JobTracker

Original issue reported on code.google.com by enno.pom...@gmail.com on 3 Sep 2013 at 5:22