jayunit100 / bigpetstore

[OBSOLETE] Moved to Apache BigTop !!! See you there.
http://jayunit100.github.io/bigpetstore/slides
9 stars 3 forks source link

Running in local IDE #2

Closed jayunit100 closed 10 years ago

jayunit100 commented 10 years ago

Hi Nigel thanks. I had the pig and hive libraries set up so that could run direct eclipse, in local mode with nothing else installed.

Mvn eclipse:eclipse to generate the project and then unit tests should work.

Why has that changed?

nsavageJVM commented 10 years ago

not sure, the TestPetStoreTransactionGeneratorJob has no dependency on pig or hive as far as I am aware there were no pig or hive tests before yes I have been working on the hive embedded as I had issues which I raised with you, I have hive embedded code that runs on my box now I am still getting DataNucleus warnings however if you put this log4j.properties in the the vm arguments -Dlog4j.configuration=file:/[path to your home directory]/bigpetstore/src/main/resources/hive-log4j.properties it will filter out all the Datanucleus sql warnings

I will push it now, let me know if the tests run on your box

nsavageJVM commented 10 years ago

just merged the code and the tests now are failing on my box, debugging this now, once tests pass will push

nsavageJVM commented 10 years ago

ok

  1. your new PigETL test class you included was failing because the pig script is renamed to pigPetStoreD3, this is now fixed
  2. the hive tests are failing because the JsonStorage class needs antlr 3.5 while Hive fails on antlr 3.5 it needs antlr 3.1 please refer to for hive needing antlr 3.1 http://stackoverflow.com/questions/13938337/error-when-run-hive-0-9-0-exception-in-thread-main-java-lang-nosuchfielderror please refer to pig JsonStorage needing antlr 3.5 http://stackoverflow.com/questions/17179200/pig-exception-on-simple-load

I understand everything needs to run in the ide with no external dependencies

nsavageJVM commented 10 years ago

have tests passing needed to upgrade datanucleus, hive and other dependencise, have created version tags in pom properties

0.12.0 0.9.13.0.3
nsavageJVM commented 10 years ago

oops did not mean to close will just clean up code and push, hopefully test will pass now, let me know