nathanmarz / cascalog

Data processing on Hadoop without the hassle.
Other
1.38k stars 178 forks source link

add LZO to modules #272

Closed sritchie closed 9 years ago

sritchie commented 9 years ago

To see if tests pass.

philippwinkler commented 9 years ago

The unit test passes locally. Maybe the lzo2 lib isn't installed on the test machine (which wouldn't surprise me).

sritchie commented 9 years ago

Okay, modified to install that dependency as per twitter-lzo's travis definition.

philippwinkler commented 9 years ago

Great idea, pulling from twitter. Via Elephant-Bird we will also need the native gpl compression:

before_install:
...  
- git clone git://github.com/twitter/hadoop-lzo.git # for native libgplcompression
  - cd hadoop-lzo
  - git checkout master
  - mvn compile
  - mv target/native/Linux-* ../hadoop-lzo-native
  - cd ..

and add the library $PWD/hadoop-lzo-native/lib to the environment.

sritchie commented 9 years ago

@philippwinkler trying again with a bunch more options :)

sritchie commented 9 years ago

Boom, works!