skale-me / node-parquet

NodeJS module to access apache parquet format files
Apache License 2.0
57 stars 11 forks source link

Waiting for the API Release #6

Open BasilArockiaEdwin opened 7 years ago

BasilArockiaEdwin commented 7 years ago

Hi, We are desperately in a need to parse parquet formatted files from node server to get some meaningful information out of it.we believe this module is the best fit for our need. So,If we could tell us when can we expect the initial working version of this module that would be of very helpful.

Thanks, Basil

mvertes commented 7 years ago

Working on it right now. Expect an initial working version in the following days

mindnuts commented 7 years ago

@mvertes On Ubuntu 16.04 NPM install fails currently:

../deps/parquet-cpp/src/parquet/column/reader.h:28:33: fatal error: arrow/util/bit-util.h: No such file or directory

Do i need to install anything apart from Build tool chain?

mvertes commented 7 years ago

Check the 'before_install' parameter in .travis.yml file, which uses an ubuntu target for continuous integration (and it works). If you run as root, you must use npm install --unsafe-perm.

mvertes commented 7 years ago

@BasilArockiaEdwin, release 0.2.1 is ok now. Is it ok for you ?

BasilArockiaEdwin commented 7 years ago

@mvertes Got the below error.

-- Configuring incomplete, errors occurred! See also "/home/dpdkpcap/TARTBALL/splunk-features/splunk_downloads/splunk_sdk_javascript_node_js/node_parquet/node_modules/.staging/node-parquet-5ebb3326/build_deps/parquet-cpp/CMakeFiles/CMakeOutput.log". npm WARN parquet@1.0.0 No repository field. npm ERR! Linux 3.19.0-56-generic npm ERR! argv "/usr/bin/node" "/usr/bin/npm" "install" "node-parquet" npm ERR! node v7.0.0 npm ERR! npm v3.10.8 npm ERR! code ELIFECYCLE

npm ERR! node-parquet@0.2.1 preinstall: ./build_parquet-cpp.sh npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the node-parquet@0.2.1 preinstall script './build_parquet-cpp.sh'.

mvertes commented 7 years ago

@BasilArockiaEdwin you probably miss some pre-requisites indicated by configure errors (not printed in your incomplete trace). Check full trace, and look at pre-requisites in README.md, and as an example on Ubuntu, .travis.yml.

oya163 commented 6 years ago

I have installed all of the dependencies stated. However, still getting error stated by @BasilArockiaEdwin . Please help @mvertes