search

redsymbol / csv2parquet

Create Parquet files from CSV
67 stars 21 forks source link

shutil.which problem?! #2

Open argenisleon opened 8 years ago

argenisleon commented 8 years ago

Hi,

I am getting this error:

File "csv2parquet.py", line 330, in drill = DrillInstallation() File "csv2parquet.py", line 203, in init assert reference_executable is not None AssertionError

any help?

gsemet commented 7 years ago

you need to read the README and add the apache drill bin folder to the PATH environment variable.

gnummeli commented 6 years ago

That cannot be the only reason I am getting the same error and I have verified back and forth that the drill bin folder is in the PATH I'm using Linux Mint 18

gnummeli commented 6 years ago

Correction to my previous statement - the AssertionError is due to missing PATH indeed which I didn't notice is due to using sudo and that doesn't inherit the PATH variable from user. But what I get instead is an os level error: Traceback (most recent call last): File "./csv2parquet", line 333, in drill_script.run() File "./csv2parquet", line 265, in run os.rename(self.drill.location.full_path('parquet_tmp_output'), self.parquet_output) OSError: [Errno 18] Invalid cross-device link: '/tmp/ihc4wg3x/parquet_tmp_output' -> 'aret.parquet'

which as far as I can ascertain has something to do with the privilege setting of the /tmp directory Any suggestions?

gnummeli commented 6 years ago

Resolved I replaced os.rename by shutil.move as recommended in another forum on stackoverflow and that solved the problem. I.e. would recommend to do that change in the base program as well

sanjeet12 commented 5 years ago

setting the environment variable for apache-drill solve the above problem export PATH=$PATH:/home/Ubuntu/apache-drill-1.13.0/bin

But now it is showing FATAL: Drill script failed with error code 1. To troubleshoot, run with --debug and inspect files script, script_stderr and script_stdout.

How to solve this?

Thanks:)

pmiola73 commented 2 years ago

setting the environment variable for apache-drill solve the above problem export PATH=$PATH:/home/Ubuntu/apache-drill-1.13.0/bin

But now it is showing FATAL: Drill script failed with error code 1. To troubleshoot, run with --debug and inspect files script, script_stderr and script_stdout.

How to solve this?

Thanks:)

how did you solve it?