cdeptula / tdeoutputplugin

Tableau Data Extract Output Plugin for Pentaho Data Integration Released by Inquidia Consulting
Apache License 2.0
15 stars 6 forks source link

Exception trying to close file: java.lang.NullPointerException #6

Closed churtado closed 9 years ago

churtado commented 9 years ago

Hello,

I'm getting the same error reported in issue 5 (closed). But I will try to give you all the necessary information.

I'm running Ubuntu 14.04, using Open JDK, version 1.7.0_65. I've built PDI from source and downloaded the plugin from the marketplace. I downloaded the data extract API from Tableau's web site here: http://www.tableausoftware.com/products/api-download?ref=lp&signin=8729add136a1f2a3ca23f588fa584906&1[os]=linux

(downloaded the linux version). Set the LD_LIBRARY_PATH variable to point to /TDE-API-Linux-64Bit/lib64/dataextract, where I extracted the api. I hope this is correct.

I started the server in the bin folder (./tdeserver64) and ran a transformation, and got the errors you'll see at the end of the post. I get the feeling it has to do with permissions, but I'm not too sure.

If necessary I can provide a sample transformation. I just take some string data from an excel file (about a dozen string columns) and try to export it to tableau.

Is there anything I'm doing wrong?

Log statements:

2014/11/10 10:51:21 - output to file.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Exception trying to close file: java.lang.NullPointerException 2014/11/10 10:51:21 - output to file.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : 2014/11/10 10:51:21 - output to file.0 - Error opening extract : com.tableausoftware.TableauException: server did not call us back 2014/11/10 10:51:21 - output to file.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Error initializing step [output to file] 2014/11/10 10:51:21 - contacts ETL - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Step [output to file.0] failed to initialize! 2014/11/10 10:51:21 - output to file.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Exception trying to close file: java.lang.NullPointerException 2014/11/10 10:51:21 - Spoon - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : contacts ETL: preparing transformation execution failed 2014/11/10 10:51:21 - Spoon - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : org.pentaho.di.core.exception.KettleException: 2014/11/10 10:51:21 - Spoon - We failed to initialize at least one step. Execution can not begin! 2014/11/10 10:51:21 - Spoon - 2014/11/10 10:51:21 - Spoon - 2014/11/10 10:51:21 - Spoon - at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1149) 2014/11/10 10:51:21 - Spoon - at org.pentaho.di.ui.spoon.trans.TransGraph$27.run(TransGraph.java:3989) 2014/11/10 10:51:21 - Spoon - at java.lang.Thread.run(Thread.java:744) 2014/11/10 10:51:21 - contacts ETL - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Errors detected! 2014/11/10 10:51:21 - contacts ETL - ERROR (version TRUNK-SNAPSHOT, build 1 from 2014-10-07 18.06.25 by carlos) : Errors detected!

cdeptula commented 9 years ago

I will look into why the null pointer exception is being thrown, However, your root problem is configuration of the API.

It looks like Tableau refactored the structure of the API download and this broke the instructions in the README. Here are some updated steps to configure the API correctly, some of these you have already done.

  1. Set LD_LIBRARY_PATH to the /lib64/dataextract folder.
  2. Add /bin to your PATH variable. 2.1 - Alternatively if you do not want to change your PATH variable:
    • Move the contents of the /lib64/dataextract folder to the lib64 folder.
    • Update the LD_LIBRARY_PATH accordingly.

I will update the README with these instructions.

There is no need to start the tdeserver64 binary.

churtado commented 9 years ago

Just followed your steps to the letter and it worked. Thanks a lot!

cdeptula commented 9 years ago

I am re-opening as the null pointer exception is still an underlying bug. This way I can track it and remember to look at it when I have time. It is not a very pressing bug at the moment though.

tenderfeet commented 9 years ago

Hi, I am getting the same error. Log 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - Opening extract D:\Pentaho Data Integration\Data Sources\OrdersSansDextract.tde 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Exception trying to close file: java.lang.NullPointerException 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - Error opening extract : com.tableausoftware.TableauException: network error 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Error initializing step [Tableau Data Extract Output] 2014/11/24 11:43:24 - csv2tdeordersans - Step [CSV file input.0] initialized flawlessly. 2014/11/24 11:43:24 - csv2tdeordersans - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Step [Tableau Data Extract Output.0] failed to initialize! 2014/11/24 11:43:24 - Tableau Data Extract Output.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Exception trying to close file: java.lang.NullPointerException 2014/11/24 11:43:24 - Spoon - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : csv2tdeordersans: preparing transformation execution failed 2014/11/24 11:43:24 - Spoon - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : org.pentaho.di.core.exception.KettleException: 2014/11/24 11:43:24 - Spoon - We failed to initialize at least one step. Execution can not begin! 2014/11/24 11:43:24 - Spoon - 2014/11/24 11:43:24 - Spoon - 2014/11/24 11:43:24 - Spoon - at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1149) 2014/11/24 11:43:24 - Spoon - at org.pentaho.di.ui.spoon.trans.TransGraph$27.run(TransGraph.java:3989) 2014/11/24 11:43:24 - Spoon - at java.lang.Thread.run(Unknown Source) 2014/11/24 11:43:24 - csv2tdeordersans - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Errors detected! 2014/11/24 11:43:25 - csv2tdeordersans - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Errors detected!

cdeptula commented 9 years ago

@tenderfeet Your error most likely indicates that the TDE output step either received no rows or more likely that you have a problem in your installation. Please make sure you followed the installation instructions in the readme. https://github.com/cdeptula/tdeoutputplugin

I am aware that I need to stop this null pointer exception from displaying; however, the null pointer exception is not the root cause of your problem.

cdeptula commented 9 years ago

Fixed in release 1.1.0