Open levyj opened 8 years ago
malindac
commented
8 years ago I have updated the plugin to display the full logging details of the DataSync job that runs. Capturing the result for use further into the transformation will take some additional effort, but I believe it could be done. If you have a chance to download the latest SocrataPlugin.zip file and let me know what you think, that would be very helpful!
Thanks, Malinda
levyj
commented
8 years ago Where can I get it? https://github.com/socrata/socrata-kettle/releases still shows the 10/2015 release.
Thanks.
Jon
From: Malinda Curtis [mailto:notifications@github.com] Sent: Wednesday, April 13, 2016 4:19 PM To: socrata/socrata-kettle socrata-kettle@noreply.github.com Cc: Levy, Jonathan Jonathan.Levy@cityofchicago.org Subject: Re: [socrata/socrata-kettle] Give more feedback about results (#4)
I have updated the plugin to display the full logging details of the DataSync job that runs. Capturing the result for use further into the transformation will take some additional effort, but I believe it could be done. If you have a chance to download the latest SocrataPlugin.zip file and let me know what you think, that would be very helpful!
Thanks, Malinda
— You are receiving this because you authored the thread. Reply to this email directly or view it on GitHubhttps://github.com/socrata/socrata-kettle/issues/4#issuecomment-209651054
This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.
levyj
commented
8 years ago Hi Malinda,
I remembered this on Friday. I am happy to take a look at the latest plugin. Where can I get it?
Thank you.
Jon
Jonathan Levy Open Data Program Manager (312) 744-2790 jonathan.levy@cityofchicago.org data.cityofchicago.org @JonOpenData
-----Original Message----- From: Levy, Jonathan [Jonathan.Levy@cityofchicago.org] Received: Friday, 15 Apr 2016, 3:53PM To: socrata/socrata-kettle [reply@reply.github.com] Subject: RE: [socrata/socrata-kettle] Give more feedback about results (#4)
Where can I get it? https://github.com/socrata/socrata-kettle/releases still shows the 10/2015 release.
Thanks.
Jon
From: Malinda Curtis [mailto:notifications@github.com] Sent: Wednesday, April 13, 2016 4:19 PM To: socrata/socrata-kettle socrata-kettle@noreply.github.com Cc: Levy, Jonathan Jonathan.Levy@cityofchicago.org Subject: Re: [socrata/socrata-kettle] Give more feedback about results (#4)
I have updated the plugin to display the full logging details of the DataSync job that runs. Capturing the result for use further into the transformation will take some additional effort, but I believe it could be done. If you have a chance to download the latest SocrataPlugin.zip file and let me know what you think, that would be very helpful!
Thanks, Malinda
You are receiving this because you authored the thread. Reply to this email directly or view it on GitHubhttps://github.com/socrata/socrata-kettle/issues/4#issuecomment-209651054
It would be nice to get more feedback about the results of the Socrata Output step. On failure, the reason is in the Kettle Log, which is not terrible but can be a bit hidden, given the verbose nature of Java errors.
On success, one gets Job Status: SUCCESS in the Log. Again, this is not terrible and one often does not need to know a lot more.
However, since DataSync does return a bit more detail in both cases, it would be nice to send it to the log and/or make it available in the stream for further use. For example, the "Execute a process" step, which we use for our home-grown Data Sync execution, allows for capture of Result, Error, and Exit Value into the stream for further processing.