search

Chicago / open-data-etl-utility-kit

Use Pentaho's open source data integration tool (Kettle) to create Extract-Transform-Load (ETL) processes to update a Socrata open data portal. Documentation is available at http://open-data-etl-utility-kit.readthedocs.io/en/stable
Other
95 stars 30 forks source link

Support log-analysis utilities on Windows #3

Closed tomschenkjr closed 8 years ago

tomschenkjr commented 9 years ago

This repository contains three Bash scripts that help ETL administrators analyze the contents of Kettle/Pentaho log files: (1) A_DatasetLogs.sh (2) A_ETLRuntimes.sh (3) A_Today.sh

These should be converted to support Windows environment, likely use .bat files with similar functionality.

lgwapnitsky commented 8 years ago

are you still looking for input on these? THis can be done using PowerShell very easily.

Thank you

levyj commented 8 years ago

Yes. Noting dependencies in the documentation would be helpful.

Thanks.

lgwapnitsky commented 8 years ago

can you provide samples of the data that will be enumerated?

lgwapnitsky commented 8 years ago

What types of files are these scripts run on? It would be good to have sample output on which to test.

Larry G. Wapnitsky

E: Larry@Wapnitsky.com

_Web: Larry.Wapnitsky.com http://Larry.Wapnitsky.comTwitter: @LGWapnitsky__PGP Public Key http://larry.wapnitsky.com/larry_wapnitsky_key.txt_

On Thu, Jul 30, 2015 at 6:05 PM, Tom Schenk Jr notifications@github.com wrote:

Sorry, didn't understand the question -- samples of the log files?

— Reply to this email directly or view it on GitHub https://github.com/Chicago/open-data-etl-utility-kit/issues/3#issuecomment-126506084 .

jefw commented 8 years ago

Chipping away at this one for you. Have first 3 of 4 done, will create a pull request when I finish the last.

jefw commented 8 years ago

Completed. Issued pull request for Issue 3.