ezpaarse-project / ezpaarse

ezPAARSE can ingest your (proxy) log files and show how users access suscribed electronic ressources.
http://www.ezpaarse.org
Other
68 stars 26 forks source link

Add automation for downloading, processing, and sending logs to Ezmesure #173

Open polnum-Corte opened 2 months ago

polnum-Corte commented 2 months ago

This PR adds automation for downloading log files from an SFTP server, processing them with Ezpaarse, and sending the resulting CSV files to Ezmesure. The following changes are included: • Added index.js for downloading and processing log files. • Added toEzmesure.js for sending processed CSV files to Ezmesure.

tporquet commented 1 month ago

Thanks a lot for this PR that covers a usecase that is going to be more frequent! We've just had a look at it and we have a few comments and propositions, the main one being to move this functionality from the core ezpaarse repo to https://github.com/ezpaarse-project/ezpaarse-tools where we have other utilities.

Would you be available for a code review session in the coming weeks? Please tell us by sending some dates to us ezteam@couperin.org