search

imperva / incapsula-logs-downloader

A Python script for downloading log files from Incapsula
MIT License
30 stars 35 forks source link

Logs epoch start time is 1 week off in logs. #55

Closed browneyedleagh closed 1 year ago

browneyedleagh commented 1 year ago

I am able to download the logs with the scripts but the start time within the logs is 7 days off from when the log was downloaded.

start=1677849021959

this log was downloaded on 03/10/2013 at 10:20 am.

Imperva support says it is something with the script.

joeymoore commented 1 year ago

@browneyedleagh I believe that the timestamp is correct however the processing speed of the script it very far behind. I spent a ton of time working on the script and this new branch is glic however I have not documented the changes yet. The script has been tested in a live environment with very high log download rate and very high event rate being sent. If you want to use the glic branch and try with your existing settings, I can help you along the way where needed. Make sure to use the setting.config.template where all settings are needed however they don't all need to be populated. You can reach out to me directly at joe.moore@imperva.com

AaronSeibert commented 1 year ago

Processing and delays should be better in 3.0.0 based on @joeymoore's changes. glic branch has been merged to release-3.0.0-beta via #57, while the release has been stable for quite some time in the environments it is running in we'd like to extend testing to more environments.

joeymoore commented 1 year ago

This issue has been resolved in 3.0.0 https://github.com/imperva/incapsula-logs-downloader/tree/release-3.0.0-beta