search

imperva / incapsula-logs-downloader

A Python script for downloading log files from Incapsula
MIT License
30 stars 35 forks source link

The downloaded log delay issue #48

Open cheunal opened 1 year ago

cheunal commented 1 year ago

Hello Team,

I have used logdownloader script which is available in GitHub but Script fetching older logs from the ncapsula.

We can still see in the log the log file is download and processing completed successfully, but when we open the log file , the logs inside is keep delay and we cannot fetch the latest log.

Any advise that we can enhance the performance?

G4fanhoto commented 1 year ago

Good morning, anyone facing log delay problems?

I have late logs ranging from 7 days

Hello @imperva Any solution ????

joeymoore commented 1 year ago

Hello @G4fanhoto , Can you elaborate on where the "late" logs are? Are delays from the logs API or are they sitting on your machine that is downloading the logs?

joeymoore commented 1 year ago

@G4fanhoto please let me know if this is still an issue. A new 3.0.0 release is available and resolves a lot of known issues. Please review the readme if planning to upgrade. https://github.com/imperva/incapsula-logs-downloader/tree/release-3.0.0-beta

G4fanhoto commented 1 year ago

@G4fanhoto please let me know if this is still an issue. A new 3.0.0 release is available and resolves a lot of known issues. Please review the readme if planning to upgrade. https://github.com/imperva/incapsula-logs-downloader/tree/release-3.0.0-beta

Good afternoon my friend, how are you ?

I still keep getting logs that are 7 days overdue. Is there any setting to adjust?

joeymoore commented 1 year ago

@G4fanhoto can you please confirm which version of the script you are using? 3.0 will have little to know delay in processing the logs. Logs in general will take 10-30mins to publish. Cheers

G4fanhoto commented 9 months ago

@G4fanhoto can you please confirm which version of the script you are using? 3.0 will have little to know delay in processing the logs. Logs in general will take 10-30mins to publish. Cheers

Good morning friend, how are you? Could you help me understand why my logs are always two days late?

G4fanhoto commented 9 months ago

Yes my version 3.0

joeymoore commented 9 months ago

@G4fanhoto, I can't find the script to be at fault here but can you send me the script log? Are you seeing any error messages? Try to see if there is an exogenous issue that we're not seeing. I also poked PM to look into this.

G4fanhoto commented 9 months ago

@joeymoore

Good afternoon, I noticed in the download logs that my file is in index (847), with a total index of 73769.

I notice that it is slow to download, due to the amount of logs that are arriving.

G4fanhoto commented 4 months ago

I still have delays in collections start=1708449963553