search

imperva / incapsula-logs-downloader

A Python script for downloading log files from Incapsula
MIT License
30 stars 35 forks source link

cyclic event recording #2

Closed NikolayQT closed 5 years ago

NikolayQT commented 5 years ago

Hello. There is a cyclic recording of the same events. Logs are significantly increased in size (200 MB per 1 hour). Why are old logs downloaded and how do I fix it?

2019-03-22 14:33:45,522 ERROR Could not find file https://ХХХХХХХХХХХ.com/XXXX_XXXXXXX/ХХХХ_48.log. Response code is 404 2019-03-22 14:33:45,524 INFO Could not get log file ХХХХ_48.log. It could be that the log file does not exist yet. 2019-03-22 14:33:45,589 INFO Failed to download file 10 times, trying to recover. 2019-03-22 14:33:45,589 INFO Downloading logs index file... 2019-03-22 14:33:46,130 INFO Successfully downloaded file from URL https://ХХХХХХХХХХХ.com/XXXX_XXXXXXX/logs.index 2019-03-22 14:33:46,131 ERROR Current downloaded file is not in the index file. This is probably due to a long delay in downloading. Attempting to recover 2019-03-22 14:33:46,131 INFO No last downloaded file is found - downloading index file and starting to download all the log files in it 2019-03-22 14:33:46,131 INFO Downloading logs index file... 2019-03-22 14:33:46,395 INFO Successfully downloaded file from URL https://ХХХХХХХХХХХ.com/XXXX_XXXXXXX/logs.index 2019-03-22 14:33:46,395 INFO No last index found, will now scan the entire index. 2019-03-22 14:33:47,045 INFO Successfully downloaded file from URL https://ХХХХХХХХХХХ.com/XXXX_XXXXXXX/ХХХХ_1.log

OmerLitov commented 5 years ago

Hi, a fix was merged, please update your script