fmadio / pcap2json

High Speed PCAP to JSON conversion utility
Other
97 stars 21 forks source link

HTTP ES Push error checks #5

Closed fmadio closed 5 years ago

fmadio commented 5 years ago

HTTP ES push need to be concerend with

1) lack of output disk space for temporary files

2) correctly handle retry push in the case ES rejects the upload

fmadio commented 5 years ago

now recvs the full ES replay data. Output worker threads spent most of their time waiting for the ES. its ok because can oversubscribe x2 or x4 the threads to CPU for this.