taraslayshchuk / es2csv

Export from an Elasticsearch into a CSV file
Apache License 2.0
511 stars 190 forks source link

Not able to fetch more than 1000 records #30

Closed sreejithps303 closed 7 years ago

sreejithps303 commented 7 years ago

Hi,

I am not able to export more than 10000 records. it is only exporting when m and s value is same. as "s" has max 10k . so it max export 10k records.

eduardofv commented 7 years ago

The -s parameter is for the "scroll size". That is, the size of the batch each request retrieves. If you set -s 10000 and leave out -m you should be able to export everything in the smallest number of requests.

eduardofv commented 7 years ago

BTW, if -m is zero it means it will retrieve everything, not zero results.

taraslayshchuk commented 7 years ago

Hello,

Please provide more information: OS, python version, es2csv version, elasticsearch version and run arguments.