codelibs / elasticsearch-dataformat

Excel/CSV/BulkJSON downloads on Elasticsearch.
Apache License 2.0
145 stars 36 forks source link

Only first 100 results are downloaded (instead of full download) #60

Open fbaligand opened 4 years ago

fbaligand commented 4 years ago

Hi,

I just tested the plugin, without setting "from" or "size" options, but I get only the first 100 hits. As documentation says, I expected a full data download.

I do this GET query: curl "http://localhost:9200/my-index/_data?format=csv"

I tested elasticsearch-dataformat version 7.9.0.

fbaligand commented 3 years ago

When I tell "as documentation says", I speak about this sentence in README:

This plugin allows you to download data as a format you want. If the query dsl contains "from" parameter, the query is processed as search query. If not, it's as scan query(all data are stored.).

Is there a special param to indicate that I want a full download?

fbaligand commented 3 years ago

Hi,

I finally found how to generate a full download: add scroll=1m parameter.

I find it only after having read plugin's code. I think a line about this feature in the documentation would be nice.

martinszy commented 2 years ago

This bug is still open and this solution is still valid.