Support for Asynchronous Search

[Bukhtawar]

Overview

Occasionally business would like to run queries on vast amount of data that can take very long to return results.

Asynchronous search makes it possible for users to run such queries without worrying about the query timing out. These queries run in the background, and users can track the progress, and retrieve results as they become available.

The asynchronous search API let you asynchronously execute a search request, monitor its progress, and retrieve partial results as they become available.

Key User Stories

• [x] As a business user, I am looking to find information quickly even if result set is not complete.
• [x] As a business user, I want to get more results for my search as soon as they are available until I have the complete result set.
• [x] As a business user, I want to be able to retrieve my results of a search at a later time.
• [ ] As a business user, I want to retrieve my top 10 (top n) results for a search query in real time, while the full search results can be filled in later

RFC for asynchronous search :

RFC Asynchronous Search with Elasticsearch.pdf

[Bukhtawar]

Repo link : https://github.com/opendistro-for-elasticsearch/asynchronous-search/

[massimolauri]

This is my workaround for my use case:

create action group: curl -XPUT "https://elasticsearch-host:9200/_opendistro/_security/api/actiongroups/async_fix_action_group" -H 'Content-Type: application/json' -d'{ "allowed_actions": [ "indices:data/read/async_search/submit", "indices:data/read/async_search/submit", "indices:data/read/async_search/delete", "indices:data/read/async_search/delete", "indices:data/read/async_search/get", "indices:data/read/async_search/get*" ]}'

Add to role action group.