While most functionality seems to work reasonably well on a small scale, more consideration needs to be put into storing/querying large amounts of data, including:
OpenSearch stability e.g. the containing crashing
In some cases, this may be an issue with database setup, rather than abcd interface
Poor performance when returning many results
Query/push timeouts (in some cases, such as large scale deletion, the instruction may complete despite throwing an exception)
Discussions have also included the use of caching, which can be controlled to some extent, but is also largely handled behind the scenes, as well as pagination, lazy loading etc, although in some cases that caused issues such as generating summary histograms, all the data may be required in memory simultaneously, so there may be no clear resolution.
While most functionality seems to work reasonably well on a small scale, more consideration needs to be put into storing/querying large amounts of data, including:
Discussions have also included the use of caching, which can be controlled to some extent, but is also largely handled behind the scenes, as well as pagination, lazy loading etc, although in some cases that caused issues such as generating summary histograms, all the data may be required in memory simultaneously, so there may be no clear resolution.