NationalSecurityAgency / datawave

DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.
https://code.nsa.gov/datawave
Apache License 2.0
563 stars 244 forks source link

Create result postprocessors for things like groupby, unique query #2384

Open jwomeara opened 6 months ago

jwomeara commented 6 months ago

for the query microservices, multiple query services might respond to subsequent next requests for a query. because of that, we need to collate all of the result pages into a single page for things like groupby queries. a postprocessor should be implemented to take care of that.

ivakegg commented 3 months ago

Created WIP PRs for post processor work (pending getting mostRecentUnique back in) https://github.com/NationalSecurityAgency/datawave-query-service/pull/8 https://github.com/NationalSecurityAgency/datawave-query-executor-service/pull/8 https://github.com/NationalSecurityAgency/datawave-spring-boot-starter-query/pull/6 https://github.com/NationalSecurityAgency/datawave/pull/2466