nestauk / dap_dv_backends

MIT License
0 stars 0 forks source link

Get total docs from bucket copy #193

Closed doogyb closed 1 year ago

doogyb commented 1 year ago

When we copy a bucket to an ES index, and immediately query the count endpoint on ES, it returns the wrong total. Probably because we are immediately asking it to count as its still indexing documents. We should instead compute the total during the process of copying the bucket over, as this will guarantee the correct total count.