✨ added a statistics endpoint that talks to ES directly

jgnieuwhof commented 6 years ago

alright so here's a crack at some public statistics for the KF public website. driven hardcoded-config so it should be relatively easy to change in the future.

a few unfortunate things:

we now need to specify the underlying ES index & type in kf-arranger env vars
arranger middleware doesn't support the cardinality agg, so we have to count buckets (kf-portal-ui is doing this now as well, needs to be addressed)
it's one more point of failure when there's a data model shape change

@andricDu - you'd mentioned putting varnish in front of the server. would that be more of an ops thing handled by kf-arranger deployment strategy?

andricDu commented 6 years ago

@jgnieuwhof it would be an ops thing for sure as it would be wired up to bust the cache on ETL runs or arranger updates.

andricDu commented 6 years ago

@jgnieuwhof once conflict is resolved we can merge.

kids-first / kf-arranger

✨ added a statistics endpoint that talks to ES directly #43