search

gbif / gbif-api

GBIF API
Apache License 2.0
28 stars 5 forks source link

API analytics #46

Open fmendezh opened 4 years ago

fmendezh commented 4 years ago

It is estimated that the use of api.gbif.org has been increasing by specialized users and this situation deserves to be reported and analyzed in particular, perhaps as much as possible similar to how the use of the portal is tracked using Google Analytics.

In particular, we are interested in collecting basic metrics like:

There are existing solutions and services to manage, track and analyze APIs, however, such solutions are, in our case, unviable because of cost:

  1. https://aws.amazon.com/api-gateway/
  2. https://cloud.google.com/apigee/
  3. https://www.mulesoft.com/platform/api/anypoint-analytics
  4. https://www.ibm.com/dk-en/cloud/api-connect

Other solutions can be explored and extended to achieve similar results, for example:

  1. https://github.com/Netflix/zuul
  2. https://spring.io/projects/spring-cloud-gateway
  3. https://konghq.com/kong/
MattBlissett commented 4 years ago

Could we just look at the Varnish logs, with a traditional log analyser? That can do all three.

There are other reasons to investigate these API gateways, I think primarily better deployments and throttling, but it would be overkill just for analytics.