Elasticsearch - Githubissues

bcgov / DBC-APIM

DataBC OPEN API Services

Apache License 2.0

1 stars 0 forks source link

Elasticsearch #83

Closed BK01 closed 6 years ago

BK01 commented 6 years ago

Existing analytics software is no longer used for the API Gateway. DataBC needs to acquire the following metrics.

Total hits per month

For the following APIs

Gated Geocoder
BC Route Planner
WorkBC job postings

If possible:

Also, record results to a csv file

Proposed tech: Elasticsearch Location of active December logs: To discuss in mtg Additional metrics: Can be added in a future issue.

Approach: Parse raw access log file (Nginx). Process with Logstash and inject into Elasticsearch.

BK01 commented 6 years ago

Storage is required first (3-4 months). Interim, need to parse raw access log file (Nginx). Need to process with Logstash and inject into Elasticsearch. DataBC to provide Brock a sample log.

BK01 commented 6 years ago

@banders To discuss when you are available

BK01 commented 6 years ago

Out-of-the-box implementation did not meet requirements and was unable to interpret WorkBC logs. This test has been completed and shut down.

BK01 commented 6 years ago