bcgov / DBC-APIM

DataBC OPEN API Services
Apache License 2.0
1 stars 0 forks source link

Script - Time Series (WBC - PUB) #39

Closed BK01 closed 5 years ago

BK01 commented 7 years ago

Skills, description and deliverables - Same as Issue #9 with one difference --> Apply to the WorkBC API (DataBC to provide Elk details).

Metadata record: https://catalogue.data.gov.bc.ca/dataset/7c2bbc0c-70ac-4ca9-8670-d69ac3754c87

API console: https://catalogue.data.gov.bc.ca/dataset/workbc-job-posting-web-service/resource/9d8ee995-dd37-446c-9381-ca8f8d671486

Further details: https://www.workbc.ca/api

BK01 commented 7 years ago

If issue #9 is successful, email DataBC to acquire further details on WBC.

BK01 commented 7 years ago

Setup separate or second execute in same Jenkins job to hit the WorkBC jobs API.

DataBC to integrate into test plan for #9

BK01 commented 7 years ago

Will not work with #9 script. Need kong to turn on access logs and send to file location. New script needed for parse log files.

BK01 commented 7 years ago

@ll911 to re-configure logs (trim access logs every month). Then @BK01 to log manually from dashboard and send to API owner.

BK01 commented 7 years ago

Investigate scripting by extracting from a csv log. Will require login / auth or Jenkins.

BK01 commented 7 years ago

No longer possible as Kong/Cassandra log no longer includes virtual host in addition to an issue with parser.