search

githubbob42 / mingle2github2

0 stars 1 forks source link

Add metrics for the Background Upload #5445

Open githubbob42 opened 6 years ago

githubbob42 commented 6 years ago

Mingle Card: 5806 Description

We need to track information in librato and mixpanel related to successful and failed upload events.

One metric to consider would be the client sentEvents.  A large number of events in this backlog could be an excellent indicator to admins of problems.

Acceptance Criteria

  1. FxLogs should indicate the age of the oldest error in days.  This can be used by our technical support to identify orgs with upload issues.
  2. FxLogs should list out the first upload error in each error chain.
  3. There should be success vs fail measure, which assumes a series of failures has a single leading cause.  These counts would occasionally be sent by mobile through a route specified in the server.
  4. A count of the leading errors from #2 above.   This would be used for cataloging errors for diagnostic purposes.

Analysis

The sent messages could be added to the current download statistics for fxlogs.

Method for calculating success vs fail event counts:

  1. Every time an event is applied.  Increment one of two counters.
  2. The success counter increments every time an event is successfully applied.
  3. An error counter is incremented if the previous event is not errored.
  4. When the error counter is incremented, record and errors type.
  5. Only upload errors during a download sync for fxlogs and librato.

Related Stories

Tasks

{{ table query: SELECT Number, Name, Owner, 'Task Status' WHERE Type = Task and Story = THIS CARD ORDER BY Status }}

Defects

{{ table query: SELECT Number, Name, Owner, 'Status' WHERE Type = Defect and 'Related Story' = THIS CARD }}

Test Plan

alpine-server  dpitre / 5806_upload_metrics#268 https://github.com/dpitre/alpine-server

alpine-mobile: dpitre / 5806_bgsync_metrics  #2799 https://github.com/dpitre/alpine-mobile

Initial Test Result: Reject 

PR: 2799

User: lanrefield@seven.com  /  lastpass

Hardware: Dell XPS PC, IPAD Pro.

OS: Windows 10 & IOS 11

Browser: Chrome & Safari 

https://dev.fieldfx.com

https://fxqa6.herokuapp.com/dashboard/sync

Test Notes:  I am not able to fully verify this card. When i build the alpine packages and login to mobile i still get  4.0.1.3353  instead of 4.0.1.br1354.  

FXQA6 sandbox gives me 4.0.1.br1354 but i am not able to view Fxlogs or Librato.

.

Secondary Test Result: Reject

PR: Fieldfx version: 4.0.1.4104

User: lanrefield@seven.com  /  lastpass

Hardware: Dell XPS PC, IPAD Pro.

OS: Windows 10 & IOS 11

Browser: Chrome & Safari 

Test Notes: Yusuke and i could not see any metrics in Librato listing sync success vs failures.

We could only see the success rate percentage drop but there where no other details.

Mingle card #5919 has been created to handle the FX logs acceptance criteria above 

githubbob42 commented 6 years ago

Feature: #5294 Background Sync (Mingle)

githubbob42 commented 6 years ago

Lanre : 07/20/2018 07:33 CDT I could not see any metrics in Librato listing sync success vs failures.

githubbob42 commented 6 years ago

Lanre : 07/10/2018 11:01 CDT I am not able to fully verify this card. When i build the alpine packages and login to mobile i still get 4.0.1.3353 instead of 4.0.1.br1354.

githubbob42 commented 6 years ago

Lanre : 07/06/2018 10:39 CDT Yusuke needs to dig into the acceptance criteria.

githubbob42 commented 6 years ago

Pull Request #2799