search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.79k stars 8.19k forks source link

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/slos/fetch_historical_summary·ts - SLO API Tests fetch historical summary computes the historical summary for a rolling occurrences SLO #183750

Open kibanamachine opened 5 months ago

kibanamachine commented 5 months ago

A test failed on a tracked branch

Error: expected [ { date: '2024-05-10T00:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T01:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T02:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T03:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T04:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T05:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T06:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T07:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T08:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T09:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T10:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T11:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T12:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T13:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T14:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T15:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T16:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T17:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T18:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T19:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T20:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T21:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T22:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T23:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T00:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T01:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T02:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T03:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T04:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T05:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T06:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T07:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T08:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T09:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T10:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T11:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T12:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T13:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T14:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T15:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T16:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T17:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T18:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sli
[report_failure] output truncated to 8192 characters

First failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

delanni commented 5 months ago

/skip

kibanamachine commented 5 months ago

Skipped

main: 8f9c4ab4277c0745d1185733fe1791d09dbacdba

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

elasticmachine commented 5 months ago

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kibanamachine commented 5 months ago

New failure: kibana-on-merge - main

kdelemme commented 1 week ago

@jasonrhodes I'm in favour of removing this integration test since the API output is difficult to predict.

jasonrhodes commented 1 week ago

@jasonrhodes I'm in favour of removing this integration test since the API output is difficult to predict.

Fine by me. Are we testing this functionality in any other way, or is it just not possible to test this reliably at all, in your opinion?

kdelemme commented 1 week ago

We have some unit tests heavily relying on mocks