elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.48k stars 8.04k forks source link

[test-failed]: Chrome UI Functional Tests1.test/functional/apps/home/_newsfeed·ts - homepage app Newsfeed shows all news from newsfeed #92304

Closed liza-mae closed 3 years ago

liza-mae commented 3 years ago

Version: 7.12.0 Class: Chrome UI Functional Tests1.test/functional/apps/home/_newsfeed·ts Stack Trace:

Error: expected [ '16 February 2021\n7.11\nElastic 7.11 released\nElastic 7.11 brings the GA of searchable snapshots and the beta of schema on read as well as additional enhancements across Elastic Enterprise Search, Observability, and Security.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Elasticsearch 7.11\nThe flexibility and savings of schema on read joins the blazing speed of schema on write.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Kibana 7.11\nAnnouncing the general availability of alerting for the Elastic Stack. Plus, enhancements for Maps, Lens, and machine learning along with the introduction of tagging.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Elastic Enterprise Search 7.11\nMake easy work of indexing your web content with the new web crawler in App Search. And Box joins the collection of prebuilt Workplace Search content source integrations.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Elastic Observability 7.11\nNew views in the APM and Metrics UIs accelerate investigative workflows. ECS logging libraries enable log-to-trace correlation for streamlined analysis.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Elastic Security 7.11\nElastic Security 7.11 delivers prebuilt ML jobs and detection rules for cloud apps and hosts, streamlined SecOps workflows, and enhanced usability and accessibility.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Logstash 7.11\nLogstash 7.11 has arrived with user experience improvements to centralized pipeline management.\nRead the blog',
  '16 February 2021\n7.11\nWhat’s new in Elastic Cloud for 7.11\nIntroducing new features that help increase savings or add storage at no extra cost. Plus, you can now search and replicate across regions and cloud providers.\nRead the blog' ] to sort of equal [ '21 June 2019\nYou are functionally testing the newsfeed widget with fixtures!\nSee test/common/fixtures/plugins/newsfeed/newsfeed_simulation\nGeneric feed-viewer could go here',
  '21 June 2019\nStaging too!\nHello world\nGeneric feed-viewer could go here' ]
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/functional/apps/home/_newsfeed.ts:42:28)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at Object.apply (packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: '[\n' +
    '  "16 February 2021\\n7.11\\nElastic 7.11 released\\nElastic 7.11 brings the GA of searchable snapshots and the beta of schema on read as well as additional enhancements across Elastic Enterprise Search, Observability, and Security.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Elasticsearch 7.11\\nThe flexibility and savings of schema on read joins the blazing speed of schema on write.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Kibana 7.11\\nAnnouncing the general availability of alerting for the Elastic Stack. Plus, enhancements for Maps, Lens, and machine learning along with the introduction of tagging.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Elastic Enterprise Search 7.11\\nMake easy work of indexing your web content with the new web crawler in App Search. And Box joins the collection of prebuilt Workplace Search content source integrations.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Elastic Observability 7.11\\nNew views in the APM and Metrics UIs accelerate investigative workflows. ECS logging libraries enable log-to-trace correlation for streamlined analysis.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Elastic Security 7.11\\nElastic Security 7.11 delivers prebuilt ML jobs and detection rules for cloud apps and hosts, streamlined SecOps workflows, and enhanced usability and accessibility.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Logstash 7.11\\nLogstash 7.11 has arrived with user experience improvements to centralized pipeline management.\\nRead the blog"\n' +
    '  "16 February 2021\\n7.11\\nWhat’s new in Elastic Cloud for 7.11\\nIntroducing new features that help increase savings or add storage at no extra cost. Plus, you can now search and replicate across regions and cloud providers.\\nRead the blog"\n' +
    ']',
  expected: '[\n' +
    '  "21 June 2019\\nYou are functionally testing the newsfeed widget with fixtures!\\nSee test/common/fixtures/plugins/newsfeed/newsfeed_simulation\\nGeneric feed-viewer could go here"\n' +
    '  "21 June 2019\\nStaging too!\\nHello world\\nGeneric feed-viewer could go here"\n' +
    ']',
  showDiff: true
}

Other test failures:

Test Report: https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-kibana-tests/1375/testReport/

elasticmachine commented 3 years ago

Pinging @elastic/kibana-telemetry (Team:KibanaTelemetry)

afharo commented 3 years ago

@liza-mae this error looks like we are actually hitting the production newsfeed endpoint instead of the one intentionally injected for the tests.

We recently had to rename the id for that plugin (although not its path). This is the related PR: #90752

Do we need to change something for those tests on Cloud?

liza-mae commented 3 years ago

Version: 7.12.1 Class: Chrome UI Functional Tests1.test/functional/apps/home/_newsfeed·ts Stack Trace:

Error: expected [ '13 April 2021\nHow to map custom boundaries in Kibana with reverse geocoding\nTired of map boundaries such as zip and area codes? Now you can easily create maps in Kibana with the GeoIP processor in Elasticsearch.\nRead the blog',
  '13 April 2021\n7.12\nGetting started with runtime fields\nIntroducing runtime fields, Elastic’s implementation of schema on read. Now you can use either schema on write for performance or schema on read for flexibility.\nRead the blog',
  '06 April 2021\n7.12\nDirectly search S3 with the new frozen tier\nIntroducing in 7.12 the technical preview of the frozen tier, a feature that allows you to search object stores like S3 directly.\nLearn more in our blog',
  '06 April 2021\n7.12\nWhat’s new in Logstash 7.12\nLogstash 7.12.0 has arrived with updates to our ECS journey, ARM support, and JDK 15 support.\nLearn more in our blog',
  '23 March 2021\n7.12\nElastic 7.12 released\nElastic 7.12 brings flexibility and speed with schema on read, fully searchable object stores with the new frozen tier, and automatically scaling deployments on Elastic Cloud.\nLearn more in our blog',
  '23 March 2021\n7.12\nElasticsearch 7.12 released\nElasticsearch 7.12 introduces the general availability of runtime fields as well as the frozen tier in technical preview.\nLearn more in our blog',
  '23 March 2021\n7.12\nKibana 7.12 released\nSave and manage long-running search sessions in the background plus put your geospational data to work with location-based alerts (now generally available).\nLearn more in our blog',
  '23 March 2021\n7.12\nElastic Cloud updates for 7.12\nElastic Cloud announces the general availability of autoscaling as well as enhancements to help you manage your subscription, simplify data management, and more.\nLearn more in our blog',
  '23 March 2021\n7.12\nElastic Enterprise Search 7.12 released\n7.12 features data structure optimization, allowing for reduced deployment sizes and faster indexing. Plus continued innovation for the new Elastic web crawler and autoscaling.\nLearn more in our blog',
  '23 March 2021\n7.12\nElastic Observability 7.12 released\nElastic Observability 7.12 introduces APM correlations to spot root causes, ARM support in Beats, and native OpenTelemetry support for logs and metrics.\nLearn more in our blog',
  '23 March 2021\n7.12\nElastic Security 7.12 released\nElastic Security 7.12 arms practitioners with analyst-driven correlation, behavioral ransomware prevention, and more.\nLearn more in our blog' ] to sort of equal [ '21 June 2019\nYou are functionally testing the newsfeed widget with fixtures!\nSee test/common/fixtures/plugins/newsfeed/newsfeed_simulation\nGeneric feed-viewer could go here',
  '21 June 2019\nStaging too!\nHello world\nGeneric feed-viewer could go here' ]
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/functional/apps/home/_newsfeed.ts:42:28)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at Object.apply (packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: '[\n' +
    '  "13 April 2021\\nHow to map custom boundaries in Kibana with reverse geocoding\\nTired of map boundaries such as zip and area codes? Now you can easily create maps in Kibana with the GeoIP processor in Elasticsearch.\\nRead the blog"\n' +
    '  "13 April 2021\\n7.12\\nGetting started with runtime fields\\nIntroducing runtime fields, Elastic’s implementation of schema on read. Now you can use either schema on write for performance or schema on read for flexibility.\\nRead the blog"\n' +
    '  "06 April 2021\\n7.12\\nDirectly search S3 with the new frozen tier\\nIntroducing in 7.12 the technical preview of the frozen tier, a feature that allows you to search object stores like S3 directly.\\nLearn more in our blog"\n' +
    '  "06 April 2021\\n7.12\\nWhat’s new in Logstash 7.12\\nLogstash 7.12.0 has arrived with updates to our ECS journey, ARM support, and JDK 15 support.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElastic 7.12 released\\nElastic 7.12 brings flexibility and speed with schema on read, fully searchable object stores with the new frozen tier, and automatically scaling deployments on Elastic Cloud.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElasticsearch 7.12 released\\nElasticsearch 7.12 introduces the general availability of runtime fields as well as the frozen tier in technical preview.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nKibana 7.12 released\\nSave and manage long-running search sessions in the background plus put your geospational data to work with location-based alerts (now generally available).\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElastic Cloud updates for 7.12\\nElastic Cloud announces the general availability of autoscaling as well as enhancements to help you manage your subscription, simplify data management, and more.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElastic Enterprise Search 7.12 released\\n7.12 features data structure optimization, allowing for reduced deployment sizes and faster indexing. Plus continued innovation for the new Elastic web crawler and autoscaling.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElastic Observability 7.12 released\\nElastic Observability 7.12 introduces APM correlations to spot root causes, ARM support in Beats, and native OpenTelemetry support for logs and metrics.\\nLearn more in our blog"\n' +
    '  "23 March 2021\\n7.12\\nElastic Security 7.12 released\\nElastic Security 7.12 arms practitioners with analyst-driven correlation, behavioral ransomware prevention, and more.\\nLearn more in our blog"\n' +
    ']',
  expected: '[\n' +
    '  "21 June 2019\\nYou are functionally testing the newsfeed widget with fixtures!\\nSee test/common/fixtures/plugins/newsfeed/newsfeed_simulation\\nGeneric feed-viewer could go here"\n' +
    '  "21 June 2019\\nStaging too!\\nHello world\\nGeneric feed-viewer could go here"\n' +
    ']',
  showDiff: true
}

Other test failures:

Test Report: https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-kibana-tests/1653/testReport/

afharo commented 3 years ago

It might be solved with this PR: https://github.com/elastic/elastic-stack-testing/pull/856

elasticmachine commented 3 years ago

Pinging @elastic/kibana-core (Team:Core)

afharo commented 3 years ago

The PR https://github.com/elastic/elastic-stack-testing/pull/856 has been merged. Closing this issue. Feel free to reopen if any additional action is required.