search

layer5io / getnighthawk

Putting Nighthawk into the hands of many
https://getnighthawk.dev
Apache License 2.0
127 stars 116 forks source link

Test failures in Meshery v0.5.13 #115

Closed leecalcote closed 2 years ago

leecalcote commented 3 years ago

Description

Perf tests using Nighthawk fail.

Logs

meshery_1               | time="2021-05-19T21:10:02Z" level=info msg="attempting to save performance profile to remote provider"
meshery_1               | &{ID:<nil> Name:Extreme speeds (and feeds) LastRun: Schedule:<nil> LoadGenerators:[nighthawk] Endpoints:[https://www.google.com] ServiceMesh:open service mesh ConcurrentRequest:0 QPS:0 Duration:30s TotalResults:0 RequestHeaders: RequestCookies: RequestBody: ContentType: UpdatedAt:<nil> CreatedAt:<nil>}
meshery_1               | time="2021-05-19T21:10:02Z" level=info msg="performance profile successfully sent to remote provider: {\"id\":\"e43fb5eb-0a33-41e5-b913-73700b10c14f\",\"name\":\"Extreme speeds (and feeds)\",\"user_id\":\"5f841548-b984-4210-aa81-c007d63eccc1\",\"load_generators\":[\"nighthawk\"],\"endpoints\":[\"https://www.google.com\"],\"service_mesh\":\"open service mesh\",\"duration\":\"30s\",\"created_at\":\"2021-05-19T21:10:02.417086Z\",\"updated_at\":\"2021-05-19T21:10:02.417096Z\"}\n"
meshery_1               | time="2021-05-19T21:10:03Z" level=info msg="retrieved user: {mesheryio   http://pbs.twimg.com/profile_images/1189880475118133249/2dGcVjJp_normal.png}"
meshery_1               | time="2021-05-19T21:10:03Z" level=info msg="perf test with config: &{open service mesh_1621458603369  https://www.google.com 0 1 <nil> <nil> []  false 30s nighthawk 0    true 0 false  false 0s}"
meshery_1               | time="2021-05-19T21:10:03Z" level=info msg="Incoming object: operator-48dce85e-9820-4d12-908c-e497839c61b7.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery_1               | time="2021-05-19T21:10:04Z" level=info msg="starting test"
meshery_1               | time="2021-05-19T21:10:04Z" level=info msg="listening to test events"
meshery_1               | time="2021-05-19T21:10:04Z" level=error msg="error while transforming data: Response is nil from the generator"
meshery_1               | time="2021-05-19T21:10:04Z" level=error msg="error: unable to perform load test: error while transforming data: Response is nil from the generator"

Test configuration:

Screen Shot 2021-05-19 at 4 13 14 PM

Contributor Resources

leecalcote commented 3 years ago

Another failure in v0.5.25

Screen Shot 2021-06-21 at 9 43 47 PM 
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:11Z" level=info msg="retrieved user: {lcalcote   http://pbs.twimg.com/profile_images/880205475643441152/V_vhfnzb_normal.jpg}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:11Z" level=info msg="perf test with config: &{app mesh_1624329791521  http://www.google.com 10 10 <nil> <nil> [] application/json false 5s nighthawk 0    true 0 false  false 0s}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:12Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:12Z" level=info msg="starting test"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:12Z" level=info msg="listening to test events"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:14Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:15Z" level=info msg="attempting to publish results to remote provider"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:15Z" level=info msg="results successfully published to remote provider"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:15Z" level=info msg="Incoming object: docker-desktop, kind: Node" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:16Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:18Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:20Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:22Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:24Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:26Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:28Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:30Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:32Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=info msg="retrieved user: {lcalcote   http://pbs.twimg.com/profile_images/880205475643441152/V_vhfnzb_normal.jpg}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=info msg="perf test with config: &{app mesh_1624329791521  http://www.google.com 0 10 <nil> <nil> [] application/json false 15s nighthawk 0    true 0 false  false 0s}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=info msg="starting test"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=info msg="listening to test events"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=error msg="error while transforming data: Response is nil from the generator"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:33Z" level=error msg="error: unable to perform load test: error while transforming data: Response is nil from the generator"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:34Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:36Z" level=info msg="retrieved user: {lcalcote   http://pbs.twimg.com/profile_images/880205475643441152/V_vhfnzb_normal.jpg}"
meshery-786557679f-vdz7t    |   &{ID:18358dfc-a009-4c76-9ab9-dfef33224b3b Name:Nighthawk with content-type LastRun:<nil> Schedule:<nil> LoadGenerators:[nighthawk] Endpoints:[http://www.google.com] ServiceMesh:app mesh ConcurrentRequest:10 QPS:0 Duration:15s TotalResults:0 RequestHeaders: RequestCookies: RequestBody: ContentType:application/json UpdatedAt:<nil> CreatedAt:<nil>}
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:36Z" level=info msg="attempting to save performance profile to remote provider"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:36Z" level=info msg="performance profile successfully sent to remote provider: {\"id\":\"18358dfc-a009-4c76-9ab9-dfef33224b3b\",\"name\":\"Nighthawk with content-type\",\"user_id\":\"090e7114-509a-4046-81f1-9c5fb8daf724\",\"load_generators\":[\"nighthawk\"],\"endpoints\":[\"http://www.google.com\"],\"service_mesh\":\"app mesh\",\"concurrent_request\":10,\"duration\":\"15s\",\"last_run\":\"2021-06-22T02:43:15Z\",\"total_results\":43,\"content_type\":\"application/json\",\"created_at\":\"2021-06-15T19:39:58.365243Z\",\"updated_at\":\"2021-06-22T02:43:36.647712Z\"}\n"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:36Z" level=info msg="Incoming object: operator-15f70e8c-3918-41e8-bf95-109a5cf670af.meshery.layer5.io, kind: ConfigMap" app=meshery
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=info msg="retrieved user: {lcalcote   http://pbs.twimg.com/profile_images/880205475643441152/V_vhfnzb_normal.jpg}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=info msg="perf test with config: &{app mesh_1624329791521  http://www.google.com 0 10 <nil> <nil> [] application/json false 15s nighthawk 0    true 0 false  false 0s}"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=info msg="starting test"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=info msg="listening to test events"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=error msg="error while transforming data: Response is nil from the generator"
meshery-786557679f-vdz7t    |   time="2021-06-22T02:43:37Z" level=error msg="error: unable to perform load test: error while transforming data: Response is nil from the generator"
leecalcote commented 3 years ago

fixed?

leecalcote commented 3 years ago

HTTPS support is incomplete

leecalcote commented 3 years ago

@DelusionalOptimist is the HTTPS support still incomplete or should that be raised in another issue?