katalon-studio / katalon-testops

Manage automation results, like you test it manually
https://www.katalon.com/testops/
12 stars 16 forks source link

[Bug] Run never ending whereas all Test case are done #137

Open Rreveau opened 3 years ago

Rreveau commented 3 years ago

Sometimes on testops runs look like still running whereas as all test are finished.

Steps to Reproduce: No step to reproduce as it happens randomly.

Expected behavior: All Runs end.

Screenshots: https://analytics.katalon.com/team/41265/project/53048/executions/2503 https://analytics.katalon.com/team/41265/project/53048/executions/2420 https://analytics.katalon.com/team/41265/project/53048/executions/2714 https://analytics.katalon.com/team/41265/project/53048/executions/3627 https://analytics.katalon.com/team/41265/project/53048/executions/3719

image image-2020-06-03-09-37-26-390 image-2020-06-03-09-39-41-670

thongmgnguyen commented 3 years ago

@Rreveau, We checked in the database. The report files of these executions weren't uploaded to TestOps. It could be some broken in-network when uploading files.

Rreveau commented 3 years ago

Hello, Thank you for your answer. We just checked about this more deeply, and please check this :

Katalon TestOps: Unexpected response, URL: https://katalon-test.s3-accelerate.amazonaws.com/08e76809-580c-4d24-99e7-03d811067354?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20201103T220431Z&X-Amz-SignedHeaders=host&X-Amz-Expires=3600&X-Amz-Credential=AKIAIXB3N7Z3SQHJU4MQ%2F20201103%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=20d3046156c388ea89a9532a7d3a0ba3089d2408e3aab1f7f12cd3d2679d8308, Status: 500, Response: <?xml version="1.0" encoding="UTF-8"?>

InternalErrorWe encountered an internal error. Please try again.ASBKEY6X3K0T1T2J7UiWo2QxrmNY3bGRMXp9VmU3nLUOCYU0yxAVp6jH9ihDq/EN556BTLEc6vPSVeC20W1gCO25kyQ=

System is unable to send report to Katalon TestOps. Reason: com.kms.katalon.integration.analytics.exceptions.AnalyticsApiExeception: <?xml version="1.0" encoding="UTF-8"?>

InternalErrorWe encountered an internal error. Please try again.ASBKEY6X3K0T1T2J7UiWo2QxrmNY3bGRMXp9VmU3nLUOCYU0yxAVp6jH9ihDq/EN556BTLEc6vPSVeC20W1gCO25kyQ=
at com.kms.katalon.integration.analytics.providers.AnalyticsApiProvider.executeRequest(AnalyticsApiProvider.java:523)
at com.kms.katalon.integration.analytics.providers.AnalyticsApiProvider.executeRequest(AnalyticsApiProvider.java:533)
at com.kms.katalon.integration.analytics.providers.AnalyticsApiProvider.uploadFile(AnalyticsApiProvider.java:373)
at com.kms.katalon.integration.analytics.report.AnalyticsReportService.perform(AnalyticsReportService.java:136)
at com.kms.katalon.integration.analytics.report.AnalyticsReportService.uploadReports(AnalyticsReportService.java:73)
at com.kms.katalon.integration.analytics.report.AnalyticsReportService.upload(AnalyticsReportService.java:58)
at com.kms.katalon.integration.analytics.report.AnalyticsReportIntegration.uploadTestSuiteResult(AnalyticsReportIntegration.java:48)
at com.kms.katalon.execution.launcher.ReportableLauncher.uploadReportToIntegratingProduct(ReportableLauncher.java:350)
at com.kms.katalon.execution.launcher.ReportableLauncher.preExecutionComplete(ReportableLauncher.java:129)
at com.kms.katalon.execution.launcher.ProcessLauncher.onWatchdogComplete(ProcessLauncher.java:194)
at com.kms.katalon.execution.launcher.LaunchWatchdog.notifyProcessTerminated(LaunchWatchdog.java:136)
at com.kms.katalon.execution.launcher.LaunchWatchdog.run(LaunchWatchdog.java:66)
at java.lang.Thread.run(Thread.java:748)

09:40 -> Status: 500, Response: <?xml version="1.0" encoding="UTF-8"?>

InternalErrorWe encountered an internal error. Please try again. It seems that your WS return an error 500, as your WS seems not available sometimes. Could you check and confirm please ? And do you know how to solve that ?
thongmgnguyen commented 3 years ago

@Rreveau, The amazon S3 upload file service is sometimes unstable. We are working on it and will release a fixed version in Katalon Studio soon.

ghost commented 3 years ago

Hi, I've been attempting to get an update on this issue and came across 4 similar issues. All the other issues don't have a recent update either. At the risk of spamming each bug with these details, I'm going to mention the similar bugs in hopes of getting an update on this issue and maybe merging this issue into one. Lastly, the common thread in this problem is that it doesn't always fail. Issue 137 states there is an issue with the API upload using AWS and the response was error code 500.

My goal is to get an update please. Ty!

https://github.com/katalon-studio/katalon-testops/issues/80 https://github.com/katalon-studio/katalon-testops/issues/108 https://github.com/katalon-studio/katalon-testops/issues/137 https://github.com/katalon-studio/katalon-testops/issues/144

ghost commented 3 years ago

FYI to those interested or following this issue

ghost commented 3 years ago

Hi all,

KS 8.0.5 has fixed two issues with report upload. 1) Special characters causing null pointer exception 2) Loading reports into TestOps. It seems to work for me but I would be interested to know if you still have issues.

~Jim