SeleniumHQ / selenium

A browser automation framework and ecosystem.
https://selenium.dev
Apache License 2.0
30.41k stars 8.15k forks source link

[dotnet][rb][java][js][py] Automated Browser Version Update #14044

Closed selenium-ci closed 4 months ago

selenium-ci commented 4 months ago

User description

This is an automated pull request to update pinned browsers and drivers

Merge after verify the new browser versions properly passing the tests and no bugs need to be filed


PR Type

enhancement, configuration changes


Description


Changes walkthrough ๐Ÿ“

Relevant files
Configuration changes
repositories.bzl
Update pinned Firefox beta versions for Linux and Mac       

common/repositories.bzl
  • Updated the URL and SHA256 for the Linux beta Firefox version from
    127.0b6 to 127.0b7.
  • Updated the URL and SHA256 for the Mac beta Firefox version from
    127.0b6 to 127.0b7.
  • +4/-4     

    ๐Ÿ’ก PR-Agent usage: Comment /help on the PR to get a list of all available PR-Agent tools and their descriptions

    codiumai-pr-agent-pro[bot] commented 4 months ago

    PR Review ๐Ÿ”

    โฑ๏ธ Estimated effort to review [1-5] 2, because the changes are straightforward and limited to updating URLs and checksums for browser versions. The scope is narrow and the changes are clear, making it relatively easy to review.
    ๐Ÿงช Relevant tests No
    โšก Possible issues No
    ๐Ÿ”’ Security concerns No
    codiumai-pr-agent-pro[bot] commented 4 months ago

    PR Code Suggestions โœจ

    CategorySuggestion                                                                                                                                    Score
    Maintainability
    Add a comment to indicate that the url and sha256 values are automatically updated ___ **Consider adding a comment above the url and sha256 lines to indicate that these values are
    automatically updated. This will help future maintainers understand that these values are
    managed by an automated process and should not be manually altered.** [common/repositories.bzl [53-54]](https://github.com/SeleniumHQ/selenium/pull/14044/files#diff-25d82cd18102fed27d3202000e1f1b3a56a85ad2848236d91989cd30a3952401R53-R54) ```diff +# Automatically updated by script url = "https://ftp.mozilla.org/pub/firefox/releases/127.0b7/linux-x86_64/en-US/firefox-127.0b7.tar.bz2", sha256 = "ed1f4dce356345f16809aad3f05cc0157be79d6022cd1913f194f403d2f7b6b8", ```
    Suggestion importance[1-10]: 7 Why: Adding a comment for automated updates is a good practice for maintainability and clarity for future maintainers. The suggestion correctly identifies the new code lines and proposes a useful comment.
    7
    Best practice
    Add a trailing comma after the sha256 line for consistency ___ **To ensure consistency and avoid potential issues with line endings, consider adding a
    trailing comma after the sha256 line.** [common/repositories.bzl [54]](https://github.com/SeleniumHQ/selenium/pull/14044/files#diff-25d82cd18102fed27d3202000e1f1b3a56a85ad2848236d91989cd30a3952401R54-R54) ```diff -sha256 = "ed1f4dce356345f16809aad3f05cc0157be79d6022cd1913f194f403d2f7b6b8" +sha256 = "ed1f4dce356345f16809aad3f05cc0157be79d6022cd1913f194f403d2f7b6b8", ```
    Suggestion importance[1-10]: 5 Why: While adding a trailing comma is a minor style improvement that can help in maintaining consistency, it's not crucial or impactful on the functionality or readability of the code. The suggestion correctly targets the new code line.
    5
    codiumai-pr-agent-pro[bot] commented 4 months ago

    CI Failure Feedback ๐Ÿง

    (Checks updated until commit https://github.com/SeleniumHQ/selenium/commit/41cb8c803e4f797f8ff93aa3e3ebf592a4c3c5ba)

    **Action:** Ruby / Remote Tests (safari, macos) / Remote Tests (safari, macos)
    **Failed stage:** [Run Bazel](https://github.com/SeleniumHQ/selenium/actions/runs/9261718991/job/25477710242) [โŒ]
    **Failed test name:** Selenium::WebDriver::Window can minimize the window
    **Failure summary:** The action failed because the test Selenium::WebDriver::Window can minimize the window failed. The
    test failure was due to a Selenium::WebDriver::Error::TimeoutError:
  • The test expected no exception but received a TimeoutError after 10 seconds.
  • The error occurred while executing the script return document.hidden; and waiting for the condition
    to be met.
  • The failure was consistent across multiple attempts.
  • Relevant error logs: ```yaml 1: ##[group]Operating System 2: macOS ... 775: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'map_field.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/map_field.o(map_field.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/map_field.o(map_field.o)' 776: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'message.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/message.o(message.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/message.o(message.o)' 777: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'message_field.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/message_field.o(message_field.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/message_field.o(message_field.o)' 778: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'primitive_field.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/primitive_field.o(primitive_field.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/primitive_field.o(primitive_field.o)' 779: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'service.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/service.o(service.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/service.o(service.o)' 780: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: warning renaming duplicate member name 'string_field.o' from 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/0/string_field.o(string_field.o)' and 'bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protoc_lib/1/string_field.o(string_field.o)' 781: [1,815 / 3,092] [Sched] Building java/src/org/openqa/selenium/libcore-lib.jar (139 source files) [for tool]; Downloading external/rules_java~/toolchains/platformclasspath.jar, 23.2 MiB / 120.9 MiB ... (4 actions, 1 running) 782: INFO: From Linking external/protobuf~/libprotobuf.a [for tool]: 783: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/libtool: file: bazel-out/darwin_x86_64-opt-exec-ST-13d3ddad9198/bin/external/protobuf~/_objs/protobuf/error_listener.o has no symbols ... 815: [2,432 / 3,092] Extracting npm package @mui/icons-material@5.15.18_-796748879; 40s darwin-sandbox, disk-cache ... (4 actions, 3 running) 816: [2,573 / 3,092] Extracting npm package @mui/icons-material@5.15.18_-796748879; 41s darwin-sandbox, disk-cache ... (4 actions, 3 running) 817: [2,685 / 3,092] Extracting npm package @mui/icons-material@5.15.18_-796748879; 42s darwin-sandbox, disk-cache ... (4 actions, 3 running) 818: [2,781 / 3,092] Running bundle install (@bundle//:bundle); 11s darwin-sandbox, disk-cache ... (4 actions, 2 running) 819: [2,888 / 3,092] Running bundle install (@bundle//:bundle); 12s darwin-sandbox, disk-cache ... (4 actions, 3 running) 820: [2,958 / 3,092] Running bundle install (@bundle//:bundle); 13s darwin-sandbox, disk-cache ... (3 actions running) 821: [2,959 / 3,092] Running bundle install (@bundle//:bundle); 17s darwin-sandbox, disk-cache ... (3 actions, 2 running) 822: INFO: From Building java/src/org/openqa/selenium/remote/libapi-class.jar (66 source files): 823: java/src/org/openqa/selenium/remote/ErrorHandler.java:46: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 824: private final ErrorCodes errorCodes; 825: ^ 826: java/src/org/openqa/selenium/remote/ErrorHandler.java:60: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 827: this.errorCodes = new ErrorCodes(); 828: ^ 829: java/src/org/openqa/selenium/remote/ErrorHandler.java:68: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 830: public ErrorHandler(ErrorCodes codes, boolean includeServerErrors) { 831: ^ 832: java/src/org/openqa/selenium/remote/Response.java:97: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 833: ErrorCodes errorCodes = new ErrorCodes(); 834: ^ 835: java/src/org/openqa/selenium/remote/Response.java:97: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 836: ErrorCodes errorCodes = new ErrorCodes(); 837: ^ 838: java/src/org/openqa/selenium/remote/ProtocolHandshake.java:181: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 839: response.setStatus(ErrorCodes.SUCCESS); 840: ^ 841: java/src/org/openqa/selenium/remote/ProtocolHandshake.java:182: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 842: response.setState(ErrorCodes.SUCCESS_STRING); 843: ^ 844: java/src/org/openqa/selenium/remote/W3CHandshakeResponse.java:53: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 845: new ErrorCodes().toStatus((String) rawError, Optional.of(tuple.getStatusCode()))); 846: ^ 847: java/src/org/openqa/selenium/remote/W3CHandshakeResponse.java:56: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 848: new ErrorCodes().getExceptionType((String) rawError); 849: ^ 850: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:44: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 851: private final ErrorCodes errorCodes = new ErrorCodes(); 852: ^ 853: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:44: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 854: private final ErrorCodes errorCodes = new ErrorCodes(); 855: ^ 856: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:55: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 857: int status = response.getStatus() == ErrorCodes.SUCCESS ? HTTP_OK : HTTP_INTERNAL_ERROR; 858: ^ 859: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:101: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 860: response.setStatus(ErrorCodes.UNKNOWN_COMMAND); 861: ^ 862: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:103: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 863: response.setStatus(ErrorCodes.UNHANDLED_ERROR); 864: ^ 865: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:124: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 866: response.setStatus(ErrorCodes.SUCCESS); 867: ^ 868: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:125: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 869: response.setState(errorCodes.toState(ErrorCodes.SUCCESS)); 870: ^ 871: java/src/org/openqa/selenium/remote/codec/AbstractHttpResponseCodec.java:131: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 872: response.setState(errorCodes.toState(ErrorCodes.SUCCESS)); 873: ^ 874: java/src/org/openqa/selenium/remote/codec/w3c/W3CHttpResponseCodec.java:70: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 875: private final ErrorCodes errorCodes = new ErrorCodes(); 876: ^ 877: java/src/org/openqa/selenium/remote/codec/w3c/W3CHttpResponseCodec.java:70: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 878: private final ErrorCodes errorCodes = new ErrorCodes(); 879: ^ 880: java/src/org/openqa/selenium/remote/codec/w3c/W3CHttpResponseCodec.java:93: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 881: response.setStatus(ErrorCodes.UNKNOWN_COMMAND); 882: ^ 883: java/src/org/openqa/selenium/remote/codec/w3c/W3CHttpResponseCodec.java:98: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 884: response.setStatus(ErrorCodes.UNHANDLED_ERROR); 885: ^ 886: java/src/org/openqa/selenium/remote/codec/w3c/W3CHttpResponseCodec.java:145: warning: [removal] ErrorCodes in org.openqa.selenium.remote has been deprecated and marked for removal 887: response.setStatus(ErrorCodes.SUCCESS); ... 1023: [3,094 / 3,095] 2 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:shadow_root-safari-remote; 0s disk-cache 1024: [3,094 / 3,095] 2 / 24 tests; [Sched] Testing //rb/spec/integration/selenium/webdriver:shadow_root-safari-remote 1025: [3,094 / 3,095] 2 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:shadow_root-safari-remote; 1s local, disk-cache 1026: [3,094 / 3,095] 2 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:shadow_root-safari-remote; 65s local, disk-cache 1027: [3,095 / 3,096] 3 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:timeout-safari-remote; 0s disk-cache 1028: [3,095 / 3,096] 3 / 24 tests; [Sched] Testing //rb/spec/integration/selenium/webdriver:timeout-safari-remote 1029: [3,095 / 3,096] 3 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:timeout-safari-remote; 1s local, disk-cache 1030: [3,095 / 3,096] 3 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:timeout-safari-remote; 21s local, disk-cache 1031: [3,096 / 3,097] 4 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:error-safari-remote; 1s disk-cache 1032: [3,096 / 3,097] 4 / 24 tests; [Sched] Testing //rb/spec/integration/selenium/webdriver:error-safari-remote 1033: [3,096 / 3,097] 4 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:error-safari-remote; 1s local, disk-cache 1034: [3,096 / 3,097] 4 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:error-safari-remote; 17s local, disk-cache ... 1092: [3,112 / 3,113] 20 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:window-safari-remote; 39s local, disk-cache 1093: FAIL: //rb/spec/integration/selenium/webdriver:window-safari-remote (see /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_1.log) 1094: [3,112 / 3,113] 20 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:window-safari-remote; 40s local, disk-cache 1095: [3,112 / 3,113] 20 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:window-safari-remote; 78s local, disk-cache 1096: FAIL: //rb/spec/integration/selenium/webdriver:window-safari-remote (see /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_2.log) 1097: [3,112 / 3,113] 20 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:window-safari-remote; 79s local, disk-cache 1098: [3,112 / 3,113] 20 / 24 tests; Testing //rb/spec/integration/selenium/webdriver:window-safari-remote; 117s local, disk-cache 1099: FAIL: //rb/spec/integration/selenium/webdriver:window-safari-remote (see /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test.log) 1100: FAILED: //rb/spec/integration/selenium/webdriver:window-safari-remote (Summary) ... 1114: gets the size of the current window 1115: sets the size of the current window 1116: gets the position of the current window 1117: sets the position of the current window 1118: gets the rect of the current window 1119: sets the rect of the current window 1120: can maximize the current window 1121: can make window full screen 1122: can minimize the window (FAILED - 1) 1123: Failures: 1124: 1) Selenium::WebDriver::Window can minimize the window 1125: Failure/Error: 1126: expect { 1127: wait.until { driver.execute_script('return document.hidden;') } 1128: }.not_to raise_error 1129: expected no Exception, got # with backtrace: 1130: # ./rb/lib/selenium/webdriver/common/wait.rb:73:in `until' 1131: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:131:in `block (3 levels) in ' 1132: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1133: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1134: Finished in 36.5 seconds (files took 0.26274 seconds to load) 1135: 9 examples, 1 failure 1136: Failed examples: ... 1151: gets the size of the current window 1152: sets the size of the current window 1153: gets the position of the current window 1154: sets the position of the current window 1155: gets the rect of the current window 1156: sets the rect of the current window 1157: can maximize the current window 1158: can make window full screen 1159: can minimize the window (FAILED - 1) 1160: Failures: 1161: 1) Selenium::WebDriver::Window can minimize the window 1162: Failure/Error: 1163: expect { 1164: wait.until { driver.execute_script('return document.hidden;') } 1165: }.not_to raise_error 1166: expected no Exception, got # with backtrace: 1167: # ./rb/lib/selenium/webdriver/common/wait.rb:73:in `until' 1168: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:131:in `block (3 levels) in ' 1169: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1170: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1171: Finished in 36.58 seconds (files took 0.27186 seconds to load) 1172: 9 examples, 1 failure 1173: Failed examples: ... 1188: gets the size of the current window 1189: sets the size of the current window 1190: gets the position of the current window 1191: sets the position of the current window 1192: gets the rect of the current window 1193: sets the rect of the current window 1194: can maximize the current window 1195: can make window full screen 1196: can minimize the window (FAILED - 1) 1197: Failures: 1198: 1) Selenium::WebDriver::Window can minimize the window 1199: Failure/Error: 1200: expect { 1201: wait.until { driver.execute_script('return document.hidden;') } 1202: }.not_to raise_error 1203: expected no Exception, got # with backtrace: 1204: # ./rb/lib/selenium/webdriver/common/wait.rb:73:in `until' 1205: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:131:in `block (3 levels) in ' 1206: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1207: # ./rb/spec/integration/selenium/webdriver/window_spec.rb:130:in `block (2 levels) in ' 1208: Finished in 36.36 seconds (files took 0.25263 seconds to load) 1209: 9 examples, 1 failure 1210: Failed examples: 1211: rspec ./rb/spec/integration/selenium/webdriver/window_spec.rb:127 # Selenium::WebDriver::Window can minimize the window 1212: ================================================================================ 1213: /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_1.log 1214: /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_2.log 1215: INFO: From Testing //rb/spec/integration/selenium/webdriver:window-safari-remote: 1216: [3,113 / 3,114] 21 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:guard-safari-remote; 1s disk-cache 1217: [3,113 / 3,114] 21 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:guard-safari-remote; 0s local, disk-cache 1218: [3,113 / 3,114] 21 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:guard-safari-remote; 15s local, disk-cache 1219: [3,114 / 3,115] 22 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:devtools-safari-remote; 0s disk-cache 1220: [3,114 / 3,115] 22 / 24 tests, 1 failed; [Sched] Testing //rb/spec/integration/selenium/webdriver:devtools-safari-remote 1221: [3,114 / 3,115] 22 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:devtools-safari-remote; 1s local, disk-cache 1222: [3,114 / 3,115] 22 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:devtools-safari-remote; 250s local, disk-cache 1223: [3,115 / 3,116] 23 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:navigation-safari-remote; 1s disk-cache 1224: [3,115 / 3,116] 23 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:navigation-safari-remote; 0s local, disk-cache 1225: [3,115 / 3,116] 23 / 24 tests, 1 failed; Testing //rb/spec/integration/selenium/webdriver:navigation-safari-remote; 17s local, disk-cache 1226: INFO: Found 24 test targets... 1227: INFO: Elapsed time: 1925.971s, Critical Path: 359.17s 1228: INFO: 2878 processes: 1403 disk cache hit, 1171 internal, 244 darwin-sandbox, 52 local, 8 worker. 1229: INFO: Build completed, 1 test FAILED, 2878 total actions 1230: //rb/spec/integration/selenium/webdriver:action_builder-safari-remote PASSED in 111.0s 1231: //rb/spec/integration/selenium/webdriver:bidi-safari-remote PASSED in 118.2s 1232: //rb/spec/integration/selenium/webdriver:devtools-safari-remote PASSED in 250.9s 1233: //rb/spec/integration/selenium/webdriver:driver-safari-remote PASSED in 58.9s 1234: //rb/spec/integration/selenium/webdriver:element-safari-remote PASSED in 53.0s 1235: //rb/spec/integration/selenium/webdriver:error-safari-remote PASSED in 17.7s ... 1245: //rb/spec/integration/selenium/webdriver:timeout-safari-remote PASSED in 21.7s 1246: //rb/spec/integration/selenium/webdriver:virtual_authenticator-safari-remote PASSED in 16.2s 1247: //rb/spec/integration/selenium/webdriver:zipper-safari-remote PASSED in 17.4s 1248: //rb/spec/integration/selenium/webdriver/bidi:browsing_context-safari-remote PASSED in 236.3s 1249: //rb/spec/integration/selenium/webdriver/bidi:log_inspector-safari-remote PASSED in 277.4s 1250: //rb/spec/integration/selenium/webdriver/remote:driver-safari-remote PASSED in 16.4s 1251: //rb/spec/integration/selenium/webdriver/remote:element-safari-remote PASSED in 17.1s 1252: //rb/spec/integration/selenium/webdriver/safari:driver-safari-remote PASSED in 15.5s 1253: //rb/spec/integration/selenium/webdriver:window-safari-remote FAILED in 3 out of 3 in 39.1s 1254: Stats over 3 runs: max = 39.1s, min = 38.7s, avg = 38.9s, dev = 0.2s 1255: /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test.log 1256: /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_1.log 1257: /Users/runner/.bazel/execroot/_main/bazel-out/darwin_x86_64-fastbuild/testlogs/rb/spec/integration/selenium/webdriver/window-safari-remote/test_attempts/attempt_2.log 1258: Executed 24 out of 24 tests: 23 tests pass and 1 fails locally. 1259: There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. 1260:  1261: ##[error]Process completed with exit code 3. ```

    โœจ CI feedback usage guide:
    The CI feedback tool (`/checks)` automatically triggers when a PR has a failed check. The tool analyzes the failed checks and provides several feedbacks: - Failed stage - Failed test name - Failure summary - Relevant error logs In addition to being automatically triggered, the tool can also be invoked manually by commenting on a PR: ``` /checks "https://github.com/{repo_name}/actions/runs/{run_number}/job/{job_number}" ``` where `{repo_name}` is the name of the repository, `{run_number}` is the run number of the failed check, and `{job_number}` is the job number of the failed check. #### Configuration options - `enable_auto_checks_feedback` - if set to true, the tool will automatically provide feedback when a check is failed. Default is true. - `excluded_checks_list` - a list of checks to exclude from the feedback, for example: ["check1", "check2"]. Default is an empty list. - `enable_help_text` - if set to true, the tool will provide a help message with the feedback. Default is true. - `persistent_comment` - if set to true, the tool will overwrite a previous checks comment with the new feedback. Default is true. - `final_update_message` - if `persistent_comment` is true and updating a previous checks message, the tool will also create a new message: "Persistent checks updated to latest commit". Default is true. See more information about the `checks` tool in the [docs](https://pr-agent-docs.codium.ai/tools/ci_feedback/).