eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.28k stars 720 forks source link

Windows cannot delete workspace #17175

Closed pshipton closed 10 months ago

pshipton commented 1 year ago

I've seen quite a few "Cannot delete workspace" errors in the last while. Looking at the latest https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly/460/console

/cygdrive/c/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly/aqa-tests/TKG/lib
$ ls -l
ls: jcstress-tests-all-20220908.jar: Permission denied
total 19584
-rw-r----- 1 Unknown+User Unknown+Group 19939328 Apr 12 19:58 jcstress-tests-all-20220908.jar

$ rm jcstress-tests-all-20220908.jar 
rm: remove write-protected regular file 'jcstress-tests-all-20220908.jar'? y
rm: cannot remove 'jcstress-tests-all-20220908.jar': Permission denied

@llxia

llxia commented 1 year ago

Both cleanWs and rm -rf failed in the test build:

22:01:14  [WS-CLEANUP] Deleting project workspace...
22:01:14  [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
22:01:19  ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly\aqa-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] echo
22:01:19  Exception: hudson.AbortException: Cannot delete workspace: Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly\aqa-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] sh
22:01:20  + rm -rf C:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly/aqa-tests/TKG
22:01:20  rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_x86-64_windows_Nightly/aqa-tests/TKG/lib/jcstress-tests-all-20220908.jar': Permission denied

I am not sure why the owner is Unknown+User. jcstress-tests-all-20220908.jar should be created by jenkins user. @AdamBrousseau do you have any insight on the machine side?

AdamBrousseau commented 1 year ago

Looked a bit. No idea why that file got re-owned. I ran the sanitize job, which does a reboot. Then I was able to rm the DIR. If there are more I suspect they will clean themselves up eventually with the automated cleanups. Doesn't help the test builds from failing though. I wonder if the test pipelines should be updated to not fail if cleanup fails? Or perhaps just on Windows? But maybe that is sweeping more issues under the rug.

pshipton commented 1 year ago

It's just on Windows and has been happening often lately, I suspect it's a real issue that needs to be fixed.

llxia commented 1 year ago

It's just on Windows and has been happening often lately

Do you also see copyArtifacts from test.getDependency failure in these builds?

Here is what I noticed cleanWs worked at the beginning of the above extended.functional test build, which means jcstress-tests-all-20220908.jar did not exist then. In the above build, copyArtifacts from test.getDependency failed with FlowInterruptedException. It means the test build would have to download the jars on demand.

21:58:53  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
21:58:53  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...

If the jars are downloaded on demand, the functional test build will not download jcstress-tests-all-20220908.jar at all because jcstress-tests-all-20220908.jar is for the system tests. Then I am not sure where jcstress-tests-all-20220908.jar came from.

Is it possible something happened during copyArtifacts. jcstress-tests-all-20220908.jar got copied halfway with a Unknown+User user? Also, why copyArtifacts fails with FlowInterruptedException? It should not happen.

pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_extended.system_x86-64_windows_Nightly_testList_1/514 03:32:04 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_windows_Nightly_testList_1/aqa-tests/TKG/lib/jython-standalone.jar': Permission denied

llxia commented 1 year ago

FlowInterruptedException during copyArtifacts from test.getDependency in https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_extended.system_x86-64_windows_Nightly_testList_1/514

01:27:08  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
01:27:08  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_special.system_x86-64_windows_Personal_testList_0/135 23:31:28 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk11_j9_special.system_x86-64_windows_Personal_testList_0/aqa-tests/TKG/lib/jython-standalone.jar':

18:33:05  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
18:33:06  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
18:33:06  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk20_j9_extended.functional_x86-64_windows_Nightly_testList_1/38 01:52:56 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk20_j9_extended.functional_x86-64_windows_Nightly_testList_1/aqa-tests/TKG/lib/jcstress-tests-all-20220908.jar': Permission denied

23:54:30  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
23:54:31  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
23:54:31  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
llxia commented 1 year ago
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0/513 win2019x64-openj9-2 04:53:24 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0/aqa-tests/TKG/lib/jython-standalone.jar': Permission denied

02:08:00  Timeout set to expire in 2 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
04:08:00  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
04:08:01  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
04:08:01  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_extended.functional_x86-64_windows_Nightly_testList_0/147 04:56:30 rm: cannot remove 'F:/Users/jenkins/workspace/Test_openjdk19_j9_extended.functional_x86-64_windows_Nightly_testList_0/aqa-tests/TKG/lib/jcstress-tests-all-20220908.jar': Permission denied

23:16:41  Timeout set to expire in 2 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
01:16:41  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
01:16:41  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
01:16:41  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
pshipton commented 1 year ago

It's also interesting it does nothing for 2 hours when there is a problem.

pshipton commented 1 year ago

A different failure type, perhaps related.

https://openj9-jenkins.osuosl.org/job/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/39

06:56:01  ===============================================
06:56:01  Running test jdk11_tier1_buffer_0 ...
06:56:01  ===============================================
06:56:01  jdk11_tier1_buffer_0 Start Time: Thu Apr 20 05:56:01 2023 Epoch Time (ms): 1681988161191
06:56:01  variation: Mode150
06:56:01  JVM_OPTIONS:  -XX:+UseCompressedOops 
06:56:01  { \
06:56:01  echo "";  echo "TEST SETUP:"; \
06:56:01  "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image\\bin\\java" -Xshareclasses:destroyAll; "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image\\bin\\java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done"; \
06:56:01  mkdir -p "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\TKG\\output_16819527527242\\jdk11_tier1_buffer_0"; \
06:56:01  cd "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\TKG\\output_16819527527242\\jdk11_tier1_buffer_0"; \
06:56:01  echo "";  echo "TESTING:"; \
06:56:01  "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image\\bin\\java" -Xmx512m -jar "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests///..//jvmtest\\openjdk\\jtreg\\lib\\jtreg.jar" \
06:56:01  -agentvm -a -ea -esa -v:fail,error,time,nopass -retain:fail,error,*.dmp,javacore.*,heapdump.*,*.trc -ignore:quiet -timeoutFactor:8 -xml:verify  -concurrency:4 -nativepath:"F:\Users\jenkins\workspace\Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/openjdk-test-image\\jdk\\jtreg\\native" -vmoptions:"-Xmx512m  -XX:+UseCompressedOops  " \
06:56:01  -w ""F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\TKG\\output_16819527527242\\jdk11_tier1_buffer_0"\\work" \
06:56:01  -r ""F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\TKG\\output_16819527527242\\jdk11_tier1_buffer_0"\\report" \
06:56:01  -jdk:"F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image" \
06:56:01  -exclude:"F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\openjdk\\openjdk-jdk\\test\\jdk\\ProblemList.txt" \
06:56:01  -exclude:"F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests///..//jvmtest\\openjdk\\excludes/ProblemList_openjdk20-openj9.txt" \
06:56:01   \
06:56:01   \
06:56:01  "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\openjdk\\openjdk-jdk\\test\\jdk/java/nio/Buffer"; \
06:56:01  if [ $? -eq 0 ]; then echo "-----------------------------------"; echo "jdk11_tier1_buffer_0""_PASSED"; echo "-----------------------------------"; cd F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/;  else echo "-----------------------------------"; echo "jdk11_tier1_buffer_0""_FAILED"; echo "-----------------------------------"; fi; \
06:56:01  echo "";  echo "TEST TEARDOWN:"; \
06:56:01  "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image\\bin\\java" -Xshareclasses:destroyAll; "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/openjdkbinary/j2sdk-image\\bin\\java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done"; \
06:56:01   } 2>&1 | tee -a "F:/Users/jenkins/workspace/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/aqa-tests/\\TKG\\output_16819527527242\\TestTargetResult";
06:56:02  
06:56:02  TEST SETUP:
06:56:02  
06:56:02  Attempting to destroy all caches in cacheDir C:\Users\jenkins\AppData\Local\javasharedresources\
06:56:02  
06:56:02  JVMSHRC429I Failed to remove older generation of shared class cache "sharedcc_LOCAL SERVICE"
06:56:02  
06:56:02  Attempting to destroy all caches in cacheDir C:\Users\jenkins\AppData\Local\javasharedresources\
06:56:02  
06:56:02  JVMSHRC429I Failed to remove older generation of shared class cache "sharedcc_LOCAL SERVICE"
06:56:02  cache cleanup done
06:56:02  
06:56:02  TESTING:
06:56:04  Directory "F:\Users\jenkins\workspace\Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly\aqa-tests\TKG\output_16819527527242\jdk11_tier1_buffer_0\work" not found: creating
06:56:04  Directory "F:\Users\jenkins\workspace\Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly\aqa-tests\TKG\output_16819527527242\jdk11_tier1_buffer_0\report" not found: creating
06:56:11  After 20s process did not stop
[Pipeline] sh
06:56:13  ++ uname
06:56:13  + '[' CYGWIN_NT-6.3 = AIX ']'
06:56:13  ++ uname
06:56:13  + '[' CYGWIN_NT-6.3 = SunOS ']'
06:56:13  ++ uname
06:56:13  + '[' CYGWIN_NT-6.3 = '*BSD' ']'
06:56:13  + MAKE=make
06:56:13  + make -f ./aqa-tests/TKG/testEnv.mk testEnvTeardown
06:56:13  make: Nothing to be done for 'testEnvTeardown'.
[Pipeline] echo
06:56:13  Could not find test result, set build result to FAILURE.
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Post)
[Pipeline] step
06:56:13  TAP Reports Processing: START
06:56:13  Looking for TAP results report in workspace using pattern: aqa-tests/TKG/**/*.tap
06:56:38  Did not find any matching files. Setting build result to FAILURE.
[Pipeline] junit
06:56:38  Recording test results
06:56:51  Body did not finish within grace period; terminating with extreme prejudice
[Pipeline] }
[Pipeline] // stage
[Pipeline] echo
06:56:51  PROCESSCATCH: Terminating any hung/left over test processes:
[Pipeline] sh
06:56:52  + aqa-tests/terminateTestProcesses.sh jenkins
06:56:52  Windows machine, using powershell queries...
06:56:57  Windows rogue processes detected, attempting to stop them..
06:56:57  
06:56:57  
06:56:57  __GENUS                    : 2
06:56:57  __CLASS                    : Win32_Process
06:56:57  __SUPERCLASS               : CIM_Process
06:56:57  __DYNASTY                  : CIM_ManagedSystemElement
06:56:57  __RELPATH                  : Win32_Process.Handle="2596"
06:56:57  __PROPERTY_COUNT           : 45
06:56:57  __DERIVATION               : {CIM_Process, CIM_LogicalElement, 
06:56:57                               CIM_ManagedSystemElement}
06:56:57  __SERVER                   : WIN2012R2-X86-6
06:56:57  __NAMESPACE                : root\cimv2
06:56:57  __PATH                     : \\WIN2012R2-X86-6\root\cimv2:Win32_Process.Handle=
06:56:57                               "2596"
06:56:57  Caption                    : make.exe
06:56:57  CommandLine                : "C:\cygwin64\bin\make.exe"
06:56:57  CreationClassName          : Win32_Process
06:56:57  CreationDate               : 20230419200548.658093-300
06:56:57  CSCreationClassName        : Win32_ComputerSystem
06:56:57  CSName                     : WIN2012R2-X86-6
06:56:57  Description                : make.exe
06:56:57  ExecutablePath             : C:\cygwin64\bin\make.exe
06:56:57  ExecutionState             : 
06:56:57  Handle                     : 2596
06:56:57  HandleCount                : 108
06:56:57  InstallDate                : 
06:56:57  KernelModeTime             : 156250
06:56:57  MaximumWorkingSetSize      : 1380
06:56:57  MinimumWorkingSetSize      : 200
06:56:57  Name                       : make.exe
06:56:57  OSCreationClassName        : Win32_OperatingSystem
06:56:57  OSName                     : Microsoft Windows Server 2012 R2 
06:56:57                               Standard|C:\Windows|\Device\Harddisk0\Partition1
06:56:57  OtherOperationCount        : 275
06:56:57  OtherTransferCount         : 10520
06:56:57  PageFaults                 : 1419
06:56:57  PageFileUsage              : 5428
06:56:57  ParentProcessId            : 4004
06:56:57  PeakPageFileUsage          : 5476
06:56:57  PeakVirtualSize            : 568520704
06:56:57  PeakWorkingSetSize         : 5440
06:56:57  Priority                   : 8
06:56:57  PrivatePageCount           : 5558272
06:56:57  ProcessId                  : 2596
06:56:57  QuotaNonPagedPoolUsage     : 7
06:56:57  QuotaPagedPoolUsage        : 60
06:56:57  QuotaPeakNonPagedPoolUsage : 10
06:56:57  QuotaPeakPagedPoolUsage    : 61
06:56:57  ReadOperationCount         : 20
06:56:57  ReadTransferCount          : 6796
06:56:57  SessionId                  : 0
06:56:57  Status                     : 
06:56:57  TerminationDate            : 
06:56:57  ThreadCount                : 3
06:56:57  UserModeTime               : 0
06:56:57  VirtualSize                : 566415360
06:56:57  WindowsVersion             : 6.3.9600
06:56:57  WorkingSetSize             : 5545984
06:56:57  WriteOperationCount        : 13
06:56:57  WriteTransferCount         : 1831
06:56:57  PSComputerName             : WIN2012R2-X86-6
06:56:57  ProcessName                : make.exe
06:56:57  Handles                    : 108
06:56:57  VM                         : 566415360
06:56:57  WS                         : 5545984
06:56:57  Path                       : C:\cygwin64\bin\make.exe
06:56:57  
06:56:57  __GENUS                    : 2
06:56:57  __CLASS                    : Win32_Process
06:56:57  __SUPERCLASS               : CIM_Process
06:56:57  __DYNASTY                  : CIM_ManagedSystemElement
06:56:57  __RELPATH                  : Win32_Process.Handle="3020"
06:56:57  __PROPERTY_COUNT           : 45
06:56:57  __DERIVATION               : {CIM_Process, CIM_LogicalElement, 
06:56:57                               CIM_ManagedSystemElement}
06:56:57  __SERVER                   : WIN2012R2-X86-6
06:56:57  __NAMESPACE                : root\cimv2
06:56:57  __PATH                     : \\WIN2012R2-X86-6\root\cimv2:Win32_Process.Handle=
06:56:57                               "3020"
06:56:57  Caption                    : make.exe
06:56:57  CommandLine                : "C:\cygwin64\bin\make.exe"
06:56:57  CreationClassName          : Win32_Process
06:56:57  CreationDate               : 20230419200552.158099-300
06:56:57  CSCreationClassName        : Win32_ComputerSystem
06:56:57  CSName                     : WIN2012R2-X86-6
06:56:57  Description                : make.exe
06:56:57  ExecutablePath             : C:\cygwin64\bin\make.exe
06:56:57  ExecutionState             : 
06:56:57  Handle                     : 3020
06:56:57  HandleCount                : 117
06:56:57  InstallDate                : 
06:56:57  KernelModeTime             : 468750
06:56:57  MaximumWorkingSetSize      : 1380
06:56:57  MinimumWorkingSetSize      : 200
06:56:57  Name                       : make.exe
06:56:57  OSCreationClassName        : Win32_OperatingSystem
06:56:57  OSName                     : Microsoft Windows Server 2012 R2 
06:56:57                               Standard|C:\Windows|\Device\Harddisk0\Partition1
06:56:57  OtherOperationCount        : 1110
06:56:57  OtherTransferCount         : 37560
06:56:57  PageFaults                 : 1512
06:56:57  PageFileUsage              : 5568
06:56:57  ParentProcessId            : 2336
06:56:57  PeakPageFileUsage          : 5616
06:56:57  PeakVirtualSize            : 568520704
06:56:57  PeakWorkingSetSize         : 5604
06:56:57  Priority                   : 8
06:56:57  PrivatePageCount           : 5701632
06:56:57  ProcessId                  : 3020
06:56:57  QuotaNonPagedPoolUsage     : 7
06:56:57  QuotaPagedPoolUsage        : 60
06:56:57  QuotaPeakNonPagedPoolUsage : 10
06:56:57  QuotaPeakPagedPoolUsage    : 61
06:56:57  ReadOperationCount         : 161
06:56:57  ReadTransferCount          : 45436
06:56:57  SessionId                  : 0
06:56:57  Status                     : 
06:56:57  TerminationDate            : 
06:56:57  ThreadCount                : 3
06:56:57  UserModeTime               : 0
06:56:57  VirtualSize                : 566415360
06:56:57  WindowsVersion             : 6.3.9600
06:56:57  WorkingSetSize             : 5713920
06:56:57  WriteOperationCount        : 94
06:56:57  WriteTransferCount         : 16459
06:56:57  PSComputerName             : WIN2012R2-X86-6
06:56:57  ProcessName                : make.exe
06:56:57  Handles                    : 117
06:56:57  VM                         : 566415360
06:56:57  WS                         : 5713920
06:56:57  Path                       : C:\cygwin64\bin\make.exe
06:56:57  
06:56:57  __GENUS                    : 2
06:56:57  __CLASS                    : Win32_Process
06:56:57  __SUPERCLASS               : CIM_Process
06:56:57  __DYNASTY                  : CIM_ManagedSystemElement
06:56:57  __RELPATH                  : Win32_Process.Handle="2900"
06:56:57  __PROPERTY_COUNT           : 45
06:56:57  __DERIVATION               : {CIM_Process, CIM_LogicalElement, 
06:56:57                               CIM_ManagedSystemElement}
06:56:57  __SERVER                   : WIN2012R2-X86-6
06:56:57  __NAMESPACE                : root\cimv2
06:56:57  __PATH                     : \\WIN2012R2-X86-6\root\cimv2:Win32_Process.Handle=
06:56:57                               "2900"
06:56:57  Caption                    : make.exe
06:56:57  CommandLine                : "C:\cygwin64\bin\make.exe"
06:56:57  CreationClassName          : Win32_Process
06:56:57  CreationDate               : 20230419200553.611218-300
06:56:57  CSCreationClassName        : Win32_ComputerSystem
06:56:57  CSName                     : WIN2012R2-X86-6
06:56:57  Description                : make.exe
06:56:57  ExecutablePath             : C:\cygwin64\bin\make.exe
06:56:57  ExecutionState             : 
06:56:57  Handle                     : 2900
06:56:57  HandleCount                : 119
06:56:57  InstallDate                : 
06:56:57  KernelModeTime             : 156250
06:56:57  MaximumWorkingSetSize      : 1380
06:56:57  MinimumWorkingSetSize      : 200
06:56:57  Name                       : make.exe
06:56:57  OSCreationClassName        : Win32_OperatingSystem
06:56:57  OSName                     : Microsoft Windows Server 2012 R2 
06:56:57                               Standard|C:\Windows|\Device\Harddisk0\Partition1
06:56:57  OtherOperationCount        : 702
06:56:57  OtherTransferCount         : 24518
06:56:57  PageFaults                 : 1451
06:56:57  PageFileUsage              : 5496
06:56:57  ParentProcessId            : 2276
06:56:57  PeakPageFileUsage          : 5544
06:56:57  PeakVirtualSize            : 568520704
06:56:57  PeakWorkingSetSize         : 5540
06:56:57  Priority                   : 8
06:56:57  PrivatePageCount           : 5627904
06:56:57  ProcessId                  : 2900
06:56:57  QuotaNonPagedPoolUsage     : 7
06:56:57  QuotaPagedPoolUsage        : 60
06:56:57  QuotaPeakNonPagedPoolUsage : 10
06:56:57  QuotaPeakPagedPoolUsage    : 61
06:56:57  ReadOperationCount         : 72
06:56:57  ReadTransferCount          : 32239
06:56:57  SessionId                  : 0
06:56:57  Status                     : 
06:56:57  TerminationDate            : 
06:56:57  ThreadCount                : 3
06:56:57  UserModeTime               : 156250
06:56:57  VirtualSize                : 566415360
06:56:57  WindowsVersion             : 6.3.9600
06:56:57  WorkingSetSize             : 5648384
06:56:57  WriteOperationCount        : 23
06:56:57  WriteTransferCount         : 4004
06:56:57  PSComputerName             : WIN2012R2-X86-6
06:56:57  ProcessName                : make.exe
06:56:57  Handles                    : 119
06:56:57  VM                         : 566415360
06:56:57  WS                         : 5648384
06:56:57  Path                       : C:\cygwin64\bin\make.exe
06:56:57  
06:56:57  __GENUS                    : 2
06:56:57  __CLASS                    : Win32_Process
06:56:57  __SUPERCLASS               : CIM_Process
06:56:57  __DYNASTY                  : CIM_ManagedSystemElement
06:56:57  __RELPATH                  : Win32_Process.Handle="3120"
06:56:57  __PROPERTY_COUNT           : 45
06:56:57  __DERIVATION               : {CIM_Process, CIM_LogicalElement, 
06:56:57                               CIM_ManagedSystemElement}
06:56:57  __SERVER                   : WIN2012R2-X86-6
06:56:57  __NAMESPACE                : root\cimv2
06:56:57  __PATH                     : \\WIN2012R2-X86-6\root\cimv2:Win32_Process.Handle=
06:56:57                               "3120"
06:56:57  Caption                    : make.exe
06:56:57  CommandLine                : "C:\cygwin64\bin\make.exe"
06:56:57  CreationClassName          : Win32_Process
06:56:57  CreationDate               : 20230419200553.720593-300
06:56:57  CSCreationClassName        : Win32_ComputerSystem
06:56:57  CSName                     : WIN2012R2-X86-6
06:56:57  Description                : make.exe
06:56:57  ExecutablePath             : C:\cygwin64\bin\make.exe
06:56:57  ExecutionState             : 
06:56:57  Handle                     : 3120
06:56:57  HandleCount                : 121
06:56:57  InstallDate                : 
06:56:57  KernelModeTime             : 2656250
06:56:57  MaximumWorkingSetSize      : 1380
06:56:57  MinimumWorkingSetSize      : 200
06:56:57  Name                       : make.exe
06:56:57  OSCreationClassName        : Win32_OperatingSystem
06:56:57  OSName                     : Microsoft Windows Server 2012 R2 
06:56:57                               Standard|C:\Windows|\Device\Harddisk0\Partition1
06:56:57  OtherOperationCount        : 4870
06:56:57  OtherTransferCount         : 128590
06:56:57  PageFaults                 : 1957
06:56:57  PageFileUsage              : 5688
06:56:57  ParentProcessId            : 3208
06:56:57  PeakPageFileUsage          : 5688
06:56:57  PeakVirtualSize            : 568520704
06:56:57  PeakWorkingSetSize         : 5716
06:56:57  Priority                   : 8
06:56:57  PrivatePageCount           : 5824512
06:56:57  ProcessId                  : 3120
06:56:57  QuotaNonPagedPoolUsage     : 7
06:56:57  QuotaPagedPoolUsage        : 60
06:56:57  QuotaPeakNonPagedPoolUsage : 10
06:56:57  QuotaPeakPagedPoolUsage    : 61
06:56:57  ReadOperationCount         : 1007
06:56:57  ReadTransferCount          : 230050
06:56:57  SessionId                  : 0
06:56:57  Status                     : 
06:56:57  TerminationDate            : 
06:56:57  ThreadCount                : 3
06:56:57  UserModeTime               : 312500
06:56:57  VirtualSize                : 566415360
06:56:57  WindowsVersion             : 6.3.9600
06:56:57  WorkingSetSize             : 5853184
06:56:57  WriteOperationCount        : 954
06:56:57  WriteTransferCount         : 166686
06:56:57  PSComputerName             : WIN2012R2-X86-6
06:56:57  ProcessName                : make.exe
06:56:57  Handles                    : 121
06:56:57  VM                         : 566415360
06:56:57  WS                         : 5853184
06:56:57  Path                       : C:\cygwin64\bin\make.exe
06:56:57  
06:56:57  __GENUS                    : 2
06:56:57  __CLASS                    : Win32_Process
06:56:57  __SUPERCLASS               : CIM_Process
06:56:57  __DYNASTY                  : CIM_ManagedSystemElement
06:56:57  __RELPATH                  : Win32_Process.Handle="4088"
06:56:57  __PROPERTY_COUNT           : 45
06:56:57  __DERIVATION               : {CIM_Process, CIM_LogicalElement, 
06:56:57                               CIM_ManagedSystemElement}
06:56:57  __SERVER                   : WIN2012R2-X86-6
06:56:57  __NAMESPACE                : root\cimv2
06:56:57  __PATH                     : \\WIN2012R2-X86-6\root\cimv2:Win32_Process.Handle=
06:56:57                               "4088"
06:56:57  Caption                    : java.exe
06:56:57  CommandLine                : F:\Users\jenkins\workspace\Test_openjdk20_j9_sanit
06:56:57                               y.openjdk_x86-64_windows_Nightly\openjdkbinary\j2s
06:56:57                               dk-image\bin\java.exe -Xmx512m -jar F:/Users/jenki
06:56:57                               ns/workspace/Test_openjdk20_j9_sanity.openjdk_x86-
06:56:57                               64_windows_Nightly/aqa-tests///..//jvmtest\openjdk
06:56:57                               \jtreg\lib\jtreg.jar -agentvm -a -ea -esa 
06:56:57                               -v:fail,error,time,nopass -retain:fail,error,*.dmp
06:56:57                               ,javacore.*,heapdump.*,*.trc -ignore:quiet 
06:56:57                               -timeoutFactor:8 -xml:verify -concurrency:4 -nativ
06:56:57                               epath:F:\Users\jenkins\workspace\Test_openjdk20_j9
06:56:57                               _sanity.openjdk_x86-64_windows_Nightly/openjdkbina
06:56:57                               ry/openjdk-test-image\jdk\jtreg\native 
06:56:57                               "-vmoptions:-Xmx512m  -XX:+UseCompressedOops  " 
06:56:57                               -w F:/Users/jenkins/workspace/Test_openjdk20_j9_sa
06:56:57                               nity.openjdk_x86-64_windows_Nightly/aqa-tests/\TKG
06:56:57                               \output_16819527527242\jdk11_tier1_buffer_0\work 
06:56:57                               -r F:/Users/jenkins/workspace/Test_openjdk20_j9_sa
06:56:57                               nity.openjdk_x86-64_windows_Nightly/aqa-tests/\TKG
06:56:57                               \output_16819527527242\jdk11_tier1_buffer_0\report
06:56:57                                -jdk:F:/Users/jenkins/workspace/Test_openjdk20_j9
06:56:57                               _sanity.openjdk_x86-64_windows_Nightly/openjdkbina
06:56:57                               ry/j2sdk-image -exclude:F:/Users/jenkins/workspace
06:56:57                               /Test_openjdk20_j9_sanity.openjdk_x86-64_windows_N
06:56:57                               ightly/aqa-tests/\openjdk\openjdk-jdk\test\jdk\Pro
06:56:57                               blemList.txt -exclude:F:/Users/jenkins/workspace/T
06:56:57                               est_openjdk20_j9_sanity.openjdk_x86-64_windows_Nig
06:56:57                               htly/aqa-tests///..//jvmtest\openjdk\excludes/Prob
06:56:57                               lemList_openjdk20-openj9.txt F:/Users/jenkins/work
06:56:57                               space/Test_openjdk20_j9_sanity.openjdk_x86-64_wind
06:56:57                               ows_Nightly/aqa-tests/\openjdk\openjdk-jdk\test\jd
06:56:57                               k/java/nio/Buffer
06:56:57  CreationClassName          : Win32_Process
06:56:57  CreationDate               : 20230420055601.738724-300
06:56:57  CSCreationClassName        : Win32_ComputerSystem
06:56:57  CSName                     : WIN2012R2-X86-6
06:56:57  Description                : java.exe
06:56:57  ExecutablePath             : F:\Users\jenkins\workspace\Test_openjdk20_j9_sanit
06:56:57                               y.openjdk_x86-64_windows_Nightly\openjdkbinary\j2s
06:56:57                               dk-image\bin\java.exe
06:56:57  ExecutionState             : 
06:56:57  Handle                     : 4088
06:56:57  HandleCount                : 433
06:56:57  InstallDate                : 
06:56:57  KernelModeTime             : 62656250
06:56:57  MaximumWorkingSetSize      : 1380
06:56:57  MinimumWorkingSetSize      : 200
06:56:57  Name                       : java.exe
06:56:57  OSCreationClassName        : Win32_OperatingSystem
06:56:57  OSName                     : Microsoft Windows Server 2012 R2 
06:56:57                               Standard|C:\Windows|\Device\Harddisk0\Partition1
06:56:57  OtherOperationCount        : 71414
06:56:57  OtherTransferCount         : 1608786
06:56:57  PageFaults                 : 196431
06:56:57  PageFileUsage              : 416120
06:56:57  ParentProcessId            : 4388
06:56:57  PeakPageFileUsage          : 510764
06:56:57  PeakVirtualSize            : 1525989376
06:56:57  PeakWorkingSetSize         : 165928
06:56:57  Priority                   : 8
06:56:57  PrivatePageCount           : 426106880
06:56:57  ProcessId                  : 4088
06:56:57  QuotaNonPagedPoolUsage     : 28
06:56:57  QuotaPagedPoolUsage        : 610
06:56:57  QuotaPeakNonPagedPoolUsage : 70
06:56:57  QuotaPeakPagedPoolUsage    : 636
06:56:57  ReadOperationCount         : 12025
06:56:57  ReadTransferCount          : 38629726
06:56:57  SessionId                  : 0
06:56:57  Status                     : 
06:56:57  TerminationDate            : 
06:56:57  ThreadCount                : 29
06:56:57  UserModeTime               : 249687500
06:56:57  VirtualSize                : 1425326080
06:56:57  WindowsVersion             : 6.3.9600
06:56:57  WorkingSetSize             : 100757504
06:56:57  WriteOperationCount        : 700
06:56:57  WriteTransferCount         : 496921
06:56:57  PSComputerName             : WIN2012R2-X86-6
06:56:57  ProcessName                : java.exe
06:56:57  Handles                    : 433
06:56:57  VM                         : 1425326080
06:56:57  WS                         : 100757504
06:56:57  Path                       : F:\Users\jenkins\workspace\Test_openjdk20_j9_sanit
06:56:57                               y.openjdk_x86-64_windows_Nightly\openjdkbinary\j2s
06:56:57                               dk-image\bin\java.exe
06:56:57  
06:56:57  
06:56:57  
06:56:58  
06:56:58  
06:56:58  __GENUS          : 2
06:56:58  __CLASS          : __PARAMETERS
06:56:58  __SUPERCLASS     : 
06:56:58  __DYNASTY        : __PARAMETERS
06:56:58  __RELPATH        : 
06:56:58  __PROPERTY_COUNT : 1
06:56:58  __DERIVATION     : {}
06:56:58  __SERVER         : 
06:56:58  __NAMESPACE      : 
06:56:58  __PATH           : 
06:56:58  ReturnValue      : 0
06:56:58  PSComputerName   : 
06:56:58  
06:56:58  __GENUS          : 2
06:56:58  __CLASS          : __PARAMETERS
06:56:58  __SUPERCLASS     : 
06:56:58  __DYNASTY        : __PARAMETERS
06:56:58  __RELPATH        : 
06:56:58  __PROPERTY_COUNT : 1
06:56:58  __DERIVATION     : {}
06:56:58  __SERVER         : 
06:56:58  __NAMESPACE      : 
06:56:58  __PATH           : 
06:56:58  ReturnValue      : 0
06:56:58  PSComputerName   : 
06:56:58  
06:56:58  __GENUS          : 2
06:56:58  __CLASS          : __PARAMETERS
06:56:58  __SUPERCLASS     : 
06:56:58  __DYNASTY        : __PARAMETERS
06:56:58  __RELPATH        : 
06:56:58  __PROPERTY_COUNT : 1
06:56:58  __DERIVATION     : {}
06:56:58  __SERVER         : 
06:56:58  __NAMESPACE      : 
06:56:58  __PATH           : 
06:56:58  ReturnValue      : 0
06:56:58  PSComputerName   : 
06:56:58  
06:56:58  __GENUS          : 2
06:56:58  __CLASS          : __PARAMETERS
06:56:58  __SUPERCLASS     : 
06:56:58  __DYNASTY        : __PARAMETERS
06:56:58  __RELPATH        : 
06:56:58  __PROPERTY_COUNT : 1
06:56:58  __DERIVATION     : {}
06:56:58  __SERVER         : 
06:56:58  __NAMESPACE      : 
06:56:58  __PATH           : 
06:56:58  ReturnValue      : 0
06:56:58  PSComputerName   : 
06:56:58  
06:56:58  __GENUS          : 2
06:56:58  __CLASS          : __PARAMETERS
06:56:58  __SUPERCLASS     : 
06:56:58  __DYNASTY        : __PARAMETERS
06:56:58  __RELPATH        : 
06:56:58  __PROPERTY_COUNT : 1
06:56:58  __DERIVATION     : {}
06:56:58  __SERVER         : 
06:56:58  __NAMESPACE      : 
06:56:58  __PATH           : 
06:56:58  ReturnValue      : 0
06:56:58  PSComputerName   : 
06:56:58  
06:56:58  
06:56:58  
06:56:58  Sleeping for 10 seconds...
06:57:08  Processes stopped successfully
[Pipeline] cleanWs
06:57:09  [WS-CLEANUP] Deleting project workspace...
06:57:09  [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
06:57:51  [WS-CLEANUP] done
[Pipeline] sh
06:57:52  + find /cygdrive/c/temp -name '*core*' -print -exec rm -f '{}' ';'
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
06:57:52  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_special.system_x86-64_windows_Personal/138 win2019x64-openj9-5a rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk11_j9_special.system_x86-64_windows_Personal/aqa-tests/TKG/lib/jcstress-tests-all-20220908.jar': Permission denied

09:58:42  Timeout set to expire in 1 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
09:58:42  Exception: hudson.AbortException: Unable to find a build for artifact copy from: getTRSSOutput
[Pipeline] echo
09:58:42  Cannot get cached TRSS JSON data. Skipping copyArtifacts...
[Pipeline] timeout
09:58:42  Timeout set to expire in 2 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
11:58:42  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
11:58:43  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
11:58:43  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_special.system_x86-64_windows_Personal_testList_1/68 win2019x64-openj9-4 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk17_j9_special.system_x86-64_windows_Personal_testList_1/aqa-tests/TKG/lib/jtreg_7_1_1_1.tar.gz': Permission denied

10:06:17  Timeout set to expire in 2 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
12:06:17  Cancelling nested steps due to timeout
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
12:06:18  Exception: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException
[Pipeline] echo
12:06:18  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
[Pipeline] timeout
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_extended.functional_x86-32_windows_Nightly_testList_1/517 win2019x64-openj9-5a rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk8_j9_extended.functional_x86-32_windows_Nightly_testList_1/aqa-tests/TKG/lib/jtreg_7_1_1_1.tar.gz': Permission denied


https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0/517 win2012x64-openj9-1a ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0\aqa-tests\systemtest_prereqs\mauve\mauve.jar'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.

This one is different, caused by the MauveMultiThrdLoad_5m_2 test failure, which seems machine problem. LT java.lang.ClassNotFoundException: gnu.testlet.java.lang.Character.classInfo.isAnonymousClass

pshipton commented 1 year ago

This one never ran any testing, I guess it's trying to delete the workspace first.

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.functional_x86-64_windows_Nightly/525 win2019x64-openj9-2 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_x86-64_windows_Nightly/aqa-tests/TKG/lib/jython-standalone.jar': Permission denied

I do see

00:40:34  Attempting to get test duration data from TRSS.
00:40:34  curl --silent --max-time 120 https://trss.adoptopenjdk.net/api/getTestAvgDuration?limit=10&jdkVersion=11&impl=j9&platform=x86-64_windows&group=functional&level=sanity
00:40:34  Warning: cannot parse data from TRSS.
00:40:34  Attempting to get test duration data from cached files.
00:40:34  
00:40:34  TEST DURATION
00:40:34  ====================================================================================
00:40:34  Total number of tests searched: 361
00:40:34  Number of test durations found: 0
00:40:34  No test duration data found.
00:40:34  (Default duration assigned, executed tests: 40s; not executed tests: 0s.)
00:40:34  ====================================================================================
pshipton commented 1 year ago

Seems related https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_extended.system_x86-64_windows_Nightly/507 win2019x64-openj9-5a

23:07:10  Timeout set to expire in 1 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
23:07:10  Exception: hudson.AbortException: Unable to find a build for artifact copy from: getTRSSOutput
[Pipeline] echo
23:07:10  Cannot get cached TRSS JSON data. Skipping copyArtifacts...
[Pipeline] timeout
23:07:10  Timeout set to expire in 2 hr 0 min
[Pipeline] {
[Pipeline] copyArtifacts
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
23:13:34  Exception: hudson.remoting.RequestAbortedException: java.io.IOException: Unexpected termination of the channel
[Pipeline] echo
23:13:34  Cannot run copyArtifacts from test.getDependency. Skipping copyArtifacts...
[Pipeline] sh
23:13:34  win2019x64-openj9-5a was marked offline: Connection was broken: java.io.EOFException
pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_1/471 win2019x64-openj9-3 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_1/aqa-tests/TKG/lib/jtreg_6_1_1.tar.gz': Permission denied

pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.functional_x86-64_windows_Release/62 win2019x64-openj9-5a rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_x86-64_windows_Release/aqa-tests/TKG/lib/jcstress-tests-all-20220908.jar': Permission denied

pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_sanity.openjdk_x86-32_windows_Nightly/532 win2019x64-openj9-2 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk8_j9_sanity.openjdk_x86-32_windows_Nightly/aqa-tests/TKG/lib/jtreg_7_1_1_1.tar.gz': Permission denied


https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.functional_x86-64_windows_Nightly_testList_1/472/ win2012x64-openj9-1a ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk17_j9_sanity.functional_x86-64_windows_Nightly_testList_1\aqa-tests\TKG\lib\jtreg_7_2_1.tar.gz'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.


https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_0/472 win2019x64-openj9-1 ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_0\aqa-tests\systemtest_prereqs\mauve\mauve.jar'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.


https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_1/472/ win2019x64-openj9-3 ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk17_j9_extended.system_x86-64_windows_Nightly_testList_1\aqa-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.

AdamBrousseau commented 1 year ago

I wonder if we can add some debug in the test pipeline code https://javadoc.jenkins.io/plugin/workflow-step-api/org/jenkinsci/plugins/workflow/steps/FlowInterruptedException.html

Special exception that can be thrown out of FutureCallback.onFailure(java.lang.Throwable) to indicate that the flow was aborted from the inside. (This could be caught like any other exception and rethrown or ignored. It only takes effect if thrown all the way up. Consumers, such as steps, may find [isActualInterruption()](https://javadoc.jenkins.io/plugin/workflow-step-api/org/jenkinsci/plugins/workflow/steps/FlowInterruptedException.html#isActualInterruption()) useful in deciding whether to ignore or rethrow the exception.) No stack trace is printed (except by [Throwable.getCause()](https://docs.oracle.com/javase/8/docs/api/java/lang/Throwable.html?is-external=true#getCause()) and/or [Throwable.getSuppressed()](https://docs.oracle.com/javase/8/docs/api/java/lang/Throwable.html?is-external=true#getSuppressed()) if present), and you can control the Result and CauseOfInterruption.

pshipton commented 1 year ago

There doesn't seem a benefit for me to keep reporting the failures, I will start ignoring them.

https://openj9-jenkins.osuosl.org/job/Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0/526 rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk8_j9_sanity.system_x86-32_windows_Nightly_testList_0/aqa-tests/TKG/lib/jython-standalone.jar': Permission denied

AdamBrousseau commented 1 year ago

fyi @llxia still happening https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.system_x86-64_windows_Nightly/67/console

02:05:06.202  [WS-CLEANUP] Deleting project workspace...
02:05:06.202  [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
02:05:12.568  ERROR: Cannot delete workspace :Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk21_j9_sanity.system_x86-64_windows_Nightly\aqa-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] echo
02:05:12.575  Exception: hudson.AbortException: Cannot delete workspace: Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk21_j9_sanity.system_x86-64_windows_Nightly\aqa-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] sh
02:05:13.452  + rm -rf C:/Users/jenkins/workspace/Test_openjdk21_j9_sanity.system_x86-64_windows_Nightly/aqa-tests/TKG
02:05:13.453  rm: cannot remove 'C:/Users/jenkins/workspace/Test_openjdk21_j9_sanity.system_x86-64_windows_Nightly/aqa-tests/TKG/lib/jython-standalone.jar': Permission denied
llxia commented 10 months ago

As we updated the logic to pre-stage 3rd party libs on the machines (https://github.com/adoptium/aqa-tests/issues/4500), this issue should be resolved. Please reopen if this occurs again.