llvm / llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
http://llvm.org
Other
27.92k stars 11.52k forks source link

Unable to successfully run tests for LLDB on Windows #77992

Open aganea opened 8 months ago

aganea commented 8 months ago

I am unable to successfully pass all LLDB tests. Using latest Visual Studio 17.8.3 on Windows 11 version 23H2. Using LLVM commit https://github.com/llvm/llvm-project/commit/6c2fbc3a68ba6d4bd1c8c2c43c98cff5e82f2ba4. I am including a branch below with an easy repro.

Just open an elevated admin cmd.exe and run the following. This runs the official Windows LLVM release script:

C:\git>git clone https://github.com/aganea/llvm-project.git
...
C:\git>cd llvm-project && git switch bugreport_lldb_tests && cd ..
...
C:\git>llvm-project\llvm\utils\release\build_llvm_release.bat --version 18.0.0 --x64
...
Failed Tests (20):
  lldb-api :: commands/settings/use_source_cache/TestUseSourceCache.py
  lldb-api :: commands/watchpoints/hello_watchpoint/TestMyFirstWatchpoint.py
  lldb-api :: commands/watchpoints/multiple_hits/TestMultipleHits.py
  lldb-api :: commands/watchpoints/multiple_threads/TestWatchpointMultipleThreads.py
  lldb-api :: commands/watchpoints/step_over_watchpoint/TestStepOverWatchpoint.py
  lldb-api :: commands/watchpoints/unaligned-watchpoint/TestUnalignedWatchpoint.py
  lldb-api :: commands/watchpoints/watchpoint_commands/TestWatchpointCommands.py
  lldb-api :: commands/watchpoints/watchpoint_commands/command/TestWatchpointCommandLLDB.py
  lldb-api :: commands/watchpoints/watchpoint_commands/command/TestWatchpointCommandPython.py
  lldb-api :: commands/watchpoints/watchpoint_commands/condition/TestWatchpointConditionCmd.py
  lldb-api :: commands/watchpoints/watchpoint_count/TestWatchpointCount.py
  lldb-api :: commands/watchpoints/watchpoint_disable/TestWatchpointDisable.py
  lldb-api :: commands/watchpoints/watchpoint_size/TestWatchpointSizes.py
  lldb-api :: python_api/watchpoint/TestSetWatchpoint.py
  lldb-api :: python_api/watchpoint/TestWatchpointIgnoreCount.py
  lldb-api :: python_api/watchpoint/TestWatchpointIter.py
  lldb-api :: python_api/watchpoint/condition/TestWatchpointConditionAPI.py
  lldb-api :: python_api/watchpoint/watchlocation/TestTargetWatchAddress.py
  lldb-shell :: SymbolFile/DWARF/dwo-static-data-member-access.test
  lldb-shell :: Unwind/windows-unaligned-x86_64.test

********************
Unexpectedly Passed Tests (2):
  lldb-api :: lang/cpp/class-template-non-type-parameter-pack/TestClassTemplateNonTypeParameterPack.py
  lldb-api :: lang/cpp/class-template-type-parameter-pack/TestClassTemplateTypeParameterPack.py

Testing Time: 392.03s

Total Discovered Tests: 2883
  Unsupported        :  758 (26.29%)
  Passed             : 2072 (71.87%)
  Expectedly Failed  :   31 (1.08%)
  Failed             :   20 (0.69%)
  Unexpectedly Passed:    2 (0.07%)

See full error log: lldb_test_errors.txt

@JDevlieghere are you able to take a look please?

llvmbot commented 8 months ago

@llvm/issue-subscribers-lldb

Author: Alexandre Ganea (aganea)

I am unable to successfully pass all LLDB tests. Using latest Visual Studio 17.8.3 on Windows 11 version 23H2. Using LLVM commit https://github.com/llvm/llvm-project/commit/6c2fbc3a68ba6d4bd1c8c2c43c98cff5e82f2ba4. I am including a branch below with an easy repro. Just open an elevated admin cmd.exe and run the following. This runs the official Windows LLVM release script: ``` C:\git>git clone https://github.com/aganea/llvm-project.git ... C:\git>cd llvm-project && git switch bugreport_lldb_tests && cd .. ... C:\git>llvm-project\llvm\utils\release\build_llvm_release.bat --version 18.0.0 --x64 ... Failed Tests (20): lldb-api :: commands/settings/use_source_cache/TestUseSourceCache.py lldb-api :: commands/watchpoints/hello_watchpoint/TestMyFirstWatchpoint.py lldb-api :: commands/watchpoints/multiple_hits/TestMultipleHits.py lldb-api :: commands/watchpoints/multiple_threads/TestWatchpointMultipleThreads.py lldb-api :: commands/watchpoints/step_over_watchpoint/TestStepOverWatchpoint.py lldb-api :: commands/watchpoints/unaligned-watchpoint/TestUnalignedWatchpoint.py lldb-api :: commands/watchpoints/watchpoint_commands/TestWatchpointCommands.py lldb-api :: commands/watchpoints/watchpoint_commands/command/TestWatchpointCommandLLDB.py lldb-api :: commands/watchpoints/watchpoint_commands/command/TestWatchpointCommandPython.py lldb-api :: commands/watchpoints/watchpoint_commands/condition/TestWatchpointConditionCmd.py lldb-api :: commands/watchpoints/watchpoint_count/TestWatchpointCount.py lldb-api :: commands/watchpoints/watchpoint_disable/TestWatchpointDisable.py lldb-api :: commands/watchpoints/watchpoint_size/TestWatchpointSizes.py lldb-api :: python_api/watchpoint/TestSetWatchpoint.py lldb-api :: python_api/watchpoint/TestWatchpointIgnoreCount.py lldb-api :: python_api/watchpoint/TestWatchpointIter.py lldb-api :: python_api/watchpoint/condition/TestWatchpointConditionAPI.py lldb-api :: python_api/watchpoint/watchlocation/TestTargetWatchAddress.py lldb-shell :: SymbolFile/DWARF/dwo-static-data-member-access.test lldb-shell :: Unwind/windows-unaligned-x86_64.test ******************** Unexpectedly Passed Tests (2): lldb-api :: lang/cpp/class-template-non-type-parameter-pack/TestClassTemplateNonTypeParameterPack.py lldb-api :: lang/cpp/class-template-type-parameter-pack/TestClassTemplateTypeParameterPack.py Testing Time: 392.03s Total Discovered Tests: 2883 Unsupported : 758 (26.29%) Passed : 2072 (71.87%) Expectedly Failed : 31 (1.08%) Failed : 20 (0.69%) Unexpectedly Passed: 2 (0.07%) ``` See full error log: [lldb_test_errors.txt](https://github.com/llvm/llvm-project/files/13924621/lldb_test_errors.txt) @JDevlieghere are you able to take a look please?