search

iree-org / iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.
http://iree.dev/
Apache License 2.0
2.56k stars 568 forks source link

Error invoking IREE compiler tool iree-compile.exe - on NVIDIA RTX 3060 #14513

Open 1tylermitchell opened 1 year ago

1tylermitchell commented 1 year ago

What happened?

gradio temporary image cache located at C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\shark_tmp/gradio. You may change this by setting the GRADIO_TEMP_DIR environment variable.
No temporary images files to clear.
vulkan devices are available.
shark_tank local cache is located at C:\Users\tyler\.local/shark_tank/ . You may change this by setting the --local_tank_cache= flag
metal devices are not available.
cuda devices are available.
shark_tank local cache is located at C:\Users\tyler\.local/shark_tank/ . You may change this by setting the --local_tank_cache= flag
local-sync devices are available.
shark_tank local cache is located at C:\Users\tyler\.local/shark_tank/ . You may change this by setting the --local_tank_cache= flag
local-task devices are available.
shark_tank local cache is located at C:\Users\tyler\.local/shark_tank/ . You may change this by setting the --local_tank_cache= flag
diffusers\models\cross_attention.py:30: FutureWarning: Importing from cross_attention is deprecated. Please import from diffusers.models.attention_processor instead.
['AMD Ryzen 7 7700X 8-Core Processor => local-task://0', 'AMD Radeon(TM) Graphics => vulkan://0', 'NVIDIA GeForce RTX 3060 => vulkan://1', 'NVIDIA GeForce RTX 3060 => cuda://0']
['AMD Ryzen 7 7700X 8-Core Processor => local-task://0', 'AMD Radeon(TM) Graphics => vulkan://0', 'NVIDIA GeForce RTX 3060 => vulkan://1', 'NVIDIA GeForce RTX 3060 => cuda://0']
Running on local URL:  http://0.0.0.0:8080
shark_tank local cache is located at C:\Users\tyler\.local/shark_tank/ . You may change this by setting the --local_tank_cache= flag

To create a public link, set `share=True` in `launch()`.
Found 1 device(s).
Device: 0
  Name: NVIDIA GeForce RTX 3060
  Compute Capability: 8.6
Tuned models are currently not supported for this setting.
failed to download model, falling back and using import_mlir
No vmfb found. Compiling and saving to C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_scale_model_input_1_512_512_cuda_fp16.vmfb
Configuring for device:cuda
Found 1 device(s).
Device: 0
  Name: NVIDIA GeForce RTX 3060
  Compute Capability: 8.6
Saved vmfb in C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_scale_model_input_1_512_512_cuda_fp16.vmfb.
Loading flatbuffer at C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_scale_model_input_1_512_512_cuda_fp16.vmfb as a mmapped file
No vmfb found. Compiling and saving to C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_step_1_512_512_cuda_fp16.vmfb
Configuring for device:cuda
Found 1 device(s).
Device: 0
  Name: NVIDIA GeForce RTX 3060
  Compute Capability: 8.6
Saved vmfb in C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_step_1_512_512_cuda_fp16.vmfb.
Loading flatbuffer at C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\euler_step_1_512_512_cuda_fp16.vmfb as a mmapped file
use_tuned? sharkify: False
_1_64_512_512_fp16_stable-diffusion-2-1-base
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
No vmfb found. Compiling and saving to C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\clip_1_64_512_512_fp16_stable-diffusion-2-1-base_cuda.vmfb
Configuring for device:cuda
Found 1 device(s).
Device: 0
  Name: NVIDIA GeForce RTX 3060
  Compute Capability: 8.6
Saved vmfb in C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\clip_1_64_512_512_fp16_stable-diffusion-2-1-base_cuda.vmfb.
Loading flatbuffer at C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\clip_1_64_512_512_fp16_stable-diffusion-2-1-base_cuda.vmfb as a mmapped file
No vmfb found. Compiling and saving to C:\Users\tyler\AppData\Local\Temp\scoped_dir16596_1940293082\unet_1_64_512_512_fp16_stable-diffusion-2-1-base_cuda.vmfb
Configuring for device:cuda
Found 1 device(s).
Device: 0
  Name: NVIDIA GeForce RTX 3060
  Compute Capability: 8.6
Error invoking IREE compiler tool iree-compile.exe
Diagnostics:
Please report issues to https://github.com/openxla/iree/issues and include the crash backtrace.
Exception Code: 0xC0000005
Exception Code: 0xC0000005
Exception Code: 0xC0000005
0x00007FFF035DBA40, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1ABA40 byte(s)0x00007FFF035DBA40, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1ABA40 byte(s)0x00007FFF035DBA40, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1ABA40 byte(s), ireeCompilerRunLldMain() + 0xF4FF0 byte(s), ireeCompilerRunLldMain() + 0xF4FF0 byte(s), ireeCompilerRunLldMain() + 0xF4FF0 byte(s)

0x00007FFF035DE92E0x00007FFF035DE92E, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1AE92E byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1AE92E byte(s), ireeCompilerRunLldMain() + 0xF7EDE byte(s)
0x00007FFF035DE92E, ireeCompilerRunLldMain() + 0xF7EDE byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1AE92E byte(s), ireeCompilerRunLldMain() + 0xF7EDE byte(s)0x00007FFF048B4843
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1484843 byte(s)0x00007FFF048B4843, ireeCompilerRunLldMain() + 0x13CDDF3 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1484843 byte(s), ireeCompilerRunLldMain() + 0x13CDDF3 byte(s)
0x00007FFF048B45C40x00007FFF048B4843, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14845C4 byte(s)0x00007FFF048B45C4, ireeCompilerRunLldMain() + 0x13CDB74 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14845C4 byte(s), ireeCompilerRunLldMain() + 0x13CDB74 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1484843 byte(s), ireeCompilerRunLldMain() + 0x13CDDF3 byte(s)
0x00007FFF048ADF04, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DF04 byte(s), ireeCompilerRunLldMain() + 0x13C74B4 byte(s)
0x00007FFF048ADF04, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DF04 byte(s), ireeCompilerRunLldMain() + 0x13C74B4 byte(s)
0x00007FFF048ACAB70x00007FFF048B45C4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147CAB7 byte(s)0x00007FFF048ACAB7, ireeCompilerRunLldMain() + 0x13C6067 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147CAB7 byte(s), ireeCompilerRunLldMain() + 0x13C6067 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14845C4 byte(s), ireeCompilerRunLldMain() + 0x13CDB74 byte(s)
0x00007FFF048880BE, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14580BE byte(s)0x00007FFF048880BE, ireeCompilerRunLldMain() + 0x13A166E byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14580BE byte(s), ireeCompilerRunLldMain() + 0x13A166E byte(s)
0x00007FFF048878120x00007FFF048ADF04, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1457812 byte(s)0x00007FFF04887812, ireeCompilerRunLldMain() + 0x13A0DC2 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1457812 byte(s), ireeCompilerRunLldMain() + 0x13A0DC2 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DF04 byte(s), ireeCompilerRunLldMain() + 0x13C74B4 byte(s)
0x00007FFF0486BFF6, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x143BFF6 byte(s)0x00007FFF0486BFF6, ireeCompilerRunLldMain() + 0x13855A6 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x143BFF6 byte(s), ireeCompilerRunLldMain() + 0x13855A6 byte(s)
0x00007FFF048AD268, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147D268 byte(s)0x00007FFF048AD268, ireeCompilerRunLldMain() + 0x13C6818 byte(s)
0x00007FFF048ACAB7, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147D268 byte(s), ireeCompilerRunLldMain() + 0x13C6818 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147CAB7 byte(s), ireeCompilerRunLldMain() + 0x13C6067 byte(s)
0x00007FFF048ADB61, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DB61 byte(s), ireeCompilerRunLldMain() + 0x13C7111 byte(s)
0x00007FFF048ADB61, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DB61 byte(s), ireeCompilerRunLldMain() + 0x13C7111 byte(s)
0x00007FFF04471A060x00007FFF048880BE, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1041A06 byte(s)0x00007FFF04471A06, ireeCompilerRunLldMain() + 0xF8AFB6 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1041A06 byte(s), ireeCompilerRunLldMain() + 0xF8AFB6 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x14580BE byte(s), ireeCompilerRunLldMain() + 0x13A166E byte(s)
0x00007FFF043248B6, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xEF48B6 byte(s)0x00007FFF043248B6, ireeCompilerRunLldMain() + 0xE3DE66 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xEF48B6 byte(s), ireeCompilerRunLldMain() + 0xE3DE66 byte(s)
0x00007FFF0367775A0x00007FFF048878120x00007FFF0367775A, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1457812 byte(s), ireeCompilerRunLldMain() + 0x13A0DC2 byte(s)
0x00007FFF0367CD630x00007FFF0367CD63, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
0x00007FFF0486BFF6, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x143BFF6 byte(s)0x00007FFF0367E5110x00007FFF0367E511, ireeCompilerRunLldMain() + 0x13855A6 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)
, ireeCompilerRunLldMain() + 0x197AC1 byte(s)

0x00007FFF036794A40x00007FFF036794A4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)
, ireeCompilerRunLldMain() + 0x192A54 byte(s)
0x00007FFF048AD268, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147D268 byte(s)0x00007FFF036776E70x00007FFF036776E7, ireeCompilerRunLldMain() + 0x13C6818 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s)
, ireeCompilerRunLldMain() + 0x190C97 byte(s)

0x00007FFF03E4B0FB0x00007FFF03E4B0FB, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xA1B0FB byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xA1B0FB byte(s), ireeCompilerRunLldMain() + 0x9646AB byte(s), ireeCompilerRunLldMain() + 0x9646AB byte(s)

0x00007FFF048ADB61, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x147DB61 byte(s), ireeCompilerRunLldMain() + 0x13C7111 byte(s)0x00007FFF0367775A0x00007FFF0367775A
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)
, ireeCompilerRunLldMain() + 0x190D0A byte(s)
0x00007FFF04471A060x00007FFF0367CD630x00007FFF0367CD63, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1041A06 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
, ireeCompilerRunLldMain() + 0x196313 byte(s)
, ireeCompilerRunLldMain() + 0xF8AFB6 byte(s)
0x00007FFF0367E5110x00007FFF0367E511, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)

0x00007FFF043248B6, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xEF48B6 byte(s), ireeCompilerRunLldMain() + 0xE3DE66 byte(s)
0x00007FFF036794A40x00007FFF036794A4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)
, ireeCompilerRunLldMain() + 0x192A54 byte(s)
0x00007FFF0367775A0x00007FFF036776E70x00007FFF036776E7, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s)

, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)
0x00007FFF040817220x00007FFF04081722, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xC51722 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xC51722 byte(s), ireeCompilerRunLldMain() + 0xB9ACD2 byte(s)
, ireeCompilerRunLldMain() + 0xB9ACD2 byte(s)
0x00007FFF0367CD63, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)0x00007FFF0367775A0x00007FFF0367775A
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)

0x00007FFF0367CD630x00007FFF0367CD630x00007FFF0367E511, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
, ireeCompilerRunLldMain() + 0x196313 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)
0x00007FFF0367E5110x00007FFF0367E511, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)
, ireeCompilerRunLldMain() + 0x197AC1 byte(s)
0x00007FFF036794A4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)0x00007FFF03677C000x00007FFF03677C00
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x247C00 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x247C00 byte(s), ireeCompilerRunLldMain() + 0x1911B0 byte(s)
, ireeCompilerRunLldMain() + 0x1911B0 byte(s)
0x00007FFF0367DF470x00007FFF0367DF47, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24DF47 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24DF47 byte(s), ireeCompilerRunLldMain() + 0x1974F7 byte(s)
, ireeCompilerRunLldMain() + 0x1974F7 byte(s)
0x00007FFF036776E7, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s)
0x00007FFF036777450x00007FFF03677745, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x247745 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x247745 byte(s), ireeCompilerRunLldMain() + 0x190CF5 byte(s)
, ireeCompilerRunLldMain() + 0x190CF5 byte(s)
0x00007FFF03E4B0FB0x00007FFF0367CD630x00007FFF0367CD63, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
, ireeCompilerRunLldMain() + 0x196313 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xA1B0FB byte(s), ireeCompilerRunLldMain() + 0x9646AB byte(s)
0x00007FFF0367E5110x00007FFF0367E511, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)

0x00007FFF0367775A, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s)0x00007FFF036794A4, ireeCompilerRunLldMain() + 0x190D0A byte(s)0x00007FFF036794A4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)

, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)
0x00007FFF036776E7, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s)
0x00007FFF036776E7, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s), ireeCompilerRunLldMain() + 0x190C97 byte(s)
0x00007FFF040813F6, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xC513F6 byte(s), ireeCompilerRunLldMain() + 0xB9A9A6 byte(s)0x00007FFF040813F60x00007FFF0367CD63, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xC513F6 byte(s), ireeCompilerRunLldMain() + 0xB9A9A6 byte(s)

, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)
0x00007FFF0367775A0x00007FFF0367775A, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24775A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s), ireeCompilerRunLldMain() + 0x190D0A byte(s)

0x00007FFF0367E511, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)0x00007FFF0367CD630x00007FFF0367CD63
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24CD63 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s), ireeCompilerRunLldMain() + 0x196313 byte(s)

0x00007FFF0367E5110x00007FFF0367E5110x00007FFF036794A4, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x24E511 byte(s), ireeCompilerRunLldMain() + 0x197AC1 byte(s)
, ireeCompilerRunLldMain() + 0x197AC1 byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2494A4 byte(s), ireeCompilerRunLldMain() + 0x192A54 byte(s)
0x00007FFF036796A80x00007FFF036796A8, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2496A8 byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2496A8 byte(s), ireeCompilerRunLldMain() + 0x192C58 byte(s)
, ireeCompilerRunLldMain() + 0x192C58 byte(s)
0x00007FFF036776E70x00007FFF035FC3BC, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1CC3BC byte(s), ireeCompilerRunLldMain() + 0x11596C byte(s)
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x2476E7 byte(s)0x00007FFF035FC3BC, ireeCompilerRunLldMain() + 0x190C97 byte(s)
0x00007FFF034EF5A2, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0x1CC3BC byte(s), ireeCompilerRunLldMain() + 0x11596C byte(s), C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xBF5A2 byte(s)
, ireeCompilerRunLldMain() + 0x8B52 byte(s)
0x00007FFF034EE628, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xBE628 byte(s), ireeCompilerRunLldMain() + 0x7BD8 byte(s)0x00007FFF034EF5A2
, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xBF5A2 byte(s), ireeCompilerRunLldMain() + 0x8B52 byte(s)
0x00007FFF040817220x00007FF86DBF9363, C:\Windows\System32\ucrtbase.dll(0x00007FF86DBD0000) + 0x29363 byte(s), _recalloc() + 0xA3 byte(s)
0x00007FFF034EE628, C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\_mlir_libs\IREECompiler.dll(0x00007FFF03430000) + 0xBE628 byte(s), ireeCompilerRunLldMain() + 0x7BD8 byte(s)
0x00007FF86F2226AD, C:\Windows\System32\KERNEL32.DLL(0x00007FF86F210000) + 0x126AD byte(s), BaseThreadInitThunk() + 0x1D byte(s)
0x00007FF86DBF9363, C:\Windows\System32\ucrtbase.dll(0x00007FF86DBD0000) + 0x29363 byte(s), _recalloc() + 0xA3 byte(s)
0x00007FF87082AA68, C:\Windows\SYSTEM32\ntdll.dll(0x00007FF8707D0000) + 0x5AA68 byte(s), RtlUserThreadStart() + 0x28 byte(s)
0x00007FF86F2226AD, C:\Windows\System32\KERNEL32.DLL(0x00007FF86F210000) + 0x126AD byte(s), BaseThreadInitThunk() + 0x1D byte(s)
0x00007FF87082AA68

Invoked with:
 iree-compile.exe C:\Users\tyler\AppData\Local\Temp\_MEI462042\iree\compiler\tools\..\_mlir_libs\iree-compile.exe - --iree-input-type=tm_tensor --iree-vm-bytecode-module-output-format=flatbuffer-binary --iree-hal-target-backends=cuda --mlir-print-debuginfo --mlir-print-op-on-diagnostic=false --iree-llvmcpu-target-cpu-features=host --iree-hal-cuda-llvm-target-arch=sm_86 --iree-stream-resource-index-bits=64 --iree-vm-target-index-bits=64 --iree-vm-bytecode-module-strip-source-map=true --iree-util-zero-fill-elided-attrs --iree-preprocessing-pass-pipeline=builtin.module(func.func(iree-flow-detach-elementwise-from-named-ops,iree-flow-convert-1x1-filter-conv2d-to-matmul,iree-preprocessing-convert-conv2d-to-img2col,iree-preprocessing-pad-linalg-ops{pad-size=32}))

Need more information? Set IREE_SAVE_TEMPS=/some/dir in your environment to save all artifacts and reproducers.

Retrying with a different base model configuration
mat1 and mat2 shapes cannot be multiplied (128x768 and 1024x320)
Retrying with a different base model configuration
Given groups=1, weight of size [320, 4, 3, 3], expected input[2, 9, 64, 64] to have 4 channels, but got 9 channels instead
Retrying with a different base model configuration
Given groups=1, weight of size [320, 4, 3, 3], expected input[2, 9, 64, 64] to have 4 channels, but got 9 channels instead
Retrying with a different base model configuration
Given groups=1, weight of size [320, 4, 3, 3], expected input[4, 7, 512, 512] to have 4 channels, but got 7 channels instead
Retrying with a different base model configuration
Traceback (most recent call last):
  File "gradio\routes.py", line 442, in run_predict
  File "gradio\blocks.py", line 1392, in process_api
  File "gradio\blocks.py", line 1111, in call_function
  File "gradio\utils.py", line 346, in async_iteration
  File "gradio\utils.py", line 339, in __anext__
  File "anyio\to_thread.py", line 33, in run_sync
  File "anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
  File "anyio\_backends\_asyncio.py", line 807, in run
  File "gradio\utils.py", line 322, in run_sync_iterator_async
  File "gradio\utils.py", line 691, in gen_wrapper
  File "ui\txt2img_ui.py", line 188, in txt2img_inf
  File "apps\stable_diffusion\src\pipelines\pipeline_shark_stable_diffusion_txt2img.py", line 134, in generate_images
  File "apps\stable_diffusion\src\pipelines\pipeline_shark_stable_diffusion_utils.py", line 235, in produce_img_latents
  File "apps\stable_diffusion\src\pipelines\pipeline_shark_stable_diffusion_utils.py", line 114, in load_unet
  File "apps\stable_diffusion\src\models\model_wrappers.py", line 826, in unet
  File "apps\stable_diffusion\src\models\model_wrappers.py", line 821, in unet
  File "apps\stable_diffusion\src\models\model_wrappers.py", line 63, in check_compilation
SystemExit: Could not compile Unet. Please create an issue with the detailed log at https://github.com/nod-ai/SHARK/issues

Steps to reproduce your issue

What component(s) does this issue relate to?

Compiler

Version information

776a9c2

Additional context

I regularly run auto1111 SD2 on same machine with no problem. First time trying shark.

ScottTodd commented 1 year ago

Do we have a way to symbolize crashes in iree\compiler\_mlir_libs\IREECompiler.dll or generate reproducers from shark? I'm not sure how we could triage this without that info.