bailuan
commented
4 weeks ago adding --streaming_llm could avoid the error.
Open bailuan opened 1 month ago
bailuan
commented
4 weeks ago adding --streaming_llm could avoid the error.
Error log:
(shark-turbine-llama-forward) root@cltech218:/workspace/bailuan/shark-turbine-llama-forward/SHARK-ModelDev/models/turbine_models/custom_models# python stateless_llama.py --compile_to=vmfb --device=llvm-cpu --external_weights=safetensors --external_weight_file=/root/.cache/huggingface/hub/models--meta-llama--Llama-2-7b-chat-hf/model-00001-of-00002.safetensors bailuan...0 bailuan...1 Loading checkpoint shards: 100%| 2/2 [00:05<00:00, 2.58s/it] Decomposing torch SDPA I1014 03:52:01.329000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] create_symbol s0 = 2 for input0.size()[1] [2, 9223372036854775806] (fx/experimental/proxy_tensor.py:1315 in inner_wrap_fake), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s0" Starting from v4.46, thelogitsmodel output will have the same type as the model (except at train time, where it will always be FP32) I1014 03:52:06.535000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [0/0] create_symbol s0 = 2 for L['arg0_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s0" I1014 03:52:26.000000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3633] [0/0] produce_guards I1014 03:52:36.196000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] create_symbol s0 = 2 for input1.size()[1] [2, 9223372036854775806] (fx/experimental/proxy_tensor.py:1315 in inner_wrap_fake), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s0" I1014 03:52:36.198000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] create_symbol s1 = 32 for input1.size()[2] [2, 9223372036854775806] (fx/experimental/proxy_tensor.py:1315 in inner_wrap_fake), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s1" I1014 03:52:36.200000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] create_symbol s2 = 128 for input1.size()[3] [2, 9223372036854775806] (fx/experimental/proxy_tensor.py:1315 in inner_wrap_fake), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s2" We detected that you are passingpast_key_valuesas a tuple of tuples. This is deprecated and will be removed in v4.47. Please convert your cache or use an appropriateCacheclass (https://huggingface.co/docs/transformers/kv_cache#legacy-cache-format) I1014 03:52:36.636000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] set_replacement s1 = 32 (solve) ValueRanges(lower=32, upper=32, is_bool=False) I1014 03:52:36.637000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] eval Eq(s1, 32) [guard added] (_prims/__init__.py:1942 in _cat_meta), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s1, 32)" I1014 03:52:36.644000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] set_replacement s2 = 128 (solve) ValueRanges(lower=128, upper=128, is_bool=False) I1014 03:52:36.644000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] eval Eq(s2, 128) [guard added] (_prims/__init__.py:1942 in _cat_meta), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s2, 128)" I1014 03:52:38.055000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] eval s0 + 1 < 9223372036854775807 [guard added] (_decomp/decompositions.py:762 in slice_forward), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="s0 + 1 < 9223372036854775807" I1014 03:52:39.173000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s0 = 2 for L['arg1_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s0" I1014 03:52:39.176000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s1 = 2 for L['arg2_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s1" I1014 03:52:39.179000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s2 = 2 for L['arg3_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s2" I1014 03:52:39.184000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s3 = 2 for L['arg4_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s3" I1014 03:52:39.187000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s4 = 2 for L['arg5_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s4" I1014 03:52:39.191000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s5 = 2 for L['arg6_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s5" I1014 03:52:39.195000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s6 = 2 for L['arg7_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s6" I1014 03:52:39.199000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s7 = 2 for L['arg8_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s7" I1014 03:52:39.203000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s8 = 2 for L['arg9_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s8" I1014 03:52:39.207000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s9 = 2 for L['arg10_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s9" I1014 03:52:39.211000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s10 = 2 for L['arg11_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s10" I1014 03:52:39.215000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s11 = 2 for L['arg12_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s11" I1014 03:52:39.219000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s12 = 2 for L['arg13_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s12" I1014 03:52:39.223000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s13 = 2 for L['arg14_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s13" I1014 03:52:39.226000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s14 = 2 for L['arg15_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s14" I1014 03:52:39.230000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s15 = 2 for L['arg16_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s15" I1014 03:52:39.234000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s16 = 2 for L['arg17_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s16" I1014 03:52:39.238000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s17 = 2 for L['arg18_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s17" I1014 03:52:39.242000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s18 = 2 for L['arg19_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s18" I1014 03:52:39.245000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s19 = 2 for L['arg20_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s19" I1014 03:52:39.249000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s20 = 2 for L['arg21_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s20" I1014 03:52:39.253000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s21 = 2 for L['arg22_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s21" I1014 03:52:39.257000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s22 = 2 for L['arg23_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s22" I1014 03:52:39.261000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s23 = 2 for L['arg24_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s23" I1014 03:52:39.265000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s24 = 2 for L['arg25_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s24" I1014 03:52:39.269000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s25 = 2 for L['arg26_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s25" I1014 03:52:39.273000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s26 = 2 for L['arg27_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s26" I1014 03:52:39.276000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s27 = 2 for L['arg28_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s27" I1014 03:52:39.280000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s28 = 2 for L['arg29_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s28" I1014 03:52:39.284000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s29 = 2 for L['arg30_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s29" I1014 03:52:39.288000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s30 = 2 for L['arg31_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s30" I1014 03:52:39.293000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s31 = 2 for L['arg32_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s31" I1014 03:52:39.297000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s32 = 2 for L['arg33_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s32" I1014 03:52:39.301000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s33 = 2 for L['arg34_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s33" I1014 03:52:39.304000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s34 = 2 for L['arg35_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s34" I1014 03:52:39.308000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s35 = 2 for L['arg36_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s35" I1014 03:52:39.312000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s36 = 2 for L['arg37_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s36" I1014 03:52:39.316000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s37 = 2 for L['arg38_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s37" I1014 03:52:39.320000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s38 = 2 for L['arg39_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s38" I1014 03:52:39.324000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s39 = 2 for L['arg40_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s39" I1014 03:52:39.334000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s40 = 2 for L['arg41_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s40" I1014 03:52:39.337000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s41 = 2 for L['arg42_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s41" I1014 03:52:39.341000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s42 = 2 for L['arg43_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s42" I1014 03:52:39.345000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s43 = 2 for L['arg44_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s43" I1014 03:52:39.349000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s44 = 2 for L['arg45_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s44" I1014 03:52:39.353000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s45 = 2 for L['arg46_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s45" I1014 03:52:39.357000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s46 = 2 for L['arg47_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s46" I1014 03:52:39.360000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s47 = 2 for L['arg48_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s47" I1014 03:52:39.364000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s48 = 2 for L['arg49_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s48" I1014 03:52:39.368000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s49 = 2 for L['arg50_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s49" I1014 03:52:39.372000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s50 = 2 for L['arg51_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s50" I1014 03:52:39.376000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s51 = 2 for L['arg52_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s51" I1014 03:52:39.380000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s52 = 2 for L['arg53_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s52" I1014 03:52:39.384000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s53 = 2 for L['arg54_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s53" I1014 03:52:39.388000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s54 = 2 for L['arg55_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s54" I1014 03:52:39.392000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s55 = 2 for L['arg56_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s55" I1014 03:52:39.396000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s56 = 2 for L['arg57_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s56" I1014 03:52:39.399000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s57 = 2 for L['arg58_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s57" I1014 03:52:39.403000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s58 = 2 for L['arg59_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s58" I1014 03:52:39.407000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s59 = 2 for L['arg60_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s59" I1014 03:52:39.411000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s60 = 2 for L['arg61_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s60" I1014 03:52:39.415000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s61 = 2 for L['arg62_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s61" I1014 03:52:39.418000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s62 = 2 for L['arg63_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s62" I1014 03:52:39.422000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3545] [1/0] create_symbol s63 = 2 for L['arg64_1'].size()[1] [2, 4094] (_dynamo/variables/builder.py:2276 in <lambda>), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL="s63" I1014 03:52:59.590000 139781498798080 torch/fx/experimental/symbolic_shapes.py:3633] [1/0] produce_guards I1014 03:52:59.596000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s1 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.597000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s1) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s1)" I1014 03:52:59.601000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s2 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.601000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s2) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s2)" I1014 03:52:59.606000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s3 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.606000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s3) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s3)" I1014 03:52:59.611000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s4 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.612000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s4) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s4)" I1014 03:52:59.618000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s5 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.618000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s5) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s5)" I1014 03:52:59.625000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s6 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.625000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s6) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s6)" I1014 03:52:59.632000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s7 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.632000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s7) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s7)" I1014 03:52:59.640000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s8 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.640000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s8) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s8)" I1014 03:52:59.649000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s9 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.649000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s9) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s9)" I1014 03:52:59.658000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s10 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.659000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s10) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s10)" I1014 03:52:59.672000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s11 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.673000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s11) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s11)" I1014 03:52:59.683000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s12 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.683000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s12) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s12)" I1014 03:52:59.694000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s13 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.694000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s13) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s13)" I1014 03:52:59.706000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s14 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.706000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s14) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s14)" I1014 03:52:59.987000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s15 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:52:59.987000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s15) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s15)" I1014 03:53:00.000000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s16 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.001000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s16) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s16)" I1014 03:53:00.014000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s17 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.015000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s17) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s17)" I1014 03:53:00.029000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s18 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.029000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s18) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s18)" I1014 03:53:00.044000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s19 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.044000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s19) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s19)" I1014 03:53:00.059000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s20 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.060000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s20) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s20)" I1014 03:53:00.076000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s21 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.076000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s21) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s21)" I1014 03:53:00.092000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s22 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.093000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s22) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s22)" I1014 03:53:00.110000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s23 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.110000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s23) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s23)" I1014 03:53:00.128000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s24 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.128000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s24) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s24)" I1014 03:53:00.147000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s25 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.147000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s25) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s25)" I1014 03:53:00.166000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s26 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.166000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s26) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s26)" I1014 03:53:00.187000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s27 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.187000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s27) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s27)" I1014 03:53:00.207000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s28 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.208000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s28) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s28)" I1014 03:53:00.229000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s29 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.229000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s29) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s29)" I1014 03:53:00.251000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s30 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.251000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s30) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s30)" I1014 03:53:00.273000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s31 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.273000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s31) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s31)" I1014 03:53:00.296000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s32 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.296000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s32) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s32)" I1014 03:53:00.320000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s33 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.320000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s33) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s33)" I1014 03:53:00.345000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s34 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.345000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s34) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s34)" I1014 03:53:00.370000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s35 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.370000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s35) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s35)" I1014 03:53:00.402000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s36 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.403000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s36) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s36)" I1014 03:53:00.429000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s37 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.429000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s37) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s37)" I1014 03:53:00.456000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s38 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.456000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s38) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s38)" I1014 03:53:00.484000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s39 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.484000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s39) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s39)" I1014 03:53:00.512000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s40 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.512000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s40) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s40)" I1014 03:53:00.541000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s41 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.541000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s41) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s41)" I1014 03:53:00.570000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s42 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.570000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s42) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s42)" I1014 03:53:00.600000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s43 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.601000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s43) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s43)" I1014 03:53:00.631000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s44 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.631000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s44) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s44)" I1014 03:53:00.662000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s45 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.663000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s45) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s45)" I1014 03:53:00.694000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s46 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.695000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s46) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s46)" I1014 03:53:00.727000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s47 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.727000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s47) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s47)" I1014 03:53:00.760000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s48 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.761000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s48) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s48)" I1014 03:53:00.794000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s49 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.794000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s49) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s49)" I1014 03:53:00.829000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s50 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.829000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s50) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s50)" I1014 03:53:00.864000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s51 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.864000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s51) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s51)" I1014 03:53:00.899000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s52 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.900000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s52) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s52)" I1014 03:53:00.936000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s53 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.936000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s53) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s53)" I1014 03:53:00.973000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s54 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:00.973000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s54) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s54)" I1014 03:53:01.017000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s55 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.017000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s55) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s55)" I1014 03:53:01.056000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s56 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.056000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s56) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s56)" I1014 03:53:01.095000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s57 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.095000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s57) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s57)" I1014 03:53:01.135000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s58 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.136000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s58) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s58)" I1014 03:53:01.176000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s59 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.177000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s59) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s59)" I1014 03:53:01.217000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s60 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.218000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s60) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s60)" I1014 03:53:01.259000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s61 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.259000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s61) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s61)" I1014 03:53:01.302000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s62 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.302000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s62) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s62)" I1014 03:53:01.345000 139781498798080 torch/fx/experimental/symbolic_shapes.py:4764] [1/0] set_replacement s63 = s0 (solve) ValueRanges(lower=2, upper=4094, is_bool=False) I1014 03:53:01.346000 139781498798080 torch/fx/experimental/symbolic_shapes.py:5015] [1/0] eval Eq(s0, s63) [guard added] (_dynamo/guards.py:1716 in SHAPE_ENV), for more info run with TORCHDYNAMO_EXTENDED_DEBUG_GUARD_ADDED="Eq(s0, s63)" ERROR 10-14 03:53:07 [ir_utils.py:200] module failed to verify (dumping to /tmp/turbine_module_builder_error.mlir) Traceback (most recent call last): File "/workspace/bailuan/envs/shark-turbine-llama-forward/lib/python3.10/site-packages/shark_turbine/aot/support/ir_utils.py", line 215, in finalize_construct self.module_op.verify() iree.compiler._mlir_libs._site_initialize.<locals>.MLIRError: Verification failed: error: "<eval_with_key>.0 from /workspace/bailuan/20231221_pytorch_install/pytorch/torch/fx/experimental/proxy_tensor.py:652 in wrapped":77:0: 'torch.aten.copy_' op operand #0 must be Multi-dimensional array modeling Torch's Tensor type, but got '!torch.vtensor<[?,?],f32>' note: "<eval_with_key>.0 from /workspace/bailuan/20231221_pytorch_install/pytorch/torch/fx/experimental/proxy_tensor.py:652 in wrapped":77:0: see current operation: %235 = "torch.aten.copy_"(%225, %233, %234) : (!torch.vtensor<[?,?],f32>, !torch.vtensor<[?,?],f32>, !torch.bool) -> !torch.vtensor<[?,?],f32> Traceback (most recent call last): File "/workspace/bailuan/shark-turbine-llama-forward/SHARK-ModelDev/models/turbine_models/custom_models/stateless_llama.py", line 500, in <module> mod_str, _ = export_transformer_model( File "/workspace/bailuan/shark-turbine-llama-forward/SHARK-ModelDev/models/turbine_models/custom_models/stateless_llama.py", line 460, in export_transformer_model inst = StateUpdateModule(context=Context(), import_to=import_to) File "/workspace/bailuan/envs/shark-turbine-llama-forward/lib/python3.10/site-packages/shark_turbine/aot/compiled_module.py", line 654, in __new__ module_builder.finalize_construct() File "/workspace/bailuan/envs/shark-turbine-llama-forward/lib/python3.10/site-packages/shark_turbine/aot/support/ir_utils.py", line 215, in finalize_construct self.module_op.verify() iree.compiler._mlir_libs._site_initialize.<locals>.MLIRError: Verification failed: error: "<eval_with_key>.0 from /workspace/bailuan/20231221_pytorch_install/pytorch/torch/fx/experimental/proxy_tensor.py:652 in wrapped":77:0: 'torch.aten.copy_' op operand #0 must be Multi-dimensional array modeling Torch's Tensor type, but got '!torch.vtensor<[?,?],f32>' note: "<eval_with_key>.0 from /workspace/bailuan/20231221_pytorch_install/pytorch/torch/fx/experimental/proxy_tensor.py:652 in wrapped":77:0: see current operation: %235 = "torch.aten.copy_"(%225, %233, %234) : (!torch.vtensor<[?,?],f32>, !torch.vtensor<[?,?],f32>, !torch.bool) -> !torch.vtensor<[?,?],f32>Error envs: