No module named 'fused_layer_norm_cuda'

[Garin2-colab]

when i run your 'a woman on grass with her hair on fire' i got this error. thank you in advance!

---

Error occurred when executing DownloadAndLoadLuminaModel:

No module named 'fused_layer_norm_cuda'

File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LuminaWrapper\nodes.py", line 77, in loadmodel model = lumina_models.dict[train_args.model](qk_norm=train_args.qk_norm, cap_feat_dim=2048) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LuminaWrapper\lumina_models\nextdit.py", line 1007, in NextDiT_2B_GQA_patch2 return NextDiT(patch_size=2, dim=2304, n_layers=24, n_heads=32, n_kv_heads=8, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LuminaWrapper\lumina_models\nextdit.py", line 707, in init [ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LuminaWrapper\lumina_models\nextdit.py", line 708, in TransformerBlock( File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LuminaWrapper\lumina_models\nextdit.py", line 544, in init self.attention_norm1 = RMSNorm(dim, eps=norm_eps) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\giantstep01\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\apex\normalization\fused_layer_norm.py", line 393, in init fused_layer_norm_cuda = importlib.import_module("fused_layer_norm_cuda") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "importlib__init__.py", line 126, in import_module File "", line 1204, in _gcd_import File "", line 1176, in _find_and_load File "", line 1140, in _find_and_load_unlocked

[Garin2-colab]

i installed apex but still get the error. is this related to my "--disable-cuda-malloc" setup?

[kijai]

Does this error happen if you simply uninstall apex? It should skip that part and still work if apex is not detected. If it's detected and not installed correctly, it will error out. I never managed to get apex working on windows myself.

[Garin2-colab]

first of all thank you for taking time to answer my question. After i uninstalled apex, it started working!!!

[kijai]

first of all thank you for taking time to answer my question. After i uninstalled apex, it started working!!!

Okay, good to know! I really need to try on Linux if apex can make this any faster...