search

comfyanonymous / ComfyUI_bitsandbytes_NF4

GNU Affero General Public License v3.0
335 stars 29 forks source link

Worked fine last night then today getting issues. #29

Open dorothythul opened 3 months ago

dorothythul commented 3 months ago

I did not do anything but start comfy today and got his error when it was working fine last night.. I updated comfy multiple times, uninstalled and reinstalled bitsandbytes. when i try and run it now i get this error.

Error occurred when executing CheckpointLoaderNF4:

Expecting value: line 1 column 1 (char 0)

File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4__init__.py", line 178, in load_checkpoint out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae=True, output_clip=True, embedding_directory=folder_paths.get_folder_paths("embeddings"), model_options={"custom_operations": OPS}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\comfy\sd.py", line 511, in load_checkpoint_guess_config out = load_state_dict_guess_config(sd, output_vae, output_clip, output_clipvision, embedding_directory, output_model, model_options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\comfy\sd.py", line 553, in load_state_dict_guess_config model.load_model_weights(sd, diffusion_model_prefix) File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 225, in load_model_weights m, u = self.diffusion_model.load_state_dict(to_load, strict=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2201, in load_state_dict load(self, state_dict) File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2189, in load load(child, child_state_dict, child_prefix) # noqa: F821 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2189, in load load(child, child_state_dict, child_prefix) # noqa: F821 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2189, in load load(child, child_state_dict, child_prefix) # noqa: F821 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2183, in load module._load_from_state_dict( File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4__init.py", line 97, in _load_from_state_dict self.weight = ForgeParams4bit.from_prequantized( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\bitsandbytes\nn\modules.py", line 281, in from_prequantized self.quant_state = QuantState.from_dict(qs_dict=quantized_stats, device=device) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\bitsandbytes\functional.py", line 709, in from_dict qs_dict.update(unpack_tensor_to_dict(qs_dict.pop(first_qs_key))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\bitsandbytes\utils.py", line 198, in unpack_tensor_to_dict unpacked_dict = json.loads(json_str) ^^^^^^^^^^^^^^^^^^^^ File "json\init__.py", line 346, in loads File "json\decoder.py", line 337, in decode File "json\decoder.py", line 355, in raw_decode