search

zer0int / CLIP-fine-tune

Fine-tuning code for CLIP models
MIT License
169 stars 8 forks source link

error report #2

Closed T8mars closed 5 months ago

T8mars commented 6 months ago

File "D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\nodes.py", line 1879, in load_custom_node module_spec.loader.exec_module(module) File "", line 879, in exec_module File "", line 1016, in get_code File "", line 1073, in get_data FileNotFoundError: [Errno 2] No such file or directory: 'D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\custom_nodes\CLIP-fine-tune\init.py'

Cannot import D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\custom_nodes\CLIP-fine-tune module for custom nodes: [Errno 2] No such file or directory: 'D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\custom_nodes\CLIP-fine-tune\init.py' [Allor]: No new updates. [Allor]: 0 nodes were overridden. [Allor]: 12 modules were enabled. [Allor]: 98 nodes were loaded. [AnimateDiff] - WARNING - xformers is enabled but it has a bug that can cause issue while using with AnimateDiff. [custom_nodes.comfyui_controlnet_aux] | INFO -> Using ckpts path: D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\custom_nodes\comfyui_controlnet_aux\ckpts [custom_nodes.comfyui_controlnet_aux] | INFO -> Using symlinks: False [custom_nodes.comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider'] DWPose: Onnxruntime with acceleration providers detected Adding D:\ComfyUI-aki\ComfyUI-aki-v1.2_T8\custom_nodes to sys.path

zer0int commented 6 months ago

Sorry, this repo does not have any custom nodes for ComfyUI; it's for fine-tuning CLIP (via the command line, independent of ComfyUI)! To use your fine-tune with ComfyUI:

If you fine-tuned a GmP-CLIP via the "exp-ft*" scripts, first use this: exp-ft-C-convert-GmP-back-to-weight.py And then: ft-C-convert-for-SDXL-comfyUI-OpenAI-CLIP.py

Likewise, if you have a "normal" (no GmP) fine-tune, simply use this: ft-C-convert-for-SDXL-comfyUI-OpenAI-CLIP.py

This will give you a "state_dict" file you can then plug into SDXL etc. via ComfUI (without the need for adding any custom nodes etc.):

dualclip

Please scroll all the way down in the readme on my repo; I outlined the full steps to "plug your fine-tune into ComfyUI" there.