kijai / ComfyUI-Florence2

Inference Microsoft Florence2 VLM
MIT License
768 stars 51 forks source link

Eating up maximum RAM continuously even after finished doing generation already #51

Closed hakemz91 closed 3 months ago

hakemz91 commented 3 months ago

Here's the crazy thing. My RAM kept filling up non-stop even after the image finished generating. I remember hearing about this node problem in a YouTube video... and now it's happening to me. I'm surprised no one has brought up this issue yet, so here it is. Had to stop ctrl+c comfyui every time I finished generation. Hope it is fixed. I use Windows 11 btw and using comfyUI portable. GPU RTX 3060 12 GB and Intel i5 12400 cpu. And this is in my comfyui console: Null: 4578 [START] Security scan [DONE] Security scan

ComfyUI-Manager: installing dependencies done.

ComfyUI startup time: 2024-08-05 23:01:45.116122 Platform: Windows Python version: 3.11.8 (tags/v3.11.8:db85d51, Feb 6 2024, 22:03:32) [MSC v.1937 64 bit (AMD64)] Python executable: D:\ComfyUI\ComfyUI\python_embeded\python.exe ComfyUI Path: D:\ComfyUI\ComfyUI\ComfyUI Log path: D:\ComfyUI\ComfyUI\comfyui.log

Prestartup times for custom nodes: 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\rgthree-comfy 1.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Manager

Total VRAM 12288 MB, total RAM 32554 MB pytorch version: 2.3.0+cu121 xformers version: 0.0.26.post1 Set vram state to: NORMAL_VRAM Device: cuda:0 NVIDIA GeForce RTX 3060 : cudaMallocAsync Using xformers cross attention [Prompt Server] web root: D:\ComfyUI\ComfyUI\ComfyUI\web Adding extra search path checkpoints C:\FromOSBefore\AITools\stable-diffusion-webui\models/Stable-diffusion Adding extra search path configs C:\FromOSBefore\AITools\stable-diffusion-webui\models/Stable-diffusion Adding extra search path vae C:\FromOSBefore\AITools\stable-diffusion-webui\models/VAE Adding extra search path loras C:\FromOSBefore\AITools\stable-diffusion-webui\models/Lora Adding extra search path loras C:\FromOSBefore\AITools\stable-diffusion-webui\models/LyCORIS Adding extra search path upscale_models C:\FromOSBefore\AITools\stable-diffusion-webui\models/ESRGAN Adding extra search path upscale_models C:\FromOSBefore\AITools\stable-diffusion-webui\models/RealESRGAN Adding extra search path upscale_models C:\FromOSBefore\AITools\stable-diffusion-webui\models/SwinIR Adding extra search path embeddings C:\FromOSBefore\AITools\stable-diffusion-webui\embeddings Adding extra search path hypernetworks C:\FromOSBefore\AITools\stable-diffusion-webui\models/hypernetworks Adding extra search path controlnet C:\FromOSBefore\AITools\stable-diffusion-webui\extensions/sd-webui-controlnet/models Adding D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes to sys.path Efficiency Nodes: Attempting to add Control Net options to the 'HiRes-Fix Script' Node (comfyui_controlnet_aux add-on)...Success! Loaded Efficiency nodes from D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui Loaded ControlNetPreprocessors nodes from D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui_controlnet_aux Loaded AdvancedControlNet nodes from D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet Could not find AnimateDiff nodes Loaded IPAdapter nodes from D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus Loaded VideoHelperSuite from D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite

Loading: ComfyUI-Impact-Pack (V6.0.1)

Loading: ComfyUI-Impact-Pack (Subpack: V0.6)

Loading: ComfyUI-Impact-Pack (V6.0.1)

Loaded ImpactPack nodes from[Impact Pack] Wildcards loading done. D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Impact-Pack [Impact Pack] Wildcards loading done. [Crystools INFO] Crystools version: 1.16.6 [Crystools INFO] CPU: 12th Gen Intel(R) Core(TM) i5-12400 - Arch: AMD64 - OS: Windows 10 [Crystools INFO] Pynvml (Nvidia) initialized. [Crystools INFO] GPU/s: [Crystools INFO] 0) NVIDIA GeForce RTX 3060 [Crystools INFO] NVIDIA Driver: 552.22 [Moondream] trying to update model versions...ok [Moondream] found model versions: 2024-03-04, 2024-03-06, 2024-03-13, 2024-04-02, 2024-05-08, 2024-05-20, 2024-07-23 [Moondream] model revsion references: latest -> 48be9138e0faaec8802519b1b828350e33525d46 2023-03-04 -> b3d72d14957e9965facc14f53dc01c7e3bbe0eec 2024-03-04 -> b3d72d14957e9965facc14f53dc01c7e3bbe0eec 2024-03-05 -> 4a8fa31450e8def597abae38a8fa915d18e90b9f 2024-03-06 -> c064b4c517bbdbbad6351b1959c90b79858822be 2024-03-13 -> 2b705eea63f9bff6dae9b52c2daeb26bc10e4aeb 2024-04-02 -> 9ba2958f5a886de83fa18a235d651295a05b4d13 2024-05-08 -> 6275e4316f99adc1f8fd7f63301327f1ac4bfe5e 2024-05-20 -> af5f98991c2661d0c4448ff6c2fb3c19e74f1c02 2024-07-23 -> 79671eae7b5340017e91065d09c1ce1a352c0e8d

Loading: ComfyUI-Impact-Pack (V6.0.1)

[Impact Pack] Wildcards loading done.

Loading: ComfyUI-Inspire-Pack (V0.82.7)

Total VRAM 12288 MB, total RAM 32554 MB pytorch version: 2.3.0+cu121 xformers version: 0.0.26.post1 Set vram state to: NORMAL_VRAM Device: cuda:0 NVIDIA GeForce RTX 3060 : cudaMallocAsync

Loading: ComfyUI-Manager (V2.48.5)

ComfyUI Revision: 2469 [a178e259] | Released on '2024-08-05'


Mixlab Nodes: Loaded

ChatGPT.available True edit_mask.available True

lama torchscript model not found: D:\ComfyUI\ComfyUI\ComfyUI\models\lama\big-lama.pt,pls download from https://github.com/enesmsahin/simple-lama-inpainting/releases/download/v0.1.0/big-lama.pt

LaMaInpainting.available True

clip_interrogator_model not found: D:\ComfyUI\ComfyUI\ComfyUI\models\clip_interrogator\Salesforce\blip-image-captioning-base, pls download from https://huggingface.co/Salesforce/blip-image-captioning-base

ClipInterrogator.available True [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json

text_generator_model not found: D:\ComfyUI\ComfyUI\ComfyUI\models\prompt_generator\text2image-prompt-generator, pls download from https://huggingface.co/succinctly/text2image-prompt-generator/tree/main

zh_en_model not found: D:\ComfyUI\ComfyUI\ComfyUI\models\prompt_generator\opus-mt-zh-en, pls download from https://huggingface.co/Helsinki-NLP/opus-mt-zh-en/tree/main

PromptGenerate.available True ChinesePrompt.available True RembgNode_.available True [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json TripoSR.available


N-Suite Revision: 59ecf716

Current version of packaging: 24.0 Version of cpuinfo: Not found Current version of git: 3.1.43 Current version of moviepy: 1.0.3 Current version of cv2: 4.9.0 Current version of skbuild: 0.17.6 Version of typing: Not found Current version of diskcache: 5.6.3 Current version of llama_cpp: 0.2.76 Current version of timm: 1.0.3 A new version of Albumentations is available: 1.4.12 (you have 1.4.7). Upgrade using: pip install --upgrade albumentations [ReActor] - STATUS - Running v0.5.1-a6 in ComfyUI Torch version: 2.3.0+cu121 (pysssss:WD14Tagger) [DEBUG] Available ORT providers: AzureExecutionProvider, CPUExecutionProvider (pysssss:WD14Tagger) [DEBUG] Using ORT providers: CUDAExecutionProvider, CPUExecutionProvider

Comfyroll Studio v1.76 : 175 Nodes Loaded

For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki

[START] ComfyUI AlekPet Nodes v1.0.13

Node -> ArgosTranslateNode: ArgosTranslateCLIPTextEncodeNode, ArgosTranslateTextNode [Loading] Node -> DeepTranslatorNode: DeepTranslatorCLIPTextEncodeNode, DeepTranslatorTextNode [Loading] Node -> GoogleTranslateNode: GoogleTranslateCLIPTextEncodeNode, GoogleTranslateTextNode [Loading]Node -> ExtrasNode: PreviewTextNode, HexToHueNode, ColorsCorrectNode [Loading]

Node -> PoseNode: PoseNode [Loading] Node -> IDENode: IDENode [Loading] Node -> PainterNode: PainterNode [Loading]

[END] ComfyUI AlekPet Nodes

A new version of Albumentations is available: 1.4.12 (you have 1.4.7). Upgrade using: pip install --upgrade albumentations [tinyterraNodes] Loaded Nvidia APEX normalization not installed, using PyTorch LayerNorm

[rgthree] Loaded 39 magnificent nodes. [rgthree] Will use rgthree's optimized recursive execution.

WAS Node Suite: OpenCV Python FFMPEG support is enabled WAS Node Suite Warning: ffmpeg_bin_path is not set in D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\was-node-suite-comfyui\was_suite_config.json config file. Will attempt to use system ffmpeg binaries if available. WAS Node Suite: Finished. Loaded 217 nodes successfully.

    "Art is the lie that enables us to recognize the truth." - Friedrich Nietzsche

Import times for custom nodes: 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\canvas_tab 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\image-resize-comfyui 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\websocket_image_save.py 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ControlNet-LLLite-ComfyUI 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-SDXL-EmptyLatentImage 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_aspect_ratios 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\sdxl_prompt_styler 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_Noise 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\cg-use-everywhere 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\Vector_Sculptor_ComfyUI 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\sdxl-recommended-res-calc 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\cg-prompt-info 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUi_NNLatentUpscale 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-fitsize 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui_controlnet_aux 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Prompt-Expansion 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Image-Saver 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-WD14-Tagger 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_InstantID 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\AuraSR-ComfyUI 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_essentials 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-AutomaticCFG 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Video-Matting 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-inpaint-nodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_omost 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-tooling-nodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-various 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Impact-Pack 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyMath 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-layerdiffuse 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfy-image-saver 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\mikey_nodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Custom-Scripts 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-nodes-hnmr 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Kolors-MZ 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Frame-Interpolation 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Florence2 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\rgthree-comfy 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-KJNodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_ExtraModels 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\OneButtonPrompt 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-dream-project 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Inspire-Pack 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-TiledDiffusion 0.0 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_tinyterraNodes 0.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Crystools 0.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui_segment_anything 0.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\PuLID_ComfyUI 0.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-ollama 0.2 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-KwaiKolorsWrapper 0.3 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-N-Nodes 0.3 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Manager 0.3 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\clipseg.py 0.4 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Image-Filters 0.4 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-reactor-node 0.5 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_FaceAnalysis 0.5 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-SUPIR 0.5 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-art-venture 1.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_Custom_Nodes_AlekPet 1.1 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\was-node-suite-comfyui 1.2 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\comfyui-mixlab-nodes 3.5 seconds: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Hangover-Moondream

Starting server To see the GUI go to: http://192.168.0.101:8188 or http://127.0.0.1:8188 To see the GUI go to: https://192.168.0.101:8189 or https://127.0.0.1:8189 FETCH DATA from: D:\ComfyUI\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json [DONE] [Impact Pack] Wildcards loading done. got prompt [rgthree] Using rgthree's optimized recursive execution. [rgthree] First run patching recursive_output_delete_if_changed and recursive_will_execute. [rgthree] Note: If execution seems broken due to forward ComfyUI changes, you can disable the optimization from rgthree settings in ComfyUI. Loading model from D:\ComfyUI\ComfyUI\ComfyUI\models\LLM\Florence-2-base using sdpa for attention The image is a black and white portrait of a young man wearing a t-shirt and sunglasses. He is sitting on a bed of orange bricks with a cat lying next to him. The man has short dark hair and a mustache and is looking directly at the camera with a serious expression. The image appears to be a screenshot of a video playing on a computer screen. Offloading model... model weight dtype torch.bfloat16, manual cast: None model_type FLOW clip missing: ['textprojection.weight'] Requested to load FluxClipModel Loading 1 new model Using xformers attention in VAE Using xformers attention in VAE Requested to load AutoencodingEngine Loading 1 new model Requested to load Flux Loading 1 new model loading in lowvram mode 9903.88662261963 100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:16<00:00, 4.22s/it] Requested to load AutoencodingEngine Loading 1 new model Prompt executed in 63.30 seconds

hakemz91 commented 3 months ago

211_Flux_img2img_image_enhancer.json Ok got it...it happened because the flux loading model...had to choose e4m3fn instead of default. Otherwise it will eat maximum RAM. My bad. Dont notice this before. piccc