search

IuvenisSapiens / ComfyUI_Qwen2-VL-Instruct

The successful integration of Qwen2-VL-Instruct into the ComfyUI platform has enabled a smooth operation, supporting (but not limited to) text-based queries, video queries, single-image queries, and multi-image queries for generating captions or responses.
Apache License 2.0
67 stars 8 forks source link

Qwen2-VL-7B-Instruct-GPTQ-Int8报错 #14

Closed tqangxl closed 2 months ago

tqangxl commented 2 months ago

Qwen2_VQA 'BitsAndBytesConfig' object has no attribute 'get_loading_attributes'

ComfyUI Error Report

Error Details

## System Information
- **ComfyUI Version:** v0.2.2-26-g9f4daca
- **Arguments:** ComfyUI\main.py --windows-standalone-build
- **OS:** nt
- **Python Version:** 3.11.9 (tags/v3.11.9:de54cf5, Apr  2 2024, 10:12:12) [MSC v.1938 64 bit (AMD64)]
- **Embedded Python:** true
- **PyTorch Version:** 2.4.1+cu124
## Devices

- **Name:** cuda:0 NVIDIA GeForce RTX 2070 with Max-Q Design : cudaMallocAsync
  - **Type:** cuda
  - **VRAM Total:** 8589606912
  - **VRAM Free:** 7480541184
  - **Torch VRAM Total:** 0
  - **Torch VRAM Free:** 0

## Logs

2024-09-12 00:49:58,670 - root - INFO - Total VRAM 8192 MB, total RAM 40832 MB 2024-09-12 00:49:58,671 - root - INFO - pytorch version: 2.4.1+cu124 2024-09-12 00:49:58,681 - root - INFO - Set vram state to: NORMAL_VRAM 2024-09-12 00:49:58,682 - root - INFO - Device: cuda:0 NVIDIA GeForce RTX 2070 with Max-Q Design : cudaMallocAsync 2024-09-12 00:49:59,690 - root - INFO - Using pytorch cross attention 2024-09-12 00:50:01,274 - root - INFO - [Prompt Server] web root: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\web 2024-09-12 00:50:08,048 - root - INFO - Total VRAM 8192 MB, total RAM 40832 MB 2024-09-12 00:50:08,048 - root - INFO - pytorch version: 2.4.1+cu124 2024-09-12 00:50:08,049 - root - INFO - Set vram state to: NORMAL_VRAM 2024-09-12 00:50:08,050 - root - INFO - Device: cuda:0 NVIDIA GeForce RTX 2070 with Max-Q Design : cudaMallocAsync 2024-09-12 00:50:20,443 - root - INFO - Import times for custom nodes: 2024-09-12 00:50:20,444 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\websocket_image_save.py 2024-09-12 00:50:20,444 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_QwenVL 2024-09-12 00:50:20,444 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-PixelResolutionCalculator 2024-09-12 00:50:20,444 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\sd-dynamic-thresholding 2024-09-12 00:50:20,444 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-PickScore-Nodes 2024-09-12 00:50:20,445 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\cg-use-everywhere 2024-09-12 00:50:20,445 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\sd-perturbed-attention 2024-09-12 00:50:20,445 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\cg-image-picker 2024-09-12 00:50:20,445 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\masquerade-nodes-comfyui 2024-09-12 00:50:20,445 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_Text_Translation 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_InstantID 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Universal-Styler 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-inpaint-nodes 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\Comfyui_CXH_joy_caption 2024-09-12 00:50:20,446 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-TiledDiffusion 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui_segment_anything 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfy-image-saver 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_Qwen2-VL-Instruct 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-browser 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Custom-Scripts 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-DynamiCrafterWrapper 2024-09-12 00:50:20,447 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Frame-Interpolation 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Florence2 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Notifications 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-prompt-reader-node 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\rgthree-comfy 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_essentials 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-KJNodes 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_MiniCPM-V-2_6-int4 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes 2024-09-12 00:50:20,448 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_tinyterraNodes 2024-09-12 00:50:20,449 - root - INFO - 0.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux 2024-09-12 00:50:20,449 - root - INFO - 0.1 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Inspire-Pack 2024-09-12 00:50:20,449 - root - INFO - 0.1 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-tensorops 2024-09-12 00:50:20,449 - root - INFO - 0.1 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite 2024-09-12 00:50:20,449 - root - INFO - 0.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-SAM2 2024-09-12 00:50:20,449 - root - INFO - 0.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-SUPIR 2024-09-12 00:50:20,449 - root - INFO - 0.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-tbox 2024-09-12 00:50:20,449 - root - INFO - 0.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-DDColor 2024-09-12 00:50:20,449 - root - INFO - 0.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Gemini 2024-09-12 00:50:20,449 - root - INFO - 0.3 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Fluxpromptenhancer 2024-09-12 00:50:20,449 - root - INFO - 0.3 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\Plush-for-ComfyUI 2024-09-12 00:50:20,450 - root - INFO - 0.5 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Manager 2024-09-12 00:50:20,450 - root - INFO - 0.5 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Crystools 2024-09-12 00:50:20,450 - root - INFO - 0.7 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Easy-Use 2024-09-12 00:50:20,450 - root - INFO - 0.8 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-CCSR 2024-09-12 00:50:20,450 - root - INFO - 1.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-ollama 2024-09-12 00:50:20,450 - root - INFO - 1.1 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfy_mtb 2024-09-12 00:50:20,450 - root - INFO - 1.2 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-EasyCivitai-XTNodes 2024-09-12 00:50:20,450 - root - INFO - 1.6 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\was-node-suite-comfyui 2024-09-12 00:50:20,450 - root - INFO - 2.0 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUi-Ollama-YN 2024-09-12 00:50:20,450 - root - INFO - 2.1 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack 2024-09-12 00:50:20,451 - root - INFO - 2.4 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_FaceAnalysis 2024-09-12 00:50:20,451 - root - INFO - 2.5 seconds: D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\comfyui-reactor-node 2024-09-12 00:50:20,451 - root - INFO - 2024-09-12 00:50:20,469 - root - INFO - Starting server

2024-09-12 00:50:20,469 - root - INFO - To see the GUI go to: http://127.0.0.1:8188 2024-09-12 00:50:24,797 - openai._base_client - INFO - Retrying request to /models in 0.811237 seconds 2024-09-12 00:50:25,850 - openai._base_client - INFO - Retrying request to /models in 1.602567 seconds 2024-09-12 00:50:28,838 - groq._base_client - INFO - Retrying request to /openai/v1/models in 0.838358 seconds 2024-09-12 00:50:30,171 - groq._base_client - INFO - Retrying request to /openai/v1/models in 1.657592 seconds 2024-09-12 00:50:55,203 - root - INFO - got prompt 2024-09-12 00:50:55,844 - root - ERROR - !!! Exception during processing !!! 'BitsAndBytesConfig' object has no attribute 'get_loading_attributes' 2024-09-12 00:50:55,846 - root - ERROR - Traceback (most recent call last): File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\execution.py", line 323, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\execution.py", line 198, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\execution.py", line 169, in _map_node_over_list process_inputs(input_dict, i) File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\execution.py", line 158, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\ComfyUI\custom_nodes\ComfyUI_Qwen2-VL-Instruct\nodes.py", line 131, in inference self.model = Qwen2VLForConditionalGeneration.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 3404, in from_pretrained config.quantization_config = AutoHfQuantizer.merge_quantization_configs( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Lib\Dev\AI\ComfyUI\ComfyUI_portable\python_embeded\Lib\site-packages\transformers\quantizers\auto.py", line 172, in merge_quantization_configs loading_attr_dict = quantization_config_from_args.get_loading_attributes() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'BitsAndBytesConfig' object has no attribute 'get_loading_attributes'

2024-09-12 00:50:55,848 - root - INFO - Prompt executed in 0.64 seconds

## Attached Workflow
Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":25,"last_link_id":24,"nodes":[{"id":24,"type":"DisplayText","pos":{"0":-1377,"1":-1782},"size":{"0":340.37530517578125,"1":290.904541015625},"flags":{},"order":1,"mode":0,"inputs":[{"name":"text","type":"STRING","link":24,"widget":{"name":"text"}}],"outputs":[{"name":"STRING","type":"STRING","links":null,"shape":6}],"properties":{"Node name for S&R":"DisplayText"},"widgets_values":["","Dell Group is a global technology company that specializes in the design, manufacturing, and distribution of personal computers, servers, and other IT products. The company was founded in 1984 by Michael Dell, who was inspired by the success of Apple Inc. and wanted to create a more affordable and reliable personal computer. Dell Group has since expanded its product line to include a wide range of IT solutions, including laptops, desktops, and servers. The company is headquartered in Round Rock, Texas, and has over 100,000 employees worldwide."]},{"id":25,"type":"Qwen2_VQA","pos":{"0":-1794,"1":-1783},"size":{"0":400,"1":292},"flags":{},"order":0,"mode":0,"inputs":[{"name":"source_path","type":"PATH","link":null}],"outputs":[{"name":"STRING","type":"STRING","links":[24],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"Qwen2_VQA"},"widgets_values":["戴尔集团","Qwen2-VL-7B-Instruct-GPTQ-Int8","8bit",true,0.7,2048,200704,1003520,1483,"randomize"]}],"links":[[24,25,0,24,0,"STRING"]],"groups":[],"config":{},"extra":{"ds":{"scale":1.3310000000000004,"offset":[2113.8341039826105,1901.7571905757538]}},"version":0.4}



## Additional Context
(Please add any additional context or steps to reproduce the error here)