search

IuvenisSapiens / ComfyUI_MiniCPM-V-2_6-int4

The implementation of MiniCPM-V-2_6-int4 has been seamlessly integrated into the ComfyUI platform, enabling the support for text-based queries, video queries, single-image queries, and multi-image queries to generate captions or responses.
Apache License 2.0
133 stars 8 forks source link

module 'triton' has no attribute '_C' #17

Open alenhrp opened 3 months ago

alenhrp commented 3 months ago

Error occurred when executing MiniCPM_VQA:

Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): module 'triton' has no attribute '_C'

File "F:\Zho_Chinese_ComfyUI_windows_portable\ComfyUI\execution.py", line 317, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "F:\Zho_Chinese_ComfyUI_windows_portable\ComfyUI\execution.py", line 192, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "F:\Zho_Chinese_ComfyUI_windows_portable\ComfyUI\execution.py", line 169, in _map_node_over_list process_inputs(input_dict, i) File "F:\Zho_Chinese_ComfyUI_windows_portable\ComfyUI\execution.py", line 158, in process_inputs results.append(getattr(obj, func)(inputs)) File "F:\Zho_Chinese_ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_MiniCPM-V-2_6-int4\nodes_legacy.py", line 153, in inference self.model = AutoModel.from_pretrained( File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\models\auto\auto_factory.py", line 556, in from_pretrained return model_class.from_pretrained( File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\modeling_utils.py", line 3389, in from_pretrained hf_quantizer.preprocess_model( File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\quantizers\base.py", line 166, in preprocess_model return self._process_model_before_weight_loading(model, kwargs) File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\quantizers\quantizer_bnb_4bit.py", line 256, in _process_model_before_weight_loading from ..integrations import get_keys_to_not_convert, replace_with_bnb_linear File "", line 1075, in _handle_fromlist File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\utils\import_utils.py", line 1380, in getattr module = self._get_module(self._class_to_module[name]) File "F:\Zho_Chinese_ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\utils\import_utils.py", line 1392, in _get_module raise RuntimeError(

alenhrp commented 3 months ago

Can someone help me out here?