Moondream Interrogator dont start

[joelandresnavarro]

Hi, @Hangover3832 yesterday I install your extensión but when I start queue the moondream 2 loading it dont do anything, can you help me? (Moondream interrogator note have trust remote access “TRUE”

got prompt [rgthree] Using rgthree's optimized recursive execution. [rgthree] First run patching recursive_output_delete_if_changed and recursive_will_execute. [rgthree] Note: If execution seems broken due to forward ComfyUI changes, you can disable the optimization from rgthree settings in ComfyUI. C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\functional.py:507: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ..\aten\src\ATen\native\TensorShape.cpp:3550.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] moondream: loading model vikhyatk/moondream2, please stand by.... !!! Exception during processing !!! Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connection.py", line 174, in _new_conn conn = connection.create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\util\connection.py", line 95, in create_connection raise err File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\util\connection.py", line 85, in create_connection sock.connect(sa) TimeoutError: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connectionpool.py", line 715, in urlopen httplib_response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connectionpool.py", line 404, in _make_request self._validate_conn(conn) File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connectionpool.py", line 1058, in _validate_conn conn.connect() File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connection.py", line 363, in connect self.sock = conn = self._new_conn() ^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connection.py", line 179, in _new_conn raise ConnectTimeoutError( urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x00000241ABC77910>, 'Connection to huggingface.co timed out. (connect timeout=10)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\requests\adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\connectionpool.py", line 799, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\urllib3\util\retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /vikhyatk/moondream2/resolve/main/config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x00000241ABC77910>, 'Connection to huggingface.co timed out. (connect timeout=10)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\file_download.py", line 1238, in hf_hub_download metadata = get_hf_file_metadata( ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\utils_validators.py", line 118, in _inner_fn return fn(args, kwargs) ^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\file_download.py", line 1631, in get_hf_file_metadata r = _request_wrapper( ^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\file_download.py", line 385, in _request_wrapper response = _request_wrapper( ^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\file_download.py", line 408, in _request_wrapper response = get_session().request(method=method, url=url, params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\requests\sessions.py", line 589, in request resp = self.send(prep, send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\requests\sessions.py", line 703, in send r = adapter.send(request, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\utils_http.py", line 67, in send return super().send(request, args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\requests\adapters.py", line 507, in send raise ConnectTimeout(e, request=request) requests.exceptions.ConnectTimeout: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /vikhyatk/moondream2/resolve/main/config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x00000241ABC77910>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: 33bd3199-2032-4a12-abdd-16996d5c9242)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\utils\hub.py", line 398, in cached_file resolved_file = hf_hub_download( ^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\utils_validators.py", line 118, in _inner_fn return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\huggingface_hub\file_download.py", line 1371, in hf_hub_download raise LocalEntryNotFoundError( huggingface_hub.utils._errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Hangover-Moondream\ho_moondream.py", line 56, in interrogate self.model = AutoModelForCausalLM.from_pretrained(huggingface_model, trust_remote_code=trust_remote_code).to(dev) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\models\auto\auto_factory.py", line 521, in from_pretrained config, kwargs = AutoConfig.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\models\auto\configuration_auto.py", line 1111, in from_pretrained config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\configuration_utils.py", line 633, in get_config_dict config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\configuration_utils.py", line 688, in _get_config_dict resolved_config_file = cached_file( ^^^^^^^^^^^^ File "C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\utils\hub.py", line 441, in cached_file raise EnvironmentError( OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like vikhyatk/moondream2 is not the path to a directory containing a file named config.json. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.

Prompt executed in 361.53 seconds

[Hangover3832]

Looks like an outdated library, can you please run C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\python.exe -m pip freeze | findstr "timm einops transformers" and post the output

[joelandresnavarro]

Fixed up👍🏼 Thank you

@Hangover3832 other thing you can you share with me your discord username? I would like to give you some suggestions

[joelandresnavarro]

@Hangover3832 here the output at the command line (It Run but I dont know if there is an error “1Torch was not compiled with flash attention")

got prompt [rgthree] Using rgthree's optimized recursive execution. [rgthree] First run patching recursive_output_delete_if_changed and recursive_will_execute. [rgthree] Note: If execution seems broken due to forward ComfyUI changes, you can disable the optimization from rgthree settings in ComfyUI. moondream: loading model vikhyatk/moondream2, please stand by.... Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. C:\Users\joela\OneDrive\Documentos\Stable Diffusion\ComfyUI_windows_portable\python_embeded\Lib\site-packages\timm\models\vision_transformer.py:91: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at ..\aten\src\ATen\native\transformers\cuda\sdp_utils.cpp:263.) x = F.scaled_dot_product_attention( Prompt executed in 7.66 seconds

[Hangover3832]

@Hangover3832 other thing you can you share with me your discord username? I would like to give you some suggestions

@joelandresnavarro, I apologize but I don't like to share my contact details here on github, but you are welcome to open an issue for your suggestions.

here the output at the command line (It Run but I dont know if there is an error “1Torch was not compiled with flash attention")

As far as I know, flash attention is not well implemented in Windows. If the node works fine beside this you are probably good to go.