Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate`

Error occurred when executing OmostLLMLoaderNode:

Using low_cpu_mem_usage=True or a device_map requires Accelerate: pip install accelerate

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_omost\omost_nodes.py", line 99, in load_llm llm_model = AutoModelForCausalLM.from_pretrained( File "D:\ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\models\auto\auto_factory.py", line 563, in from_pretrained return model_class.from_pretrained( File "D:\ComfyUI_windows_portable\python_embeded\lib\site-packages\transformers\modeling_utils.py", line 3122, in from_pretrained raise ImportError(

I tried pip install accelerate as below，But it still shows the same error after install and restart comfyui,

D:\ComfyUI_windows_portable\python_embeded>pip install accelerate Requirement already satisfied: accelerate in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (0.30.1) Requirement already satisfied: numpy>=1.17 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (1.25.2) Requirement already satisfied: packaging>=20.0 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (24.0) Requirement already satisfied: psutil in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (5.9.8) Requirement already satisfied: pyyaml in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (6.0.1) Requirement already satisfied: torch>=1.10.0 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (2.0.1+cu118) Requirement already satisfied: huggingface-hub in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (0.23.0) Requirement already satisfied: safetensors>=0.3.1 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from accelerate) (0.4.3) Requirement already satisfied: filelock in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.10.0->accelerate) (3.12.3) Requirement already satisfied: typing-extensions in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.10.0->accelerate) (4.11.0) Requirement already satisfied: sympy in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.10.0->accelerate) (1.12) Requirement already satisfied: networkx in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.10.0->accelerate) (3.1) Requirement already satisfied: jinja2 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from torch>=1.10.0->accelerate) (3.1.2) Requirement already satisfied: fsspec>=2023.5.0 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from huggingface-hub->accelerate) (2024.3.1) Requirement already satisfied: requests in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from huggingface-hub->accelerate) (2.31.0) Requirement already satisfied: tqdm>=4.42.1 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from huggingface-hub->accelerate) (4.66.4) Requirement already satisfied: colorama in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from tqdm>=4.42.1->huggingface-hub->accelerate) (0.4.6) Requirement already satisfied: MarkupSafe>=2.0 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from jinja2->torch>=1.10.0->accelerate) (2.1.3) Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from requests->huggingface-hub->accelerate) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from requests->huggingface-hub->accelerate) (3.7) Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from requests->huggingface-hub->accelerate) (2.2.1) Requirement already satisfied: certifi>=2017.4.17 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from requests->huggingface-hub->accelerate) (2024.2.2) Requirement already satisfied: mpmath>=0.19 in c:\users\frank\appdata\local\programs\python\python310\lib\site-packages (from sympy->torch>=1.10.0->accelerate) (1.3.0)

[notice] A new release of pip is available: 23.2.1 -> 24.0 [notice] To update, run: C:\Users\Frank\AppData\Local\Programs\Python\Python310\python.exe -m pip install --upgrade pip

D:\ComfyUI_windows_portable\python_embeded>

=========================== may anyone could help me?

huchenlei / ComfyUI_omost

Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate` #30

I tried pip install accelerate as below，But it still shows the same error after install and restart comfyui,