AutoAWQ gone missing (model loader) and charecter not loading (for my case, out of 5 charecters, only 2 of them are loading)

[PRCbubu]

Describe the bug

When I start the program, it went blank screen (like, noting except for the UI elements). So, when I was trying to select the character from the dropdown menu, it was not selecting the characters, barring the two. Then I tried to edit the characters in "Parameters" option, but there also, character cannot be selected. I checked in the folder directly and found, characters are already there but for some reason, it is not getting selected.

And as for the second bug/problem, the AutoAWQ loader is missing.

Is there an existing issue for this?

• [X] I have searched the existing issues

Reproduction

1) Start the program 2) Let it load 3) Bug/problem

Screenshot

This is the screenshot of the missing AutoAWQ loader.

Logs

Traceback (most recent call last):
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\queueing.py", line 527, in process_events
    response = await route_utils.call_process_api(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\route_utils.py", line 261, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1786, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1338, in call_function
    prediction = await anyio.to_thread.run_sync(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\utils.py", line 759, in wrapper
    response = f(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\chat.py", line 1131, in handle_character_menu_change
    html = redraw_html(history, state['name1'], state['name2'], state['mode'], state['chat_style'], state['character_menu'])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\chat.py", line 483, in redraw_html
    return chat_html_wrapper(history, name1, name2, mode, style, character, reset_cache=reset_cache)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 303, in chat_html_wrapper
    return generate_cai_chat_html(history['visible'], name1, name2, style, character, reset_cache)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 227, in generate_cai_chat_html
    row = [convert_to_markdown_wrapped(entry, use_cache=i != len(history) - 1) for entry in _row]
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 227, in <listcomp>
    row = [convert_to_markdown_wrapped(entry, use_cache=i != len(history) - 1) for entry in _row]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 149, in convert_to_markdown_wrapped
    return convert_to_markdown.__wrapped__(string)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 76, in convert_to_markdown
    string = replace_quotes(string)
             ^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 63, in replace_quotes
    replaced_text = re.sub(pattern, lambda m: f'<q>{m.group(1)}{m.group(2)}{m.group(3)}</q>', text, flags=re.DOTALL)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\re\__init__.py", line 185, in sub
    return _compile(pattern, flags).sub(repl, string, count)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: expected string or bytes-like object, got 'NoneType'
---------------------------------------------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\queueing.py", line 527, in process_events
    response = await route_utils.call_process_api(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\route_utils.py", line 261, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1786, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1338, in call_function
    prediction = await anyio.to_thread.run_sync(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\utils.py", line 759, in wrapper
    response = f(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^
  File "D:\StableDiffution\text-generation-webui\modules\loaders.py", line 351, in blacklist_samplers
    if loader == 'All' or sampler in loaders_samplers[loader]:
                                     ~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'AutoAWQ'

System Info

ASUS ROG STRIX Laptop.
CPU: Intel i7 10875H
GPU: NVIDIA RTX 2080 Super

Settings (extensions used) in textgen:
"gallery"
"send_pictures"
"autonomics"
"alltalk_tts" (with deepspeed and low vram)
"LLM_Web_search"
"Memoir"

[PRCbubu]

Please @oobabooga help me!

[oobabooga]

I removed intentionally because it had bad defaults. Try loading the model though the transformers loader. It will use AutoAWQ automatically.

[PRCbubu]

I removed intentionally because it had bad defaults. Try loading the model though the transformers loader. It will use AutoAWQ automatically.

So, what about the characters not loading up properly? Like I'm not able to figure out, where it problem. Check the logs, the first part that ends with TypeError: expected string or bytes-like object, got 'NoneType is the output log of it.

[PRCbubu]

Also, I'm getting this error now, even though there are charecters with yaml and png files in the charecter folder, Somehow these are not getting selected @oobabooga

[PRCbubu]

Send

what do you mean ?

[prb8592]

I tried loading an AWQ model using the Transformers loader. It resulted in an error: Loading an AWQ quantized model requires auto-awq library ('pip install autoawq')

Using the cmd prompt, I then tried installing autoawq using the pip command specified. This resulted in the error: ERROR: Could not find a version that satisfies the requirement autoawq (from versions: none) ERROR: No matching distribution found for autoawq

My system: Windows 10 python version 3.13.0 NVIDIA GeForce RTX 3080 Ti text-gen-webui version 1.15

[WhiteBite]

I have the same problem.