oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.41k stars 5.3k forks source link

Getting an Attribute Error when i try to download a llama 2 model #3250

Closed babakar7 closed 1 year ago

babakar7 commented 1 year ago

Describe the bug

Getting an Attribute Error when i try to download a llama 2 model using id: meta-llama/Llama-2-13b-chat

Is there an existing issue for this?

Reproduction

Download a llama 2 model on a macbook pro M1.

Screenshot

No response

Logs

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.11/site-packages/gradio/routes.py", line 427, in run_predict
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/gradio/blocks.py", line 1323, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/gradio/blocks.py", line 1051, in call_function
    prediction = await anyio.to_thread.run_sync(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/anyio/to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 807, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/BABS/Desktop/WEB/projects/text-gen/modules/models_settings.py", line 90, in apply_model_settings_to_state
    model_settings = get_model_settings_from_yamls(model)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/BABS/Desktop/WEB/projects/text-gen/modules/models_settings.py", line 13, in get_model_settings_from_yamls
    if re.match(pat.lower(), model.lower()):
                             ^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'lower'

System Info

MAC BOOK PRO M1 14inch
github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.