henk717 / KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!
http://koboldai.com
GNU Affero General Public License v3.0
369 stars 130 forks source link

Old presets cause errors in model loading #252

Open one-some opened 1 year ago

one-some commented 1 year ago

Per Rip_gel on discord:

  File "B:\python\lib\site-packages\socketio\server.py", line 730, in _handle_event_internal
    r = server._trigger_event(data[0], namespace, sid, *data[1:])
        │      │              │        │          │     └ ['load_model', {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_l...
        │      │              │        │          └ 'AN9SpKFBcE-1zGG1AAAH'
        │      │              │        └ '/'
        │      │              └ ['load_model', {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_l...
        │      └ <function Server._trigger_event at 0x000002214ED34160>
        └ <socketio.server.Server object at 0x0000022150224D90>

  File "B:\python\lib\site-packages\socketio\server.py", line 755, in _trigger_event
    return self.handlers[namespace][event](*args)
           │    │        │          │       └ ('AN9SpKFBcE-1zGG1AAAH', {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': ...
           │    │        │          └ 'load_model'
           │    │        └ '/'
           │    └ {'/': {'OAI_Key_Update': <function get_oai_models at 0x0000022150368E50>, 'get_cluster_models': <function get_cluster_models ...
           └ <socketio.server.Server object at 0x0000022150224D90>

  File "B:\python\lib\site-packages\flask_socketio\__init__.py", line 282, in _handler
    return self._handle_event(handler, message, namespace, sid,
           │    │             │        │        │          └ 'AN9SpKFBcE-1zGG1AAAH'
           │    │             │        │        └ '/'
           │    │             │        └ 'load_model'
           │    │             └ <function UI_2_load_model at 0x000002215039B280>
           │    └ <function SocketIO._handle_event at 0x000002215014CD30>
           └ <flask_socketio.SocketIO object at 0x0000022150224CA0>

  File "B:\python\lib\site-packages\flask_socketio\__init__.py", line 826, in _handle_event
    ret = handler(*args)
          │        └ ({'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', ...
          └ <function UI_2_load_model at 0x000002215039B280>

> File "aiserver.py", line 589, in g
    return f(*a, **k)
           │  │    └ {}
           │  └ ({'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', ...
           └ <function UI_2_load_model at 0x0000022150399F70>

  File "aiserver.py", line 8697, in UI_2_load_model
    load_model(use_gpu=data['use_gpu'], gpu_layers=data['gpu_layers'], disk_layers=data['disk_layers'], online_model=data['online_model'], url=koboldai_vars.colaburl, use_8_bit=data['use_8_bit'])
    │                  │                           │                               │                                 │                         │                                 └ {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', '...
    │                  │                           │                               │                                 │                         └ <koboldai_settings.koboldai_vars object at 0x000002215029A430>
    │                  │                           │                               │                                 └ {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', '...
    │                  │                           │                               └ {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', '...
    │                  │                           └ {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', '...
    │                  └ {'model': 'NeoCustom', 'path': 'D:\\KoboldAI\\models\\gpt-neo-2.7B-Picard', 'use_gpu': True, 'key': '', 'gpu_layers': '10', '...
    └ <function load_model at 0x0000022150362280>

  File "aiserver.py", line 3354, in load_model
    if preset['Model Name'] == koboldai_vars.model:
       │                       └ <koboldai_settings.koboldai_vars object at 0x000002215029A430>
       └ {'genamt': 50, 'rep_pen': 1.1, 'rep_pen_range': 1476, 'rep_pen_slope': 1.3, 'sampler_order': [6, 5, 0, 2, 3, 1, 4], 'temp': 0...

KeyError: 'Model Name'
ebolam commented 1 year ago

ugh. No way around this other than to delete the old preset file. The format changed...