I tried to use DAdaptLion to do the training but could not use it.

[ghost]

I tried to use DAdaptLion to do the training but could not use it.

Traceback (most recent call last): File "/var/opt/LECO/./train_lora.py", line 343, in main(args) File "/var/opt/LECO/./train_lora.py", line 330, in main train(config, prompts) File "/var/opt/LECO/./train_lora.py", line 80, in train optimizer_module = train_util.get_optimizer(config.train.optimizer) File "/var/opt/LECO/train_util.py", line 344, in get_optimizer raise ValueError("DAdapt optimizer must be dadaptadam or dadaptlion") ValueError: DAdapt optimizer must be dadaptadam or dadaptlion

train_util.py

def get_optimizer(name: str):
    name = name.lower()  # <------- 1.  lower case.

    if name.startswith("dadapt"):
        import dadaptation

        if name == "dadaptadam":
            return dadaptation.DAdaptAdam
        elif name == "dadaptLion":        # <------- 2. upper case.
            return dadaptation.DAdaptLion
        else:
            raise ValueError("DAdapt optimizer must be dadaptadam or dadaptlion")

Thanks for the great software, I'm using it to its fullest.