search

Linaqruf / kohya-trainer

Adapted from https://note.com/kohya_ss/n/nbf7ce8d80f29 for easier cloning
Apache License 2.0
1.83k stars 300 forks source link

src/tcmalloc.cc:283] Attempt to free invalid pointer 0x5b75557939d0 #255

Closed MushroomFleet closed 1 year ago

MushroomFleet commented 1 year ago

receives this error with the SDXL Finetuning and SDXL Lora Finetuning Colab Notebooks:

src/tcmalloc.cc:283] Attempt to free invalid pointer 0x5b75557939d0

It seen when you reach "3.4. Bucketing and Latents Caching" these return and again when you start the training. was working before, unsure what caused that?

MushroomFleet commented 1 year ago

as recommended elsewhere where other found the same error, i commented out the libtcmalloc.so (inside first section)

def prepare_environment():
#    os.environ["LD_PRELOAD"] = "libtcmalloc.so"
    os.environ["TF_CPP_MIN_LOG_LEVEL"] = "3"
    os.environ["SAFETENSORS_FAST_GPU"] = "1"
    os.environ["PYTHONWARNINGS"] = "ignore"

this fixed the problem for them and it also works here.