cloneofsimo / lora

Using Low-rank adaptation to quickly fine-tune diffusion models.
https://arxiv.org/abs/2106.09685
Apache License 2.0
6.94k stars 479 forks source link

bug with PivotalTuningDatasetCapation #197

Open psy2013GitHub opened 1 year ago

psy2013GitHub commented 1 year ago

the class define: https://github.com/cloneofsimo/lora/blob/master/lora_diffusion/dataset.py#L119 bug: the _self.instance_imagespath did not align with self.captions

blow is details

first both align well self.instance_images_path = list(set(possibily_src_images)) self.captions = [ x.split("/")[-1].split(".")[0] for x in self.instance_images_path ]

then here is the bug, _self.instance_imagespath is sorted but not self.captions self.instance_images_path = sorted(self.instance_images_path)