apple / ml-4m

4M: Massively Multimodal Masked Modeling
https://4m.epfl.ch
Apache License 2.0
1.57k stars 91 forks source link

how to convert the trained FM pth model file to safetensors format? #6

Open MiZhangWhuer opened 3 months ago

MiZhangWhuer commented 3 months ago

Thanks for providing the traning source for FM model. I notice that there is the scripts fourm/vq/init.py to pause the pre-trained tokens. However, there is no scripts that can parse the trained FM pth model file (PyTorch model file) to the safetensors format. How could we deal with this situation?