kyutai-labs / moshi

Apache License 2.0
6.77k stars 532 forks source link

Better VQ method recommendation #152

Open youngsheen opened 1 week ago

youngsheen commented 1 week ago

Due diligence

Topic

The paper

Question

Hi,

Excellent work! The open-sourced contributions to the field are invaluable.

I am the author of GPST, and I sincerely appreciate your citation of my work in the Moshi paper. It means a lot to see our research interconnected.

I would also like to take this opportunity to share my latest research, which focuses on a new VQ method called SimVQ to address the representation collapse problem in VQ models. This approach allows for bypassing the need for hierarchical architectures, potentially simplifying implementation while maintaining performance. You can find further details in my paper here and the code available at GitHub. I welcome you to explore it and consider its applications within your future work.

Best regards,