bytedance / 1d-tokenizer

This repo contains the code for 1D tokenizer and generator
Apache License 2.0
567 stars 24 forks source link

how to used RAR just for reconstruction #47

Open sorobedio opened 3 weeks ago

sorobedio commented 3 weeks ago

Hello,

Thank you for the fantastic work! I’m currently using Titok to convert images to data, but I think it might be beneficial to try RAR for this task. Could you provide guidance on using RAR? It would be especially helpful if you could share a simple Colab notebook with a straightforward function to demonstrate this.

Thank you!

cornettoyu commented 3 weeks ago

Hi,

RAR is only for generation task and I am afraid it may not work for your purpose on tokenization :) We will provide a toy example to demonstrate how to use RAR to generate images soon.