vcskaushik / LLMzip

GNU General Public License v3.0
41 stars 1 forks source link

Use for non-text data? #2

Closed dmikushin closed 3 months ago

dmikushin commented 1 year ago

Dear authors,

To what extent this work could be potentially applied to non-textual data? Have you done any experiments?

Thank you!

vcskaushik commented 3 months ago

Sorry for the late reply. But the idea would work for other data as well.

We haven't done any experiments, but this paper from Google shows that even an LLM trained on text can even compress images "well enough".

https://arxiv.org/abs/2309.10668