Hey @lucidrains I from classical ML and Speech Synthesis space, and I am sorta new to the NLP space and I have read this article with regards to decoding.
https://huggingface.co/blog/how-to-generate
I am wondering if the same techniques could be applied to character level embeddings? I am trying to find literature on the subject but I have hit a wall. If you know any resources a survey perhaps that would be helpful. It seems like the only thing that would work in a naive fashion here is greedy decoding
ArEnSc
commented
2 years ago
Hey @lucidrains I from classical ML and Speech Synthesis space, and I am sorta new to the NLP space and I have read this article with regards to decoding. https://huggingface.co/blog/how-to-generate I am wondering if the same techniques could be applied to character level embeddings? I am trying to find literature on the subject but I have hit a wall. If you know any resources a survey perhaps that would be helpful. It seems like the only thing that would work in a naive fashion here is greedy decoding