divyenduz / languagelearners

LingoParrot - LanguageLearners.club
1 stars 0 forks source link

Split large text into natural chunks #58

Open divyenduz opened 4 years ago

divyenduz commented 4 years ago

Note: this is not an easy fix because the natural language tool that will split the text has to support all the languages.

On larger messages, AWS translate and comprehend hit the size limit

Error: Failed to translate: TextSizeLimitExceededException: Input text size exceeds limit. Max length of request text allowed is 5000 bytes while in this request the text size is 7299 bytes

To get around this, the input needs to be split https://aws.amazon.com/blogs/media/how-to-translate-large-text-documents-with-amazon-translate/ using natural language tools.

Resources