400 Bad request errors with Japanese texts

[ttreder-explorance]

Describe the bug We are getting 400 errors when calling POST /v2/translate with the DeepL-node library translateText() method when using Japanese comments from the following file.

To Reproduce Steps to reproduce the behavior:

• Load all the comments from the provided xlsx file into an array.
• Batch comments with payload size < 12KiB.
• Call translateText() with arrays of comments, no sourceLang param and 'en-US' as targetLang.
• The first 4 batches should fail with this response: DeepL API response POST /v2/translate 400 Response details:, content =
• The 5th batch should succeed with a 200 OK response.

Expected behavior The /v2/translate endpoint should have a consistent behaviour when translating Japanese texts.

Environment:

• NodeJS: 18.0
• DeepL-node: 1.13.0
• macOS, Windows or Linux

Additional context We did try the translation API with a lot of different languages, so far Japanese seems to be the only one causing this issue. Also worth noting that when we use the /document DeepL API translate the document correctly.

[daniel-jones-dev]

Hi @ttreder-explorance, can you please share the code you used, or the array indices in each batch? I was not able to reproduce the issue so far, using the first 60 or 100 array items.

[ttreder-explorance]

const translator = new Translator(YOUR_API_KEY, {
  maxRetries: 5
  minTimeout: 20000,
});
log.getLogger('deepl').setLevel('debug');
let searchParams = new URLSearchParams();
let commentsToTranslate: AnalysisMappedComment[] = [];
comments.forEach((comment) => {
        searchParams.append("text", comment);
        const commentsByteLength = searchParams.toString().length;

        if (commentsByteLength > 122880) {
          const result = await translator.translateText(
               commentsToTranslate,
               null,
               "en-US",
          );
          // Do what you want with the result

          searchParams = new URLSearchParams({ text: comment });
          commentsToTranslate = [comment];
        } else {
          commentsToTranslate.push(comment);
        }
      });
}

if (commentsToTranslate.length > 0) {
      const result = await translator.translateText(
            commentsToTranslate,
            null,
            "en-US",
       );
       // Do what you want with the result
}