[BUG-234161] Azure Translation Services, First Impressions

[sl-service-account]

Copied from FIRE-33098 since apparently LL implemented this. That wasn't clear.

Description:

I've done some testing using the translation service, using Azure F0 free model I just created for this.

• Quotes and links are not translating (any use of " and \ breaks the message). Links are problematic. (Translation failed: One of the request inputs is not valid.) Update:
  • \n is translated into a new line even when typed. Clearly the data sent isnt being urlencoded.
  • facebook -> (LinkedIn)
  • www.facebook.com -> (Translation failed: One of the request inputs is not valid.)
  • The other failure that didnt include " or \ included a marketplace url using [website title] syntax.
• My own messages are translated, but nobody else can see this translation. This is either wasteful, nearly pointless, or should at least be optional if displaying the translation to everyone isn't the intent.
• Its kinda hard to tell what's the translation and not. I would greatly appreciate being able to colorize translated output (leaving the original message segment intact). For my own reasons to ignore it as I'm only doing this for testing.
• As these are paid services - hash and cache messages, perhaps with an adjustable limit, so that repeat messages are not translated again. Perform a simple hash of a message to verify if it needs to be translated again, otherwise pull from the cached one with that hash. For people who are trying desperately to stay below the Azure 2M character limit, they may want 10,000 messages cached, but I'm sure it will have a performance hit eventually, so a slider or manual input would be nice. This hash should not include an avatar/object name as many repeat messages are just 'Yes' or 'No', etc.
  • The max rate I tested was 35.4k characters/hour. This results in a 2M limit being consumed 2 hours a day in a 28 day month. Less aggressive, but very active areas were 9k/hr (8hr/day*month). This is feasible to stay in the Azure F0 (free) tier and translate everything, which included group chat. The $10 charge per million characters after equates to 28 hours at spammy, or 110 hours at busy.
  • ~60% of messages in the spammy area were unique. 40% of them could have been saved with a hash+cache feature. The spammy area was Exhale dance club, all real-user typed and gesture chat.
• If the API allows it, being able to monitor usage statistics may be a valuable floater.

Original Jira Fields

| Field | Value | | ------------- | ------------- | | Issue | BUG-234161 | | Summary | Azure Translation Services, First Impressions | | Type | New Feature Request | | Priority | Unset | | Status | Accepted | | Resolution | Accepted | | Reporter | Pazako Karu (pazako.karu) | | Created at | 2023-07-22T17:31:06Z | | Updated at | 2023-08-02T18:18:32Z | ``` { 'Build Id': 'unset', 'Business Unit': ['Platform'], 'Date of First Response': '2023-08-02T13:18:28.854-0500', 'How would you like the feature to work?': 'Copied from FIRE-33098 since apparently LL implemented this. That wasn\'t clear. \r\n\r\nI\'ve done some testing using the translation service, using Azure F0 free model I just created for this.\r\n\r\n Quotes and links are not translating (any use of " and \\ breaks the message). Links are problematic. (Translation failed: One of the request inputs is not valid.) Update:\r\n\r\n \\n is translated into a new line even when typed. Clearly the data sent isnt being urlencoded.\r\n facebook -> (LinkedIn)\r\n www.facebook.com -> (Translation failed: One of the request inputs is not valid.)\r\n The other failure that didnt include " or \\ included a marketplace url using [website title] syntax.\r\n My own messages are translated, but nobody else can see this translation. This is either wasteful, nearly pointless, or should at least be optional if displaying the translation to everyone isn\'t the intent.\r\n Its kinda hard to tell what\'s the translation and not. I would greatly appreciate being able to colorize translated output (leaving the original message segment intact). For my own reasons to ignore it as I\'m only doing this for testing.\r\n As these are paid services - hash and cache messages, perhaps with an adjustable limit, so that repeat messages are not translated again. Perform a simple hash of a message to verify if it needs to be translated again, otherwise pull from the cached one with that hash. For people who are trying desperately to stay below the Azure 2M character limit, they may want 10,000 messages cached, but I\'m sure it will have a performance hit eventually, so a slider or manual input would be nice. This hash should not include an avatar/object name as many repeat messages are just \'Yes\' or \'No\', etc.\r\n The max rate I tested was 35.4k characters/hour. This results in a 2M limit being consumed 2 hours a day in a 28 day month. Less aggressive, but very active areas were 9k/hr (8hr/day*month). This is feasible to stay in the Azure F0 (free) tier and translate everything, which included group chat. The $10 charge per million characters after equates to 28 hours at spammy, or 110 hours at busy.\r\n ~60% of messages in the spammy area were unique. 40% of them could have been saved with a hash+cache feature. The spammy area was Exhale dance club, all real-user typed and gesture chat.\r\n If the API allows it, being able to monitor usage statistics may be a valuable floater.\r\n', 'ReOpened Count': 0.0, 'Severity': 'Unset', 'Target Viewer Version': 'viewer-development', 'Why is this feature important to you? How would it benefit the community?': 'Firestorms jira only has Description and Environment, so Ive not broken up this into a Q/A setup. ', } ```

[sl-service-account]

Spidey Linden commented at 2023-08-02T18:18:29Z

Issue accepted. We have no estimate when it may be implemented. Please see future release notes for this fix.