search

kolserdav / ana

Application for composing texts in another language
GNU Affero General Public License v3.0
21 stars 1 forks source link

informal treatment (enhancement) #100

Open Wjxfi opened 1 year ago

Wjxfi commented 1 year ago

slang, abbreviations, shortening two words into one, like "y'all" and more.

kolserdav commented 1 year ago

At the moment, it is undesirable to prescribe this in the application, since it would be better if it was already out of the box from ctranslate2 and argos-train. We only use them:

https://github.com/kolserdav/ana/blob/3b03d696ffa99b2035a105b04805e0d5418a9ef0/packages/translate2/core/translate.py#L1-L125

kolserdav commented 1 year ago

@PJ-Finlay , do you have any one?

kolserdav commented 1 year ago

Hi, @guillaumekln , can you answer this?

kolserdav commented 1 year ago

@Wjxfi , contact me on email.

PJ-Finlay commented 1 year ago

At the moment, it is undesirable to prescribe this in the application, since it would be better if it was already out of the box from ctranslate2 and argos-train. We only use them:

https://github.com/kolserdav/ana/blob/3b03d696ffa99b2035a105b04805e0d5418a9ef0/packages/translate2/core/translate.py#L1-L125

I agree we would want to add examples of translating this correctly to the training data.