search

kolserdav / ana

Application for composing texts in another language
GNU Affero General Public License v3.0
23 stars 1 forks source link

informal treatment (enhancement) #100

Open Wjxfi opened 11 months ago

Wjxfi commented 11 months ago

slang, abbreviations, shortening two words into one, like "y'all" and more.

kolserdav commented 11 months ago

At the moment, it is undesirable to prescribe this in the application, since it would be better if it was already out of the box from ctranslate2 and argos-train. We only use them:

https://github.com/kolserdav/ana/blob/3b03d696ffa99b2035a105b04805e0d5418a9ef0/packages/translate2/core/translate.py#L1-L125

kolserdav commented 11 months ago

@PJ-Finlay , do you have any one?

kolserdav commented 11 months ago

Hi, @guillaumekln , can you answer this?

kolserdav commented 11 months ago

@Wjxfi , contact me on email.

PJ-Finlay commented 10 months ago

At the moment, it is undesirable to prescribe this in the application, since it would be better if it was already out of the box from ctranslate2 and argos-train. We only use them:

https://github.com/kolserdav/ana/blob/3b03d696ffa99b2035a105b04805e0d5418a9ef0/packages/translate2/core/translate.py#L1-L125

I agree we would want to add examples of translating this correctly to the training data.