SillyTavern / SillyTavern-Extras

Extensions API for SillyTavern.
GNU Affero General Public License v3.0
549 stars 124 forks source link

[Feature request] Chinese support for summarize and classify modules #21

Closed g51503john02 closed 1 year ago

g51503john02 commented 1 year ago

After cross-testing with Chinese and English, I found that the summarize and classify modules do not support Chinese. For the summarize module, the Chinese language makes the summed plot completely irrelevant. For the classify module, the Chinese language will result in completely wrong emotion recognition.

I know that by design, the models or principles of these two modules may only support English, so it would be nice if they could support Chinese or more languages, thank you very much.

Cohee1207 commented 1 year ago

I did not train any of these. Please take a look at Huggingface for compatible models and try them out. My readme document has instructions on how to replace BART/BERT models used

g51503john02 commented 1 year ago

I found the classify module specifically for Chinese, you can add it to the read me file for others to reference. touch20032003/xuyuan-trial-sentiment-bert-chinese

Cohee1207 commented 1 year ago

Added

bash99 commented 1 year ago

After cross-testing with Chinese and English, I found that the summarize and classify modules do not support Chinese. For the summarize module, the Chinese language makes the summed plot completely irrelevant. For the classify module, the Chinese language will result in completely wrong emotion recognition.

I know that by design, the models or principles of these two modules may only support English, so it would be nice if they could support Chinese or more languages, thank you very much.

May I ask which main llm model you used has best chinese support in sillyTavern?