alinlab / MASKER

MASKER: Masked Keyword Regularization for Reliable Text Classification (AAAI 2021)
https://arxiv.org/abs/2012.09392
51 stars 11 forks source link

Other language usage #5

Open phc4valid opened 3 years ago

phc4valid commented 3 years ago

Hi , I really like and appreciate what you guys are doing. Is it possible to implement the method on other languages ? etc :Chinese General-usage of language model was being used in the method , I was curious about the difference between domain-specific finetuned language model and models with MASKER mentioned in the paper and how they affect OOD and performance on downstream tasks. Have you given a try ,yet? Really looking forward to your response. Thanks.

sangwoomo commented 3 years ago

Hi, I'm not an expert of other languages, but I think MASKER would be applied for other languages if pre-trained language models are available (e.g., Chinese version of BERT), as the implementation of masked keyword regularization would be straightforward upon those models.