huggingface / transfer-learning-conv-ai

🦄 State-of-the-Art Conversational AI with Transfer Learning
MIT License
1.74k stars 430 forks source link

Custom vocabulary #110

Open harrystuart opened 3 years ago

harrystuart commented 3 years ago

Should I expect to need to make any modifications to the training srcipt if my data has a lot of terms that would not be part of the GPT vocabulary? For example, medical terms and acronyms.

Thanks

gorkemgoknar commented 2 years ago

Maybe you can finetune gpt2 on medical dataset then use it for your chatbot.