Evaluation in other languages

huggingface / transfer-learning-conv-ai

🦄 State-of-the-Art Conversational AI with Transfer Learning

MIT License

1.74k stars 430 forks source link

Evaluation in other languages #94

Open VikasRajashekar opened 3 years ago

VikasRajashekar commented 3 years ago

I build this model using the GPT2 German pre-trained model. And fine-tuned on German persona dataset. How do I evaluate the model? Because the scripts provided seem to evaluate on secret English dataset using parl-AI.

pourdabiri commented 3 years ago

How did you train the model on the german GPT-2 model? The "--model" argument in train.py only accepts the pre-defined GPT-2 values.