search

facebookresearch / ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
https://parl.ai
MIT License
10.49k stars 2.1k forks source link

HuggingFace Transformers interop #2215

Open stephenroller opened 4 years ago

stephenroller commented 4 years ago

HuggingFace's transformers has a lot of great models built in. We can make a generic interop to it.

I believe we want both a huggingface/ranker and huggingface/generator. We might need some special cases depending on which transformer, but as a first milestone I'd like to support a GPT-2 generator and Transformer-XL.

As a second milestone, we should a more generic interop utility.

Tests and coverage mandatory. Examples in the task docstring also.

github-actions[bot] commented 4 years ago

This issue has not had activity in 30 days. Marking as stale.