Can I use the project for a text to text task?

xlang-ai / UnifiedSKG

[EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models

https://arxiv.org/abs/2201.05966

Apache License 2.0

546 stars 58 forks source link

Can I use the project for a text to text task? #18

Closed puraminy closed 2 years ago

puraminy commented 2 years ago

I am interested in using prefix-tuning with t5 implemented in this project, but for a text to text project. (text generation). Could you guide me which files should I follow or how to modify them to add such a task. Or if I just want to use the prefixtuning part of the models in my own project, how can I call the model.

Timothyxxx commented 2 years ago

Hi,

It could be achieved by our framework. Just add your own task, seq2seq_convertion file and config in tasks, seq2seq_construction and configure file as we showed in Add a new task into UnifiedSKG section. It is also recommended to read through the code and check what we did for the FeTaQA or other tasks and #14 if you need more details in running. Feel free to clean the code by yourself.

Hope these information helpful! Thanks!