OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
Apache License 2.0
2.39k stars 248 forks source link

How to perform text infilling #438

Open oierIM opened 4 months ago

oierIM commented 4 months ago

I'm attempting to perform text infilling, but it doesn't seem to work. I'm not sure if the input that I am providing is correct or not, or how to change it so that it works propertly. Here is the code that I'm using:

from transformers import OFAModel, OFATokenizer

model = OFAModel.from_pretrained('path', use_cache=True)
tokenizer = OFATokenizer.from_pretrained('path')

txt = ' what is the complete text of "A <mask> woman"?'

inputs = tokenizer([txt], return_tensors="pt").input_ids
gen = model.generate(inputs)

If I print 'gen', I get the following: ['\x1a "what\'s the woman"?"? "what\'s the woman"?"? "what\'s']