what is the difference between virtual type words and soft prompt

zjunlp / KnowPrompt

[WWW 2022] KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction

MIT License

191 stars 34 forks source link

what is the difference between virtual type words and soft prompt #29

Closed lihuiliullh closed 4 months ago

lihuiliullh commented 5 months ago

It seems that the virtual type words and soft prompt are the same thing, except that virtual type words are initialized according to the prior probability distribution. May I know whether my understanding is correct?

njcx-ai commented 5 months ago

Thank you for your interest in KnowPrompt. Your understanding is correct; virtual type words are indeed implemented using soft prompts. In addition to being initialized according to the prior probability distribution, virtual type words also serve as typer markers in relation extraction tasks.