How context part is constructed?

[Rexhaif]

Hi, I've read the paper and repository description. But I'm still unsure how the context part of model input is constructed. So far I see two possible options:

• Context consist of only one conversation turn aka user's latest input
• Context is constructed in the way similar to DialoGPT and can contain multiple turns:

  'user_input' <|endoftext|> 'model_reply' <|endoftext|> 'user_input' <|endoftext|> ...<|endoftext|> 'user_input'

  Can you clarify it?

[golsun]

Hi @Rexhaif

DialogRPT supports multi-turn context, if you're using the latest version I just updated (this commit), the context should look like:

 'context_turn_1' <|endoftext|> 'context_turn_2' <|endoftext|> 'context_turn_3' <|endoftext|> ...<|endoftext|> 'context_turn_4'

It's consistent with DialoGPT and Hugging Face model card (see example)

[Rexhaif]

Thanks!

[Mikeygoldman1]

@golsun Hi, in this case below, is the model ranking 'context_turn_4' while taking into account all the previous contexts?

'context_turn_1' <|endoftext|> 'context_turn_2' <|endoftext|> 'context_turn_3' <|endoftext|> ...<|endoftext|> 'context_turn_4'