Closed gmichalo closed 3 years ago
I was wondering why you separate the keywords with the word [SEP]?
out.write(' [SEP] '.join(new_words)+'\n')
I am mostly asking because if I am understanding the code correctly the [SEP] is between any two keywords and not keywords from different sentences.
Hi, your understanding is correct and it's just a heuristic. Maybe inserting [SEP] between keywords from different sentences would be better but we didn't try other strategies.
I was wondering why you separate the keywords with the word [SEP]?
I am mostly asking because if I am understanding the code correctly the [SEP] is between any two keywords and not keywords from different sentences.