Combine input entries with the same identifier into a single document

[karlhigley]

Since entries with the same identifier may contain overlapping or the same content, extract the distinct sentences from each document (i.e. filter out duplicates within each document).