fix: Deduplicate index entries

ietf-tools / xml2rfc

Generate RFCs and IETF drafts from document source in XML according to the IETF xml2rfc v2 and v3 vocabularies

https://ietf-tools.github.io/xml2rfc/

BSD 3-Clause "New" or "Revised" License

64 stars 35 forks source link

fix: Deduplicate index entries #1050

Closed jennifer-richards closed 9 months ago

jennifer-richards commented 9 months ago

This PR addresses two issues:

Duplicate entries per term in the index.
Duplicate terms in the index.

Fixes #988

kesara commented 9 months ago

The root cause for having duplicate terms is some terms are stored with white spaces due to line breaks. For example, there can be two unique entries because one term is 'Oblivious Gateway Resource' and the other is 'Oblivious Gateway Resource' (due to line breaks).