V1.0 candidate; new deduper options, new taggers

[soldni]

• Version 1.0 candidate
• Added --dedupe.min_words and --dedupe.min_length to deduplication tool to filter documents/paragraphs under specific length
• Added taggers to detect repetitions
• Added support for custom BOS/EOS/PAD tokens in tokenize command
• Improved speed of tokenizer when using Llama
• Preliminary integration of WIMBD tools in Dolma
• New tests
• Added configurations to recreate Dolma v1.5 and v1.6
• Added Dolma manuscript