This PR contains a basic duplicate remover, that looks at the names of blips and their quadrants and removes lines from the CSV file if they match. This also includes a hard coded alternative names map that will catch variations of names and simplify them to catch duplicates (e.g. csharp, C#, CSHARP)
It also includes a data integrity verifier that will check if the CSV file header and data is correctly formatted.
This PR contains a basic duplicate remover, that looks at the names of blips and their quadrants and removes lines from the CSV file if they match. This also includes a hard coded alternative names map that will catch variations of names and simplify them to catch duplicates (e.g. csharp, C#, CSHARP)
It also includes a data integrity verifier that will check if the CSV file header and data is correctly formatted.
The verifier will run when fetching and merging
Resolves #60 Resolves #75 Resolves #67