Canonicalise club names to expand first name initials and distinguish between ambiguous names

k-j-m / CourseAnalysis

Analysis of fell race routes based on the data available through fellrunner.org.uk

1 stars 2 forks source link

Canonicalise club names to expand first name initials and distinguish between ambiguous names #12

Open k-j-m opened 7 years ago

k-j-m commented 7 years ago

In the downloaded results database, convert all club names to canonical form. This will let us distinguish between ambiguously-named runners by matching on name + club instead of name alone.

It will also let us add missing first name information for result sets that only include first name initial.

k-j-m commented 7 years ago

I plan to do this as follows:

make a big list of all club names and sort alphabetically
for each club name decide on a canonical form
write the canonical form next to each occurrence of club name (turn this file into a synonym->canonical lookup dictionary)
step through each race results file and replace each club name entry with the canonical form. Modify the files in place (but keep a backup handy)