Localized language code extraction

[NeonDaniel]

The extract_langcode method only extracts localized language codes for "en-us" and "pt-br". langs.json probably needs to be extended to parse more variants (i.e. en-uk, en-au, fr-ca, es-mx...). Or maybe a separate mapping of country names to codes to parse separately? It may be more generically useful to be able to parse locales separate from languages for things like default units, currencies, better location parsing

[NeonDaniel]

From Matrix discussion:

extract_langcode("American English") = 'en'
extract_countrycode("American English") = "us"

"American English" or "Inglês Americano" both resolve to US, skills for sure wont have a list for every country in every language

[JarbasAl]

Considerations:

• country codes can be ISO Alpha-2, Alpha-3, and Numeric Country Codes.
• The new methods should have a flag to support all of these
• Should be json based like the lang utils for ease of translation and portability
• what is valid input? do we need a confidence param?
• from a country name you can easily get the code
• from a language you can return the "main" country, but its basically a fuzzy match ...
• from a city you could also return the country, this starts getting more into geolocation territory
• we often need to extract lat, lon from arbitrary strings, some work is done in the big datetime rewrite
  • location awareness is a context clue for other parsers, for example to determine what date is "summer" or "winter"