`infer`: new command to infer additional dataset characteristics based on summary stats/frequency table

[jqnatividad]

Date/Datetime formats

• when --infer-date is enabled, format should be set to the format used
• for all Date/Datetime columns, on the last pass right before displaying results, it will check min, max, median and modes to see if they match one of the 19 date formats recognized by qsv-dateparser
• if there are multiple formats detected, set format to either "multi_date", "multi_datetime", or "multi_date_datetime"

Location

• add --infer-location flag
• for all String columns, on the last pass right before displaying results, it will check min, max, median and modes to see if they match common location formats - https://www.maptools.com/tutorials/lat_lon/formats
• for Float columns:
  • if the range is between -90 and 90, its inferred to be latitude format
  • if the range is between -180 and 180, infer longitude format

Email

• add --infer-email flag
• for all String columns, on the last pass right before displaying results, it will check min, max, median and modes to see if they match common email formats using the email_address crate

Using the same approach above (looking at summary stats min, max, median, modes), also infer:

• Hostnames with --infer-hostnames option
• IP addresses with --infer-ipaddress option, for both ipv4 and ipv6 formats
• Phone numbers with --infer-phoneno option
• Currency with --infer-currency option, adding currency symbol metadata to the format entry - e.g. "currency - USD ( $ )", "currency - JPY (¥)", "currency = PHP (₱)", "currency - ? ($)", etc.
  As some currency symbols like the $ is used in several countries, it will use "?" instead of the three-letter ISO 4217 code if it cannot infer it.

Also add -F, --infer-all-formats convenience option.

If a CSV is indexed and --format-sample <sample_size> option is used, randomly sample the CSV to further verify if the inferred format using the summary stats is correct.

[jqnatividad]

For qsv pro, add the option to infer custom formats using luau or python scripts. These scripts will have the added ability to lookup reference data maintained in https://data.dathere.com (e.g. ISO code tables, congressional district, school district, Census geoid, etc.), other CKAN instances, and internal databases/data sources.

[jqnatividad]

make this a new "smart" command instead, so we don't overload stats with options..

Still, the format command will just add a format column to stats's output or the stats cache.