feat: updated dataset (2020-10-13) - Githubissues

ipfs-shipyard / ipfs-geoip

geoip lookup over DAG-CBOR dataset loaded from IPFS

MIT License

70 stars 21 forks source link

feat: updated dataset (2020-10-13) #80

Closed lidel closed 3 years ago

lidel commented 3 years ago

This PR updates the IPv4 City geoip dataset to the latest free version provided on https://dev.maxmind.com/geoip/geoip2/geolite2/ (GeoLite2-City-CSV_20201013)

Closes #68 Closes #63

Changes

Refactored code behind npm run generate to be compatible with new input format without changing output format too much
- BREAKING CHANGE: area_code and metro_code are no longer provided due to upstream changes
Generated a new b-tree from GeoLite2-City-CSV_20201013 dataset
- Note: most of the naming bugs fixed in #78 got fixed in the upstream dataset, but I've kept our overrides just to protect against future regressions.

Not in this PR

no IPv6 – it is tracked in #60
did not change the DAG format – it still uses stringified JSON and ipfs.object API instead of ipfs.dag and dag-cbor
- this is a bigger chunk of work, and should be tackled as part of #60

Test/Preview: ipfs-geoip on WebUI's Peers screen

I've run this PR against ipfs-webui and Peers screen looks good.

My node is located in Poland. I no longer see "USA" nodes with 30ms ping – faster-than-light networking is no more ;)

2020-10-19--16-10-23

With this updated dataset, we now see much better distribution across all continents:

Screenshot_2020-10-19 Peers IPFS(3)