[epic] Reference data updates

cybergreen-net / pm

Tech project management repo (issue tracker only)

2 stars 1 forks source link

[epic] Reference data updates #76

Closed rufuspollock closed 7 years ago

rufuspollock commented 7 years ago

[x] Split out reference datasets to own repos:
- [x] refdata-risk
- [x] refdata-country
- [x] move data
- [x] refdata-asn
- [x] move data
[x] Refactor each of those repos to new structure - as per new docs
[x] Add amplification factor to risk reference data
[ ] NOT CRITICAL Merge https://github.com/cybergreen-net/asname-historical with refdata-asn repo

zelima commented 7 years ago

New repos set up for reference data

risk - https://github.com/cybergreen-net/refdata-risk
country - https://github.com/cybergreen-net/refdata-country
asn - https://github.com/cybergreen-net/refdata-asn

Notes:

Only repo for risk contains actual data
datapackage.json's are constructed according to "new" columns, that csv files should have. (may need to modify)

rufuspollock commented 7 years ago

@zelima i assume we have not moved data because not on critical path. How long would this take?

zelima commented 7 years ago

@rgrp Easy with country, as soon as I start RDS work tomorrow. Not sure about ASN (complete version, with names) as there is no csv version of mapping as-number -> asn-name -> country yet

zelima commented 7 years ago

@rufuspollock reference data is moved to repos. But yet we are missing scripts for getting them

rufuspollock commented 7 years ago

FIXED. This was a fixed a while ago.