Open jamiew opened 3 years ago
This was implemented in the go-shenanigans https://github.com/dewi-alliance/go-etl-shenanigans/blob/main/scheduler/validator_isp.go
Amazing, love it
Table name is validator_isp
Here's the create statement I dug up from postgres... I think we will need geo_data
to be a jsonb
CREATE TABLE public.validator_isp (
address text NOT NULL,
isp text,
geo_data text
);
ALTER TABLE ONLY public.validator_isp
ADD CONSTRAINT validator_isp_pkey PRIMARY KEY (address);
Would it be annoying to parse the JSON and include each column individually? It's possible to join on jsonb fields with raw SQL but not via Metabase's nice GUI tools, so I'd likely end up creating a view that does the extraction if we don't do it here
{
"host": "100.121.169.153",
"ip": "100.121.169.153",
"rdns": "100.121.169.153",
"asn": 0,
"isp": "",
"country_name": "",
"country_code": "",
"region_name": "",
"region_code": "",
"city": "",
"postal_code": "",
"continent_name": "",
"continent_code": "",
"latitude": 0,
"longitude": 0,
"metro_code": 0,
"timezone": "",
"datetime": ""
}```
Added all the fields to its own columns.
@jamiew this is also done afaik
Explorer API is using KeyCDN to fetch geo location, ISP and other information for each validator
This appears to be publicly accessible and would useful to have in DeWi ETL as well:
=>
We should investigate if a commercial license is strictly required, or if this is OK for the ~2000 queries or so we would need for initial import