search

peeringdb / peeringdb-py

PeeringDB python client
BSD 2-Clause "Simplified" License
89 stars 22 forks source link

Investigate odd missing relationships during initial syncs #91

Open vegu opened 5 months ago

vegu commented 5 months ago 
peeringdb -C . sync --fetch-private
Syncing to https://www.peeringdb.com/api
[org] Fetching from remote cache
[org] Processing 28576 objects
[campus] Fetching from remote cache
[campus] Processing 52 objects
[fac] Fetching from remote cache
[fac] Processing 5439 objects
Fetching dangling relationship Campus 14
Fetching dangling relationship Campus 93
Fetching dangling relationship Campus 60
Fetching dangling relationship Campus 68
Fetching dangling relationship Campus 64
[net] Fetching from remote cache
[net] Processing 30698 objects
Fetching dangling relationship Organization 30220
Fetching dangling relationship Organization 30281
[ix] Fetching from remote cache
[ix] Processing 1197 objects
[carrier] Fetching from remote cache
[carrier] Processing 179 objects
[carrierfac] Fetching from remote cache
[carrierfac] Processing 2970 objects
Fetching dangling relationship Facility 921
Fetching dangling relationship Facility 471
Fetching dangling relationship Facility 4490
Fetching dangling relationship Facility 10524
Fetching dangling relationship Facility 13740
Fetching dangling relationship Facility 1815
Fetching dangling relationship Facility 14685
Fetching dangling relationship Facility 14680
Fetching dangling relationship Facility 14681
[ixfac] Fetching from remote cache
[ixfac] Processing 3729 objects
[ixlan] Fetching from API (private)
[ixlan] Processing 1197 objects
[ixpfx] Fetching from remote cache
[ixpfx] Processing 2322 objects
Fetching dangling relationship InternetExchangeLan 3323
Fetching dangling relationship InternetExchange 3323
[netfac] Fetching from remote cache
[netfac] Processing 50542 objects
[netixlan] Fetching from remote cache
[netixlan] Processing 54948 objects
[poc] Fetching from API (private)
[poc] Processing 51677 objects

The campus objects can be explained by being referenced while pending (a single facility contained and referencing the campus). The Organization, Facilities and IXLans however should be looked at.

It might be stale data referencing deleted objects.

Confirmed that this happens with and without the public cache enabled.

jackcarrozzo commented 5 months ago

+1