peeringdb / peeringdb-py

PeeringDB python client
BSD 2-Clause "Simplified" License
89 stars 22 forks source link

Updates crashing after latest upgrade. #75

Closed ninjaix closed 1 year ago

ninjaix commented 1 year ago

./pdbvenv/bin/peeringdb sync Syncing to https://www.peeringdb.com/api Updating resources: org fac net ix carrier carrierfac ixfac ixlan ixpfx netfac netixlan poc Fetching & updating all: org Updates to be processed: 0 Fetching & updating all: fac Updates to be processed: 0 Fetching & updating all: net Updates to be processed: 0 Fetching & updating all: ix Updates to be processed: 0 Fetching & updating all: carrier Updates to be processed: 15 Fetching & updating all: carrierfac Updates to be processed: 91 Fetching & updating all: ixfac Updates to be processed: 0 Fetching & updating all: ixlan Updates to be processed: 1160 Fetched no data for ix-6 Fetched no data for ix-8 Fetched no data for ix-15 Fetched no data for org-35 Fetched no data for ix-16 Fetched no data for org-37 Fetched no data for ix-19 Fetched no data for org-48 Fetched no data for ix-20 Fetched no data for org-51 Fetched no data for ix-25 Fetched no data for org-64 Fetched no data for ix-32 Fetched no data for org-76 Fetched no data for ix-36 Fetched no data for org-85 Traceback (most recent call last): File "./pdbvenv/bin/peeringdb", line 8, in sys.exit(main()) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/cli.py", line 68, in main return handler(config=cfg, *vars(options)) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/commands.py", line 18, in _wrapped r = func(a, k) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/commands.py", line 249, in handle client.update_all(rs, since) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_update.py", line 70, in update_all ctx.sync_resource(r, since=since) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 76, in _wrapped return _consume_task(gen) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 60, in _consume_task r = _consume_task_or_generator(item) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 48, in _consume_task_or_generator return _consume_task(item) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 60, in _consume_task r = _consume_task_or_generator(item) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 48, in _consume_task_or_generator return _consume_task(item) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 57, in _consume_task item = gen.send(r) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_tasks_sequential.py", line 32, in send return self._gen.send(x) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_update.py", line 164, in fetch_and_index data, e = fetch_func() File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_update.py", line 224, in fetch_dangling return self.fetcher.fetch_all(_R, 0, dict(id__in=_pks)) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_fetch.py", line 61, in fetch_all return self._req(lambda: self.all(R.tag, depth=depth, params)) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_fetch.py", line 33, in _req return func(), None File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/peeringdb/_fetch.py", line 61, in return self._req(lambda: self.all(R.tag, depth=depth, **params)) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/twentyc/rpc/client.py", line 111, in all return self._load(self._request(typ, params=kwargs)) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/twentyc/rpc/client.py", line 88, in _load self._throw(res, data) File "/root/peeringdb-py/pdbvenv/lib/python3.8/site-packages/twentyc/rpc/client.py", line 75, in _throw raise Exception("%d Internal error: %s" % (res.status_code, err)) Exception: 429 Internal error: Too Many Requests

rob-job commented 1 year ago

I found this issue and think it's related. https://github.com/peeringdb/peeringdb/issues/1317

ninjaix commented 1 year ago

Tried the first step and that didn't work. I just ended up dropping all the tables.