search

pypa / bandersnatch

A PyPI mirror client according to PEP 381 http://www.python.org/dev/peps/pep-0381/
Academic Free License v3.0
448 stars 141 forks source link

stale serial errors blocking synchronization #1416

Open TechCiel opened 1 year ago

TechCiel commented 1 year ago

According to pypi/warehouse#12214 , it has been a long-existing problem for the PyPI CDN to serve stale JSON API response, causing persisting error in syncing. This time, the mirror has been broken for over a week.

Could we implement a workaround in bandersnatch, allowing setting aside the problematic package, and continue to sync other packages? That's to say, to force fetch the change log even though the todo file exists?

cooperlees commented 1 year ago

Howdy - Sure has been a long standing issue. https://github.com/pypa/bandersnatch/pull/1335 removed our PURGE call that use to assist / workaround this. But as you can see, we have not been able to workaround it.

Could we implement a workaround in bandersnatch, allowing setting aside the problematic package, and continue to sync other packages? That's to say, to force fetch the change log even though the todo file exists?

How do you want to detect the problematic package? From there how should we store problematic package state?

The current workaround is to just rm the TODO file.