jayvdb / pypidb

PyPI client side database with SCM/VCS URLs
Apache License 2.0
13 stars 3 forks source link

mrab-regex slow due to fetching of bitbucket issues #23

Open jayvdb opened 4 years ago

jayvdb commented 4 years ago

https://bitbucket.org/mrabarnett/mrab-regex/issues/123 are being fetched, because the bitbucket SCM picker doesnt block those URLs.

jayvdb commented 4 years ago

poster

pypidb/_scm_url_cleaner.py:782: in get_root
    return self._get_root(url)
...
DEBUG    pypidb._scm_url_cleaner:__init__.py:157 Calling pypidb._scm_url_cleaner.SCMURLCleaner.get_root(self = <pypidb._scm_url_cleaner.SCMURLCleaner object at 0x7f03e15cb130>, url = 'http://bitbucket.org/chrisatlee/poster')
DEBUG    pypidb._adapters:_adapters.py:57 domain block of https://bitbucket.org/chrisatlee/poster skipped
DEBUG    pypidb._adapters:_adapters.py:33 IPblock of https://bitbucket.org/chrisatlee/poster skipped
DEBUG    https_everywhere.adapter:adapter.py:86 No implementation for get_redirect('https://bitbucket.org/chrisatlee/poster')
DEBUG    https_everywhere.adapter:adapter.py:117 no redirection of https://bitbucket.org/chrisatlee/poster occurred
DEBUG    cachecontrol.controller:controller.py:126 Looking up "https://bitbucket.org/chrisatlee/poster" in the cache
DEBUG    cachecontrol.controller:controller.py:179 Current age based on date: 811375
DEBUG    cachecontrol.controller:controller.py:201 Freshness lifetime from expires: 432000
DEBUG    urllib3.connectionpool:connectionpool.py:955 Starting new HTTPS connection (1): bitbucket.org:443
DEBUG    pypidb._scm_url_cleaner:__init__.py:198 Exception Failed occurred in pypidb._scm_url_cleaner.SCMURLCleaner.get_root, "Timeout >100.0s"