search

dependabot / dependabot-core

🤖 Dependabot's core logic for creating update PRs.
https://docs.github.com/en/code-security/dependabot
MIT License
4.72k stars 1.02k forks source link

Dependencies failed to update - Unknown error in pip #10598

Closed VicenteCosta closed 3 weeks ago

VicenteCosta commented 2 months ago

Is there an existing issue for this?

Package ecosystem

pip

Package manager version

No response

Language version

3.12.3

Manifest location and content before the Dependabot update

orchestrate/prefect/Pipfile:

[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
aiofiles =">=23.2.1"
components = {editable = true, path = "."}
dbt-snowflake = ">=1.8.3"
jsonlines = ">=4.0.0"
pandas = ">=2.2.2"
prefect = ">=2.19.5"
prefect-aws = ">=0.4.17"
prefect-dbt = "~=0.4.0"
prefect-docker = ">=0.5.2"
prefect-slack = ">=0.2.6"
prefect-snowflake = ">=0.27.6"
prefect-sqlalchemy = ">=0.4.3"
pymssql = ">=2.3.0"
psycopg2-binary = ">=2.9.9"
s3fs = ">=2024.6.0"
slack-sdk = ">=3.28.0"
snowflake-sqlalchemy = { extras = ["pandas"], version = ">=1.5.3" }
sshtunnel = ">=0.4.0"
anaplanconnector = "*"

[dev-packages]
bpython = "*"
coverage = "*"
icecream = "*"
ipykernel = "*"
pytest = "*"
pytest-asyncio = "*"
pytest-cov = "*"
python-dotenv = "*"
ruff = "*"
mypy = "*"
pytest-github-actions-annotate-failures = "*"
moto = {extras = ["s3", "ssm"], version = "*"}
responses = "*"

[requires]
python_version = "3.12.3"

orchestrate/prefect/requirements.txt

-i https://pypi.org/simple
agate==1.9.1
aiobotocore==2.13.1; python_version >= '3.8'
aiofiles==24.1.0; python_version >= '3.8'
aiohttp==3.9.5; python_version >= '3.8'
aioitertools==0.11.0; python_version >= '3.6'
aiosignal==1.3.1; python_version >= '3.7'
aiosqlite==0.20.0; python_version >= '3.8'
alembic==1.13.1; python_version >= '3.8'
anaplanconnector==0.1.2; python_version >= '3.6'
annotated-types==0.7.0; python_version >= '3.8'
anyio==3.7.1; python_version >= '3.7'
apprise==1.8.0; python_version >= '3.6'
asgi-lifespan==2.1.0; python_version >= '3.7'
asn1crypto==1.5.1
asyncpg==0.29.0; python_full_version >= '3.8.0'
attrs==23.2.0; python_version >= '3.7'
babel==2.15.0; python_version >= '3.8'
bcrypt==4.1.3; python_version >= '3.7'
boto3==1.34.131; python_version >= '3.8'
botocore==1.34.131; python_version >= '3.8'
cachetools==5.3.3; python_version >= '3.7'
certifi==2024.6.2; python_version >= '3.6'
cffi==1.16.0; platform_python_implementation != 'PyPy'
charset-normalizer==3.3.2; python_full_version >= '3.7.0'
click==8.1.7; python_version >= '3.7'
cloudpickle==3.0.0; python_version >= '3.8'
colorama==0.4.6; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4, 3.5, 3.6'
#-e . ; python_version >= '3.6'
coolname==2.2.0
croniter==2.0.5; python_version >= '2.6' and python_version not in '3.0, 3.1, 3.2, 3.3'
cryptography==42.0.8; python_version >= '3.7'
daff==1.3.46
dateparser==1.2.0; python_version >= '3.7'
dbt-adapters==1.3.1; python_full_version >= '3.8.0'
dbt-common==1.4.0; python_version >= '3.8'
dbt-core==1.8.3; python_version >= '3.8'
dbt-extractor==0.5.1; python_full_version >= '3.6.1'
dbt-semantic-interfaces==0.5.1; python_version >= '3.8'
dbt-snowflake==1.8.3; python_version >= '3.8'
deepdiff==7.0.1; python_version >= '3.8'
dnspython==2.6.1; python_version >= '3.8'
docker==7.1.0; python_version >= '3.8'
email-validator==2.2.0
filelock==3.15.4; python_version >= '3.8'
frozenlist==1.4.1; python_version >= '3.8'
fsspec==2024.6.0; python_version >= '3.8'
google-auth==2.30.0; python_version >= '3.7'
graphql-core==3.2.3; python_version >= '3.6' and python_version < '4'
graphviz==0.20.3; python_version >= '3.8'
greenlet==3.0.3; python_version >= '3' and platform_machine == 'aarch64' or (platform_machine == 'ppc64le' or (platform_machine == 'x86_64' or (platform_machine == 'amd64' or (platform_machine == 'AMD64' or (platform_machine == 'win32' or platform_machine == 'WIN32')))))
griffe==0.47.0; python_version >= '3.8'
h11==0.14.0; python_version >= '3.7'
h2==4.1.0
hpack==4.0.0; python_full_version >= '3.6.1'
httpcore==1.0.5; python_version >= '3.8'
httpx[http2]==0.27.0; python_version >= '3.8'
humanize==4.9.0; python_version >= '3.8'
hyperframe==6.0.1; python_full_version >= '3.6.1'
idna==3.7; python_version >= '3.5'
importlib-metadata==6.11.0; python_version >= '3.8'
importlib-resources==6.1.3; python_version >= '3.8'
isodate==0.6.1
itsdangerous==2.2.0; python_version >= '3.8'
jaraco.classes==3.4.0; python_version >= '3.8'
jinja2==3.1.4; python_version >= '3.7'
jinja2-humanize-extension==0.4.0; python_version >= '3.0'
jmespath==1.0.1; python_version >= '3.7'
jsonlines==4.0.0; python_version >= '3.8'
jsonpatch==1.33; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4, 3.5, 3.6'
jsonpointer==3.0.0; python_version >= '3.7'
jsonschema==4.22.0; python_version >= '3.8'
jsonschema-specifications==2023.12.1; python_version >= '3.8'
keyring==24.3.1
kubernetes==29.0.0; python_version >= '3.6'
leather==0.4.0
logbook==1.5.3
mako==1.3.5; python_version >= '3.8'
markdown==3.6; python_version >= '3.8'
markdown-it-py==3.0.0; python_version >= '3.8'
markupsafe==2.1.5; python_version >= '3.7'
mashumaro[msgpack]==3.13.1; python_version >= '3.8'
mdurl==0.1.2; python_version >= '3.7'
minimal-snowplow-tracker==0.0.2
more-itertools==10.3.0; python_version >= '3.8'
msgpack==1.0.8
multidict==6.0.5; python_version >= '3.7'
mypy-boto3-s3==1.34.120; python_version >= '3.8'
mypy-boto3-secretsmanager==1.34.128; python_version >= '3.8'
networkx==3.3; python_version >= '3.10'
numpy==2.0.0; python_version >= '3.12'
oauthlib==3.2.2; python_version >= '3.6'
ordered-set==4.1.0; python_version >= '3.7'
orjson==3.10.5; python_version >= '3.8'
packaging==24.1; python_version >= '3.8'
pandas==2.2.2; python_version >= '3.9'
paramiko==3.4.0; python_version >= '3.6'
parsedatetime==2.6
pathspec==0.12.1; python_version >= '3.8'
pendulum==3.0.0; python_version >= '3.12'
platformdirs==4.2.2; python_version >= '3.8'
prefect==2.19.6; python_version >= '3.8'
prefect-aws==0.4.17; python_version >= '3.8'
prefect-dbt==0.4.3; python_version >= '3.8'
prefect-docker==0.5.2; python_version >= '3.8'
prefect-shell==0.2.5; python_version >= '3.8'
prefect-slack==0.2.6; python_version >= '3.8'
prefect-snowflake[pandas]==0.27.6; python_version >= '3.8'
prefect-sqlalchemy==0.4.3; python_version >= '3.8'
protobuf==4.25.3; python_version >= '3.8'
psycopg2-binary==2.9.9; python_version >= '3.7'
pyarrow==16.1.0
pyasn1==0.6.0; python_version >= '3.8'
pyasn1-modules==0.4.0; python_version >= '3.8'
pycparser==2.22; python_version >= '3.8'
pydantic[email]==2.7.4; python_version >= '3.8'
pydantic-core==2.18.4; python_version >= '3.8'
pygments==2.18.0; python_version >= '3.8'
pyjwt==2.8.0; python_version >= '3.7'
pymssql==2.3.0
pynacl==1.5.0; python_version >= '3.6'
pyopenssl==24.1.0; python_version >= '3.7'
pyparsing==3.1.2; python_full_version >= '3.6.8'
python-dateutil==2.9.0.post0; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3'
python-multipart==0.0.9; python_version >= '3.8'
python-slugify==8.0.4; python_version >= '3.7'
pytimeparse==1.1.8
pytz==2024.1
pyyaml==6.0.1; python_version >= '3.6'
readchar==4.1.0; python_version >= '3.8'
referencing==0.35.1; python_version >= '3.8'
regex==2024.5.15; python_version >= '3.8'
requests==2.32.3; python_version >= '3.8'
requests-oauthlib==2.0.0; python_version >= '3.4'
rfc3339-validator==0.1.4; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4'
rich==13.7.1; python_full_version >= '3.7.0'
rpds-py==0.18.1; python_version >= '3.8'
rsa==4.9; python_version >= '3.6' and python_version < '4'
ruamel.yaml==0.18.6; python_version >= '3.7'
ruamel.yaml.clib==0.2.8; python_version < '3.13' and platform_python_implementation == 'CPython'
s3fs==2024.6.0; python_version >= '3.8'
s3transfer==0.10.2; python_version >= '3.8'
sgqlc==16.3; python_version >= '3.7' and python_version < '4.0'
shellingham==1.5.4; python_version >= '3.7'
six==1.16.0; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3'
slack-sdk==3.30.0; python_version >= '3.6'
sniffio==1.3.1; python_version >= '3.7'
snowflake-connector-python[pandas,secure-local-storage]==3.11.0; python_version >= '3.8'
snowflake-sqlalchemy[pandas]==1.5.3; python_version >= '3.8'
sortedcontainers==2.4.0
sqlalchemy[asyncio]==1.4.52; python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4, 3.5'
sqlparse==0.5.0; python_version >= '3.8'
sshtunnel==0.4.0
tenacity==8.4.2; python_version >= '3.8'
text-unidecode==1.3
time-machine==2.14.1; implementation_name != 'pypy'
toml==0.10.2; python_version >= '2.6' and python_version not in '3.0, 3.1, 3.2, 3.3'
tomlkit==0.12.5; python_version >= '3.7'
typer==0.12.3; python_version >= '3.7'
typing-extensions==4.12.2; python_version >= '3.8'
tzdata==2024.1; python_version >= '2'
tzlocal==5.2; python_version >= '3.8'
ujson==5.10.0; python_version >= '3.8'
urllib3==2.2.2; python_version >= '3.10'
uvicorn==0.28.1; python_version >= '3.8'
websocket-client==1.8.0; python_version >= '3.8'
websockets==12.0; python_version >= '3.8'
wrapt==1.16.0; python_version >= '3.6'
yarl==1.9.4; python_version >= '3.7'
zipp==3.19.2; python_version >= '3.8'

dependabot.yml content

version: 2
updates:
  - package-ecosystem: "pip"
    directory: "/orchestrate/prefect/"
    schedule:
      interval: "daily"
      time: "09:00"
      timezone: "Europe/Belfast"
    groups:
      all-dependencies:
        patterns:
          - "*"
  - package-ecosystem: "pip"
    directory: "/applications/code_doc_gen"
    schedule:
      interval: "daily"
      time: "09:00"
      timezone: "Europe/Belfast"
    groups:
      all-dependencies:
        patterns:
          - "*"
  - package-ecosystem: "pip"
    directory: "/applications/streamlit"
    schedule:
      interval: "daily"
      time: "09:00"
      timezone: "Europe/Belfast"
    groups:
      all-dependencies:
        patterns:
          - "*"
  - package-ecosystem: "pip"
    directory: "/administrate/snow_python_src"
    schedule:
      interval: "daily"
      time: "09:00"
      timezone: "Europe/Belfast"
    groups:
      all-dependencies:
        patterns:
          - "*"

Updated dependency

No response

What you expected to see, versus what you actually saw

What I expected: The dependabot action to be successful and possibly raise a couple of PR's to update version What I actually saw: This error: https://github.com/convex-insurance/data-engineering/actions/runs/10834946597/job/30065341451 Dependabot encountered '16' error(s) during execution, please check the logs for more details.

+---------------+
|    Errors     |
+---------------+
| unknown_error |
+---------------+
+------------------------------------+
|   Dependencies failed to update    |
+--------------------+---------------+
| prefect            | unknown_error |
| prefect-aws        | unknown_error |
| prefect-dbt        | unknown_error |
| prefect-docker     | unknown_error |
| prefect-slack      | unknown_error |
| prefect-snowflake  | unknown_error |
| prefect-sqlalchemy | unknown_error |
| pymssql            | unknown_error |
| s3fs               | unknown_error |
| slack-sdk          | unknown_error |
| pytest             | unknown_error |
| pytest-asyncio     | unknown_error |
| ruff               | unknown_error |
| mypy               | unknown_error |
| moto               | unknown_error |

Native package manager behavior

No response

Images of the diff or a link to the PR, issue, or logs

No response

Smallest manifest that reproduces the issue

No response

PhilippWillms commented 1 month ago

The error message is not visible behind the link you provided. Seems you need to add it to the issue.

VicenteCosta commented 3 weeks ago

Looks like the issue was a mismatch between prefect new version (3.0) and a mismatch with some specific versions from the adapters (prefect-aws, prefect-dbt , etc). All is sorted now