Nike-Inc / spark-expectations

A Python Library to support running data quality rules while the spark job is running⚡
https://engineering.nike.com/spark-expectations
Apache License 2.0
148 stars 32 forks source link

[FEATURE] Loosen pluggy version #93

Closed mikita-sakalouski closed 1 month ago

mikita-sakalouski commented 1 month ago

Is your feature request related to a problem? Please describe. Currently pluggy version is hardcoded to pluggy = "1.0.0" which is not allowing to use latest versions of pytest.

Describe the solution you'd like I would like to have pluggy dependencies as follows pluggy = "^1"

Describe alternatives you've considered No alternatives

Additional context

× No solution found when resolving dependencies:
  ╰─▶ Because only the following versions of pytest are available:
          pytest<=8.1.0
          pytest==8.1.1
          pytest==8.1.2
          pytest==8.2.0
          pytest==8.2.1
          pytest>=9.dev0
      and pytest==8.1.0 was yanked (reason: See https://github.com/pytest-dev/pytest/issues/12069), we can conclude that pytest>=8.1.0,<8.1.1 cannot be used.
      And because pytest>=8.1.1,<=8.1.2 depends on pluggy>=1.4 and pluggy>=1.5, we can conclude that pytest>=8.1.0 depends on pluggy>=1.4.
      And because spark-expectations>=1.1.0 depends on pluggy==1.0.0 and only the following versions of spark-expectations are available:
          spark-expectations<=1.1.0
          spark-expectations==1.1.1
          spark-expectations==2.0.0
      we can conclude that pytest>=8.1.0,<9.dev0 and spark-expectations>=1.1.0 are incompatible.
      And because you require pytest>=8.1 and spark-expectations>=1.1.0, we can conclude that the requirements are unsatisfiable.

      hint: pytest was requested with a pre-release marker (e.g., any of:
          pytest>8.1.0,<8.1.1
          pytest>8.1.1,<8.1.2
          pytest>8.1.2,<8.2.0
          pytest>8.2.0,<8.2.1
          pytest>8.2.1,<9.dev0
      ), but pre-releases weren't enabled (try: `--prerelease=allow`)