airbytehq / PyAirbyte

PyAirbyte brings the power of Airbyte to every Python developer.
https://docs.airbyte.com/pyairbyte
Other
231 stars 41 forks source link

Apply security and compatibility updates for PyAirbyte dependencies (Sep 2024) #386

Closed aaronsteers closed 1 month ago

aaronsteers commented 1 month ago

There are a number of dependencies of PyAirbyte which are stale relative to security updates. We'd also like to build a formal process to stay on top of relevant security and dependency updates.

This issue will track a number of action items:

### Tasks
- [x] Enable GitHub security scanning
- [x] Enable dependabot in GitHub
- [x] Handle initial of dependabot recommendations
- [ ] #382
- [ ] https://github.com/airbytehq/PyAirbyte/pull/383
- [x] Make issues for any other remaining long-term action items
- [ ] https://github.com/airbytehq/PyAirbyte/pull/396
- [ ] https://github.com/airbytehq/PyAirbyte/issues/397
- [ ] https://github.com/airbytehq/PyAirbyte/issues/398
aaronsteers commented 1 month ago

As noted in task list above, this week we enabled dependabot updates and GitHub security scanning.

We've also merged 9 dependabot updates this week, which will release shortly.

The largest blocker right now for the other libraries is the SQLAlchemy 2.x bump. That was previously blocked by Snowflake and BigQuery drivers not supporting the 2.x, which both have now gotten caught up on. I have this draft PR as a WIP, but it may need to be broken into smaller updates.

aaronsteers commented 1 month ago

Just released:

aaronsteers commented 1 month ago

The latest version of PyAirbyte,, released today, includes support for SQLalchemy 2.0 along with the latest version of the Airbyte CDK, along with several other dependency updates.

https://github.com/airbytehq/PyAirbyte/releases/tag/v0.17.9

Closing this issue as resolved for our high pri updates. New issues have been created to track Pendulum and jsonschema.

Any other dependency updates that are needed may be requested by creating a new GitHub issue here in this repo.