crflynn / databricks-dbapi

DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters
MIT License
22 stars 8 forks source link

Hard dependency on `pyhive[hive]` causes installation issues #19

Closed evansd closed 2 years ago

evansd commented 2 years ago

Thanks for creating this package! We're investigating using it in OpenSAFELY.

This may not be an easy issue to solve, and certainly won't be high priority for you, but just wanted to flag up that the way the dependencies of this package are configured has caused us some problems. Specifically, the dependency on pyhive[hive] pulls in sasl which we don't need and which is awkward to install because it has no wheel and needs the libsasl2 headers to compile.

To work around them we've had to fork the package and edit the dependencies (https://github.com/opensafely-core/databricks-dbapi/pull/1): https://github.com/opensafely-core/databricks-dbapi/pull/1/files

It's possible that future updates to pip and pip-tools will give us other ways to work around this issue without needing to fork. But I thought it was worth mentioning this problem in case an easier solution occurs to you.