search

aws / amazon-redshift-python-driver

Redshift Python Connector. It supports Python Database API Specification v2.0.
Apache License 2.0
202 stars 72 forks source link

PackageNotFoundError: scramp when using redshift_connector library in glue #219

Open learncode1146 opened 2 months ago

learncode1146 commented 2 months ago

In aws glue shell job , i am using a wheel file which has all the libraries needed for aws wrangler, redshift-connector and i do see scramp library part of the wheel file. However when i install this wheel during glue python shell job i am getting the following error event though scramp library is installed.

Glue python version 3.9 aws wrangler version = 3.7.3 redshift-connector version = 2.1.1

I am trying to connect to redshift serverless using the above libraries and here

`

from redshift_connector.core import BINARY, Connection, Cursor File "/glue/lib/installation/redshift_connector/core.py", line 18, in | from redshift_connector.core import BINARY, Connection, Cursor File "/glue/lib/installation/redshift_connector/core.py", line 18, in -- | -- from scramp import ScramClient # type: ignore File "/glue/lib/installation/scramp/__init__.py", line 12, in | __version__ = version("scramp") File "/.pyenv/versions/3.9.10/lib/python3.9/importlib/metadata.py", line 560, in version |     return Distribution.from_name(distribution_name) File "/.pyenv/versions/3.9.10/lib/python3.9/importlib/metadata.py", "/.pyenv/versions/3.9.10/lib/python3.9/importlib/metadata.py", line 187, in from_name raise PackageNotFoundError(name) importlib.metadata.PackageNotFoundError: scramp

`

kkadiyam commented 1 month ago

I am stuck on same issue, You got any luck with this ?