search

microsoft / Spark-Hive-Tools

This is for issue/feedback tracking on Spark & Hive Tools
Creative Commons Attribution 4.0 International
6 stars 9 forks source link

Token Expiration every 1-1.5 hour when connecting with Synapse: Pyspark Interactive #33

Open skandupmanyu opened 2 years ago

skandupmanyu commented 2 years ago

I am using the extension to connect to Azure Synapse Interactive PySpark session. The session expires every 1-1.5 hour with the following error message:

An error was encountered: Invalid status code '401' from https://syn-hdmc-az1-data-platform-dev.dev.azuresynapse.net/livyApi/versions/2019-11-01-preview/sparkPools/spkpooldscimd/sessions/180 with error payload: {"code":"ExpiredAuthenticationToken","message":"Token Authentication failed with SecurityTokenExpiredException - IDX10223: Lifetime validation failed. The token is expired. ValidTo: '[PII is hidden]', Current time: '[PII is hidden]'."}

It looks like the bearer token for Livy API is not getting refreshed.

zesluo commented 2 years ago

sorry for the inconvenience. If you are trying to use Synapse pyspark interactive , please use synapse studio instead, thanks. Since it's dependency will not be maintained anymore, it will also not be maintained. Currently, we are updating doc.

skandupmanyu commented 2 years ago

So the VSCode connectivity to Synapse would no longer be supported?

skandupmanyu commented 2 years ago

Now that VSCode extension is retiring as mentioned in the doc, what are the plans to use PyCharm/VSCode to develop .py scripts instead of notebooks on Synapse?

nilsbuer commented 5 months ago

It seems the message has changed when a Token in azure synapse expires. In the past I scanned for "ExpiredAuthenticationToken" now I see only the message "AuthenticationFailed". Did they change the response messages?