search

microsoft / azuredatastudio

Azure Data Studio is a data management and development tool with connectivity to popular cloud and on-premises databases. Azure Data Studio supports Windows, macOS, and Linux, with immediate capability to connect to Azure SQL and SQL Server. Browse the extension library for more database support options including MySQL, PostgreSQL, and MongoDB.
https://learn.microsoft.com/sql/azure-data-studio
MIT License
7.6k stars 909 forks source link

Getting a livy error when running a notebook - Standard_D8s_v3, 5 nodes #2928

Closed gengelbms closed 5 years ago

gengelbms commented 6 years ago

Issue Type: Bug

image

CTP 2.0 Deployment pip3 install --index-url https://private-repo.microsoft.com/python/ctp-2.0 mssqlctl

Ports Gengelb-MacBook-Pro:~ gengelb$ kubectl get svc -n kubcluster2 | grep -v "" NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE service-master-pool-lb LoadBalancer 10.0.237.18 104.40.16.115 31433:30096/TCP 19h service-mssql-controller-lb LoadBalancer 10.0.51.34 40.78.48.203 30080:31156/TCP 19h service-proxy-lb LoadBalancer 10.0.152.85 104.40.20.70 30777:32367/TCP 19h service-security-lb LoadBalancer 10.0.89.169 104.40.18.171 30443:30366/TCP 19h

I created a 5 node cluster on AKS:

az aks create --name kubcluster2 \ --resource-group gengelbaksgroup \ --generate-ssh-keys \ --node-vm-size Standard_D8s_v3 \ --node-count 5 \ --kubernetes-version 1.10.7

When a run a notebook with a code cell with print(1), I get:

The code failed because of a fatal error: Invalid status code '500' from https://104.40.18.171:30443/gateway/default/livy/v1/sessions with error payload:

Error 500 Server Error

HTTP ERROR 500

Problem accessing /gateway/default/livy/v1/sessions. Reason: 

    Server Error

Powered by Jetty://

.

Some things to try: a) Make sure Spark has enough available resources for Jupyter to create a Spark context. b) Contact your Jupyter administrator to make sure the Spark magics library is configured correctly. c) Restart the kernel.

Azure Data Studio version: Azure Data Studio 1.0.0 (cab8f3e37c9ac4367e0dacef5185da08bd8021c2, 2018-09-20T21:41:50.803Z) OS version: Darwin x64 17.7.0

System Info |Item|Value| |---|---| |CPUs|Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz (8 x 3100)| |GPU Status|2d_canvas: enabled
checker_imaging: disabled_off
flash_3d: enabled
flash_stage3d: enabled
flash_stage3d_baseline: enabled
gpu_compositing: enabled
multiple_raster_threads: enabled_on
native_gpu_memory_buffers: enabled
rasterization: enabled
video_decode: enabled
video_encode: enabled
webgl: enabled
webgl2: enabled| |Load (avg)|1, 2, 2| |Memory (System)|16.00GB (6.48GB free)| |Process Argv|/Applications/Azure Data Studio.app/Contents/MacOS/Electron| |Screen Reader|no| |VM|0%|
chlafreniere commented 5 years ago

We haven't seen this particular issue for a few months now, so closing this issue.