microsoft / vscode-data-wrangler

Other
418 stars 16 forks source link

Unable to see view Data Frame after last update on 04/09/2024 #274

Open jmmferrao opened 1 week ago

jmmferrao commented 1 week ago

Type: Bug

Behaviour

Expected vs. Actual

Cannot open a data frame when trying to view the data with data wrangler.

This is the message that I got: Received malformed content: {"name": "KeyError", "message": "'38e8d628-6b75-4cd7-a11f-b54dcff88ce3'", "stack": "Traceback \u001b[1;36m(most recent call last)\u001b[0m:\n\u001b[1;36m File \u001b[1;32m:56\u001b[1;36m in \u001b[1;35mDW_DEBUG_WRAPPER\u001b[1;36m\n\u001b[1;31mKeyError\u001b[0m\u001b[1;31m:\u001b[0m '38e8d628-6b75-4cd7-a11f-b54dcff88ce3'\n"}

Steps to reproduce:

  1. Tried to run same code that I had before but it does no show. DW telemetry data:

[ { "name": "Activate", "properties": { "WranglerHost": "vscode", "configurations": "{\"dataWrangler.debug\":true,\"dataWrangler.enabledFileTypes\":{\"csv\":true,\"tsv\":true,\"parquet\":true,\"xlsx\":true,\"xls\":true},\"dataWrangler.startInEditModeForNotebookEntrypoints\":false,\"dataWrangler.columnInsights.displayOnOpen\":true,\"dataWrangler.useRelativePath\":false,\"dataWrangler.experiments.autoDetectCsvDelimiter\":true,\"dataWrangler.experiments.fastCsvParsing\":true,\"dataWrangler.experiments.useJupyterProposedAPI\":true,\"dataWrangler.experiments.copilot.enabled\":false}", "abexp.assignmentcontext": "vsliv368:30146709;vspor879:30202332;vspor708:30202333;vspor363:30204092;binariesv615:30325510;vsaa593cf:30376535;c4g48928:30535728;asynctok:30898717;dsvsc020:30976470;dwaa612cf:30983454;jg8ic977:31013176;dvdeprecation:31068756;dwnewjupyter:31046869;" }, "measurements": { "duration": 0.012 } }, { "name": "LaunchDataWrangler", "properties": { "WranglerHost": "vscode", "entryPoint": "JupyterDataViewer", "format": "py", "viewMode": "dataViewer", "abexp.assignmentcontext": "vsliv368:30146709;vspor879:30202332;vspor708:30202333;vspor363:30204092;binariesv615:30325510;vsaa593cf:30376535;c4g48928:30535728;asynctok:30898717;dsvsc020:30976470;dwaa612cf:30983454;jg8ic977:31013176;dvdeprecation:31068756;dwnewjupyter:31046869;", "sessionUriHash": "8186fe1a6c26da2c31e5a830d2161f9369ce81c6f35d8f86270fd04fda41b648", "originalUriHash": "246e656b4d9b11a29d2127cace0d8899f48bb83d0b52f38337e288ae0a526b74" } }, { "name": "PackageDependenciesResolved", "properties": { "WranglerHost": "vscode", "installed": "{\"pandas\":\"2.1.1\",\"pyarrow\":\"15.0.1\"}", "required": "{\"pandas\":\"1.2.0\"}", "unsatisfied": "[]", "abexp.assignmentcontext": "vsliv368:30146709;vspor879:30202332;vspor708:30202333;vspor363:30204092;binariesv615:30325510;vsaa593cf:30376535;c4g48928:30535728;asynctok:30898717;dsvsc020:30976470;dwaa612cf:30983454;jg8ic977:31013176;dvdeprecation:31068756;dwnewjupyter:31046869;", "sessionUriHash": "8186fe1a6c26da2c31e5a830d2161f9369ce81c6f35d8f86270fd04fda41b648", "originalUriHash": "246e656b4d9b11a29d2127cace0d8899f48bb83d0b52f38337e288ae0a526b74", "currentViewMode": "dataViewer" } }, { "name": "OperationCodeExecutionFailed", "properties": { "WranglerHost": "vscode", "dataFrameType": "pandas", "telemetrySource": "startSession", "operationKey": "Variable", "abexp.assignmentcontext": "vsliv368:30146709;vspor879:30202332;vspor708:30202333;vspor363:30204092;binariesv615:30325510;vsaa593cf:30376535;c4g48928:30535728;asynctok:30898717;dsvsc020:30976470;dwaa612cf:30983454;jg8ic977:31013176;dvdeprecation:31068756;dwnewjupyter:31046869;", "sessionUriHash": "8186fe1a6c26da2c31e5a830d2161f9369ce81c6f35d8f86270fd04fda41b648", "originalUriHash": "246e656b4d9b11a29d2127cace0d8899f48bb83d0b52f38337e288ae0a526b74", "currentViewMode": "dataViewer" }, "measurements": { "shapeBeforeRows": 0, "shapeBeforeColumns": 0, "codeGenTimeInMS": 0, "codeExecTimeInMS": 37 } }, { "error": { "message": "dataLoadFailedError", "stack": "Error: dataLoadFailedError\n at e.raiseError (c:\Users\1151827\.vscode\extensions\ms-toolsai.datawrangler-1.8.0\out\extension.js:2:426208)\n at e. (c:\Users\1151827\.vscode\extensions\ms-toolsai.datawrangler-1.8.0\out\extension.js:2:398441)\n at c:\Users\1151827\.vscode\extensions\ms-toolsai.datawrangler-1.8.0\out\extension.js:2:387867\n at Object.next (c:\Users\1151827\.vscode\extensions\ms-toolsai.datawrangler-1.8.0\out\extension.js:2:387972)\n at o (c:\Users\1151827\.vscode\extensions\ms-toolsai.datawrangler-1.8.0\out\extension.js:2:386686)" }, "properties": { "WranglerHost": "vscode", "errorCode": "dataLoadFailedError", "innerError": "Start session > Failed to execute code", "operationKey": "Variable", "failedDuringCodeExecution": "true", "inputErrors": "{}", "abexp.assignmentcontext": "vsliv368:30146709;vspor879:30202332;vspor708:30202333;vspor363:30204092;binariesv615:30325510;vsaa593cf:30376535;c4g48928:30535728;asynctok:30898717;dsvsc020:30976470;dwaa612cf:30983454;jg8ic977:31013176;dvdeprecation:31068756;dwnewjupyter:31046869;", "sessionUriHash": "8186fe1a6c26da2c31e5a830d2161f9369ce81c6f35d8f86270fd04fda41b648", "originalUriHash": "246e656b4d9b11a29d2127cace0d8899f48bb83d0b52f38337e288ae0a526b74", "currentViewMode": "dataViewer" } } ]

Diagnostic data

{
  "installed": {
    "pandas": "2.1.1",
    "pyarrow": "15.0.1"
  },
  "required": {
    "pandas": "1.2.0"
  },
  "unsatisfied": []
}

Extension version: 1.8.0 VS Code version: Code 1.92.2 (fee1edb8d6d72a0ddff41e5f71a671c23ed924b9, 2024-08-14T17:29:30.058Z) OS version: Windows_NT x64 10.0.19045 Modes:

System Info |Item|Value| |---|---| |CPUs|12th Gen Intel(R) Core(TM) i7-1265U (12 x 2688)| |GPU Status|2d_canvas: enabled
canvas_oop_rasterization: enabled_on
direct_rendering_display_compositor: disabled_off_ok
gpu_compositing: enabled
multiple_raster_threads: enabled_on
opengl: enabled_on
rasterization: enabled
raw_draw: disabled_off_ok
skia_graphite: disabled_off
video_decode: enabled
video_encode: enabled
vulkan: disabled_off
webgl: enabled
webgl2: enabled
webgpu: enabled
webnn: disabled_off| |Load (avg)|undefined| |Memory (System)|15.64GB (4.35GB free)| |Process Argv|--crash-reporter-id e6e70bc1-19c7-4c9c-a4f6-7841285c762a| |Screen Reader|no| |VM|0%|
A/B Experiments ``` vsliv368:30146709 vspor879:30202332 vspor708:30202333 vspor363:30204092 vscod805cf:30301675 binariesv615:30325510 vsaa593cf:30376535 py29gd2263:31024239 c4g48928:30535728 azure-dev_surveyone:30548225 a9j8j154:30646983 962ge761:30959799 pythongtdpath:30769146 welcomedialogc:30910334 pythonnoceb:30805159 asynctok:30898717 pythonregdiag2:30936856 pythonmypyd1:30879173 h48ei257:31000450 pythontbext0:30879054 accentitlementst:30995554 dsvsc016:30899300 dsvsc017:30899301 dsvsc018:30899302 cppperfnew:31000557 dsvsc020:30976470 pythonait:31006305 dsvsc021:30996838 jg8ic977:31013176 pythoncenvpt:31062603 a69g1124:31058053 dvdeprecation:31068756 dwnewjupyter:31046869 2f103344:31071589 impr_priority:31102340 nativerepl1:31104043 refactort:31108082 pythonrstrctxt:31112756 flighttreat:31119336 wkspc-onlycs-t:31111718 wkspc-ranged-t:31125599 ei213698:31121563 aajjf12562:31125793 ```
pwang347 commented 1 week ago

Hi @jmmferrao, does this issue still happen consistently for you after reloading VS Code?

JoseMFerrao commented 1 week ago

Hello, unfortunately yes. Somehow everything works fine if I put some break points along the code and use the extension every 100 lines or so, but if I try to use the extension for the first time at line 700 for instance, I still get the same error...

pwang347 commented 1 week ago

Hi @JoseMFerrao thanks for confirming. You mentioned that this only started happening on 9/4/2024. Could you please share what the most recent working version is for you out of this list?

image

If you click "Switch to pre-release version" on the extension page you can install more granular versions: image

Then from here you can install with

image

Thanks!

JoseMFerrao commented 1 week ago

Hello @pwang347!

The most recent working version for me is 1.6.0.

For now I can manage this limitation with the break points along the code and if needed I will switch back to the older version.

Thank you very much for the help and support!

kycutler commented 4 days ago

Hi @JoseMFerrao, thanks for the information!

Did you happen to try the pre-release versions of Data Wrangler including 1.7.0, 1.7.1, and 1.7.2? Is there a specific one of these versions that started having the issue? This will help us narrow down what the problematic changes may be.

JoseMFerrao commented 3 days ago

Hello @kycutler!

I do not want to point you in the wrong direction, so let me start by saying that I have the auto update option turned on for all Microsoft extensions, including data wrangler.

Having said that, I did not willingly decided to make use of pre-realease versions. Thus, unless the auto update feature installed one of those pre-realease versions automatically, I did not try any of them.

kycutler commented 2 days ago

@JoseMFerrao understood, thank you for the clarification -- would you be willing to install the pre-release versions manually and see if they have the issue as well? There are many changes between versions 1.6.0 and 1.8.0, so narrowing it down to a specific 1.7.x pre-release version would help us a lot to identify the cause of the issue. You can always switch back to a stable version after.

JoseMFerrao commented 2 hours ago

@kycutler I will try to find the time to test the pre-release versions and let you know if I can narrow the issue to one of those pre-released versions!