search

zowe / zowe-explorer-vscode

Visual Studio Code Extension for Zowe, which lets users interact with z/OS Data Sets, Unix System Services, and Jobs on a remote mainframe instance. Powered by Zowe SDKs.
Eclipse Public License 2.0
162 stars 90 forks source link

Get Dataset list fails #1270

Open bearou opened 3 years ago

bearou commented 3 years ago

Describe the bug

2 closely related situations where opening a dataset fails

  1. de-expanding/closing/contracting dataset (pressing down marker ) after opening same dataset sometimes (regrettably not always) causes 'get Dataset List command submitted' to run repeatedly.

  2. opening a dataset with 227k members not only takes a long time (2+ minutes) and it also locks VSC with no possibility to do other things og regret the act.

To Reproduce

Ref. 1)

  1. Go to VCS Zowe Favorites
  2. Expand profile
  3. Expand dataset (dont know if number of members is important)
  4. De-expand (contract?) dataset

Ref. 2)

  1. Have large dataset with 200k members
  2. Go to VCS Zowe Favorites
  3. Expand profile
  4. Expand large dataset

Expected behavior

Ref. 1. After de-expand I always expect the extension to immediately be ready for new commands.

Ref. 2. Would be better if we either get the possibility to cancel operation or be able to work on other stuff while 'Getting Dataset List'

Desktop (please complete the following information):

crawr commented 3 years ago

Hello @bearou . Our squad previously looked at how well Zowe Explorer handles large datasets. The results of that research is here; https://ent.box.com/s/vk3oqr5porksaio0up4ooekcgiamruek

We have also recently implemented the Member Filter search where you could limit the number returned by the Get Dataset call to the members you might be interested in, and not all the members in that PDS.

Additionally, we will work on documenting the limitations for large datasets.

I hope this helps

lauren-li commented 2 years ago

The first part of this issue may be resolved when issue #754 is addressed.

ebennett48375 commented 2 years ago

I am also seeing performance issues with a PDS containing about 12,000 members. When I first expand the PDS, performance is very good. The list is displayed and the UI is ready in just a few seconds. When I collapse the PDS node, the UI locks up with a busy cursor for about a minute. Same thing happens every time I expand/collapse the node after the first time.

I've attached a Javascript profile in zipped format if it helps. CPU-20211228T183525.563Z.cpuprofile.zip