Texera / texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows
https://texera.github.io
Apache License 2.0
160 stars 68 forks source link

Reduce the Information Fetching of the File Selection Window of Scan Operators #2757

Closed mengw15 closed 1 month ago

mengw15 commented 1 month ago

Summary:

This PR introduces a new file-selection component for dynamically selecting datasets and their versions, and subsequently displaying files belonging to the selected version.

Purpose:

The main goal of this PR is to optimize resource usage. Instead of initially fetching all file nodes for all versions of all datasets, we first retrieve all datasets. Based on the user's selection, we then fetch the corresponding versions of the selected dataset. Finally, upon selecting a version, we fetch and display the file nodes for that specific version.

Dynamic Fetching:

Fetch all datasets initially. Fetch versions of the selected dataset upon dataset selection. Fetch file nodes of the selected version upon version selection.

UI Enhancements:

Each dataset option displays its dataset ID and owner status. Upon selecting a dataset, the default version is set to the latest version, users can change the version if needed. Files are automatically displayed once a version is selected.

截屏2024-07-29 上午10 01 03