Data Explorer - Githubissues

dafreels / metalus-api

Provides a set of APIs and a UI for working with the Metalus library

4 stars 12 forks source link

Data Explorer #142

Open dafreels opened 3 years ago

dafreels commented 3 years ago

Metalus Studio should include a Data Explorer tool to inspect data while working on Pipelines/Applications. Features should include:

List Directories/Buckets
List files within a Directory/Bucket
View header/schema
View a sample of data
Generate the Metalus Schema JSON definition from the data

Supported file formats:

CSV
Parquet
Avro
JSON
Text
JDBC

File compression should be supported.

Mock UI: Metalus API_UI - Data Explorer UI

Proposed High Level Architecture: Metalus API_UI - Data Explorer