amundsen-io / amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
https://www.amundsen.io/amundsen/
Apache License 2.0
4.39k stars 954 forks source link

Feature Proposal: In Memory loader #2257

Closed HaoXuAI closed 1 month ago

HaoXuAI commented 1 month ago

The current supported loaders are all loading data from file systems(csv/json) into the destination. Instead it can be a simple loader take in Record in memory and load it directly.

Expected Behavior or Use Case

Service or Ingestion ETL

Data builder

Possible Implementation

Example Screenshots (if appropriate):

Context

boring-cyborg[bot] commented 1 month ago

Thanks for opening your first issue here!

kristenarmes commented 1 month ago

closing this since it has been triaged - will track by status label