search

matrixorigin / matrixone

Hyperconverged cloud-edge native database
https://docs.matrixorigin.cn/en
Apache License 2.0
1.76k stars 273 forks source link

[Feature Request]: DATALINK type #13914

Open fengttt opened 8 months ago

fengttt commented 8 months ago

Is there an existing issue for the same feature request?

Is your feature request related to a problem?

This request is for a rough equivalent of the DB2 datalink type.
https://www.ibm.com/docs/en/i/7.2?topic=datalinks-working

Describe the feature you'd like

I don't think we need the full datalink feature, but essentially, we want a new datatype, which can points to a file stored outside of the database. The datalink type should contain an URL, which is either a public https/s3, or file inside one of our stage.

This is especially useful for storing image/video and other big files. It is a must have for AI applications.

Note that main consumer of this feature is probably UDF. And/or content serving.

Describe implementation you've considered

No response

Documentation, Adoption, Use Case, Migration Strategy

No response

Additional information

No response

fengttt commented 8 months ago

Note that this is not a simple URL type -- we should allow stage syntax, and with that, all those authentication and authorization of the stage must be checked.

arjunsk commented 1 month ago

Waiting for the STAGE PR to be merged to master. @cpegeric

Then will use the stage_util.go class to convert STAGE URL to File Service URL