search

StarRocks / starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
https://starrocks.io
Apache License 2.0
8.75k stars 1.76k forks source link

Ability to hide/get creds from external sources for FILES() queries. #40288

Open metalshanked opened 8 months ago

metalshanked commented 8 months ago

Hi, is there a way to hide or pull secret creds from alternate location instead of keeping it in plaintext in FILES() query like below? would be great if these creds can be store in some config or env variable instead of hardcoding it in query Example aws creds "aws.s3.access_key" = "XXXXXXXXXX", "aws.s3.secret_key" = "YYYYYYYYYY",

SELECT * FROM FILES(
    "path" = "s3://inserttest/parquet/insert_wiki_edit_append.parquet",
    "format" = "parquet",
    "aws.s3.access_key" = "XXXXXXXXXX",
    "aws.s3.secret_key" = "YYYYYYYYYY",
    "aws.s3.region" = "us-west-2"

);

jaogoy commented 3 months ago

There should be a creadential object in the furture.