activeloopai / deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
https://activeloop.ai
Mozilla Public License 2.0
7.87k stars 605 forks source link

Allow creds_key to be passed to deeplake.empty() and deeplake.load() #2860

Closed nvoxland-al closed 1 month ago

nvoxland-al commented 1 month ago

🚀 🚀 Pull Request

Impact

Description

As long as org_id and a token are passed along, the creds passed to deeplake.load and deeplake.empty can be given managed credentials from the organization.

Example:

ds = deeplake.empty("s3://my/path", creds={"creds_key": "aws_creds"}, org_id="my_org")
ds = deeplake.load("s3://my/path" creds={"creds_key": "aws_creds"}, org_id="my_org")

Things to be aware of

Also works with deeplake.delete and exists

sonarcloud[bot] commented 1 month ago

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
45.2% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud