Lightning-AI / litdata

Transform datasets at scale. Optimize datasets for fast AI model training.
Apache License 2.0
250 stars 24 forks source link

Add support for encrypting / decrypting the chunks + API Keys #197

Open tchaton opened 6 days ago

tchaton commented 6 days ago

🚀 Feature

Motivation

Add support for encrypting & decrypting the chunks to enable users to consume the data outside anywhere safely.

The data would be decrypted in RAM.

Pitch

Alternatives

Additional context