epam / ai-dial-core

The main component of AI DIAL, which provides unified API to different chat completion and embedding models, assistants, and applications
https://epam-rail.com
Apache License 2.0
56 stars 16 forks source link

Add resource type to user metadata of a blob #465

Closed PMitrafanau closed 5 days ago

PMitrafanau commented 2 weeks ago

Problem statement

Currently, it's impossible to find all resources of a specific type in storage without using wildcard search. That can limit functionality on some back-end storages. For example, AWS S3 doesn't support a retention policy with a wildcard in the file prefix condition.

Some of the platform users want to know the ResourceType of a particular object stored in back-end storage. Storing that data with object metadata can help properly identify the ResourceType of the stored object.