OpenCSGs / csghub-server

csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.
https://opencsg.com/models
Apache License 2.0
556 stars 98 forks source link

return internal s3 signed url if client request has header X-OPENCSG-… #145

Closed Rader closed 1 month ago

Rader commented 1 month ago

a new ENV STARHUB_SERVER_S3_INTERNAL_ENDPOINT for service csghub_server which defines the internal ip address of s3 storage (like minio).

If request from client like csghub-sdk has http header X-OPENCSG-S3-Internal, csghub-server will return presigned url with internal s3 ip, to avoid download LFS object through public network.