search

huggingface / text-generation-inference

Large Language Model Text Generation Inference
http://hf.co/docs/text-generation-inference
Apache License 2.0
8.34k stars 943 forks source link

multiple origins #1941

Open LukaszHem opened 1 month ago

LukaszHem commented 1 month ago

Feature request

Using CORS_ALLOW_ORIGIN I was able to set single origin to avoid CORS issues. CORS_ALLOW_ORIGIN=123.45.67.8:1234 How do I set it up for multiple origins?

Motivation

I want to use TGI to from multiple origins. I could set up proxy between TGI and my TGI clients, but that looks like a hacky solution. It gets even hackier when you need to use streaming (which I need to do).

Your contribution

Maybe we could pass list of origins separated by comma CORS_ALLOW_ORIGIN=origin1,origin2 CORS_ALLOW_ORIGIN=123.45.67.8:1234,123.45.67.8:1243

github-actions[bot] commented 1 week ago

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

LukaszHem commented 1 week ago

Up to avoid stale.