search

tobegit3hub / simple_tensorflow_serving

Generic and easy-to-use serving service for machine learning models
https://stfs.readthedocs.io
Apache License 2.0
757 stars 195 forks source link

GPU docker with authentication #86

Open KonradAdamczyk opened 3 years ago

KonradAdamczyk commented 3 years ago

Hi,

How to run TFserving GPU image with http basic auth enabled?

https://github.com/tobegit3hub/simple_tensorflow_serving/blob/master/Dockerfile.latest-gpu uses simple_tensorflow_serving: CMD ["simple_tensorflow_serving", "--port=8500", "--model_config_file=./examples/model_config_file.json"]

which don't have any auth related settings: https://github.com/tobegit3hub/simple_tensorflow_serving/blob/master/simple_tensorflow_serving/command.py

tobegit3hub commented 3 years ago

The auth settings are in https://github.com/tobegit3hub/simple_tensorflow_serving/blob/master/simple_tensorflow_serving/server.py#L89 .

I'm not sure if it is available in WSGI and any contribution is welcome.