Remove the 1s lock for inference - Githubissues

aws / sagemaker-tensorflow-serving-container

A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.

Apache License 2.0

174 stars 101 forks source link

Remove the 1s lock for inference #186

Closed schenqian closed 3 years ago

schenqian commented 3 years ago

Issue #, if available: Tensorflow Inference Container adding one second delay to all inference requests - Latency increases by 1 second

Description of changes: Remove 1s lock for inference

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot commented 3 years ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8ddbbdc1ec7e30dbece769bff2c7c34e484ae5b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 3 years ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8ddbbdc1ec7e30dbece769bff2c7c34e484ae5b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 3 years ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8ddbbdc1ec7e30dbece769bff2c7c34e484ae5b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 3 years ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8ddbbdc1ec7e30dbece769bff2c7c34e484ae5b7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository