Feature: Support multiple inference.py files and universal inference.… - Githubissues

aws / sagemaker-tensorflow-serving-container

A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.

Apache License 2.0

174 stars 101 forks source link

Feature: Support multiple inference.py files and universal inference.… #228

Closed sachanub closed 1 year ago

sachanub commented 1 year ago

Design doc: https://quip-amazon.com/biizAu4KYIuP/Multi-Model-Endpoint-Model-Specific-Inference-Files

Issue #, if available: https://t.corp.amazon.com/D30094580

Description of changes:

Added support for multiple inference.py files if Sagemaker multi model mode is enabled.
Modified python_service.py and serve.py to use universal inference.py as default and multiple inference.py files if available.
Universal requirements.txt file is used.
Changed directory structure of universal inference.py file.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 91107540b57aa4fc5cc0e89ed7e0ef716033e709
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: b19568b3392acba9296d894a3aaf09d2283be5e6
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 1a5d9e43f3e9d89f29dd5049eae43585a618f4bd
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: fa6d180e310b7c8c761f497b9c18d475d622c0b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d99b7208682e0b9d9007b5247b098cb7352ebbb0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 77378c65d4e144d9e86e3957b4a37733e2b18080
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 96678b6d3ecec3861fdf002459bbc7fe61dae933
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d2361b72d7af16195b5e5b2de850f3bc94359934
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8860ba2bddd657c28c27e66655be10b1fa4f9e81
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d50072a4309a751de2cb207564bf0e4e7be678e1
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 3ef74b0536d4636d763ff8e2f271de3ed78bc43a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 31a6f1f5cfa0707bd6efe7d5fed1be4af0ef7df9
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: dfe1beec08dc4072baabbd6dc9dda7379b5c4162
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 5ba8af2f3454e2ac84e3249ab5a545e3e5cb66bf
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d3f7ceae98cc3169023c5f7bf5b71f157d407e02
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: aba0963ee3ed8c9031b3d8bd5ba14bf2d0b6fe43
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 919de5c263ef328e57987e96a538a48150c4b00c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: f9a736f8642eaf920ecca227d43168924ecc503e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 5e4ffa98c148eebd7c9e85a2fae832de2745a1de
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d046d40cd0f76a7419800af7864f1c0b074359ef
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: bd336a8a6464b3c9dd33ec1ed0ae3d1e9406dbfc
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 7334fb8cae194b885ff97cca145ce9e865d68fa9
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 4647b73c0296311ec664ffab6d591b8625a75a89
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 008c2b008c1ad64d12ee2aea248bb9e24795256b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: f171de9cdb25ba9a16a669813dc8cee68783cd1b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: a456ba9b831b0f461813b038f2f68face4b0c125
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: a7e9024009469a89161b2b3cd9315cb0459aa234
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 54db583132cf1104dd1eb370aca2582834c0f1d6
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: d8c2d4bfbc971830577ddae1a75c302ffd6c4d7c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 430b36add5ba3a63d878c343b5e664f4a78db946
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 018766b07c07f27d6ea2ccef34df732d7a8068db
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 54bc23c685eea01e107e74b4c1b8039479e3266f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: b928f437226da4f0df4b2a65f18add5e24535c34
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: dddea8b35667a7e61cec04a87b9963205d1f3172
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 2bda00d70207ba5823c1029ca51eca94148e452b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 4047ca140167d11a263b130b42d4ac68b8a015a1
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 79e50b4b8ebf591dd5e7ef38ca578437c2ed22cd
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 24e2a1bd7e3c168950e6b0f47d8d541a7d2e418a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: a33ea2379c63bb95464b4a780be53f1f77dd6fe1
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 008f76d36732c234655bf47065542cc6782e078c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: eb5d17ce72a36d6364fab29b0c2cd56aa3b78371
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 4cfbb8e897a0c4654d96efe05baa85f97ae19f20
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 7b4e57230c9103542876dc05350502017b8e11f3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 32d6b9ab959f4be86d3f88da4537db1b2a6e743d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 8048712ade16a7ab61df67ddb45a0074fa31ed00
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: ab13c3faa948d44522bcf4486cb82440674cee88
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 4d9b478fb1291001f34fd90023a49e59b4bc6d5e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 275c8d9148a1501a4427f75ec9c951d2241aded7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 116fb225353d7783de1bc92497827e4f6f758066
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot commented 1 year ago

AWS CodeBuild CI Report

CodeBuild project: sagemaker-tensorflow-serving-container-pr
Commit ID: 5cde4a417d5a2ba7a682fdb92aa47c6b82308cfb
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Next