issues
search
aws
/
sagemaker-inference-toolkit
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
Apache License 2.0
370
stars
82
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Default output function encodes results to JSON and that seems to add to response latency.
#84
vdantu
opened
3 years ago
1
fix: Fixing issue #82
#83
amaharek
closed
3 years ago
3
JVM detect the CPU count as 1 when more CPUs are available for the container.
#82
amaharek
closed
3 years ago
2
fix: remove conflicting dependencies
#81
ajaykarpur
closed
3 years ago
1
fix: remove conflicting dependencies
#80
schenqian
closed
3 years ago
1
fix: remove conflicting dependencies
#79
schenqian
closed
3 years ago
2
Documentation for creating multi model end point for unsupported algorithms is not clear
#78
raj-vuram
closed
3 years ago
0
In a multi-model scenario pass model name as argument to input_fn() and output_fn()
#77
RajeshRamchander
opened
3 years ago
0
fix: add SIGCHILD Handler for MMS
#76
dhanainme
closed
3 years ago
6
fix: noop change
#75
ahakanbaba
closed
3 years ago
2
fix: write the mms config file to a subdir of base_dir instead of /etc
#74
ahakanbaba
opened
3 years ago
4
fix: add model-archiver and multi-model-server to required packages
#73
ajaykarpur
closed
3 years ago
4
SageMaker inference should be able to run as non-root user.
#72
akulk314
opened
3 years ago
3
change: upgrade MMS version and update command
#71
akulk314
closed
3 years ago
5
Be able to change SageMaker endpoint log level
#70
oonisim
opened
3 years ago
12
Warning: "Calling MMS with mxnet-model-server. Please move to multi-model-server."
#69
mb-dev
opened
3 years ago
2
How to overwrite batch transform output in S3
#68
BaoshengHeTR
opened
3 years ago
5
Update README.md
#67
yonghyeokrhee
closed
3 years ago
1
fix: add model-archiver and multi-model-server to listed dependencies
#66
ankurtri
closed
3 years ago
3
Allow model_fn to get more arguments
#65
ehsanmok
opened
3 years ago
2
Enhance UX for inference
#64
ehsanmok
opened
3 years ago
0
fix: clean up stack trace and sanitize only response phrase
#63
ajaykarpur
closed
3 years ago
1
fix: remove prohibited characters from error response
#62
ajaykarpur
closed
3 years ago
7
feature: Support multiple accept types
#61
bveeramani
closed
3 years ago
2
feature: Decode application/x-npz content type
#60
bveeramani
closed
3 years ago
2
logging in JSON format
#59
alext234
opened
3 years ago
2
Torchserve support for PyTorch Inference
#58
dhanainme
closed
3 years ago
1
infra: clarify feature request issue template
#57
ajaykarpur
closed
4 years ago
1
Request encoding function for application/jsonlines output format
#56
BaoshengHeTR
opened
4 years ago
5
Deploying multiple model artifacts, each having their own inference handler
#55
ghost
opened
4 years ago
5
documentation: fix package name in pip install command
#54
obrep
closed
4 years ago
2
End-to-End example for *NON* multi model deployment
#53
nvs-abhilash
opened
4 years ago
7
Ability to define custom log4j properties
#52
arvarik
opened
4 years ago
1
fix: include stacktrace when handling an error
#51
laurenyu
closed
4 years ago
0
fix: Remove typing
#49
ajaykarpur
closed
4 years ago
0
Cloudwatch does not log stack trace when error occurs during invocation.
#50
Olamyy
closed
3 years ago
3
infra: Do not parallelize unit tests in buildspecs
#48
ajaykarpur
closed
4 years ago
0
feature: Add Python 3.7 support
#47
ajaykarpur
closed
4 years ago
0
Update README example
#46
ajaykarpur
opened
4 years ago
0
providing gpu_id to the custom inference script's model_fn
#45
muhyun
closed
4 years ago
7
fix: add model_dir to python path at service initialization
#44
chuyang-deng
closed
4 years ago
0
fix: Remove duplicated call to validate_and_initialize when handling requests
#43
ajaykarpur
closed
4 years ago
0
feature: MME support
#42
ajaykarpur
closed
4 years ago
0
Local development WorkerLifeCycle skip
#41
danielmapar
opened
4 years ago
1
Controlling multiple copies of same model within Sagemaker multi-model-server
#40
Kuntal-G
closed
3 years ago
3
doc: convert README to Markdown and add emoji
#39
ajaykarpur
closed
4 years ago
0
doc: remove labels from issue templates
#38
knakad
closed
4 years ago
0
infra: fix buildspec-release.yml
#37
knakad
closed
4 years ago
0
doc: add missing docstrings and update README
#36
ajaykarpur
closed
4 years ago
0
Update setup.py
#35
nadiaya
closed
4 years ago
0
Previous
Next