issues
search
aws-samples
/
foundation-model-benchmarking-tool
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
https://aws-samples.github.io/foundation-model-benchmarking-tool/
MIT No Attribution
182
stars
27
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add in g6e 2xl and 4xl files
#211
dheerajoruganty
opened
4 hours ago
0
Update pricing.yml
#210
aarora79
closed
5 hours ago
0
Add concurrency=3 for g6e instance configs
#209
dheerajoruganty
closed
1 day ago
0
Add config files for g6e instances
#208
dheerajoruganty
closed
1 day ago
0
Add support and pricing for g6e instances
#207
dheerajoruganty
closed
1 day ago
0
Add support for non aws models - openAI + gemini
#206
madhurprash
opened
3 days ago
0
Config file for llama3 8b on inf2 using triton with DJL
#205
madhurprash
closed
1 day ago
0
Integration triton inference server with djl
#204
madhurprash
closed
3 days ago
0
Add support for non AWS models to be benchmarked
#203
madhurprash
opened
6 days ago
0
FMBench integration: Triton Inference Server with DJL Python Backend with Transformers Neuronx
#202
madhurprash
closed
3 days ago
0
Contains a configuration file trn and doc fix for triton on AWS chips
#201
madhurprash
closed
1 week ago
0
bug fix + updated triton vllm config file
#200
madhurprash
closed
1 week ago
0
Update config-ec2-llama3-8b.yml
#199
antara678
closed
1 week ago
0
update llama2 7b quick file
#198
madhurprash
closed
3 weeks ago
0
Update llama2-7b quick file
#197
madhurprash
closed
3 weeks ago
0
Bug fix for evals
#196
madhurprash
closed
3 weeks ago
0
write multiple to s3 bug fix in evals
#195
madhurprash
closed
3 weeks ago
0
Triton integration
#194
madhurprash
closed
1 week ago
0
Add Support for Metrics While Benchmarking on Neuron and EC2
#193
dheerajoruganty
closed
3 weeks ago
0
triton-itegration
#192
madhurprash
closed
1 week ago
0
Multi model w djl
#191
aarora79
closed
3 weeks ago
0
Any pypi package for this tool?
#190
zhimin-z
closed
3 weeks ago
0
[WIP] Adding Metrics while Benchmarking on EC2
#189
dheerajoruganty
closed
3 weeks ago
0
Tagging
#188
antara678
closed
3 weeks ago
0
adding platform identification for deployment
#187
madhurprash
closed
3 weeks ago
0
remove unecessary --runtime=nvidia from the docker command
#186
madhurprash
closed
1 month ago
0
Fix EC2 container not running due to bad flag
#185
dheerajoruganty
closed
1 month ago
0
prompt template key fix
#184
madhurprash
closed
1 month ago
0
Support for Intel Instances and Configuration Updates
#183
dheerajoruganty
closed
1 month ago
0
clean up analytics, create documentation for it
#182
madhurprash
closed
1 month ago
0
add ec2 instructions to enable docker runs without sudo
#181
madhurprash
closed
1 month ago
0
Support for error handling for DJL + mistral config file on EC2
#180
madhurprash
closed
3 days ago
0
amd support
#179
aarora79
closed
1 month ago
0
Deployment Support for x86 AMD CPUs on EC2
#178
dheerajoruganty
closed
1 month ago
0
Added Inital Support for AMD x86 CPUs
#177
dheerajoruganty
closed
1 month ago
0
Adding support for custom tmp directory + preliminary config files for mistral on inf2/trn1
#176
madhurprash
closed
1 month ago
0
config file update for llama3-8b
#175
madhurprash
closed
1 month ago
0
Update README.md
#174
aarora79
closed
1 month ago
0
Adding youtube logo on embedded image link
#173
madhurprash
closed
1 month ago
0
Update CITATION.cff
#172
aarora79
closed
1 month ago
0
handling chart size for one model config
#171
madhurprash
closed
1 month ago
0
add hallucination metric to model evals on FMBench
#170
madhurprash
opened
1 month ago
0
Updating model eval links/config file
#169
madhurprash
closed
1 month ago
0
Adding model evaluations to FMBench
#168
madhurprash
closed
1 month ago
0
add trn config file + code update for trn deployment
#167
madhurprash
closed
1 month ago
0
Aws inf
#166
antara678
closed
1 month ago
0
Fix to correctly parse response in message API format for SageMaker inference
#165
fespigares
closed
3 weeks ago
1
support for llama3.1 on neuron + use_messages_api metadata addition
#164
madhurprash
closed
1 month ago
0
Add files via upload
#163
antara678
closed
1 month ago
0
Update neuron_deploy.py with logger statements
#162
antara678
closed
1 month ago
0
Next