issues
search
awslabs
/
fmbench-orchestrator
Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously
https://aws-samples.github.io/foundation-model-benchmarking-tool/
2
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Config example has non-existent configs referenced
#29
jimburtoft
opened
19 hours ago
0
70B model timeout on inf2
#28
jimburtoft
opened
2 days ago
1
Increase the startup time/make it configurable + look into HF_HUB_ENABLE_HF_TRANSFER for faster downloads
#27
madhurprash
opened
2 days ago
0
Update iam.md documentation
#26
jimburtoft
closed
1 day ago
0
Add support to run Orchestrator for Bedrock and Sagemaker Endpoints
#25
dheerajoruganty
closed
1 day ago
0
Add support for Intel and AMD with AL2023
#24
dheerajoruganty
closed
2 weeks ago
0
Add functionality to upload custom files to host
#23
dheerajoruganty
closed
2 weeks ago
0
Add functionality for dynamic region + ami id determination + config file updates
#22
madhurprash
closed
2 weeks ago
0
Add support to get FMBench Log file from remote machine
#21
dheerajoruganty
closed
2 weeks ago
0
Dynamically figure out the AMI + region where instances are deployed
#20
madhurprash
closed
2 weeks ago
0
config across NVIDIA GPU & AWS Chips + neuron script fix
#19
madhurprash
closed
3 weeks ago
0
Bring your own instance updates
#18
dheerajoruganty
closed
3 weeks ago
0
code addition to handle for pre existing instances
#17
madhurprash
closed
3 weeks ago
0
Neuron
#16
dheerajoruganty
closed
3 weeks ago
0
Add Neuron Support and Put folder into instance
#15
dheerajoruganty
closed
3 weeks ago
0
Add Support for BYO DATASET
#14
dheerajoruganty
closed
1 month ago
0
Fixes for iam_arn for instance profile
#13
dheerajoruganty
closed
1 month ago
0
code refactoring + working version
#12
madhurprash
closed
1 month ago
0
make fmbench tokenizer and config params optional
#11
dheerajoruganty
closed
1 month ago
0
Add support for Bring your own key for Instance ids
#10
dheerajoruganty
closed
1 month ago
0
Small Fixes for Terminating instances per region
#9
dheerajoruganty
closed
1 month ago
0
Add Support for Specifying `VPC_ID` Per Region for EC2 Instance Creation
#8
dheerajoruganty
opened
1 month ago
0
Add handling for when Instance_id is passed, but is Invalid
#7
dheerajoruganty
opened
1 month ago
0
Add Handling when Create EC2 call fails
#6
dheerajoruganty
opened
1 month ago
0
Add AMI map support
#5
dheerajoruganty
closed
1 week ago
1
Add Failed Run Handing
#4
dheerajoruganty
opened
1 month ago
0
Add multi region support
#3
dheerajoruganty
closed
1 month ago
2
Add support to create instances across multiple regions
#2
dheerajoruganty
closed
1 month ago
1
Initial Readme
#1
dheerajoruganty
closed
1 month ago
0