issues
search
aws-samples
/
foundation-model-benchmarking-tool
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
MIT No Attribution
151
stars
21
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
html report generation with quarto, llama3-8b on trn1
#90
aarora79
closed
1 month ago
0
Issue 85 - Remove S3 depencies
#89
RajeshRamchander
closed
1 month ago
0
bump up version for concurrency fix and instance count > 1 support
#88
aarora79
closed
1 month ago
0
Fix bug at high concurrency level, support for instance count > 1
#87
aarora79
closed
1 month ago
0
OpenOrca and byo dataset updates
#86
aarora79
closed
1 month ago
0
FMBench needs to be configurable so that no S3 access is needed
#85
RajeshRamchander
closed
4 weeks ago
1
bump up version number to v1.0.34
#84
aarora79
closed
1 month ago
0
bug fixes for business summary chart, dont delete endpoint for BYOE, …
#83
aarora79
closed
1 month ago
0
add kaleido==0.2.1
#82
aarora79
closed
1 month ago
0
update readme to mention about config files
#81
aarora79
closed
1 month ago
0
updated manifest.txt for latest set of config files
#80
aarora79
closed
1 month ago
0
report enhancements - config file in report, FMBench version
#79
aarora79
closed
1 month ago
0
Bump jinja2 from 3.1.3 to 3.1.4
#78
dependabot[bot]
opened
2 months ago
0
readme file updates
#77
aarora79
closed
2 months ago
0
new business summary chart
#76
aarora79
closed
2 months ago
0
config-file updates - llama2-7b and llama3-8b
#75
madhurprash
closed
2 months ago
0
llama3-8b-instruct inf2 config file
#74
madhurprash
closed
2 months ago
0
llama2-7b quick file with detailed comments
#73
madhurprash
closed
2 months ago
0
llama3 8b, 70b p4d config files
#72
madhurprash
closed
2 months ago
0
Bump tqdm from 4.66.1 to 4.66.3
#71
dependabot[bot]
opened
2 months ago
0
Bump sagemaker from 2.203.0 to 2.218.0 in /src/fmbench
#70
dependabot[bot]
opened
2 months ago
0
PR for lmi-dist + trt config files on p4, p5
#69
madhurprash
closed
2 months ago
0
To integrate the Open-Orca HF dataset to FMBench
#68
madhurprash
closed
4 weeks ago
1
config files for llama2 7b/13b on inf2
#67
madhurprash
closed
2 months ago
0
updating config files for llama3 with comments, updating inf2 pricing
#66
madhurprash
closed
2 months ago
0
config files for llama3, adding on demand pricing for llama3 bedrock models
#65
madhurprash
closed
2 months ago
0
FMBench to support REST predictors
#64
madhurprash
closed
2 months ago
0
FMBench to support an REST Predictor
#63
madhurprash
closed
2 months ago
0
removing the accept_eula parameter for mistral models
#62
madhurprash
closed
2 months ago
0
Support for Llama3 added to FMBench: Readme update
#61
madhurprash
closed
2 months ago
0
Support for Llama3 added to FMBench
#60
madhurprash
closed
2 months ago
0
config file updates
#59
aarora79
closed
2 months ago
0
Bump litellm from 1.34.0 to 1.34.42 in /src/fmbench
#58
dependabot[bot]
opened
2 months ago
0
Bedrock functionality, code cleanup, new config files
#57
aarora79
closed
2 months ago
0
Bump idna from 3.6 to 3.7
#56
dependabot[bot]
opened
2 months ago
0
Bump transformers from 4.36.2 to 4.38.0
#55
dependabot[bot]
opened
2 months ago
0
Bump transformers from 4.36.2 to 4.38.0 in /src
#54
dependabot[bot]
opened
2 months ago
0
Bump transformers from 4.36.2 to 4.38.0 in /src/fmbench
#53
dependabot[bot]
opened
2 months ago
0
Updated llama chat model inf parameters and 70b djl config file
#52
madhurprash
closed
2 months ago
0
Updated llama chat model inf parameters and 70b djl config file
#51
madhurprash
closed
2 months ago
0
Updating the 70b djl config file
#50
madhurprash
closed
2 months ago
0
testing p5, byo ep and price per token bug fix
#49
madhurprash
closed
2 months ago
0
To add support for bring your own sagemaker pre existing endpoint
#48
madhurprash
closed
2 months ago
0
To add support for bring your own sagemaker pre existing endpoint
#47
madhurprash
closed
2 months ago
0
To add support for bring your own sagemaker pre existing endpoint
#46
madhurprash
closed
2 months ago
0
To add support for bring your own 'SageMaker' pre existing endpoint
#45
madhurprash
closed
4 weeks ago
1
price per token added
#44
madhurprash
closed
2 months ago
0
changes to djl script, adding region to buckets and the p5 config file
#43
madhurprash
closed
3 months ago
0
read/write bucket with region specified
#42
madhurprash
closed
3 months ago
0
adding region to stack-role cft
#41
madhurprash
closed
3 months ago
0
Previous
Next