search

aws-neuron / aws-neuron-samples

Example code for AWS Neuron SDK developers building inference and training applications
Other
101 stars 32 forks source link

sample per sec #28

Closed Soroushmehr1 closed 10 months ago

Soroushmehr1 commented 10 months ago

What is the samples per second and sequence per second of the bert model ran on Trainium 32x?

hannanjgaws commented 10 months ago

You can view the performance of BERT on Trn1 on our performance page: https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/benchmarks/trn1/trn1-performance.html#trn1-performance.