Fixed multi-gpu issue and refactored and optimized NIM benchmark - Githubissues

aws-samples / awsome-inference

MIT No Attribution

31 stars 10 forks source link

Fixed multi-gpu issue and refactored and optimized NIM benchmark #1

Closed JoeyTPChou closed 4 months ago

JoeyTPChou commented 4 months ago

Fixed multi-gpu bug with a temporary workaround inside helm's `values.yaml.
Refactored and optimized the GenAI Perf benchmark