fmperf-project / fmperf

Cloud Native Benchmarking of Foundation Models
Apache License 2.0
21 stars 10 forks source link

Remove transformers dependency #11

Open tdoublep opened 5 months ago

tdoublep commented 5 months ago

We had to add a dependency on transformers in order to perform client-side tokenization when using fmperf with vLLM. Since vLLM recently added support for server-side truncation, this is no longer necessary. We should be able to adapt the load generator to use this new feature, removing that dependency completely.