Closed maxdebayser closed 2 months ago
cc: @tdoublep
Actually the I'm no longer sure if this PR makes sense because there is a dependency on the approx
module that is used in both cases. Or maybe we could copy this module to this repo.
Actually the I'm no longer sure if this PR makes sense because there is a dependency on the
approx
module that is used in both cases. Or maybe we could copy this module to this repo.
Ah right. Maybe we could just copy it yeah
Ah right. Maybe we could just copy it yeah
Done
With this change we can run with the vLLM backend without having to install this dependency.