Open sorasoras opened 1 month ago
I through this is gonna be useful for serving larger scale of user so it should be useful for this project It should be quite useful for inference when scale up.
https://arxiv.org/abs/2403.09347
No response
I doubt this applies to inference as much as it does for training. Admittedly, I haven't given the paper a thorough read yet.
🚀 The feature, motivation and pitch
I through this is gonna be useful for serving larger scale of user so it should be useful for this project It should be quite useful for inference when scale up.
Alternatives
https://arxiv.org/abs/2403.09347
Additional context
No response