-
https://blog.reachsumit.com/posts/2023/12/towards-ranking-aware-llms/
-
A small model for a certain language can improve download speeds, reduce the load on our phone, and should also improve translation speeds.When the user selects the language, the onnx model file is do…
-
### Proposal to improve performance
_No response_
### Report of performance regression
_No response_
### Misc discussion on performance
Question:
When deploying LoRA with vLLM, suppose I have …
-
Through Ollama, there is a wide selection of embedding models available, and the operation is very efficient. Supporting Ollama's embedding models will effectively enhance the convenience of use.
-
# 🐛 Bug
XFormers can not perform memory_efficient_attention,
## Command
## To Reproduce
The code is from attention_processors line 266 (it can change but not too much) of the diffusers libra…
-
Hi guys, pretty interesting project.
I was wondering if there is any way to save models after a zero-shot model is finetuned for few-shot model.
So for example, if I finetuned a couple of say, `…
-
### **Is your feature request related to a problem? Please describe.**
PyRIT currently lacks built-in support for easily using and comparing multiple LLM providers. This makes it challenging for user…
-
That does not require duplicating the order of the Taylor series.
-
Whenever we use external models for feature extraction that are based on torch, it's presumably much more efficient to serve them through [TorchServe](https://pytorch.org/serve/).
-
### Feature request
LoRAX currently only supports text generation models (e.g., causal language models). It lacks support for sequence classification models like `AutoModelForSequenceClassification`.…