-
**What would you like to be added/modified:**
1. Build a collaborative code intelligent agent alignment dataset for LLMs:
- The dataset should include behavioral trajectories, feedback, and i…
-
Hello,
Thank you for your effort on releasing such great implementation of GFN! I am working on the using GFN to finetune an LLM to be a policy model (which I believe would be a popular use cas…
-
- add tab completion for folders and subfolders (like a regular linux shell)
because without that adding files requires either changing directories all the time or diving into a copy&paste hell ;)
-…
-
In many near day ago, I’m assigned to a new research paper about Stable Diffusion and LLM, so I don’t have much time for updating new feature, but now the model is came to training process, so I come …
-
The llm module is support infer use `vllm` or use multi GPUs?
If not, when will these features be implemented ?
-
(Lowest of the low priorities)
SSMs have been making the rounds but people have only cared about them for 'major' tasks. (NMT models, speech, LLM). Since they're special LSTMs and we see better per…
-
First let me preface this by the forewarning that I barely understand what I'm doing, but I have been successfully running distributed edge LLMs locally for awhile now. Apologies in advance for any te…
-
### Is your feature request related to a problem? Please describe.
GroupChat uses a nested conversation between two agents. Currently it does not utilise the recent TransformMessages capability nor…
-
I'm wondering if I can get an easier pipeline by loading the awq weights with vllm:
```
from vllm import LLM, SamplingParams
prompts = [
"Hello, my name is",
"The president of the Uni…
-
**What would you like to be added/modified**:
This issue aims to build a cloud-edge collaborative inference framework for LLM on KubeEdge-Ianvs. Namely, it aims to help all cloud-edge LLM develop…