-
Hello @patil-suraj,
I get the following assertion error:
Code:
```
gen = pipeline("question-generation", model='valhalla/t5-base-qg-hl', ans_model='valhalla/t5-base-qa-qg-hl')
qa = gen('Dire…
-
Because of C# compiler still does not allow to generate expressions from statement lambdas (CS0834), is it feasible to have some workaround in the Salterelle Compiler? For instance my first idea:
An …
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
## Question: Multi-Agent RAG System Based on Graphs
Hi,
Is it possible to create a…
-
Not sure if this is a question, bug report or API proposal, but I was pretty surprised when I tried to switch from Swagger to .NET 9 OpenApi generation, and saw that it generates these NullableOfXXX v…
-
I am attempting to generate new TagStandard41h* and TagStandard52h* families and I am seeing extremely long generation time estimates. I have attempted to generate some of the larger Standard families…
-
**Describe the issue**
This is actually not a issue but a simple question which is I have run bfcl generate on llama3.1 with python_ast test category and I got list of results from model. Next, If I …
-
I'm trying to implement various methods from the [patchscopes](https://arxiv.org/abs/2401.06102) paper, and some of them utilize token generation to eg. explain the meaning of a patched representation…
-
### Your current environment
```text
Your output of `python collect_env.py` here
```
### Model Input Dumps
_No response_
### 🐛 Describe the bug
When I load LLM as:
`llm = LLM(
…
-
### 🚀 The feature, motivation and pitch
temperature/top_k/top_p These values will affect the model output,The default value should be read from generation_config.json if the user does not set it.
…
-
### Checklist
- [ ] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.…