eth-sri lmql issues - Githubissues

eth-sri / lmql

A language for constraint-guided and efficient LLM programming.

https://lmql.ai

Apache License 2.0

3.64k stars 197 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

OpenAIStreamError: logprobs, best_of and echo parameters are not available on gpt-35-turbo model.

#307 younes-io closed 8 months ago
0
does Azure really work ?

#305 younes-io closed 8 months ago
8
[Question] Support constraining via context free grammar for dsls

#304 DanielProkhorov opened 9 months ago
2
Fix broken links in docs

#303 jrinder42 closed 9 months ago
1
Broken Doc Links

#302 jrinder42 closed 8 months ago
3
Fixed bug where ContextTracer wasn't properly initializing a tracer

#301 andy-zhou closed 8 months ago
1
Support for Phi-2

#300 mlinegar closed 7 months ago
1
OpenAI Chat 'choices' ("where")

#299 jloganolson opened 9 months ago
0
Lmql playground crashes with: [WinError 2] The system cannot find the specified file

#298 ChristophRaab closed 8 months ago
5
LMQL fails to use llama-cpp-python to load models

#297 klutzydrummer opened 9 months ago
3
[support Qwen models] AssertionError: Cannot intersect further patterns if '*' has already been handled.

#296 justairr opened 9 months ago
3
Fix "Bathing Suite" typo

#294 endolith closed 8 months ago
1
Chat templates

#293 SamGalanakis opened 9 months ago
5
Add standalone example of running LMQL from within Python

#292 lbeurerkellner opened 9 months ago
0
How to load in-process model from my local folder?

#291 SuperMasterBlasterLaser closed 9 months ago
1
LMQL doesn't run when fed latin accented characters

#290 OPaivaHeitor opened 10 months ago
1
Different Test Levels

#289 lbeurerkellner closed 10 months ago
0
Zabirauf kwargs

#288 lbeurerkellner closed 10 months ago
0
Serve-model running out of memory with multiple GPUs

#287 motaatmo opened 10 months ago
4
Query Request Builder

#286 Christof23 opened 10 months ago
2
Parsing Error for Example Code

#285 hiiroo closed 9 months ago
2
added torch.compile

#284 andrecharneca closed 10 months ago
0
Torch 2.0 compile model

#283 andrecharneca opened 10 months ago
3
Using lmql with self-hosted models on gcloud

#282 PrachiMPatel opened 10 months ago
1
Integrating huggingface chat templates

#281 SamGalanakis closed 9 months ago
3
Added verbose in ops.follow to print

#280 zabirauf closed 10 months ago
1
Starting the playground with a self-hosted model

#277 KamilLegault opened 10 months ago
2
Support for GPT-4-turbo

#276 Borisvl opened 10 months ago
1
Unable to run program using Python and remote server url

#275 bhasamritasarmah closed 10 months ago
2
[Question] How to use Yi models with local llama-cpp-python when there is no standard tokenizer

#274 Rybens92 opened 10 months ago
7
How to solve the repetition and long ongoing generation?

#273 AL-377 opened 10 months ago
3
[Error during generate()] index out of range in self

#272 akhilrazdan opened 10 months ago
2
special tokens/templates best practices

#271 palatos opened 10 months ago
4
determining the speed of generation based on model's underlying quality

#270 mcapizzi-cohere closed 10 months ago
1
The issue of the postprocess_order for STOPS_AT operators.

#269 zhangyuhanjc closed 10 months ago
1
AssertionError: Length of deterministic continuation did not match length of provided logprobs. Provided logprobs: 1505, Provided IDs: []

#268 steve36871 opened 10 months ago
1
UTF8 non-breaking space leads to incorrect parsing

#267 arnaud-secondlayer opened 10 months ago
1
Vision Support

#266 ambroser53 opened 10 months ago
1
Add support for T5 family

#265 paucodeici opened 10 months ago
1
Feature Request: `past_key_values` landed in `transformers`, and could speed up generations

#263 freckletonj opened 11 months ago
2
Best way for structured output and few-shot optimization

#262 motaatmo opened 11 months ago
1
Feature request: Batched inference for llama.cpp models

#261 ggbetz opened 11 months ago
5
Broad exception handling while checking tiktoken tokenizer

#260 sergray closed 8 months ago
2
lmtp_client not starting

#259 motaatmo closed 10 months ago
4
Question about logit_bias/mask

#258 zhangyuhanjc closed 11 months ago
3
Role tags for local models

#257 giorgiopiatti opened 11 months ago
2
CPU and memory leak

#256 WhoIsDarth opened 11 months ago
3
Fixes doc urls

#255 bleugreen closed 11 months ago
1
AWQ loader for transformers

#254 bleugreen closed 11 months ago
2
Add feature to use deployments in replicate

#253 fjfricke closed 10 months ago
3

Previous Next