eth-sri lmql issues - Githubissues

eth-sri / lmql

A language for constraint-guided and efficient LLM programming.

https://lmql.ai

Apache License 2.0

3.47k stars 191 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

is model.score_sync not deterministic ?

#357 4mbroise opened 6 days ago
0
The decoder returned a sequence that exceeds the provided max_len when using local:llama.cpp

#356 jzju opened 1 week ago
0
Starting out support for lmql with conda on wsl

#355 Gayanukaa opened 3 weeks ago
0
Support for GPT-4o

#354 mainpyp opened 1 month ago
0
Support for Ollama

#353 fjfricke opened 1 month ago
0
Difficulty getting started!

#352 mcchung52 opened 1 month ago
3
Make STOPS_AT work with Tokens

#351 sashokbg closed 2 months ago
1
Llama 3 GGUF Tokenizer

#350 sashokbg closed 2 months ago
5
python AttributeError: 'NoneType' object has no attribute 'get_event_loop', lmql == 0.7.3

#349 TioeAre opened 2 months ago
1
FileNotFoundError: [WinError 2] 系统找不到指定的文件。

#348 290971393 opened 2 months ago
0
[Question] Whats is the default decoder used in queries ?

#347 4mbroise closed 2 months ago
1
Azure OpenAI API instruct model not ERROR on query

#346 Onebu opened 2 months ago
1
`lmql serve-model llama.cpp:<PATH TO WEIGHTS>.gguf` only works with an absolute path

#344 filippobistaffa opened 3 months ago
0
lmql run not working for llama models even though same script works in playground and also for openai models

#343 iurimatias opened 3 months ago
1
Docs for cache behaviour

#342 benwhalley opened 3 months ago
1
Use external files and avoid quoting?

#341 benwhalley opened 3 months ago
0
Fix batched openai request worker race

#340 kentjhall closed 2 months ago
2
Batched OpenAI request worker async race (AssertionError: bopenai...)

#339 kentjhall opened 3 months ago
0
Add a normal llama.cpp server endpoint option.

#338 lastrosade opened 3 months ago
1
cannot import name 'OutputGraph' from 'torch._dynamo.output_graph'

#337 scruel closed 3 months ago
1
add support for torch_compile with HF models

#336 Saibo-creator closed 3 months ago
1
Use CUDA_VISIBLE_DEVICES in "lmql serve" layout calculation

#335 stevenbedrick closed 3 months ago
1
add a basic QueryBuilder, test and doc

#334 Saibo-creator closed 1 month ago
2
`--layout` ignores CUDA_VISIBLE_DEVICES

#333 stevenbedrick closed 3 months ago
0
fix ending quote parsing error in qstring

#332 Saibo-creator opened 4 months ago
0
Model Repeats Same Phrase

#331 sashokbg closed 4 months ago
1
Proposal for new KeyWord `using`

#330 gamendez98 opened 4 months ago
0
Possible error with nests of nested queries in Python

#329 mlinegar opened 4 months ago
2
[BUG] sub-queries fail with temperature=0

#328 gamendez98 opened 4 months ago
1
Client-side (decoding) memory leak with async @lmql.query

#327 stevenbedrick closed 4 months ago
3
Unable to use model loaded on gpu and cpu

#326 ebudmada closed 4 months ago
1
Quotes aren't always parsed properly

#324 nopepper opened 4 months ago
3
How can I get classification to work with OpenAI models?

#322 ZmeiGorynych closed 4 months ago
5
Add support for OpenAI tools/function-calling API

#321 bitnom opened 4 months ago
3
lmql.runtime.tokenizer.TokenizerNotAvailableError

#320 Kaimary closed 4 months ago
0
Fix playground on windows

#319 CodeWordKey closed 4 months ago
1
Fix MANIFEST.in for proper build

#318 CodeWordKey closed 4 months ago
1
Is there any way to replicate function calling like in openai assistants api?

#317 KurtKobalt closed 4 months ago
1
Is it possible to run LMQL with LMStudio locally ?

#316 zacaikido closed 4 months ago
2
Explicitly use python3

#314 tillfalko closed 3 months ago
3
Allow specifying model path for hf models

#313 Ranguna closed 4 months ago
1
Dolphin models doesn't run

#312 DanielProkhorov closed 4 months ago
2
Do any of the playground examples work ?

#311 younes-io closed 4 months ago
6
LMQL distribution: `NameError: name 'CLASSIFICATION' is not defined`

#310 younes-io closed 3 months ago
3
[Question] SSLCertVerificationError when Using lmql with llamaindex

#308 nx-chen02 opened 5 months ago
1
OpenAIStreamError: logprobs, best_of and echo parameters are not available on gpt-35-turbo model.

#307 younes-io closed 5 months ago
0
does Azure really work ?

#305 younes-io closed 5 months ago
8
[Question] Support constraining via context free grammar for dsls

#304 DanielProkhorov opened 6 months ago
2
Fix broken links in docs

#303 jrinder42 closed 5 months ago
1
Broken Doc Links

#302 jrinder42 closed 5 months ago
3