noamgat lm-format-enforcer issues

noamgat / lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

MIT License

994 stars 45 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add NVIDIA TRT-LLM integration

#68 aerdem4 closed 4 months ago
13
NEW vLLM Update leads to attribute error when integrating

#67 ivysdad closed 5 months ago
3
Is multiple choice constraints possible via StringParser?

#66 ivysdad closed 5 months ago
3
Deploying a vLLM server with LMFE support

#65 jloganolson closed 2 months ago
8
Will it support generating multiple JSON in the future?

#64 Vincentyua closed 5 months ago
1
Empty list cannot be closed after a newline

#63 AriX closed 5 months ago
2
Fix invalid JSON in `test_invalid_value_type_in_json_string`

#62 AriX closed 5 months ago
0
When writing with JSON Schema Parser, model can output empty object or invalid JSON.

#61 kmccleary3301 opened 5 months ago
4
Added optional banned tokens parameter to vllm processor.

#60 kmccleary3301 closed 4 months ago
1
Feature/json string pattern regex

#59 noamgat closed 5 months ago
0
Feature/union typed arrays

#58 noamgat closed 5 months ago
0
Making the json freetext cacher not crash if the tokenizer has empty tokens

#57 noamgat closed 5 months ago
0
What will happen when generating tokens that do not meet the requirements

#56 Vincentyua closed 4 months ago
3
Incorrect schemaless JSON mode

#55 idealover closed 5 months ago
2
Tokenizer must not contain empty tokens Error

#54 unoriginalscreenname closed 5 months ago
5
Bug in generating objects in union of types.

#53 LorrinWWW closed 5 months ago
7
Is there a way to enforce a LLM to generate a JSON without excessive whitespaces?

#52 LorrinWWW closed 2 months ago
9
Oobabooga Extension for lm-format-enforcer

#51 ResearchTLDR opened 6 months ago
2
Supporting of Tuple validation

#50 Chen0x00 closed 6 months ago
1
Supporting of streaming

#49 MarcusTXK closed 6 months ago
2
Example does not work

#48 unoriginalscreenname closed 5 months ago
7
Feature/decoding optimization

#47 noamgat closed 6 months ago
0
Added option to profile unit tests

#46 noamgat closed 6 months ago
0
Run TokenEnforcer flow in all unit tests

#45 noamgat closed 6 months ago
0
Any suggestions to speed up?

#44 pfZhu closed 4 months ago
11
Add support for string min/max length to json_freetext

#43 elonen closed 6 months ago
15
Limited length JSON schema string is 30x slower than plain str

#42 elonen closed 6 months ago
2
JsonSchemaParser allows invalid \' escapes and stops on them

#41 elonen closed 6 months ago
4
Is this tool related to LLM? Does it support ChatGLM?

#40 pia-ai closed 6 months ago
1
How does the function successfully deal with batch inputs

#39 pfZhu closed 6 months ago
0
Enforce attribute order

#38 tom-doerr closed 2 months ago
8
Returned wrong allowed tokens

#37 pfZhu closed 6 months ago
7
Performance issue

#36 tom-doerr opened 6 months ago
7
Halucinations? how to set null

#35 codenamics closed 7 months ago
6
Output ending prematurely

#34 jpeig closed 4 months ago
13
Is it better to use this work to achieve intent recognition than to invoke the large model directly? Because its format output is more stringent

#33 gzchenjiajun closed 7 months ago
1
Support regexes inside json schema using "pattern" field

#32 jpeig closed 5 months ago
11
Outputting invalid json & skipping schema attributes

#31 jpeig closed 2 months ago
6
Add utf-8 character support to JsonSchemaParser KEYS

#30 sanixa opened 7 months ago
5
More modular interface?

#29 simon-mo closed 7 months ago
1
Performance Optimizations?

#28 simon-mo closed 4 months ago
10
When using AsyncLLM engine, llm.get_tokenizer is not found

#27 jpeig closed 2 months ago
11
Can this be used for OpenAI models?

#26 jlia0 closed 7 months ago
1
RegEx for vLLM

#25 jpeig closed 7 months ago
1
Speed comparison with other frameworks

#24 hypocoristique closed 7 months ago
1
Limit string length

#23 xydisla closed 7 months ago
1
Ensure the vocabulary of SequenceParser won't return invalid characters.

#22 helpmefindaname closed 7 months ago
1
Compatibility with ExLlamaV2

#21 accountForIssues closed 7 months ago
7
relationship between underlying model quality and time to complete generation

#20 mcapizzi-cohere closed 7 months ago
1
Feature/haystack integration

#19 noamgat closed 7 months ago
0

Previous Next