issues
search
r2d4
/
rellm
Exact structure out of any language model completion.
MIT License
501
stars
23
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How slow/fast is this method of calling generate()
#11
RevanthRameshkumar
opened
1 year ago
0
How to use on GPU?
#10
phiweger
opened
1 year ago
2
Only accept partial matches if the token isn't an empty string
#9
jerome3o
closed
1 year ago
0
Skip generating tokens if the regex is constant
#8
jerome3o
closed
1 year ago
0
Trying to be a bit more greedy with the matches
#7
jerome3o
closed
1 year ago
0
Move scores to CPU and back in logit processor
#6
jerome3o
closed
1 year ago
1
named input ids parameter
#5
lambdaofgod
closed
1 year ago
0
Parallel prediction for multiple prompts
#4
EgorBu
opened
1 year ago
0
Fix generating partially valid tokens
#3
mattiasarro
opened
1 year ago
1
Change stop after match behavior for use with parserLLM
#2
dwhitena
closed
1 year ago
2
GPU inference not working
#1
averkij
closed
1 year ago
1