issues
search
asahi417
/
lmppl
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
MIT License
123
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fixed tensor device mismatch when using flash_attn
#12
kaiyamclarke
opened
2 days ago
0
Updated README with some examples of models and their corresponding model type
#11
groovychoons
closed
4 months ago
1
Updated batch to batch_size to match documentation
#10
groovychoons
closed
4 months ago
0
Please Update Readme - Available Models
#9
galonpy
opened
10 months ago
0
Can the LLAMA model be used for this project, please
#8
KangkangStu
opened
11 months ago
1
ImportError while trying to use device_map = "auto" parameter.
#7
dogukantai
opened
1 year ago
0
Dataset too large
#6
NHendrickson9616
opened
1 year ago
30
A quite large perplexity issue
#5
gotutiyan
closed
1 year ago
2
Handling of long input
#4
UntotaufUrlaub
closed
1 year ago
3
ppl in openai model
#3
XuandongZhao
closed
1 year ago
1
RuntimeError: Sizes of tensors must match
#2
SaiedAlshahrani
closed
1 year ago
4
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:7 and cuda:0!
#1
rachithaiyappa
closed
1 year ago
13