search

EleutherAI / lm_perplexity

MIT License
144 stars 18 forks source link

/Users/raihankhan/PycharmProjects/lm_perplexity/lm_perplexity/run_lm_perplexity.py': [Errno 2] No such file or directory #1

Open raihankhan-rk opened 1 year ago

raihankhan-rk commented 1 year ago

I can't seem to find the 'run_lm_perplexity.py' file. Can someone help, please?

Also, could someone provide a good guide on how to run this model locally on PC?

StellaAthena commented 1 year ago

I think it should be compute_perplexity.py

StellaAthena commented 1 year ago

Also, could someone provide a good guide on how to run this model locally on PC?

This isn’t a language model. It’s a utility for doing analysis of language models. There’s a very good chance that this isn’t what you’re looking for.

joan126 commented 1 year ago

I want to compute bpb for language models, what is this argument -- utf8_conversion_scalar ？