-
I followed the environment setup in the readme exactly. When performing Perplexity validation on PG19, the only difference from the original code is that I loaded the model from a local path and set t…
khfs updated
2 months ago
-
How to use the original model for inference?
I want to use original model instead of a quantized model. How can I do?
-
the script I use is https://github.com/intel-analytics/BigDL/blob/main/python/llm/example/GPU/HF-Transformers-AutoModels/Model/llama2/generate.py
with model Llama-2-70b-hf , the output sometimes is e…
-
- Use different datasets for calibration (dummy, Pile, gsm8k, triviaqa ans so on)
- Use llama2-7b with different int8 quantization types
- Use alpha in range (0, 1)
- Use lm-evaluation-harness to accu…
-
@siyuanseever 作者有加入其他未來改進功能的規劃嗎?
我的一些項目是基於此項目,一方面需要項目的功能,也出于我私心的喜歡此項目,作者加油👍。
我發現有Lora微調llama2的功能,你能教我如何使用嗎?
-
I am using the `meta-llama/Llama-2-70b-chat-hf` model on a data frame with 3000 rows, each including a 500-token text. But after 10 rows is processed, I get the following error
`[](https://localhos…
-
I want to use the demo to get some answers for a video. Unfortunately, the output I got using your demo seem not to be the answers for the input text-query as follows(the last line is the output)
!…
-
Has anyone gotten 16k context length with codellama or llama2? because i have tried multiple models but they all start producing gibberish when the context window gets past 4096. I am using exllama an…
-
Has anyone tried running the Llama2 (https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML)model? After I load the model, the APP immediately crashes after sending out the prompt.
-
I just want to put it on the record here that achieving anything close to what this model provides is prohibitively expensive and prone to technical issues, for any startup. We could really benefit fr…