-
Hello,
I've tried running realtoxicityprompts (github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/realtoxicityprompts/) through the Hugging Face leaderboard backend code (https://h…
-
File "/home/jovyan/test_inference/llama3-main/inference_DDP_table_description.py", line 1, in
from transformers import AutoTokenizer, AutoModelForCausalLM, Accelerator
ImportError: cannot imp…
-
我想量化经过lora微调后的qwen2-72b模型,按照[官方教程](https://qwen.readthedocs.io/en/latest/quantization/gptq.html)指定的GPTQ量化方式进行量化
> from auto_gptq import AutoGPTQForCausalLM, BaseQuantizeConfig
> from transforme…
-
### Describe the bug
only needs a lot time
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
every model with whisper small medium ....
### S…
-
After reading your code, i see some wired data operations, which are very confusing.
1-When using LAION、CapsFusion for image-caption aligning, i didn't see any prompt like "Describe this image" in…
-
I'm not quite sure if this is a bug. I've observed that Gemma's template does not attach EOS even at the end of the assistant's response. This behavior is quite inconsistent with the templates of othe…
-
When I try to use 'text-editing' mode, as following:
`# 2. text editing
mode = 'text-editing'
input_data = {
"prompt": 'The text is centered on a purple background and is slightly curved upw…
-
### Checklist
- [X] I have searched the [existing issues](https://github.com/streamlit/streamlit/issues) for similar issues.
- [X] I added a very descriptive title to this issue.
- [x] I have pro…
-
**Background**
In the field of multilingual large models, especially for non-English corpora, there is often a problem of insufficient data quantity and poor quality. High-quality training data is cr…
-
https://www.microsoft.com/en-us/research/blog/graphrag-new-tool-for-complex-data-discovery-now-on-github/
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems
https://arxiv.org/…