-
Hi,
Thank you for your valuable contribution and impressive project. I evaluated the ``llama-2-chat'' model on the TriviaQA task and obtained very low performance:
| Tasks |Version| Filter …
-
### systemRole
You are a professional AI code assistant. Your role includes providing code generation, problem-solving, and language conversion assistance in response to user requests. Don't apol…
-
If two or more multiple choice questions have the same stem (e.g. 'Which of the following is the largest number?') the script raises a 'Duplicate question' error and halts generation of the QTI files.…
-
I want to benchmark Unsloth on generation tasks based on different quantization methods. I have 1 million datasets with Question and answers. Can you please let me know how to do the predictions on ba…
-
when running the example:
nlp("42 is the answer to life, universe and everything.")
---------------------------------------------------------------------------
ValueError …
-
Hello,
I'm encountering an issue when trying to deploy a RAG (Retrieval-Augmented Generation) application using Hayhooks and the Haystack framework. I have two pipelines: `postgres_indexing` and `p…
-
Determine the best chunk size for our application.
The application should be able to keep track of individuals, so that RAG can make an appropriate prompt to feed to LLM, and the application can gi…
-
使用int量化模型:
`import os
import torch
from transformers import AutoTokenizer, GenerationConfig
from quant.modeling_telechat_gptq import TelechatGPTQForCausalLM
os.environ["CUDA_VISIBLE_DEVICES"]…
-
Hi,
First, congrats for this very nice and promising UI!
My first request would be being able to scroll back while answers are generated.
I often read again to prepare the next questions or m…
-
It was with great interest that I read your recent publication in Nature Methods titled "scGPT: toward building a foundation model for single-cell multi-omics using generative AI" . I found your work …