-
# Task Name
Interactive Data Analysis
## Task Objective
Interactive Data Analysis, a collaboration between humans and Large Language Model (LLM) agents, enables real-time data exploration for…
-
Dear Author,
Thanks for releasing the RITA for protein generation!
However, I wonder how can I obtain perplexity evalutation datasets used in your paper and how to calculate perplexity.
Hope for …
-
Can you please point me towards the standard datasets being used in 10.1, 10.2, 10.3 and 10.4.
-
could you please provide the muge, flickr 30 cn and coco cn you used for eval ?
thanks
-
VLMEVALKIT is a pretty convenient evaluation tool for MLLMs. I hope that the esteemed authors can create a framework for VLMEVALKIT that supports the evaluation of custom models and custom datasets. T…
-
Updated 2024-07-07.
Datasets:
- Used for evaluation:
- MMLU: https://huggingface.co/datasets/hails/mmlu_no_train
- ARC-Challenge: https://huggingface.co/datasets/allenai/ai2_arc
- HellaS…
-
## Expected behavior
EVAL_STANDALONE_END event is missing from the pseudo code definition in the Composer event doc. It looks like the pseudo code is referring to another name for the even, AFTER…
-
Paper : [https://arxiv.org/pdf/2406.16860](https://arxiv.org/pdf/2406.16860)
Website : [https://cambrian-mllm.github.io](https://cambrian-mllm.github.io)
Code : [https://github.com/cambrian-mllm/cam…
-
Hey!
Thanks for making the code available. I was wondering about the adjustment made for the anomaly detection. Is this done for all the competing methods? And is there some documentation for the dat…
-
model: Llama-2-7b-hf
step:
1、python3 converter.py --input "Llama-2-7b-hf/*.bin"--output /datasets/distserve/llama-7b --dtype float16 --model llama
2、python3 api_server/distserve_api_server.py --p…