-
Hello Weserv team!
First of all, thank you for your services. It's a lifesaver for companies with small budget on server resources.
We have a site (freetips247.com) and we use your service a lot.
…
-
Thanks for this work!
I also use the evaluation script from the https://github.com/FranxYao/chain-of-thought-hub/MMLU/run_mmlu_open_source.py
I got the same result with original repo【Falcon40b (…
-
Hello,
I don't reproduce the llama7b scores https://github.com/OpenNMT/OpenNMT-py/blob/master/eval_llm/MMLU/llama7b-onmt.txt
With this config:
```yaml
# transforms
transforms: [sentencepiece]
…
-
I'm opening this issue, with permission, to raise a concern about the proposed Code of Conduct update and articulate a discussion that so far has been mostly off the written record. I think the concer…
-
Summary of request: Add a new organization to ROR
Name of organization: Laboratoire d'études de genre et de sexualité
Website: https://legs.cnrs.fr
Link to publications: https://hal.parisnanterre…
-
目前又出现了如下错误，请看一下，谢谢！
原文：Everything about tulip sex seems orderly and intelligible; there is none of the occult mystery that attends the sexuality of, say, a Bourbon rose or a doubled peony. Those …
-
## What is your proposed change?
To create a new codelist for field `se_category` within the vulnerability component. This field appears in DDH_v0.2.xlsx.
[Link to spreadsheet](https://docs.google…
-
In your MMLU evaluation, the accuracy of Vicuna is only 24.9%, which is the same as a random guess. This is obviously wrong.
Did you directly use our delta weights (https://huggingface.co/lmsys/vicun…
-
python main.py \
> --model hf-causal-experimental \
> --model_args pretrained=../LLaMA-Efficient-Tuning/model/Baichuan-13B-Instruction \
> --tasks Ceval-valid-* \
> --device cuda:0…
-
# How would you like the feature to work?
I request the implementation of a feature that maintains the existing functionality of Linden homes while also introducing the option for Adult-rated regions…