-
How do I solve this problem? The error is as above, and the config is attached below
# Copyri…
-
I'm using lm-eval v0.4.2 to evaluate Llama 7b on the open llm leaderboard benchmark.
I found that there are accuracy gaps between single GPU and multiple GPUs as below. (I used data parallel)
| |…
-
```mermaid
sequenceDiagram
participant Eureka
participant GPT4 as LLMs GPT4
participant Gym as Isaac Gym
loop Interations: Get best reward
loop Samples: Generate rewa…
-
We need to start dividing up the work, authoring the various Threats / Controls. We'll use this issue to manage that work and their assignments.
Each threat / control is 'ticked' when assigned to …
-
Pose your questions as Issue Comments (below) for [James Evans](https://sociology.uchicago.edu/directory/James-A-Evans) regarding his 10/3 talk on *Simulating Subjects: The Promise and Peril of AI Sta…
-
-
### Title
Document Expansion by Query Prediction
### Team Name
The Indexers
### Email
keyurdhanani456@gmail.com
### Team Member 1 Name
Keyur Dhanani
### Team Member 1 Id
202…
-
### Author Pages
https://aclanthology.org/people/f/fei-liu/
https://aclanthology.org/people/f/fei-liu-utdallas/
### Type of Author Metadata Correction
- [X] The author page wrongly conflates diffe…
-
## Summary
[MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering](https://aclanthology.org/2021.tacl-1.82.pdf)
> _"MKQA contains 10,000 queries sampled from t…
-
[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…