-
Is there a way to use the webarena `ScriptBrowserEnv` in an async context? For some context on my use case, I'm not using the bundled `run.py`, but rather building up my own eval loop (following `mini…
-
When I try to evaluate the base model Meta-Llama3-8B-Instruct, it posted an assertion error.
The recipe yaml is shown below:
`
# Config for EleutherEvalRecipe in eleuther_eval.py
#
# To launch,…
-
### Discussed in https://github.com/microsoft/promptflow/discussions/3552
Originally posted by **labeebee** July 17, 2024
Hello,
I am trying to use Prompt Flow and my organization has enfor…
-
Hi,
Im studying CrewAI, i tried to create a crew to make docs about some code, when i try to use the new feature for train i got this error :
Traceback (most recent call last):
File "/home/well…
-
This issue is for the notification of papers which will be added to this repo in the future
-
-
Hi! I'm trying to evaluate several models on as many tasks as possible. On one dataset (`headqa_en`), I received a `NotADirectoryError` while trying to load the dataset.
Command:
```
lm_eval --…
-
- [ ] [Introducing PPLX Online LLMs](https://www.perplexity.ai/hub/blog/introducing-pplx-online-llms?utm_source=labs&utm_medium=labs&utm_campaign=online-llms)
# Introducing PPLX Online LLMs
**Blog**…
-
# URL
- https://arxiv.org/abs/2311.07911
# Affiliations
- Jeffrey Zhou, N/A
- Tianjian Lu, N/A
- Swaroop Mishra, N/A
- Siddhartha Brahma, N/A
- Sujoy Basu, N/A
- Yi Luan, N/A
- Denny Zho…
-
Hello, may I ask if you have encountered this situation, where the final reply on GPT-4 does not match the target, and the same prompt triggers a consistent issue every time? Is this due to my mistake…