I was attempting to set up the application based on the Quick Start guide in the README. When trying to run the elk elicit microsoft/deberta-v2-xxlarge-mnli imdb command, the program terminates with a ValueError.
Can you please help me understand what's going wrong and how I can fix it?
Thanks!
Steps to reproduce
Environment
Macbook Air M1
OS X Ventura
Python version 3.11.2
Commands run
python -m venv .venv
source .venv/bin/activate
pip install -e ".[dev]"
python --version # outputs Python 3.11.2
# Note: I get a similar error when running other commands from the README
elk elicit microsoft/deberta-v2-xxlarge-mnli imdb
I also tried a couple of suggestions from @KayKozaronek, and got the same error:
Different model/dataset combo: elk elicit gpt2 boolq
Adding a --net arg: elk elicit microsoft/deberta-v2-xxlarge-mnli imdb --net ccs
Error output
ValueError: mutable default <class 'elk.training.train.Elicit'> for field run_template is not allowed: use default_factory
(Full stack trace at the bottom of this post)
Mitigation
GPT tells me we should fix this by replacing the following property from sweep.py with a default_factory, but without more context on the project I can't tell whether this is the right solution.
Summary
Hi there,
I was attempting to set up the application based on the Quick Start guide in the README. When trying to run the
elk elicit microsoft/deberta-v2-xxlarge-mnli imdb
command, the program terminates with a ValueError.Can you please help me understand what's going wrong and how I can fix it?
Thanks!
Steps to reproduce
Environment
Commands run
I also tried a couple of suggestions from @KayKozaronek, and got the same error:
elk elicit gpt2 boolq
--net
arg:elk elicit microsoft/deberta-v2-xxlarge-mnli imdb --net ccs
Error output
(Full stack trace at the bottom of this post)
Mitigation
GPT tells me we should fix this by replacing the following property from
sweep.py
with adefault_factory
, but without more context on the project I can't tell whether this is the right solution.Full stack trace