ChangeIsKey / LSCDBenchmark

7 stars 1 forks source link

bash: task/lscd_graded@task.model=apd_compare_all: No such file or directory #24

Open kuan-yu-lin opened 1 year ago

kuan-yu-lin commented 1 year ago

Create an example with the model bert-base-cased.

The parameter of task.model.wic.ckpt changes to bert-base-cased. The parameter of dataset is changed to dwug_de_210, because there is no dataset as dwug_de. And, dataset/split=dev is also need to be specified.

After running

python main.py \
  dataset=dwug_de_210 \
  dataset/split=dev \
  task=lscd_graded \
  task/lscd_graded@task.model=apd_compare_all \
  task/wic@task.model.wic=contextual_embedder \
  task/wic/metric@task.model.wic.similarity_metric=cosine \
  task.model.wic.ckpt=bert-base-cased \
  task.model.wic.gpu=0 \
  evaluation=change_graded

I got error as

You must specify 'evaluation', e.g, evaluation=<OPTION>
Available options:
    binary_wic
    change_binary
    change_graded
    compare
    none
    wic
    wsi

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
-bash: task/lscd_graded@task.model=apd_compare_all: No such file or directory