search

ChangeIsKey / LSCDBenchmark

7 stars 1 forks source link

WiC task with deepmistake model #32

Open kuan-yu-lin opened 1 year ago

kuan-yu-lin commented 1 year ago

Here is the command lines:

python main.py -m \
    evaluation=none \
    task=wic \
    task/wic@task.model=deepmistake \
    task/wic/dm_ckpt@task.model.ckpt=WIC+RSS+DWUG+XLWSD \
    dataset=dwug_de_210 \
    dataset/split=dev \
    dataset/spelling_normalization=german \
    dataset/preprocessing=raw

Here is the error:

Error in call to target 'src.wic.deepmistake.Cache':
  AttributeError("'Cache' object has no attribute 'metadata'")
  full_key: task.model.cache
arshandalili commented 2 months ago

Reproduce results from Spanish shared task paper and SentSpearman results from RuShiftEval.