facebookresearch / ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
https://parl.ai
MIT License
10.48k stars 2.09k forks source link

Wikipedia Retriever missing dictionary #1594

Closed JohannesTK closed 5 years ago

JohannesTK commented 5 years ago

Both Wikipedia Retriever (Used For Open Squad) and Wikipedia Retriever (Used For Wizard Of Wikipedia) seem to be missing their dictionaries.

python -m parlai.scripts.interactive --model tfidf_retriever -mf models:wikipedia_2016-12-21/tfidf_retriever/drqa_docs
[building data: /home/ubuntu/ParlAI/data/models/wikipedia_2016-12-21/tfidf_retriever/drqa_docs.tgz]
[ downloading: http://parl.ai/downloads/_models/wikipedia_2016-12-21/tfidf_retriever/drqa_docs.tgz to /home/ubuntu/ParlAI/data/models/wikipedia_2016-12-21/tfidf_retriever/drqa_docs.tgz ]
Downloading drqa_docs.tgz: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7.72G/7.72G [05:06<00:00, 25.2MB/s]
unpacking drqa_docs.tgz
[ warning: overriding opt['model_file'] to /home/ubuntu/ParlAI/data/models/wikipedia_2016-12-21/tfidf_retriever/drqa_docs (previously: wiki_full_notitle )]
Traceback (most recent call last):
  File "/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/ubuntu/ParlAI/parlai/scripts/interactive.py", line 76, in <module>
    interactive(parser.parse_args(print_args=False), print_parser=parser)
  File "/home/ubuntu/ParlAI/parlai/scripts/interactive.py", line 54, in interactive
    agent = create_agent(opt, requireModelExists=True)
  File "/home/ubuntu/ParlAI/parlai/core/agents.py", line 552, in create_agent
    model = load_agent_module(opt)
  File "/home/ubuntu/ParlAI/parlai/core/agents.py", line 403, in load_agent_module
    'is correct'.format(old_dict_file, new_opt['dict_file'])
RuntimeError: WARNING: Neither the specified dict file (test_ret.dict) nor the `model_file`.dict file (/home/ubuntu/ParlAI/data/models/wikipedia_2016-12-21/tfidf_retriever/drqa_docs.dict) exists, check to make sure either is correct
stephenroller commented 5 years ago

Blah, this is a runaway check; those models don't need dicts. You can comment out that RunTime error and continue without problem.

emilydinan commented 5 years ago

Fixed by #1613