Unable to reproduce it - Githubissues

IamExperimenting commented 5 months ago

hi team, can you provide correct instruction to reproduce this. I cloned and tried I'm not able to reproduce its throwning an error.

Number of errored trials: 6
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Trial name              # failures   error file                                                                                                                                                                                                              │
├──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ run_cli_1fc5f_00000              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00000_0_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_spider_r_yaml,model_model_nam_2024-01-31_21-24-32/error.txt │
│ run_cli_1fc5f_00001              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00001_1_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_bird_r_yaml,model_model_name__2024-01-31_21-24-32/error.txt │
│ run_cli_1fc5f_00002              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00002_2_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_all_r_yaml,model_model_name_o_2024-01-31_21-24-32/error.txt │
│ run_cli_1fc5f_00003              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00003_3_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_spider_r_yaml,model_model_nam_2024-01-31_21-24-32/error.txt │
│ run_cli_1fc5f_00004              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00004_4_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_bird_r_yaml,model_model_name__2024-01-31_21-24-32/error.txt │
│ run_cli_1fc5f_00005              1   /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00005_5_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_all_r_yaml,model_model_name_o_2024-01-31_21-24-32/error.txt │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

tshu-w commented 5 months ago

Sorry for the unclear.

Can you provide the content of /home/ray_results/run_cli_2024-01-31_21-24-32/run_cli_1fc5f_00000_0_ckpt_path=None,config=configs_schema_questioning_yaml,data_config=configs_data_spider_r_yaml,model_model_nam_2024-01-31_21-24-32/error.txt?

Also, you may want to train a schema questioning model on all datasets, you can just ./run fit --config configs/schema_questioning.yaml.

IamExperimenting commented 5 months ago

@tshu-w

please find the error below,

Failure # 1 (occurred at 2024-01-31_21-24-51)
[36mray::ImplicitFunc.train()[39m (pid=3844918, ip=192.168.1.170, actor_id=caf7201a45c87ba46946f63501000000, repr=run_cli)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/ray/tune/trainable/trainable.py", line 342, in train
    raise skipped from exception_cause(skipped)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/ray/air/_internal/util.py", line 91, in run
    self._ret = self._target(*self._args, **self._kwargs)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/ray/tune/trainable/function_trainable.py", line 115, in <lambda>
    training_func=lambda: self._trainable_func(self.config),
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/ray/tune/trainable/function_trainable.py", line 332, in _trainable_func
    output = fn()
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/ray/tune/trainable/util.py", line 321, in inner
    return trainable(config, **fn_kwargs)
  File "/home/DBCopilot/src/utils/sweep_cli.py", line 52, in run_cli
    lit_cli()
  File "/home/DBCopilot/src/utils/lit_cli.py", line 30, in lit_cli
    LitCLI(
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/lightning/pytorch/cli.py", line 383, in __init__
    self.instantiate_classes()
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/lightning/pytorch/cli.py", line 533, in instantiate_classes
    self.config_init = self.parser.instantiate_classes(self.config)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_deprecated.py", line 140, in patched_instantiate_classes
    cfg = self._unpatched_instantiate_classes(cfg, **kwargs)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_core.py", line 1182, in instantiate_classes
    cfg[subcommand] = subparser.instantiate_classes(cfg[subcommand], instantiate_groups=instantiate_groups)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_deprecated.py", line 140, in patched_instantiate_classes
    cfg = self._unpatched_instantiate_classes(cfg, **kwargs)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_core.py", line 1173, in instantiate_classes
    parent[key] = component.instantiate_classes(value)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_typehints.py", line 517, in instantiate_classes
    value[num] = adapt_typehints(val, self._typehint, instantiate_classes=True, sub_add_kwargs=sub_add_kwargs)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_typehints.py", line 873, in adapt_typehints
    val = adapt_class_type(val, serialize, instantiate_classes, sub_add_kwargs, prev_val=prev_val)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_typehints.py", line 1091, in adapt_class_type
    return instantiator_fn(val_class, **{**init_args, **dict_kwargs})
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/jsonargparse/_common.py", line 109, in default_class_instantiator
    return class_type(*args, **kwargs)
  File "/home/DBCopilot/src/models/schema_questioning.py", line 32, in __init__
    self.tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 718, in from_pretrained
    tokenizer_config = get_tokenizer_config(pretrained_model_name_or_path, **kwargs)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 550, in get_tokenizer_config
    resolved_config_file = cached_file(
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/transformers/utils/hub.py", line 430, in cached_file
    resolved_file = hf_hub_download(
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 110, in _inner_fn
    validate_repo_id(arg_value)
  File "/home/miniconda3/envs/DBCopilot/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 158, in validate_repo_id
    raise HFValidationError(
huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': './models/t5-base'. Use `repo_type` argument if needed.

tshu-w commented 4 months ago

It should be fixed by this commit https://github.com/tshu-w/DBCopilot/commit/ebf167053bb00e28b8493811671f13f54436a6b4

tshu-w commented 3 months ago

Since there is no reply, I will close this issue. If you have more questions, feel free to comment or open a new issue.

tshu-w / DBCopilot

Unable to reproduce it #2