This will probably be made irrelevant by the YAML branch. However, there are two different styles for parser args. See train_model.py, and tokenize_data.py for example.
Examples:
train_model.py:
parser.add_argument("--dataset-subset", type=str, default="wikitext-2-v1",
help="Subset/config to use for Hugging Face dataset.")
tokenize_data.py for example:
parser.add_argument(
"--tokenized_data_name",
type=str,
required=True,
help="Name of tokenized data.")
This will probably be made irrelevant by the YAML branch. However, there are two different styles for parser args. See train_model.py, and tokenize_data.py for example. Examples: train_model.py: parser.add_argument("--dataset-subset", type=str, default="wikitext-2-v1", help="Subset/config to use for Hugging Face dataset.") tokenize_data.py for example: parser.add_argument( "--tokenized_data_name", type=str, required=True, help="Name of tokenized data.")