search

SupstarZh / WhitenedCSE

[ACL2023] WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
18 stars 0 forks source link

When training, I encountered issues with the parameters. #3

Open TC9905 opened 9 months ago

TC9905 commented 9 months ago

Traceback (most recent call last): File "train.py", line 586, in main() File "train.py", line 258, in main model_args, data_args, training_args = parser.parse_args_into_dataclasses() File "/opt/conda/envs/cse/lib/python3.8/site-packages/transformers/hf_argparser.py", line 166, in parse_args_into_dataclasses raise ValueError(f"Some specified arguments are not used by the HfArgumentParser: {remaining_args}") ValueError: Some specified arguments are not used by the HfArgumentParser: ['--num_pos', '3', '--dup_type', 'bpe']

"When I removed ['--num_pos', '3', '--dup_type', 'bpe'], I encountered the following error."

Traceback (most recent call last): File "train.py", line 586, in main() File "train.py", line 362, in main model = BertForCL.from_pretrained( File "/opt/conda/envs/cse/lib/python3.8/site-packages/transformers/modeling_utils.py", line 1034, in from_pretrained model = cls(config, *model_args, **model_kwargs) File "/home/mambauser/cse/WhitenedCSE-master/whitenedcse/models.py", line 342, in init cl_init(self, config) File "/home/mambauser/cse/WhitenedCSE-master/whitenedcse/models.py", line 124, in cl_init cls.mlp = MLPLayer(config) File "/home/mambauser/cse/WhitenedCSE-master/whitenedcse/models.py", line 52, in init self.dbn = ShuffledGroupWhitening(config.hidden_size, config.num_pos, num_groups=128) AttributeError: 'BertConfig' object has no attribute 'num_pos'