search

openai / grok

MIT License
4.06k stars 506 forks source link

[Bug] Function definition missing in data.py #5

Open Aman56 opened 2 years ago

Aman56 commented 2 years ago

The make_data.py file in scripts invokes create_data_files(args.data_directory) where default directory as setup is data.

The function invokes 

ArithmeticTokenizer.create_token_file(data_dir)
ArithmeticDataset.create_dataset_files(data_dir)

both of which are not defined in the corresponding class. This breaks the code when running for multiple experiments.

briancheung commented 2 years ago

Have you been able to resolve this issue? I'm running into the same blocking point.

toontran commented 1 year ago

I'm having the same issue as well

Aman56 commented 1 year ago

Have you been able to resolve this issue? I'm running into the same blocking point.

@briancheung I worked around to it. Changed the default math operator on the params and wrote a function to create data files. Hopefully that helps.

@sontungtran Not sure if this helps you as well. But my objective was to generate multiple operator datasets. If you're looking to do the same. You can try it out.