Update to `mark_as_unsupported`

understanding-search / maze-dataset

maze datasets for investigating OOD behavior of ML systems

16 stars 3 forks source link

Update to `mark_as_unsupported` #44

Closed aaron-sandoval closed 2 months ago

aaron-sandoval commented 2 months ago

Make mark_as_unsupported the only method by which the tokenizer construction space is artificially constrained. This allows all artificial constraints to be bypassed with manual construction (as opposed to use of all_instances).

review-notebook-app[bot] commented 2 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

mivanit commented 2 months ago

looks like the all tokenizer tests might be still on the old version here, merging to integration anyway