search

hplt-project / OpusTrainer

Curriculum training
https://pypi.org/project/opustrainer/
MIT License
15 stars 5 forks source link

Add URL Noise #43

Open XapaJIaMnu opened 10 months ago

XapaJIaMnu commented 10 months ago

When generating noise, we should have the option to generate URLs, because copying URLs is a desired behavior and the models seem to choke on very long deeplinks (not that they occur very often but still..)

gregtatum commented 2 months ago

Edit: Sorry, for the noise. I posted this in the wrong repo.