brando90 / MathNet-large-scale-Mathematics-Dataset-for-Machine-Learning

1 stars 0 forks source link

when generating question from the data set maker, what should we do about repeated Q,As? #57

Open brando90 opened 7 years ago

brando90 commented 7 years ago

duplicate data example, how do we deal with them? should we require users to code questions that can generate at least some number of examples? or just ave code that loops for repetitions and removes them? (this can be expensive....)