search

fastai / course22

The fast.ai course notebooks
https://course.fast.ai
2.4k stars 937 forks source link

Lesson 1, Step 3 potentially uses photo from training set #28

Closed thiagohirai closed 1 year ago

thiagohirai commented 1 year ago

Given that we obtain bird.jpg from search_images('bird photos', max_size=1) and we obtain the training set from search_images('bird photo') it's possible that bird.jpg will be used in the training set (depending on whether duckduckgo returns it both times and on the 80% probability of this having been chosen for the training set).

It would be better to use a completely new picture to evaluate our model's performance.

jph00 commented 1 year ago

Yes it's possible - it's a good exercise to think about how best to check for that.