Closed GoogleCodeExporter closed 9 years ago
I reproduced the error using one of John's datasets:
001vs002_Ascl-D_VS_Cdx2-D
3461 Images.
Class Value Images
Ascl+D 0 701
Ascl-D 0 624
Cdx2+D 0 1100
Cdx2-D 0 1036
He ran the command: `wndchrm test -i500 -j124 -f0.05 -n10 etc., etc., etc.,`
Here's what the cross-split test image statistics are according to the
ks_density script (min, max, etc here are undefined since there's no
interpolated values in his dataset)
***********REPORT********
Class Ascl+D: count= 436, min=-1.0000, max=-1.0000, mean=-1.0000, std
dev=0.0000,
Class Ascl-D: count= 552, min=-1.0000, max=-1.0000, mean=-1.0000, std
dev=0.0000,
Class Cdx2+D: count= 238, min=-1.0000, max=-1.0000, mean=-1.0000, std
dev=0.0000,
Class Cdx2-D: count= 253, min=-1.0000, max=-1.0000, mean=-1.0000, std
dev=0.0000,
So we observe that the degree to which the pool of images is randomly sampled
is inversely proportional to the amount of images in each class, which is
definitely a bug.
I made a slight change to the ks_density script so you could ask for the
cross-split statistics only and skip the ks_density graphs generation (use
--stats_only=1), so svn up before you proceed. I have enclosed John's html that
I used to reproduce the error. I used this command:
wnd-charm.googlecode.com/wnd-charm/utilities/ks_density_plot/create_probability_
density_points_from_html.pl --num_classes 4 --stats_only 1
001vs002_Ascl-D_VS_Cdx2-D.html
Original comment by christop...@nih.gov
on 15 Jul 2011 at 8:42
Attachments:
Clearly the 'negative control' is less bad.
But the bug is there too-
for 100 splits, 3 classes, 27 images per class it seems like you'd get all of
the images tested.
John's command:
wndchrm test -i500 -j124 -f0.05 -n10 etc. etc.
should be balanced(!)
Original comment by dmarkeck...@gmail.com
on 20 Jul 2011 at 3:51
Fixed in svn rev 248, will tag and release as wndchrm-1.31 shortly
Original comment by christop...@nih.gov
on 20 Jul 2011 at 4:09
Original issue reported on code.google.com by
christop...@nih.gov
on 15 Jul 2011 at 3:09Attachments: