New detailed CIFAR 100 examples

[DariusNafar]

I have complied with the request of adding all relevant probabilities and the category names while maintaining the original format. As an example, I have provided an explanation and the rest of the data is attached as a comment.

interesting example:

tag messed up: cathegory(parent) label, softmax, ILP : 12 12 12 cathegory(parent) label, softmax, ILP : mediummammals mediummammals mediummammals cathegory(parent) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 tag(child) label, softmax, ILP : 75 75 63 tag(child) label, softmax, ILP : skunk skunk porcupine tag(child) label, softmax, ILP : 0.5542430281639099 0.5542430281639099 0.014209582470357418 probability of parents of tag(child) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 names of the children of softmax parent: ['porcupine', 'skunk', 'fox', 'raccoon', 'possum'] Probabilities of the children of softmax parent: [0.014209582470357418, 0.5542430281639099, 0.05777030065655708, 0.001160784624516964, 0.0001624400174478069] names of the children of ILP parent: ['porcupine', 'skunk', 'fox', 'raccoon', 'possum'] Probabilities of the children of ILP parent: [0.014209582470357418, 0.5542430281639099, 0.05777030065655708, 0.001160784624516964, 0.0001624400174478069]

@hfaghihi15 @auszok in this example the model chooses the same parent but it chooses the child randomly. the graph is orl bottom up with this constraint:

if ( parent then orL (its children) )

we can start by fixing examples that are like this. this would explain why nandl works so much better. @kordjamshidi

[DariusNafar]

graph exactL_ifLorLtopdown:

tag messed up: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.9629725813865662 0.9629725813865662 0.9629725813865662 tag(child) label, softmax, ILP : 33 33 60 tag(child) label, softmax, ILP : forest forest plain tag(child) label, softmax, ILP : 0.9125771522521973 0.9125771522521973 4.22776720370166e-05 probability of parents of tag(child) label, softmax, ILP : 0.9629725813865662 0.9629725813865662 0.9629725813865662 names of the children of softmax parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of softmax parent: [4.22776720370166e-05, 0.9125771522521973, 3.93447517126333e-05, 0.0002684923238120973, 2.9333134079934098e-05] names of the children of ILP parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of ILP parent: [4.22776720370166e-05, 0.9125771522521973, 3.93447517126333e-05, 0.0002684923238120973, 2.9333134079934098e-05] tag improved: cathegory(parent) label, softmax, ILP : 0 0 0 cathegory(parent) label, softmax, ILP : aquaticmammals aquaticmammals aquaticmammals cathegory(parent) label, softmax, ILP : 0.7226158976554871 0.7226158976554871 0.7226158976554871 tag(child) label, softmax, ILP : 72 95 72 tag(child) label, softmax, ILP : seal whale seal tag(child) label, softmax, ILP : 0.021440057083964348 0.35139116644859314 0.021440057083964348 probability of parents of tag(child) label, softmax, ILP : 0.7226158976554871 0.7226158976554871 0.7226158976554871 names of the children of softmax parent: ['seal', 'whale', 'dolphin', 'beaver', 'otter'] Probabilities of the children of softmax parent: [0.021440057083964348, 0.35139116644859314, 0.018354278057813644, 0.009748593904078007, 0.04923539608716965] names of the children of ILP parent: ['seal', 'whale', 'dolphin', 'beaver', 'otter'] Probabilities of the children of ILP parent: [0.021440057083964348, 0.35139116644859314, 0.018354278057813644, 0.009748593904078007, 0.04923539608716965] tag messed up: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 1.0 1.0 1.0 tag(child) label, softmax, ILP : 71 71 60 tag(child) label, softmax, ILP : sea sea plain tag(child) label, softmax, ILP : 0.9987834095954895 0.9987834095954895 0.00035043692332692444 probability of parents of tag(child) label, softmax, ILP : 1.0 1.0 1.0 names of the children of softmax parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of softmax parent: [0.00035043692332692444, 1.2748088238367927e-06, 3.382299382792553e-06, 0.0008615392725914717, 0.9987834095954895] names of the children of ILP parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of ILP parent: [0.00035043692332692444, 1.2748088238367927e-06, 3.382299382792553e-06, 0.0008615392725914717, 0.9987834095954895] tag messed up: cathegory(parent) label, softmax, ILP : 7 7 7 cathegory(parent) label, softmax, ILP : insects insects insects cathegory(parent) label, softmax, ILP : 0.6927009224891663 0.6927009224891663 0.6927009224891663 tag(child) label, softmax, ILP : 14 14 7 tag(child) label, softmax, ILP : butterfly butterfly beetle tag(child) label, softmax, ILP : 0.9744971394538879 0.9744971394538879 0.013684491626918316 probability of parents of tag(child) label, softmax, ILP : 0.6927009224891663 0.6927009224891663 0.6927009224891663 names of the children of softmax parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of softmax parent: [0.013684491626918316, 5.243777923169546e-05, 8.520079973095562e-06, 0.00017540510452818125, 0.9744971394538879] names of the children of ILP parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of ILP parent: [0.013684491626918316, 5.243777923169546e-05, 8.520079973095562e-06, 0.00017540510452818125, 0.9744971394538879] tag messed up: cathegory(parent) label, softmax, ILP : 12 12 12 cathegory(parent) label, softmax, ILP : mediummammals mediummammals mediummammals cathegory(parent) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 tag(child) label, softmax, ILP : 75 75 63 tag(child) label, softmax, ILP : skunk skunk porcupine tag(child) label, softmax, ILP : 0.5542430281639099 0.5542430281639099 0.014209582470357418 probability of parents of tag(child) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 names of the children of softmax parent: ['porcupine', 'skunk', 'fox', 'raccoon', 'possum'] Probabilities of the children of softmax parent: [0.014209582470357418, 0.5542430281639099, 0.05777030065655708, 0.001160784624516964, 0.0001624400174478069] names of the children of ILP parent: ['porcupine', 'skunk', 'fox', 'raccoon', 'possum'] Probabilities of the children of ILP parent: [0.014209582470357418, 0.5542430281639099, 0.05777030065655708, 0.001160784624516964, 0.0001624400174478069] tag messed up: cathegory(parent) label, softmax, ILP : 19 19 19 cathegory(parent) label, softmax, ILP : vehicles2 vehicles2 vehicles2 cathegory(parent) label, softmax, ILP : 1.0 1.0 1.0 tag(child) label, softmax, ILP : 69 69 81 tag(child) label, softmax, ILP : rocket rocket streetcar tag(child) label, softmax, ILP : 0.9999992847442627 0.9999992847442627 2.9530961009882617e-12 probability of parents of tag(child) label, softmax, ILP : 1.0 1.0 1.0 names of the children of softmax parent: ['streetcar', 'tank', 'lawnmower', 'rocket', 'tractor'] Probabilities of the children of softmax parent: [2.9530961009882617e-12, 3.5474738524499116e-07, 2.0895942753895724e-08, 0.9999992847442627, 1.7699687049343993e-08] names of the children of ILP parent: ['streetcar', 'tank', 'lawnmower', 'rocket', 'tractor'] Probabilities of the children of ILP parent: [2.9530961009882617e-12, 3.5474738524499116e-07, 2.0895942753895724e-08, 0.9999992847442627, 1.7699687049343993e-08] tag improved: cathegory(parent) label, softmax, ILP : 9 9 9 cathegory(parent) label, softmax, ILP : largeman-madeoutdoorthings largeman-madeoutdoorthings largeman-madeoutdoorthings cathegory(parent) label, softmax, ILP : 0.6624887585639954 0.6624887585639954 0.6624887585639954 tag(child) label, softmax, ILP : 17 76 17 tag(child) label, softmax, ILP : castle skyscraper castle tag(child) label, softmax, ILP : 0.040057472884655 0.8297038674354553 0.040057472884655 probability of parents of tag(child) label, softmax, ILP : 0.6624887585639954 0.6624887585639954 0.6624887585639954 names of the children of softmax parent: ['castle', 'skyscraper', 'house', 'bridge', 'road'] Probabilities of the children of softmax parent: [0.040057472884655, 0.8297038674354553, 0.0026409870479255915, 0.0007693120860494673, 0.0009289215668104589] names of the children of ILP parent: ['castle', 'skyscraper', 'house', 'bridge', 'road'] Probabilities of the children of ILP parent: [0.040057472884655, 0.8297038674354553, 0.0026409870479255915, 0.0007693120860494673, 0.0009289215668104589] tag improved: cathegory(parent) label, softmax, ILP : 14 14 14 cathegory(parent) label, softmax, ILP : people people people cathegory(parent) label, softmax, ILP : 1.0 1.0 1.0 tag(child) label, softmax, ILP : 2 35 2 tag(child) label, softmax, ILP : baby girl baby tag(child) label, softmax, ILP : 0.0001404488575644791 0.8462315797805786 0.0001404488575644791 probability of parents of tag(child) label, softmax, ILP : 1.0 1.0 1.0 names of the children of softmax parent: ['baby', 'woman', 'man', 'boy', 'girl'] Probabilities of the children of softmax parent: [0.0001404488575644791, 0.022620750591158867, 0.0021440100390464067, 0.1288602203130722, 0.8462315797805786] names of the children of ILP parent: ['baby', 'woman', 'man', 'boy', 'girl'] Probabilities of the children of ILP parent: [0.0001404488575644791, 0.022620750591158867, 0.0021440100390464067, 0.1288602203130722, 0.8462315797805786] cathegory improved cathegory(parent) label, softmax, ILP : 11 19 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores vehicles2 largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.15478438138961792 0.4795268774032593 0.15478438138961792 tag(child) label, softmax, ILP : 19 19 19 tag(child) label, softmax, ILP : cattle cattle cattle tag(child) label, softmax, ILP : 0.5523293018341064 0.5523293018341064 0.5523293018341064 probability of parents of tag(child) label, softmax, ILP : 0.15478438138961792 0.15478438138961792 0.15478438138961792 names of the children of softmax parent: ['streetcar', 'tank', 'lawnmower', 'rocket', 'tractor'] Probabilities of the children of softmax parent: [7.666921010240912e-05, 0.010406417772173882, 0.1391446888446808, 0.0002200309099862352, 0.2177872210741043] names of the children of ILP parent: ['cattle', 'camel', 'kangaroo', 'chimpanzee', 'elephant'] Probabilities of the children of ILP parent: [0.5523293018341064, 0.0014273968990892172, 0.0015387912280857563, 8.146747859427705e-06, 0.00016900902846828103] cathegory improved cathegory(parent) label, softmax, ILP : 2 1 2 cathegory(parent) label, softmax, ILP : flowers fish flowers cathegory(parent) label, softmax, ILP : 0.25430577993392944 0.7447871565818787 0.25430577993392944 tag(child) label, softmax, ILP : 70 70 70 tag(child) label, softmax, ILP : rose rose rose tag(child) label, softmax, ILP : 0.49533140659332275 0.49533140659332275 0.49533140659332275 probability of parents of tag(child) label, softmax, ILP : 0.25430577993392944 0.25430577993392944 0.25430577993392944 names of the children of softmax parent: ['trout', 'aquariumfish', 'flatfish', 'ray', 'shark'] Probabilities of the children of softmax parent: [0.00032294285483658314, 0.07237144559621811, 0.07496422529220581, 0.00010424971696920693, 2.229586425528396e-05] names of the children of ILP parent: ['rose', 'orchid', 'poppy', 'tulip', 'sunflower'] Probabilities of the children of ILP parent: [0.49533140659332275, 6.036471404513577e-06, 0.3531321883201599, 0.002341733081266284, 7.133186591090634e-05] tag improved: cathegory(parent) label, softmax, ILP : 7 7 7 cathegory(parent) label, softmax, ILP : insects insects insects cathegory(parent) label, softmax, ILP : 0.9995417594909668 0.9995417594909668 0.9995417594909668 tag(child) label, softmax, ILP : 7 14 7 tag(child) label, softmax, ILP : beetle butterfly beetle tag(child) label, softmax, ILP : 0.1250886470079422 0.8232617974281311 0.1250886470079422 probability of parents of tag(child) label, softmax, ILP : 0.9995417594909668 0.9995417594909668 0.9995417594909668 names of the children of softmax parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of softmax parent: [0.1250886470079422, 0.037715960294008255, 0.004357694648206234, 0.007510817144066095, 0.8232617974281311] names of the children of ILP parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of ILP parent: [0.1250886470079422, 0.037715960294008255, 0.004357694648206234, 0.007510817144066095, 0.8232617974281311] tag improved: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.9980853796005249 0.9980853796005249 0.9980853796005249 tag(child) label, softmax, ILP : 60 71 60 tag(child) label, softmax, ILP : plain sea plain tag(child) label, softmax, ILP : 0.4764888882637024 0.5029975771903992 0.4764888882637024 probability of parents of tag(child) label, softmax, ILP : 0.9980853796005249 0.9980853796005249 0.9980853796005249 names of the children of softmax parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of softmax parent: [0.4764888882637024, 0.0009803432039916515, 0.006410118192434311, 0.0006404358427971601, 0.5029975771903992] names of the children of ILP parent: ['plain', 'forest', 'mountain', 'cloud', 'sea'] Probabilities of the children of ILP parent: [0.4764888882637024, 0.0009803432039916515, 0.006410118192434311, 0.0006404358427971601, 0.5029975771903992] cathegory messed up: cathegory(parent) label, softmax, ILP : 16 16 7 cathegory(parent) label, softmax, ILP : smallmammals smallmammals insects cathegory(parent) label, softmax, ILP : 0.5771759152412415 0.5771759152412415 0.39261677861213684 tag(child) label, softmax, ILP : 80 7 7 tag(child) label, softmax, ILP : squirrel beetle beetle tag(child) label, softmax, ILP : 0.03393062949180603 0.7525262236595154 0.7525262236595154 probability of parents of tag(child) label, softmax, ILP : 0.5771759152412415 0.39261677861213684 0.39261677861213684 names of the children of softmax parent: ['shrew', 'rabbit', 'hamster', 'mouse', 'squirrel'] Probabilities of the children of softmax parent: [0.040865764021873474, 0.03669155389070511, 0.00024109880905598402, 0.010967067442834377, 0.03393062949180603] names of the children of ILP parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of ILP parent: [0.7525262236595154, 0.0011975184315815568, 0.004540649242699146, 0.001634058658964932, 0.0024912685621529818] cathegory improved cathegory(parent) label, softmax, ILP : 11 12 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores mediummammals largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.45123594999313354 0.5151904821395874 0.45123594999313354 tag(child) label, softmax, ILP : 19 66 19 tag(child) label, softmax, ILP : cattle raccoon cattle tag(child) label, softmax, ILP : 0.10467976331710815 0.8292345404624939 0.10467976331710815 probability of parents of tag(child) label, softmax, ILP : 0.45123594999313354 0.5151904821395874 0.45123594999313354 names of the children of softmax parent: ['porcupine', 'skunk', 'fox', 'raccoon', 'possum'] Probabilities of the children of softmax parent: [0.0001020846757455729, 0.0008714835857972503, 0.0038939504884183407, 0.8292345404624939, 0.0013857362791895866] names of the children of ILP parent: ['cattle', 'camel', 'kangaroo', 'chimpanzee', 'elephant'] Probabilities of the children of ILP parent: [0.10467976331710815, 0.0008947288733907044, 0.03394146263599396, 5.1672217523446307e-05, 0.004516133572906256] cathegory improved cathegory(parent) label, softmax, ILP : 15 16 15 cathegory(parent) label, softmax, ILP : reptiles smallmammals reptiles cathegory(parent) label, softmax, ILP : 0.0710371658205986 0.5096592307090759 0.0710371658205986 tag(child) label, softmax, ILP : 27 27 27 tag(child) label, softmax, ILP : crocodile crocodile crocodile tag(child) label, softmax, ILP : 0.7391526699066162 0.7391526699066162 0.7391526699066162 probability of parents of tag(child) label, softmax, ILP : 0.0710371658205986 0.0710371658205986 0.0710371658205986 names of the children of softmax parent: ['shrew', 'rabbit', 'hamster', 'mouse', 'squirrel'] Probabilities of the children of softmax parent: [0.10695279389619827, 0.0031139198690652847, 3.1832754757488146e-05, 0.008865230716764927, 0.014082644134759903] names of the children of ILP parent: ['crocodile', 'lizard', 'turtle', 'dinosaur', 'snake'] Probabilities of the children of ILP parent: [0.7391526699066162, 0.00021881223074160516, 9.598013275535777e-05, 0.00015556500875391066, 1.3863043022865895e-05] cathegory improved cathegory(parent) label, softmax, ILP : 8 11 8 cathegory(parent) label, softmax, ILP : largecarnivores largeomnivoresandherbivores largecarnivores cathegory(parent) label, softmax, ILP : 0.35623377561569214 0.3749867379665375 0.35623377561569214 tag(child) label, softmax, ILP : 42 42 42 tag(child) label, softmax, ILP : leopard leopard leopard tag(child) label, softmax, ILP : 0.6413083076477051 0.6413083076477051 0.6413083076477051 probability of parents of tag(child) label, softmax, ILP : 0.35623377561569214 0.35623377561569214 0.35623377561569214 names of the children of softmax parent: ['cattle', 'camel', 'kangaroo', 'chimpanzee', 'elephant'] Probabilities of the children of softmax parent: [0.16645625233650208, 0.003660923335701227, 0.007082193158566952, 4.3065745558124036e-05, 0.021761322394013405] names of the children of ILP parent: ['leopard', 'bear', 'tiger', 'lion', 'wolf'] Probabilities of the children of ILP parent: [0.6413083076477051, 0.015526500530540943, 0.010639411397278309, 0.0022478310856968164, 8.156940020853654e-05] cathegory messed up: cathegory(parent) label, softmax, ILP : 1 1 0 cathegory(parent) label, softmax, ILP : fish fish aquaticmammals cathegory(parent) label, softmax, ILP : 0.4652025103569031 0.4652025103569031 0.3317219316959381 tag(child) label, softmax, ILP : 32 72 72 tag(child) label, softmax, ILP : flatfish seal seal tag(child) label, softmax, ILP : 0.050320688635110855 0.2775064706802368 0.2775064706802368 probability of parents of tag(child) label, softmax, ILP : 0.4652025103569031 0.3317219316959381 0.3317219316959381 names of the children of softmax parent: ['trout', 'aquariumfish', 'flatfish', 'ray', 'shark'] Probabilities of the children of softmax parent: [0.015840867534279823, 0.021271144971251488, 0.050320688635110855, 0.06783811748027802, 0.12831909954547882] names of the children of ILP parent: ['seal', 'whale', 'dolphin', 'beaver', 'otter'] Probabilities of the children of ILP parent: [0.2775064706802368, 0.0011749186087399721, 0.0031715785153210163, 0.13701461255550385, 0.03466616943478584] cathegory messed up: cathegory(parent) label, softmax, ILP : 14 14 11 cathegory(parent) label, softmax, ILP : people people largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.5728998184204102 0.5728998184204102 0.37022385001182556 tag(child) label, softmax, ILP : 98 19 19 tag(child) label, softmax, ILP : woman cattle cattle tag(child) label, softmax, ILP : 0.20877738296985626 0.24098403751850128 0.24098403751850128 probability of parents of tag(child) label, softmax, ILP : 0.5728998184204102 0.37022385001182556 0.37022385001182556 names of the children of softmax parent: ['baby', 'woman', 'man', 'boy', 'girl'] Probabilities of the children of softmax parent: [0.022025497630238533, 0.20877738296985626, 0.12764021754264832, 0.11900854110717773, 0.1150641217827797] names of the children of ILP parent: ['cattle', 'camel', 'kangaroo', 'chimpanzee', 'elephant'] Probabilities of the children of ILP parent: [0.24098403751850128, 0.0069563258439302444, 0.011943246237933636, 0.017866268754005432, 0.009583146311342716] cathegory messed up: cathegory(parent) label, softmax, ILP : 19 19 18 cathegory(parent) label, softmax, ILP : vehicles2 vehicles2 vehicles1 cathegory(parent) label, softmax, ILP : 0.5370005369186401 0.5370005369186401 0.46242520213127136 tag(child) label, softmax, ILP : 81 13 13 tag(child) label, softmax, ILP : streetcar bus bus tag(child) label, softmax, ILP : 0.07109721004962921 0.5686846375465393 0.5686846375465393 probability of parents of tag(child) label, softmax, ILP : 0.5370005369186401 0.46242520213127136 0.46242520213127136 names of the children of softmax parent: ['streetcar', 'tank', 'lawnmower', 'rocket', 'tractor'] Probabilities of the children of softmax parent: [0.07109721004962921, 0.06853868812322617, 0.002547041978687048, 0.0005416160565800965, 0.020922644063830376] names of the children of ILP parent: ['bus', 'pickuptruck', 'motorcycle', 'train', 'bicycle'] Probabilities of the children of ILP parent: [0.5686846375465393, 0.04142802208662033, 1.6214544302783906e-05, 0.2151155322790146, 6.010368451825343e-05] cathegory messed up: cathegory(parent) label, softmax, ILP : 7 7 15 cathegory(parent) label, softmax, ILP : insects insects reptiles cathegory(parent) label, softmax, ILP : 0.5257033109664917 0.5257033109664917 0.4678962826728821 tag(child) label, softmax, ILP : 18 18 27 tag(child) label, softmax, ILP : caterpillar caterpillar crocodile tag(child) label, softmax, ILP : 0.6045995354652405 0.6045995354652405 0.28778722882270813 probability of parents of tag(child) label, softmax, ILP : 0.5257033109664917 0.5257033109664917 0.4678962826728821 names of the children of softmax parent: ['beetle', 'caterpillar', 'cockroach', 'bee', 'butterfly'] Probabilities of the children of softmax parent: [0.0019257947569712996, 0.6045995354652405, 0.0006991238915361464, 0.00033366327988915145, 0.000150965410284698] names of the children of ILP parent: ['crocodile', 'lizard', 'turtle', 'dinosaur', 'snake'] Probabilities of the children of ILP parent: [0.28778722882270813, 0.10029660910367966, 2.9192162401159294e-05, 0.000492051534820348, 0.00029694251134060323] ##############################local/softmax######################### tags accuracy 0.4534186325469812 category accuracy 0.570171931227509 ##############################ILP######################### tags accuracy 0.12195121951219512 category accuracy 0.5801679328268693 constraint accuracy: 96.25177556818181

graph exactL_ifLorLbottomup:

cathegory improved cathegory(parent) label, softmax, ILP : 9 13 9 cathegory(parent) label, softmax, ILP : largeman-madeoutdoorthings non-insectinvertebrates largeman-madeoutdoorthings cathegory(parent) label, softmax, ILP : 0.0634206235408783 0.8034175038337708 0.0634206235408783 tag(child) label, softmax, ILP : 76 76 76 tag(child) label, softmax, ILP : skyscraper skyscraper skyscraper tag(child) label, softmax, ILP : 0.9585952758789062 0.9585952758789062 0.9585952758789062 probability of parents of tag(child) label, softmax, ILP : 0.0634206235408783 0.0634206235408783 0.0634206235408783 names of the children of softmax parent: ['crab', 'lobster', 'spider', 'snail', 'worm'] Probabilities of the children of softmax parent: [0.00203201686963439, 5.068417522124946e-05, 0.0007709558121860027, 2.7121292077936232e-05, 0.02463694103062153] names of the children of ILP parent: ['skyscraper', 'bridge', 'road', 'castle', 'house'] Probabilities of the children of ILP parent: [0.9585952758789062, 0.00040915136924013495, 0.0002954610390588641, 1.659527697484009e-06, 5.099396275909385e-06] cathegory improved cathegory(parent) label, softmax, ILP : 11 19 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores vehicles2 largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.15478438138961792 0.4795268774032593 0.15478438138961792 tag(child) label, softmax, ILP : 19 19 19 tag(child) label, softmax, ILP : cattle cattle cattle tag(child) label, softmax, ILP : 0.5523293018341064 0.5523293018341064 0.5523293018341064 probability of parents of tag(child) label, softmax, ILP : 0.15478438138961792 0.15478438138961792 0.15478438138961792 names of the children of softmax parent: ['rocket', 'streetcar', 'tractor', 'lawnmower', 'tank'] Probabilities of the children of softmax parent: [0.0002200309099862352, 7.666921010240912e-05, 0.2177872210741043, 0.1391446888446808, 0.010406417772173882] names of the children of ILP parent: ['cattle', 'camel', 'kangaroo', 'elephant', 'chimpanzee'] Probabilities of the children of ILP parent: [0.5523293018341064, 0.0014273968990892172, 0.0015387912280857563, 0.00016900902846828103, 8.146747859427705e-06] tag improved: cathegory(parent) label, softmax, ILP : 4 16 16 cathegory(parent) label, softmax, ILP : fruitandvegetables smallmammals smallmammals cathegory(parent) label, softmax, ILP : 0.016895180568099022 0.6974161267280579 0.6974161267280579 tag(child) label, softmax, ILP : 51 14 51 tag(child) label, softmax, ILP : mushroom butterfly mushroom tag(child) label, softmax, ILP : 0.1744469404220581 0.25543081760406494 0.1744469404220581 probability of parents of tag(child) label, softmax, ILP : 0.016895180568099022 0.018160264939069748 0.016895180568099022 names of the children of softmax parent: ['hamster', 'shrew', 'rabbit', 'squirrel', 'mouse'] Probabilities of the children of softmax parent: [0.037508267909288406, 0.004724015016108751, 0.01855202578008175, 0.03687428683042526, 0.04766392707824707] names of the children of ILP parent: ['hamster', 'shrew', 'rabbit', 'squirrel', 'mouse'] Probabilities of the children of ILP parent: [0.037508267909288406, 0.004724015016108751, 0.01855202578008175, 0.03687428683042526, 0.04766392707824707] cathegory messed up: cathegory(parent) label, softmax, ILP : 2 2 1 cathegory(parent) label, softmax, ILP : flowers flowers fish cathegory(parent) label, softmax, ILP : 0.5239618420600891 0.5239618420600891 0.47446826100349426 tag(child) label, softmax, ILP : 54 1 1 tag(child) label, softmax, ILP : orchid aquariumfish aquariumfish tag(child) label, softmax, ILP : 0.024503447115421295 0.9587657451629639 0.9587657451629639 probability of parents of tag(child) label, softmax, ILP : 0.5239618420600891 0.47446826100349426 0.47446826100349426 names of the children of softmax parent: ['poppy', 'rose', 'orchid', 'sunflower', 'tulip'] Probabilities of the children of softmax parent: [0.012938098981976509, 0.0022943061776459217, 0.024503447115421295, 3.935130371246487e-05, 0.00026803096989169717] names of the children of ILP parent: ['aquariumfish', 'flatfish', 'ray', 'shark', 'trout'] Probabilities of the children of ILP parent: [0.9587657451629639, 0.00014215291594155133, 0.00020450817828532308, 7.201094558695331e-05, 0.00018848209583666176] cathegory improved cathegory(parent) label, softmax, ILP : 0 12 0 cathegory(parent) label, softmax, ILP : aquaticmammals mediummammals aquaticmammals cathegory(parent) label, softmax, ILP : 0.02158009074628353 0.543176531791687 0.02158009074628353 tag(child) label, softmax, ILP : 95 95 95 tag(child) label, softmax, ILP : whale whale whale tag(child) label, softmax, ILP : 0.9468849301338196 0.9468849301338196 0.9468849301338196 probability of parents of tag(child) label, softmax, ILP : 0.02158009074628353 0.02158009074628353 0.02158009074628353 names of the children of softmax parent: ['fox', 'possum', 'raccoon', 'skunk', 'porcupine'] Probabilities of the children of softmax parent: [0.00014765925880055875, 2.0081597540411167e-06, 5.004944614483975e-05, 0.011618116870522499, 5.423190032161074e-06] names of the children of ILP parent: ['whale', 'seal', 'otter', 'dolphin', 'beaver'] Probabilities of the children of ILP parent: [0.9468849301338196, 0.00011530155461514369, 2.229308483947534e-05, 0.0004922893131151795, 1.9711870891114813e-07] tag messed up: cathegory(parent) label, softmax, ILP : 3 5 5 cathegory(parent) label, softmax, ILP : foodcontainers householdelectricaldevices householdelectricaldevices cathegory(parent) label, softmax, ILP : 0.2557497024536133 0.5898865461349487 0.5898865461349487 tag(child) label, softmax, ILP : 16 16 83 tag(child) label, softmax, ILP : can can sweetpepper tag(child) label, softmax, ILP : 0.29328981041908264 0.29328981041908264 0.19173775613307953 probability of parents of tag(child) label, softmax, ILP : 0.2557497024536133 0.2557497024536133 0.10030533373355865 names of the children of softmax parent: ['television', 'clock', 'keyboard', 'lamp', 'telephone'] Probabilities of the children of softmax parent: [0.1129273772239685, 0.1155630424618721, 0.000371117697795853, 0.06981389969587326, 0.07490942627191544] names of the children of ILP parent: ['television', 'clock', 'keyboard', 'lamp', 'telephone'] Probabilities of the children of ILP parent: [0.1129273772239685, 0.1155630424618721, 0.000371117697795853, 0.06981389969587326, 0.07490942627191544] tag improved: cathegory(parent) label, softmax, ILP : 13 13 13 cathegory(parent) label, softmax, ILP : non-insectinvertebrates non-insectinvertebrates non-insectinvertebrates cathegory(parent) label, softmax, ILP : 0.6172020435333252 0.6172020435333252 0.6172020435333252 tag(child) label, softmax, ILP : 79 97 79 tag(child) label, softmax, ILP : spider wolf spider tag(child) label, softmax, ILP : 0.298886239528656 0.6526738405227661 0.298886239528656 probability of parents of tag(child) label, softmax, ILP : 0.6172020435333252 0.22125305235385895 0.6172020435333252 names of the children of softmax parent: ['crab', 'lobster', 'spider', 'snail', 'worm'] Probabilities of the children of softmax parent: [9.310503810411319e-05, 0.012439937330782413, 0.298886239528656, 0.00010423521598568186, 0.00013402855256572366] names of the children of ILP parent: ['crab', 'lobster', 'spider', 'snail', 'worm'] Probabilities of the children of ILP parent: [9.310503810411319e-05, 0.012439937330782413, 0.298886239528656, 0.00010423521598568186, 0.00013402855256572366] tag improved: cathegory(parent) label, softmax, ILP : 4 4 4 cathegory(parent) label, softmax, ILP : fruitandvegetables fruitandvegetables fruitandvegetables cathegory(parent) label, softmax, ILP : 0.7319121360778809 0.7319121360778809 0.7319121360778809 tag(child) label, softmax, ILP : 53 62 53 tag(child) label, softmax, ILP : orange poppy orange tag(child) label, softmax, ILP : 0.18623663485050201 0.6353667378425598 0.18623663485050201 probability of parents of tag(child) label, softmax, ILP : 0.7319121360778809 0.26808395981788635 0.7319121360778809 names of the children of softmax parent: ['orange', 'mushroom', 'sweetpepper', 'apple', 'pear'] Probabilities of the children of softmax parent: [0.18623663485050201, 0.0005272523849271238, 0.05545232445001602, 0.004551070276647806, 0.0013741161674261093] names of the children of ILP parent: ['orange', 'mushroom', 'sweetpepper', 'apple', 'pear'] Probabilities of the children of ILP parent: [0.18623663485050201, 0.0005272523849271238, 0.05545232445001602, 0.004551070276647806, 0.0013741161674261093] cathegory improved cathegory(parent) label, softmax, ILP : 2 1 2 cathegory(parent) label, softmax, ILP : flowers fish flowers cathegory(parent) label, softmax, ILP : 0.45772552490234375 0.4736306965351105 0.45772552490234375 tag(child) label, softmax, ILP : 62 62 62 tag(child) label, softmax, ILP : poppy poppy poppy tag(child) label, softmax, ILP : 0.6399759650230408 0.6399759650230408 0.6399759650230408 probability of parents of tag(child) label, softmax, ILP : 0.45772552490234375 0.45772552490234375 0.45772552490234375 names of the children of softmax parent: ['aquariumfish', 'flatfish', 'ray', 'shark', 'trout'] Probabilities of the children of softmax parent: [0.006500578485429287, 0.007969001308083534, 7.566872000097646e-07, 0.006098391488194466, 0.03953659161925316] names of the children of ILP parent: ['poppy', 'rose', 'orchid', 'sunflower', 'tulip'] Probabilities of the children of ILP parent: [0.6399759650230408, 8.145764149958268e-05, 0.009138082154095173, 0.0016999351792037487, 0.02734457142651081] tag messed up: cathegory(parent) label, softmax, ILP : 7 8 8 cathegory(parent) label, softmax, ILP : insects largecarnivores largecarnivores cathegory(parent) label, softmax, ILP : 0.007455664221197367 0.9712820053100586 0.9712820053100586 tag(child) label, softmax, ILP : 14 14 88 tag(child) label, softmax, ILP : butterfly butterfly tiger tag(child) label, softmax, ILP : 0.5242941379547119 0.5242941379547119 0.3111104369163513 probability of parents of tag(child) label, softmax, ILP : 0.007455664221197367 0.007455664221197367 0.9712820053100586 names of the children of softmax parent: ['wolf', 'bear', 'lion', 'tiger', 'leopard'] Probabilities of the children of softmax parent: [0.0042148069478571415, 0.005631443113088608, 5.5591794080100954e-05, 0.3111104369163513, 0.08458096534013748] names of the children of ILP parent: ['wolf', 'bear', 'lion', 'tiger', 'leopard'] Probabilities of the children of ILP parent: [0.0042148069478571415, 0.005631443113088608, 5.5591794080100954e-05, 0.3111104369163513, 0.08458096534013748] tag messed up: cathegory(parent) label, softmax, ILP : 3 5 5 cathegory(parent) label, softmax, ILP : foodcontainers householdelectricaldevices householdelectricaldevices cathegory(parent) label, softmax, ILP : 0.03675832226872444 0.9531629681587219 0.9531629681587219 tag(child) label, softmax, ILP : 16 16 87 tag(child) label, softmax, ILP : can can television tag(child) label, softmax, ILP : 0.4158720374107361 0.4158720374107361 0.25379887223243713 probability of parents of tag(child) label, softmax, ILP : 0.03675832226872444 0.03675832226872444 0.9531629681587219 names of the children of softmax parent: ['television', 'clock', 'keyboard', 'lamp', 'telephone'] Probabilities of the children of softmax parent: [0.25379887223243713, 0.13312608003616333, 0.001613725209608674, 0.061082981526851654, 0.07359236478805542] names of the children of ILP parent: ['television', 'clock', 'keyboard', 'lamp', 'telephone'] Probabilities of the children of ILP parent: [0.25379887223243713, 0.13312608003616333, 0.001613725209608674, 0.061082981526851654, 0.07359236478805542] cathegory improved cathegory(parent) label, softmax, ILP : 3 5 3 cathegory(parent) label, softmax, ILP : foodcontainers householdelectricaldevices foodcontainers cathegory(parent) label, softmax, ILP : 0.051168542355298996 0.9104263186454773 0.051168542355298996 tag(child) label, softmax, ILP : 16 16 16 tag(child) label, softmax, ILP : can can can tag(child) label, softmax, ILP : 0.9239957332611084 0.9239957332611084 0.9239957332611084 probability of parents of tag(child) label, softmax, ILP : 0.051168542355298996 0.051168542355298996 0.051168542355298996 names of the children of softmax parent: ['television', 'clock', 'keyboard', 'lamp', 'telephone'] Probabilities of the children of softmax parent: [0.00791743490844965, 0.01715848594903946, 0.0002445921127218753, 0.0036265566013753414, 0.003760379273444414] names of the children of ILP parent: ['can', 'cup', 'plate', 'bowl', 'bottle'] Probabilities of the children of ILP parent: [0.9239957332611084, 7.818334415787831e-05, 0.00013613015471491963, 0.0003131440025754273, 1.758674807206262e-05] tag improved: cathegory(parent) label, softmax, ILP : 14 14 14 cathegory(parent) label, softmax, ILP : people people people cathegory(parent) label, softmax, ILP : 0.5728998184204102 0.5728998184204102 0.5728998184204102 tag(child) label, softmax, ILP : 98 19 98 tag(child) label, softmax, ILP : woman cattle woman tag(child) label, softmax, ILP : 0.20877738296985626 0.24098403751850128 0.20877738296985626 probability of parents of tag(child) label, softmax, ILP : 0.5728998184204102 0.37022385001182556 0.5728998184204102 names of the children of softmax parent: ['girl', 'boy', 'man', 'woman', 'baby'] Probabilities of the children of softmax parent: [0.1150641217827797, 0.11900854110717773, 0.12764021754264832, 0.20877738296985626, 0.022025497630238533] names of the children of ILP parent: ['girl', 'boy', 'man', 'woman', 'baby'] Probabilities of the children of ILP parent: [0.1150641217827797, 0.11900854110717773, 0.12764021754264832, 0.20877738296985626, 0.022025497630238533] tag improved: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.9838613867759705 0.9838613867759705 0.9838613867759705 tag(child) label, softmax, ILP : 33 94 33 tag(child) label, softmax, ILP : forest wardrobe forest tag(child) label, softmax, ILP : 0.2698709964752197 0.6569511294364929 0.2698709964752197 probability of parents of tag(child) label, softmax, ILP : 0.9838613867759705 0.010648847557604313 0.9838613867759705 names of the children of softmax parent: ['forest', 'mountain', 'plain', 'cloud', 'sea'] Probabilities of the children of softmax parent: [0.2698709964752197, 0.00010584887058939785, 0.0016522301593795419, 0.008226189762353897, 0.012526473961770535] names of the children of ILP parent: ['forest', 'mountain', 'plain', 'cloud', 'sea'] Probabilities of the children of ILP parent: [0.2698709964752197, 0.00010584887058939785, 0.0016522301593795419, 0.008226189762353897, 0.012526473961770535] tag messed up: cathegory(parent) label, softmax, ILP : 10 8 8 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largecarnivores largecarnivores cathegory(parent) label, softmax, ILP : 0.06120648980140686 0.518554151058197 0.518554151058197 tag(child) label, softmax, ILP : 33 33 80 tag(child) label, softmax, ILP : forest forest squirrel tag(child) label, softmax, ILP : 0.220567986369133 0.220567986369133 0.179534912109375 probability of parents of tag(child) label, softmax, ILP : 0.06120648980140686 0.06120648980140686 0.060835327953100204 names of the children of softmax parent: ['wolf', 'bear', 'lion', 'tiger', 'leopard'] Probabilities of the children of softmax parent: [0.017757276073098183, 0.016601810231804848, 0.010833840817213058, 0.14528146386146545, 0.08592341840267181] names of the children of ILP parent: ['wolf', 'bear', 'lion', 'tiger', 'leopard'] Probabilities of the children of ILP parent: [0.017757276073098183, 0.016601810231804848, 0.010833840817213058, 0.14528146386146545, 0.08592341840267181] tag messed up: cathegory(parent) label, softmax, ILP : 12 1 1 cathegory(parent) label, softmax, ILP : mediummammals fish fish cathegory(parent) label, softmax, ILP : 0.056155476719141006 0.9124108552932739 0.9124108552932739 tag(child) label, softmax, ILP : 34 34 91 tag(child) label, softmax, ILP : fox fox trout tag(child) label, softmax, ILP : 0.8218151330947876 0.8218151330947876 0.12944121658802032 probability of parents of tag(child) label, softmax, ILP : 0.056155476719141006 0.056155476719141006 0.9124108552932739 names of the children of softmax parent: ['aquariumfish', 'flatfish', 'ray', 'shark', 'trout'] Probabilities of the children of softmax parent: [0.0056716082617640495, 0.0005167833878658712, 0.002769032260403037, 0.009155934676527977, 0.12944121658802032] names of the children of ILP parent: ['aquariumfish', 'flatfish', 'ray', 'shark', 'trout'] Probabilities of the children of ILP parent: [0.0056716082617640495, 0.0005167833878658712, 0.002769032260403037, 0.009155934676527977, 0.12944121658802032] cathegory messed up: cathegory(parent) label, softmax, ILP : 12 12 11 cathegory(parent) label, softmax, ILP : mediummammals mediummammals largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.4442185163497925 0.4442185163497925 0.37613070011138916 tag(child) label, softmax, ILP : 34 19 19 tag(child) label, softmax, ILP : fox cattle cattle tag(child) label, softmax, ILP : 0.023455923423171043 0.6921738982200623 0.6921738982200623 probability of parents of tag(child) label, softmax, ILP : 0.4442185163497925 0.37613070011138916 0.37613070011138916 names of the children of softmax parent: ['fox', 'possum', 'raccoon', 'skunk', 'porcupine'] Probabilities of the children of softmax parent: [0.023455923423171043, 0.011514863930642605, 0.009368153288960457, 0.001912062056362629, 0.05660044401884079] names of the children of ILP parent: ['cattle', 'camel', 'kangaroo', 'elephant', 'chimpanzee'] Probabilities of the children of ILP parent: [0.6921738982200623, 0.003269342239946127, 0.008314111270010471, 0.004575103521347046, 0.0004376618016976863] cathegory messed up: cathegory(parent) label, softmax, ILP : 1 1 19 cathegory(parent) label, softmax, ILP : fish fish vehicles2 cathegory(parent) label, softmax, ILP : 0.8381518125534058 0.8381518125534058 0.14390377700328827 tag(child) label, softmax, ILP : 91 69 69 tag(child) label, softmax, ILP : trout rocket rocket tag(child) label, softmax, ILP : 0.0028248759917914867 0.906738817691803 0.906738817691803 probability of parents of tag(child) label, softmax, ILP : 0.8381518125534058 0.14390377700328827 0.14390377700328827 names of the children of softmax parent: ['aquariumfish', 'flatfish', 'ray', 'shark', 'trout'] Probabilities of the children of softmax parent: [1.0735111573012546e-06, 2.198228514771472e-07, 0.00029096080106683075, 0.08986307680606842, 0.0028248759917914867] names of the children of ILP parent: ['rocket', 'streetcar', 'tractor', 'lawnmower', 'tank'] Probabilities of the children of ILP parent: [0.906738817691803, 5.84330805963873e-10, 5.724170581977717e-10, 1.7195784351997645e-08, 1.1801979553638375e-06] ##############################local/softmax######################### tags accuracy 0.4534186325469812 category accuracy 0.570171931227509 ##############################ILP######################### tags accuracy 0.45181927229108354 category accuracy 0.5777688924430228 constraint accuracy: 99.75818452380952

graph exactL_ifLorLbothways:

tag messed up: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.9629725813865662 0.9629725813865662 0.9629725813865662 tag(child) label, softmax, ILP : 33 33 23 tag(child) label, softmax, ILP : forest forest cloud tag(child) label, softmax, ILP : 0.9125771522521973 0.9125771522521973 0.0002684923238120973 probability of parents of tag(child) label, softmax, ILP : 0.9629725813865662 0.9629725813865662 0.9629725813865662 names of the children of softmax parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of softmax parent: [0.0002684923238120973, 3.93447517126333e-05, 0.9125771522521973, 4.22776720370166e-05, 2.9333134079934098e-05] names of the children of ILP parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of ILP parent: [0.0002684923238120973, 3.93447517126333e-05, 0.9125771522521973, 4.22776720370166e-05, 2.9333134079934098e-05] tag messed up: cathegory(parent) label, softmax, ILP : 4 4 4 cathegory(parent) label, softmax, ILP : fruitandvegetables fruitandvegetables fruitandvegetables cathegory(parent) label, softmax, ILP : 0.7989405393600464 0.7989405393600464 0.7989405393600464 tag(child) label, softmax, ILP : 51 51 53 tag(child) label, softmax, ILP : mushroom mushroom orange tag(child) label, softmax, ILP : 0.6613088846206665 0.6613088846206665 1.7125315935118124e-05 probability of parents of tag(child) label, softmax, ILP : 0.7989405393600464 0.7989405393600464 0.7989405393600464 names of the children of softmax parent: ['orange', 'sweetpepper', 'pear', 'mushroom', 'apple'] Probabilities of the children of softmax parent: [1.7125315935118124e-05, 0.0006546579534187913, 6.105718057369813e-06, 0.6613088846206665, 1.1906232430192176e-05] names of the children of ILP parent: ['orange', 'sweetpepper', 'pear', 'mushroom', 'apple'] Probabilities of the children of ILP parent: [1.7125315935118124e-05, 0.0006546579534187913, 6.105718057369813e-06, 0.6613088846206665, 1.1906232430192176e-05] tag messed up: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 1.0 1.0 1.0 tag(child) label, softmax, ILP : 71 71 23 tag(child) label, softmax, ILP : sea sea cloud tag(child) label, softmax, ILP : 0.9987834095954895 0.9987834095954895 0.0008615392725914717 probability of parents of tag(child) label, softmax, ILP : 1.0 1.0 1.0 names of the children of softmax parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of softmax parent: [0.0008615392725914717, 3.382299382792553e-06, 1.2748088238367927e-06, 0.00035043692332692444, 0.9987834095954895] names of the children of ILP parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of ILP parent: [0.0008615392725914717, 3.382299382792553e-06, 1.2748088238367927e-06, 0.00035043692332692444, 0.9987834095954895] tag messed up: cathegory(parent) label, softmax, ILP : 7 7 7 cathegory(parent) label, softmax, ILP : insects insects insects cathegory(parent) label, softmax, ILP : 0.6927009224891663 0.6927009224891663 0.6927009224891663 tag(child) label, softmax, ILP : 14 14 24 tag(child) label, softmax, ILP : butterfly butterfly cockroach tag(child) label, softmax, ILP : 0.9744971394538879 0.9744971394538879 8.520079973095562e-06 probability of parents of tag(child) label, softmax, ILP : 0.6927009224891663 0.6927009224891663 0.6927009224891663 names of the children of softmax parent: ['cockroach', 'beetle', 'butterfly', 'caterpillar', 'bee'] Probabilities of the children of softmax parent: [8.520079973095562e-06, 0.013684491626918316, 0.9744971394538879, 5.243777923169546e-05, 0.00017540510452818125] names of the children of ILP parent: ['cockroach', 'beetle', 'butterfly', 'caterpillar', 'bee'] Probabilities of the children of ILP parent: [8.520079973095562e-06, 0.013684491626918316, 0.9744971394538879, 5.243777923169546e-05, 0.00017540510452818125] tag improved: cathegory(parent) label, softmax, ILP : 10 10 10 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.9999994039535522 0.9999994039535522 0.9999994039535522 tag(child) label, softmax, ILP : 23 71 23 tag(child) label, softmax, ILP : cloud sea cloud tag(child) label, softmax, ILP : 0.0009258993086405098 0.9984695315361023 0.0009258993086405098 probability of parents of tag(child) label, softmax, ILP : 0.9999994039535522 0.9999994039535522 0.9999994039535522 names of the children of softmax parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of softmax parent: [0.0009258993086405098, 5.94627890677657e-05, 7.569552167296933e-07, 0.0005426713032647967, 0.9984695315361023] names of the children of ILP parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of ILP parent: [0.0009258993086405098, 5.94627890677657e-05, 7.569552167296933e-07, 0.0005426713032647967, 0.9984695315361023] tag messed up: cathegory(parent) label, softmax, ILP : 12 12 12 cathegory(parent) label, softmax, ILP : mediummammals mediummammals mediummammals cathegory(parent) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 tag(child) label, softmax, ILP : 75 75 66 tag(child) label, softmax, ILP : skunk skunk raccoon tag(child) label, softmax, ILP : 0.5542430281639099 0.5542430281639099 0.001160784624516964 probability of parents of tag(child) label, softmax, ILP : 0.7867238521575928 0.7867238521575928 0.7867238521575928 names of the children of softmax parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of softmax parent: [0.001160784624516964, 0.05777030065655708, 0.014209582470357418, 0.0001624400174478069, 0.5542430281639099] names of the children of ILP parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of ILP parent: [0.001160784624516964, 0.05777030065655708, 0.014209582470357418, 0.0001624400174478069, 0.5542430281639099] cathegory improved cathegory(parent) label, softmax, ILP : 2 5 2 cathegory(parent) label, softmax, ILP : flowers householdelectricaldevices flowers cathegory(parent) label, softmax, ILP : 0.4009947180747986 0.4197061359882355 0.4009947180747986 tag(child) label, softmax, ILP : 70 82 82 tag(child) label, softmax, ILP : rose sunflower sunflower tag(child) label, softmax, ILP : 0.0010093176970258355 0.5309575796127319 0.5309575796127319 probability of parents of tag(child) label, softmax, ILP : 0.4009947180747986 0.4009947180747986 0.4009947180747986 names of the children of softmax parent: ['clock', 'keyboard', 'telephone', 'television', 'lamp'] Probabilities of the children of softmax parent: [0.004475451540201902, 0.01655183918774128, 0.00021438552357722074, 3.363997893757187e-05, 0.06797533482313156] names of the children of ILP parent: ['sunflower', 'poppy', 'tulip', 'rose', 'orchid'] Probabilities of the children of ILP parent: [0.5309575796127319, 0.11965250968933105, 0.012972929514944553, 0.0010093176970258355, 0.002159574767574668] tag improved: cathegory(parent) label, softmax, ILP : 3 3 3 cathegory(parent) label, softmax, ILP : foodcontainers foodcontainers foodcontainers cathegory(parent) label, softmax, ILP : 0.9865109920501709 0.9865109920501709 0.9865109920501709 tag(child) label, softmax, ILP : 61 10 61 tag(child) label, softmax, ILP : plate bowl plate tag(child) label, softmax, ILP : 0.20091985166072845 0.6932168006896973 0.20091985166072845 probability of parents of tag(child) label, softmax, ILP : 0.9865109920501709 0.9865109920501709 0.9865109920501709 names of the children of softmax parent: ['plate', 'bottle', 'cup', 'can', 'bowl'] Probabilities of the children of softmax parent: [0.20091985166072845, 5.330551630322589e-06, 0.0017707573715597391, 0.02352408692240715, 0.6932168006896973] names of the children of ILP parent: ['plate', 'bottle', 'cup', 'can', 'bowl'] Probabilities of the children of ILP parent: [0.20091985166072845, 5.330551630322589e-06, 0.0017707573715597391, 0.02352408692240715, 0.6932168006896973] tag improved: cathegory(parent) label, softmax, ILP : 7 7 7 cathegory(parent) label, softmax, ILP : insects insects insects cathegory(parent) label, softmax, ILP : 0.9408429265022278 0.9408429265022278 0.9408429265022278 tag(child) label, softmax, ILP : 24 7 24 tag(child) label, softmax, ILP : cockroach beetle cockroach tag(child) label, softmax, ILP : 0.08047514408826828 0.7309572696685791 0.08047514408826828 probability of parents of tag(child) label, softmax, ILP : 0.9408429265022278 0.9408429265022278 0.9408429265022278 names of the children of softmax parent: ['cockroach', 'beetle', 'butterfly', 'caterpillar', 'bee'] Probabilities of the children of softmax parent: [0.08047514408826828, 0.7309572696685791, 0.0009892807574942708, 0.05092303454875946, 0.0022413188125938177] names of the children of ILP parent: ['cockroach', 'beetle', 'butterfly', 'caterpillar', 'bee'] Probabilities of the children of ILP parent: [0.08047514408826828, 0.7309572696685791, 0.0009892807574942708, 0.05092303454875946, 0.0022413188125938177] tag improved: cathegory(parent) label, softmax, ILP : 5 5 5 cathegory(parent) label, softmax, ILP : householdelectricaldevices householdelectricaldevices householdelectricaldevices cathegory(parent) label, softmax, ILP : 0.8726553320884705 0.8726553320884705 0.8726553320884705 tag(child) label, softmax, ILP : 22 40 22 tag(child) label, softmax, ILP : clock lamp clock tag(child) label, softmax, ILP : 0.012750484049320221 0.756744921207428 0.012750484049320221 probability of parents of tag(child) label, softmax, ILP : 0.8726553320884705 0.8726553320884705 0.8726553320884705 names of the children of softmax parent: ['clock', 'keyboard', 'telephone', 'television', 'lamp'] Probabilities of the children of softmax parent: [0.012750484049320221, 0.00014153744268696755, 7.582047692267224e-05, 5.7286411902168766e-05, 0.756744921207428] names of the children of ILP parent: ['clock', 'keyboard', 'telephone', 'television', 'lamp'] Probabilities of the children of ILP parent: [0.012750484049320221, 0.00014153744268696755, 7.582047692267224e-05, 5.7286411902168766e-05, 0.756744921207428] tag improved: cathegory(parent) label, softmax, ILP : 5 5 5 cathegory(parent) label, softmax, ILP : householdelectricaldevices householdelectricaldevices householdelectricaldevices cathegory(parent) label, softmax, ILP : 0.8639704585075378 0.8639704585075378 0.8639704585075378 tag(child) label, softmax, ILP : 22 61 22 tag(child) label, softmax, ILP : clock plate clock tag(child) label, softmax, ILP : 0.03271196410059929 0.6943089962005615 0.03271196410059929 probability of parents of tag(child) label, softmax, ILP : 0.8639704585075378 0.10802529752254486 0.8639704585075378 names of the children of softmax parent: ['clock', 'keyboard', 'telephone', 'television', 'lamp'] Probabilities of the children of softmax parent: [0.03271196410059929, 0.04082654044032097, 0.0002569821663200855, 0.0007167898002080619, 0.0014308138052001595] names of the children of ILP parent: ['clock', 'keyboard', 'telephone', 'television', 'lamp'] Probabilities of the children of ILP parent: [0.03271196410059929, 0.04082654044032097, 0.0002569821663200855, 0.0007167898002080619, 0.0014308138052001595] cathegory improved cathegory(parent) label, softmax, ILP : 11 16 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores smallmammals largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.2879009246826172 0.5918319821357727 0.2879009246826172 tag(child) label, softmax, ILP : 21 21 21 tag(child) label, softmax, ILP : chimpanzee chimpanzee chimpanzee tag(child) label, softmax, ILP : 0.6603975296020508 0.6603975296020508 0.6603975296020508 probability of parents of tag(child) label, softmax, ILP : 0.2879009246826172 0.2879009246826172 0.2879009246826172 names of the children of softmax parent: ['mouse', 'rabbit', 'shrew', 'hamster', 'squirrel'] Probabilities of the children of softmax parent: [0.034108202904462814, 0.01623845100402832, 0.0007675542146898806, 0.20201370120048523, 0.009595617651939392] names of the children of ILP parent: ['chimpanzee', 'cattle', 'kangaroo', 'camel', 'elephant'] Probabilities of the children of ILP parent: [0.6603975296020508, 0.0032473010942339897, 0.00024319166550412774, 0.00023537754896096885, 0.0003842694859486073] cathegory improved cathegory(parent) label, softmax, ILP : 12 16 12 cathegory(parent) label, softmax, ILP : mediummammals smallmammals mediummammals cathegory(parent) label, softmax, ILP : 0.3066863417625427 0.35985422134399414 0.3066863417625427 tag(child) label, softmax, ILP : 66 66 66 tag(child) label, softmax, ILP : raccoon raccoon raccoon tag(child) label, softmax, ILP : 0.22744148969650269 0.22744148969650269 0.22744148969650269 probability of parents of tag(child) label, softmax, ILP : 0.3066863417625427 0.3066863417625427 0.3066863417625427 names of the children of softmax parent: ['mouse', 'rabbit', 'shrew', 'hamster', 'squirrel'] Probabilities of the children of softmax parent: [0.1473696380853653, 0.03160233795642853, 0.05948842689394951, 0.0021609708201140165, 0.022683897987008095] names of the children of ILP parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of ILP parent: [0.22744148969650269, 0.0019710815977305174, 0.02037269063293934, 0.03575970232486725, 0.00022989929129835218] cathegory improved cathegory(parent) label, softmax, ILP : 12 18 12 cathegory(parent) label, softmax, ILP : mediummammals vehicles1 mediummammals cathegory(parent) label, softmax, ILP : 0.45708051323890686 0.47548848390579224 0.45708051323890686 tag(child) label, softmax, ILP : 64 66 66 tag(child) label, softmax, ILP : possum raccoon raccoon tag(child) label, softmax, ILP : 0.00046176055911928415 0.7245110869407654 0.7245110869407654 probability of parents of tag(child) label, softmax, ILP : 0.45708051323890686 0.45708051323890686 0.45708051323890686 names of the children of softmax parent: ['bicycle', 'motorcycle', 'train', 'pickuptruck', 'bus'] Probabilities of the children of softmax parent: [0.0017350122798234224, 0.0007418274180963635, 0.04757710173726082, 0.000581485393922776, 0.006145697087049484] names of the children of ILP parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of ILP parent: [0.7245110869407654, 0.002617319580167532, 6.589529220946133e-05, 0.00046176055911928415, 0.11025030165910721] cathegory improved cathegory(parent) label, softmax, ILP : 17 11 17 cathegory(parent) label, softmax, ILP : trees largeomnivoresandherbivores trees cathegory(parent) label, softmax, ILP : 0.25551578402519226 0.26336902379989624 0.25551578402519226 tag(child) label, softmax, ILP : 59 74 96 tag(child) label, softmax, ILP : pinetree shrew willowtree tag(child) label, softmax, ILP : 0.1184447854757309 0.1453801542520523 0.06957066059112549 probability of parents of tag(child) label, softmax, ILP : 0.25551578402519226 0.06650864332914352 0.25551578402519226 names of the children of softmax parent: ['chimpanzee', 'cattle', 'kangaroo', 'camel', 'elephant'] Probabilities of the children of softmax parent: [0.04582154005765915, 0.0872073769569397, 0.02670782059431076, 0.005365992896258831, 0.07444421947002411] names of the children of ILP parent: ['willowtree', 'palmtree', 'mapletree', 'pinetree', 'oaktree'] Probabilities of the children of ILP parent: [0.06957066059112549, 0.00962323509156704, 0.0034374415408819914, 0.1184447854757309, 0.019017240032553673] cathegory messed up: cathegory(parent) label, softmax, ILP : 9 9 10 cathegory(parent) label, softmax, ILP : largeman-madeoutdoorthings largeman-madeoutdoorthings largenaturaloutdoorscenes cathegory(parent) label, softmax, ILP : 0.43805545568466187 0.43805545568466187 0.4125213325023651 tag(child) label, softmax, ILP : 68 76 23 tag(child) label, softmax, ILP : road skyscraper cloud tag(child) label, softmax, ILP : 0.03554908186197281 0.8047340512275696 0.06091582030057907 probability of parents of tag(child) label, softmax, ILP : 0.43805545568466187 0.43805545568466187 0.4125213325023651 names of the children of softmax parent: ['bridge', 'house', 'road', 'skyscraper', 'castle'] Probabilities of the children of softmax parent: [0.0055791703052818775, 0.0014562464784830809, 0.03554908186197281, 0.8047340512275696, 0.00020794570446014404] names of the children of ILP parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of ILP parent: [0.06091582030057907, 0.05170568451285362, 0.00045794391189701855, 0.0022810460068285465, 0.0006435007671825588] cathegory messed up: cathegory(parent) label, softmax, ILP : 8 8 12 cathegory(parent) label, softmax, ILP : largecarnivores largecarnivores mediummammals cathegory(parent) label, softmax, ILP : 0.5161674618721008 0.5161674618721008 0.4838283360004425 tag(child) label, softmax, ILP : 97 97 66 tag(child) label, softmax, ILP : wolf wolf raccoon tag(child) label, softmax, ILP : 0.9130183458328247 0.9130183458328247 0.044234950095415115 probability of parents of tag(child) label, softmax, ILP : 0.5161674618721008 0.5161674618721008 0.4838283360004425 names of the children of softmax parent: ['bear', 'leopard', 'lion', 'tiger', 'wolf'] Probabilities of the children of softmax parent: [4.659128899220377e-05, 0.00014103541616350412, 0.022055242210626602, 0.0024299982469528913, 0.9130183458328247] names of the children of ILP parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of ILP parent: [0.044234950095415115, 0.01769442670047283, 4.594771962729283e-05, 0.0003148670948576182, 7.290588541764009e-07] cathegory messed up: cathegory(parent) label, softmax, ILP : 12 12 16 cathegory(parent) label, softmax, ILP : mediummammals mediummammals smallmammals cathegory(parent) label, softmax, ILP : 0.5301365256309509 0.5301365256309509 0.4365248680114746 tag(child) label, softmax, ILP : 63 63 50 tag(child) label, softmax, ILP : porcupine porcupine mouse tag(child) label, softmax, ILP : 0.6539164781570435 0.6539164781570435 0.19780200719833374 probability of parents of tag(child) label, softmax, ILP : 0.5301365256309509 0.5301365256309509 0.4365248680114746 names of the children of softmax parent: ['raccoon', 'fox', 'porcupine', 'possum', 'skunk'] Probabilities of the children of softmax parent: [0.00522144790738821, 2.1190640836721286e-05, 0.6539164781570435, 0.02709238789975643, 0.0013786619529128075] names of the children of ILP parent: ['mouse', 'rabbit', 'shrew', 'hamster', 'squirrel'] Probabilities of the children of ILP parent: [0.19780200719833374, 0.009896964766085148, 0.007158924359828234, 0.06697431951761246, 0.0019976883195340633] cathegory messed up: cathegory(parent) label, softmax, ILP : 11 11 8 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores largeomnivoresandherbivores largecarnivores cathegory(parent) label, softmax, ILP : 0.5828397274017334 0.5828397274017334 0.3182767331600189 tag(child) label, softmax, ILP : 21 3 3 tag(child) label, softmax, ILP : chimpanzee bear bear tag(child) label, softmax, ILP : 0.021387854591012 0.546260416507721 0.546260416507721 probability of parents of tag(child) label, softmax, ILP : 0.5828397274017334 0.3182767331600189 0.3182767331600189 names of the children of softmax parent: ['chimpanzee', 'cattle', 'kangaroo', 'camel', 'elephant'] Probabilities of the children of softmax parent: [0.021387854591012, 0.3803342282772064, 0.0006126054795458913, 0.006346840411424637, 0.0027950755320489407] names of the children of ILP parent: ['bear', 'leopard', 'lion', 'tiger', 'wolf'] Probabilities of the children of ILP parent: [0.546260416507721, 0.000346565677318722, 0.005046089645475149, 2.9672510208911262e-05, 4.950804213876836e-05] cathegory messed up: cathegory(parent) label, softmax, ILP : 10 10 9 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes largenaturaloutdoorscenes largeman-madeoutdoorthings cathegory(parent) label, softmax, ILP : 0.4319421648979187 0.4319421648979187 0.12910810112953186 tag(child) label, softmax, ILP : 49 12 12 tag(child) label, softmax, ILP : mountain bridge bridge tag(child) label, softmax, ILP : 0.014998379163444042 0.38539886474609375 0.38539886474609375 probability of parents of tag(child) label, softmax, ILP : 0.4319421648979187 0.12910810112953186 0.12910810112953186 names of the children of softmax parent: ['cloud', 'mountain', 'forest', 'plain', 'sea'] Probabilities of the children of softmax parent: [0.0017818452324718237, 0.014998379163444042, 0.02386765368282795, 0.10766392201185226, 0.06607616692781448] names of the children of ILP parent: ['bridge', 'house', 'road', 'skyscraper', 'castle'] Probabilities of the children of ILP parent: [0.38539886474609375, 0.012689132243394852, 0.0011426620185375214, 0.004196527414023876, 0.018546557053923607] ##############################local/softmax######################### tags accuracy 0.4534186325469812 category accuracy 0.570171931227509 ##############################ILP######################### tags accuracy 0.13314674130347862 category accuracy 0.5753698520591763 constraint accuracy: 97.87919207317073

graph nandL:

tag messed up: cathegory(parent) label, softmax, ILP : 11 8 8 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores largecarnivores largecarnivores cathegory(parent) label, softmax, ILP : 0.011452531442046165 0.9883684515953064 0.9883684515953064 tag(child) label, softmax, ILP : 21 21 3 tag(child) label, softmax, ILP : chimpanzee chimpanzee bear tag(child) label, softmax, ILP : 0.9347828030586243 0.9347828030586243 0.03583316504955292 probability of parents of tag(child) label, softmax, ILP : 0.011452531442046165 0.011452531442046165 0.9883684515953064 names of the children of softmax parent: ['wolf', 'leopard', 'bear', 'tiger', 'lion'] Probabilities of the children of softmax parent: [7.690353959333152e-05, 9.059635885932948e-07, 0.03583316504955292, 6.65995094095706e-06, 0.02887481264770031] names of the children of ILP parent: ['wolf', 'leopard', 'bear', 'tiger', 'lion'] Probabilities of the children of ILP parent: [7.690353959333152e-05, 9.059635885932948e-07, 0.03583316504955292, 6.65995094095706e-06, 0.02887481264770031] cathegory improved cathegory(parent) label, softmax, ILP : 2 5 2 cathegory(parent) label, softmax, ILP : flowers householdelectricaldevices flowers cathegory(parent) label, softmax, ILP : 0.4009947180747986 0.4197061359882355 0.4009947180747986 tag(child) label, softmax, ILP : 70 82 82 tag(child) label, softmax, ILP : rose sunflower sunflower tag(child) label, softmax, ILP : 0.0010093176970258355 0.5309575796127319 0.5309575796127319 probability of parents of tag(child) label, softmax, ILP : 0.4009947180747986 0.4009947180747986 0.4009947180747986 names of the children of softmax parent: ['lamp', 'telephone', 'keyboard', 'television', 'clock'] Probabilities of the children of softmax parent: [0.06797533482313156, 0.00021438552357722074, 0.01655183918774128, 3.363997893757187e-05, 0.004475451540201902] names of the children of ILP parent: ['orchid', 'poppy', 'rose', 'sunflower', 'tulip'] Probabilities of the children of ILP parent: [0.002159574767574668, 0.11965250968933105, 0.0010093176970258355, 0.5309575796127319, 0.012972929514944553] tag messed up: cathegory(parent) label, softmax, ILP : 15 1 1 cathegory(parent) label, softmax, ILP : reptiles fish fish cathegory(parent) label, softmax, ILP : 0.08374498784542084 0.7589447498321533 0.7589447498321533 tag(child) label, softmax, ILP : 93 93 73 tag(child) label, softmax, ILP : turtle turtle shark tag(child) label, softmax, ILP : 0.31944289803504944 0.31944289803504944 0.13699352741241455 probability of parents of tag(child) label, softmax, ILP : 0.08374498784542084 0.08374498784542084 0.7589447498321533 names of the children of softmax parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of softmax parent: [0.059168923646211624, 0.10357433557510376, 0.13699352741241455, 0.011588215827941895, 0.09008067101240158] names of the children of ILP parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of ILP parent: [0.059168923646211624, 0.10357433557510376, 0.13699352741241455, 0.011588215827941895, 0.09008067101240158] tag messed up: cathegory(parent) label, softmax, ILP : 18 6 6 cathegory(parent) label, softmax, ILP : vehicles1 householdfurniture householdfurniture cathegory(parent) label, softmax, ILP : 0.08389513939619064 0.9157003164291382 0.9157003164291382 tag(child) label, softmax, ILP : 58 58 5 tag(child) label, softmax, ILP : pickuptruck pickuptruck bed tag(child) label, softmax, ILP : 0.4110468029975891 0.4110468029975891 0.30559197068214417 probability of parents of tag(child) label, softmax, ILP : 0.08389513939619064 0.08389513939619064 0.9157003164291382 names of the children of softmax parent: ['table', 'wardrobe', 'bed', 'chair', 'couch'] Probabilities of the children of softmax parent: [0.002151734661310911, 0.00048481274279765785, 0.30559197068214417, 0.0017977626994252205, 0.25419336557388306] names of the children of ILP parent: ['table', 'wardrobe', 'bed', 'chair', 'couch'] Probabilities of the children of ILP parent: [0.002151734661310911, 0.00048481274279765785, 0.30559197068214417, 0.0017977626994252205, 0.25419336557388306] cathegory improved cathegory(parent) label, softmax, ILP : 4 5 4 cathegory(parent) label, softmax, ILP : fruitandvegetables householdelectricaldevices fruitandvegetables cathegory(parent) label, softmax, ILP : 0.3813939392566681 0.4303678870201111 0.3813939392566681 tag(child) label, softmax, ILP : 57 57 57 tag(child) label, softmax, ILP : pear pear pear tag(child) label, softmax, ILP : 0.738638162612915 0.738638162612915 0.738638162612915 probability of parents of tag(child) label, softmax, ILP : 0.3813939392566681 0.3813939392566681 0.3813939392566681 names of the children of softmax parent: ['lamp', 'telephone', 'keyboard', 'television', 'clock'] Probabilities of the children of softmax parent: [0.00014490049215964973, 7.679536793148145e-05, 7.956597983138636e-05, 0.0075968969613313675, 0.000626965775154531] names of the children of ILP parent: ['mushroom', 'sweetpepper', 'pear', 'orange', 'apple'] Probabilities of the children of ILP parent: [0.0001345112978015095, 5.330032581696287e-05, 0.738638162612915, 0.0002856272622011602, 0.01754172518849373] cathegory improved cathegory(parent) label, softmax, ILP : 11 16 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores smallmammals largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.2879009246826172 0.5918319821357727 0.2879009246826172 tag(child) label, softmax, ILP : 21 21 21 tag(child) label, softmax, ILP : chimpanzee chimpanzee chimpanzee tag(child) label, softmax, ILP : 0.6603975296020508 0.6603975296020508 0.6603975296020508 probability of parents of tag(child) label, softmax, ILP : 0.2879009246826172 0.2879009246826172 0.2879009246826172 names of the children of softmax parent: ['rabbit', 'hamster', 'mouse', 'squirrel', 'shrew'] Probabilities of the children of softmax parent: [0.01623845100402832, 0.20201370120048523, 0.034108202904462814, 0.009595617651939392, 0.0007675542146898806] names of the children of ILP parent: ['cattle', 'kangaroo', 'chimpanzee', 'elephant', 'camel'] Probabilities of the children of ILP parent: [0.0032473010942339897, 0.00024319166550412774, 0.6603975296020508, 0.0003842694859486073, 0.00023537754896096885] cathegory improved cathegory(parent) label, softmax, ILP : 9 13 9 cathegory(parent) label, softmax, ILP : largeman-madeoutdoorthings non-insectinvertebrates largeman-madeoutdoorthings cathegory(parent) label, softmax, ILP : 0.0634206235408783 0.8034175038337708 0.0634206235408783 tag(child) label, softmax, ILP : 76 76 76 tag(child) label, softmax, ILP : skyscraper skyscraper skyscraper tag(child) label, softmax, ILP : 0.9585952758789062 0.9585952758789062 0.9585952758789062 probability of parents of tag(child) label, softmax, ILP : 0.0634206235408783 0.0634206235408783 0.0634206235408783 names of the children of softmax parent: ['lobster', 'crab', 'snail', 'worm', 'spider'] Probabilities of the children of softmax parent: [5.068417522124946e-05, 0.00203201686963439, 2.7121292077936232e-05, 0.02463694103062153, 0.0007709558121860027] names of the children of ILP parent: ['house', 'castle', 'skyscraper', 'bridge', 'road'] Probabilities of the children of ILP parent: [5.099396275909385e-06, 1.659527697484009e-06, 0.9585952758789062, 0.00040915136924013495, 0.0002954610390588641] cathegory improved cathegory(parent) label, softmax, ILP : 11 19 11 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores vehicles2 largeomnivoresandherbivores cathegory(parent) label, softmax, ILP : 0.15478438138961792 0.4795268774032593 0.15478438138961792 tag(child) label, softmax, ILP : 19 19 19 tag(child) label, softmax, ILP : cattle cattle cattle tag(child) label, softmax, ILP : 0.5523293018341064 0.5523293018341064 0.5523293018341064 probability of parents of tag(child) label, softmax, ILP : 0.15478438138961792 0.15478438138961792 0.15478438138961792 names of the children of softmax parent: ['streetcar', 'tank', 'tractor', 'lawnmower', 'rocket'] Probabilities of the children of softmax parent: [7.666921010240912e-05, 0.010406417772173882, 0.2177872210741043, 0.1391446888446808, 0.0002200309099862352] names of the children of ILP parent: ['cattle', 'kangaroo', 'chimpanzee', 'elephant', 'camel'] Probabilities of the children of ILP parent: [0.5523293018341064, 0.0015387912280857563, 8.146747859427705e-06, 0.00016900902846828103, 0.0014273968990892172] tag messed up: cathegory(parent) label, softmax, ILP : 2 1 1 cathegory(parent) label, softmax, ILP : flowers fish fish cathegory(parent) label, softmax, ILP : 0.25430577993392944 0.7447871565818787 0.7447871565818787 tag(child) label, softmax, ILP : 70 70 32 tag(child) label, softmax, ILP : rose rose flatfish tag(child) label, softmax, ILP : 0.49533140659332275 0.49533140659332275 0.07496422529220581 probability of parents of tag(child) label, softmax, ILP : 0.25430577993392944 0.25430577993392944 0.7447871565818787 names of the children of softmax parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of softmax parent: [0.00032294285483658314, 0.07237144559621811, 2.229586425528396e-05, 0.07496422529220581, 0.00010424971696920693] names of the children of ILP parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of ILP parent: [0.00032294285483658314, 0.07237144559621811, 2.229586425528396e-05, 0.07496422529220581, 0.00010424971696920693] tag improved: cathegory(parent) label, softmax, ILP : 1 1 1 cathegory(parent) label, softmax, ILP : fish fish fish cathegory(parent) label, softmax, ILP : 0.8899315595626831 0.8899315595626831 0.8899315595626831 tag(child) label, softmax, ILP : 1 4 1 tag(child) label, softmax, ILP : aquariumfish beaver aquariumfish tag(child) label, softmax, ILP : 0.4217182993888855 0.4408574402332306 0.4217182993888855 probability of parents of tag(child) label, softmax, ILP : 0.8899315595626831 0.1100473552942276 0.8899315595626831 names of the children of softmax parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of softmax parent: [0.032324593514204025, 0.4217182993888855, 0.011831238865852356, 0.02162722311913967, 1.8940183508675545e-05] names of the children of ILP parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of ILP parent: [0.032324593514204025, 0.4217182993888855, 0.011831238865852356, 0.02162722311913967, 1.8940183508675545e-05] tag improved: cathegory(parent) label, softmax, ILP : 18 18 18 cathegory(parent) label, softmax, ILP : vehicles1 vehicles1 vehicles1 cathegory(parent) label, softmax, ILP : 0.6327471733093262 0.6327471733093262 0.6327471733093262 tag(child) label, softmax, ILP : 8 27 8 tag(child) label, softmax, ILP : bicycle crocodile bicycle tag(child) label, softmax, ILP : 0.13731496036052704 0.47035831212997437 0.13731496036052704 probability of parents of tag(child) label, softmax, ILP : 0.6327471733093262 0.09855848550796509 0.6327471733093262 names of the children of softmax parent: ['bus', 'train', 'pickuptruck', 'bicycle', 'motorcycle'] Probabilities of the children of softmax parent: [0.03493904694914818, 0.011944594793021679, 0.0023635574616491795, 0.13731496036052704, 0.00018248599371872842] names of the children of ILP parent: ['bus', 'train', 'pickuptruck', 'bicycle', 'motorcycle'] Probabilities of the children of ILP parent: [0.03493904694914818, 0.011944594793021679, 0.0023635574616491795, 0.13731496036052704, 0.00018248599371872842] cathegory messed up: cathegory(parent) label, softmax, ILP : 2 2 1 cathegory(parent) label, softmax, ILP : flowers flowers fish cathegory(parent) label, softmax, ILP : 0.5239618420600891 0.5239618420600891 0.47446826100349426 tag(child) label, softmax, ILP : 54 1 1 tag(child) label, softmax, ILP : orchid aquariumfish aquariumfish tag(child) label, softmax, ILP : 0.024503447115421295 0.9587657451629639 0.9587657451629639 probability of parents of tag(child) label, softmax, ILP : 0.5239618420600891 0.47446826100349426 0.47446826100349426 names of the children of softmax parent: ['orchid', 'poppy', 'rose', 'sunflower', 'tulip'] Probabilities of the children of softmax parent: [0.024503447115421295, 0.012938098981976509, 0.0022943061776459217, 3.935130371246487e-05, 0.00026803096989169717] names of the children of ILP parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of ILP parent: [0.00018848209583666176, 0.9587657451629639, 7.201094558695331e-05, 0.00014215291594155133, 0.00020450817828532308] tag messed up: cathegory(parent) label, softmax, ILP : 10 16 16 cathegory(parent) label, softmax, ILP : largenaturaloutdoorscenes smallmammals smallmammals cathegory(parent) label, softmax, ILP : 0.14418943226337433 0.23534990847110748 0.23534990847110748 tag(child) label, softmax, ILP : 49 49 50 tag(child) label, softmax, ILP : mountain mountain mouse tag(child) label, softmax, ILP : 0.17923873662948608 0.17923873662948608 0.09510178864002228 probability of parents of tag(child) label, softmax, ILP : 0.14418943226337433 0.14418943226337433 0.23534990847110748 names of the children of softmax parent: ['rabbit', 'hamster', 'mouse', 'squirrel', 'shrew'] Probabilities of the children of softmax parent: [0.013296183198690414, 0.0006446148036047816, 0.09510178864002228, 0.017866099253296852, 0.057710837572813034] names of the children of ILP parent: ['rabbit', 'hamster', 'mouse', 'squirrel', 'shrew'] Probabilities of the children of ILP parent: [0.013296183198690414, 0.0006446148036047816, 0.09510178864002228, 0.017866099253296852, 0.057710837572813034] tag improved: cathegory(parent) label, softmax, ILP : 17 11 17 cathegory(parent) label, softmax, ILP : trees largeomnivoresandherbivores trees cathegory(parent) label, softmax, ILP : 0.25551578402519226 0.26336902379989624 0.25551578402519226 tag(child) label, softmax, ILP : 59 74 59 tag(child) label, softmax, ILP : pinetree shrew pinetree tag(child) label, softmax, ILP : 0.1184447854757309 0.1453801542520523 0.1184447854757309 probability of parents of tag(child) label, softmax, ILP : 0.25551578402519226 0.06650864332914352 0.25551578402519226 names of the children of softmax parent: ['cattle', 'kangaroo', 'chimpanzee', 'elephant', 'camel'] Probabilities of the children of softmax parent: [0.0872073769569397, 0.02670782059431076, 0.04582154005765915, 0.07444421947002411, 0.005365992896258831] names of the children of ILP parent: ['pinetree', 'willowtree', 'mapletree', 'oaktree', 'palmtree'] Probabilities of the children of ILP parent: [0.1184447854757309, 0.06957066059112549, 0.0034374415408819914, 0.019017240032553673, 0.00962323509156704] tag improved: cathegory(parent) label, softmax, ILP : 13 13 13 cathegory(parent) label, softmax, ILP : non-insectinvertebrates non-insectinvertebrates non-insectinvertebrates cathegory(parent) label, softmax, ILP : 0.6172020435333252 0.6172020435333252 0.6172020435333252 tag(child) label, softmax, ILP : 79 97 79 tag(child) label, softmax, ILP : spider wolf spider tag(child) label, softmax, ILP : 0.298886239528656 0.6526738405227661 0.298886239528656 probability of parents of tag(child) label, softmax, ILP : 0.6172020435333252 0.22125305235385895 0.6172020435333252 names of the children of softmax parent: ['lobster', 'crab', 'snail', 'worm', 'spider'] Probabilities of the children of softmax parent: [0.012439937330782413, 9.310503810411319e-05, 0.00010423521598568186, 0.00013402855256572366, 0.298886239528656] names of the children of ILP parent: ['lobster', 'crab', 'snail', 'worm', 'spider'] Probabilities of the children of ILP parent: [0.012439937330782413, 9.310503810411319e-05, 0.00010423521598568186, 0.00013402855256572366, 0.298886239528656] cathegory messed up: cathegory(parent) label, softmax, ILP : 12 12 15 cathegory(parent) label, softmax, ILP : mediummammals mediummammals reptiles cathegory(parent) label, softmax, ILP : 0.7077174782752991 0.7077174782752991 0.20306578278541565 tag(child) label, softmax, ILP : 34 29 29 tag(child) label, softmax, ILP : fox dinosaur dinosaur tag(child) label, softmax, ILP : 0.08149443566799164 0.653383731842041 0.653383731842041 probability of parents of tag(child) label, softmax, ILP : 0.7077174782752991 0.20306578278541565 0.20306578278541565 names of the children of softmax parent: ['porcupine', 'raccoon', 'possum', 'fox', 'skunk'] Probabilities of the children of softmax parent: [0.006172104738652706, 0.05622915178537369, 0.05002302676439285, 0.08149443566799164, 4.144652120885439e-05] names of the children of ILP parent: ['dinosaur', 'lizard', 'snake', 'crocodile', 'turtle'] Probabilities of the children of ILP parent: [0.653383731842041, 0.0015978495357558131, 9.017312549985945e-05, 0.0006822605500929058, 0.000968168256804347] tag improved: cathegory(parent) label, softmax, ILP : 4 4 4 cathegory(parent) label, softmax, ILP : fruitandvegetables fruitandvegetables fruitandvegetables cathegory(parent) label, softmax, ILP : 0.7319121360778809 0.7319121360778809 0.7319121360778809 tag(child) label, softmax, ILP : 53 62 53 tag(child) label, softmax, ILP : orange poppy orange tag(child) label, softmax, ILP : 0.18623663485050201 0.6353667378425598 0.18623663485050201 probability of parents of tag(child) label, softmax, ILP : 0.7319121360778809 0.26808395981788635 0.7319121360778809 names of the children of softmax parent: ['mushroom', 'sweetpepper', 'pear', 'orange', 'apple'] Probabilities of the children of softmax parent: [0.0005272523849271238, 0.05545232445001602, 0.0013741161674261093, 0.18623663485050201, 0.004551070276647806] names of the children of ILP parent: ['mushroom', 'sweetpepper', 'pear', 'orange', 'apple'] Probabilities of the children of ILP parent: [0.0005272523849271238, 0.05545232445001602, 0.0013741161674261093, 0.18623663485050201, 0.004551070276647806] cathegory messed up: cathegory(parent) label, softmax, ILP : 16 16 7 cathegory(parent) label, softmax, ILP : smallmammals smallmammals insects cathegory(parent) label, softmax, ILP : 0.5771759152412415 0.5771759152412415 0.39261677861213684 tag(child) label, softmax, ILP : 80 7 7 tag(child) label, softmax, ILP : squirrel beetle beetle tag(child) label, softmax, ILP : 0.03393062949180603 0.7525262236595154 0.7525262236595154 probability of parents of tag(child) label, softmax, ILP : 0.5771759152412415 0.39261677861213684 0.39261677861213684 names of the children of softmax parent: ['rabbit', 'hamster', 'mouse', 'squirrel', 'shrew'] Probabilities of the children of softmax parent: [0.03669155389070511, 0.00024109880905598402, 0.010967067442834377, 0.03393062949180603, 0.040865764021873474] names of the children of ILP parent: ['bee', 'butterfly', 'beetle', 'caterpillar', 'cockroach'] Probabilities of the children of ILP parent: [0.001634058658964932, 0.0024912685621529818, 0.7525262236595154, 0.0011975184315815568, 0.004540649242699146] cathegory messed up: cathegory(parent) label, softmax, ILP : 1 1 0 cathegory(parent) label, softmax, ILP : fish fish aquaticmammals cathegory(parent) label, softmax, ILP : 0.4652025103569031 0.4652025103569031 0.3317219316959381 tag(child) label, softmax, ILP : 32 72 72 tag(child) label, softmax, ILP : flatfish seal seal tag(child) label, softmax, ILP : 0.050320688635110855 0.2775064706802368 0.2775064706802368 probability of parents of tag(child) label, softmax, ILP : 0.4652025103569031 0.3317219316959381 0.3317219316959381 names of the children of softmax parent: ['trout', 'aquariumfish', 'shark', 'flatfish', 'ray'] Probabilities of the children of softmax parent: [0.015840867534279823, 0.021271144971251488, 0.12831909954547882, 0.050320688635110855, 0.06783811748027802] names of the children of ILP parent: ['dolphin', 'whale', 'otter', 'beaver', 'seal'] Probabilities of the children of ILP parent: [0.0031715785153210163, 0.0011749186087399721, 0.03466616943478584, 0.13701461255550385, 0.2775064706802368] cathegory messed up: cathegory(parent) label, softmax, ILP : 11 11 16 cathegory(parent) label, softmax, ILP : largeomnivoresandherbivores largeomnivoresandherbivores smallmammals cathegory(parent) label, softmax, ILP : 0.6030680537223816 0.6030680537223816 0.3779529631137848 tag(child) label, softmax, ILP : 21 80 80 tag(child) label, softmax, ILP : chimpanzee squirrel squirrel tag(child) label, softmax, ILP : 0.0006436239928007126 0.9556251168251038 0.9556251168251038 probability of parents of tag(child) label, softmax, ILP : 0.6030680537223816 0.3779529631137848 0.3779529631137848 names of the children of softmax parent: ['cattle', 'kangaroo', 'chimpanzee', 'elephant', 'camel'] Probabilities of the children of softmax parent: [0.003427318297326565, 0.0258072167634964, 0.0006436239928007126, 1.5184502444753889e-05, 0.0016269168118014932] names of the children of ILP parent: ['rabbit', 'hamster', 'mouse', 'squirrel', 'shrew'] Probabilities of the children of ILP parent: [0.002873978577554226, 9.656989277573302e-05, 0.0011560798157006502, 0.9556251168251038, 0.0005451130564324558]

[auszok]

I am getting this error when trying to run main in CIFAR100

Traceback (most recent call last): File "C:\Users\auszok\scoop\apps\python\current\lib\runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\auszok\scoop\apps\python\current\lib\runpy.py", line 87, in _run_code exec(code, runglobals) File "C:\Users\auszok\git\RelationalGraph\examples\CIFAR100\main.py", line 267, in main() File "C:\Users\auszok\git\RelationalGraph\examples\CIFAR100\main.py", line 170, in main program.load(args.namesave + "" + str(args.epochs)) File "C:\Users\auszok\git\RelationalGraph\regr\program\program.py", line 338, in load self.model.load_state_dict(torch.load(path, **kwargs)) File "C:\Users\auszok\scoop\apps\python\current\lib\site-packages\torch\serialization.py", line 579, in load with _open_file_like(f, 'rb') as opened_file: File "C:\Users\auszok\scoop\apps\python\current\lib\site-packages\torch\serialization.py", line 230, in _open_file_like return _open_file(name_or_buffer, mode) File "C:\Users\auszok\scoop\apps\python\current\lib\site-packages\torch\serialization.py", line 211, in init super(_open_file, self).init(open(name, mode)) FileNotFoundError: [Errno 2] No such file or directory: 'modelname_2'

[kordjamshidi]

This seems to be an open/upload file error (?). Is it hard to find the source of the error? @auszok Do you need a specific output report from @AdmiralDarius to be able to debug and fix this issue?

[auszok]

@AdmiralDarius You constraints definition was not correct.

The variable x was used for all elements in the constraints so all elements had the same candidates.

The easiest is not use variable name in the the constraints when not explicitly used and the system will assign unique viable and generate candidates specific to the current element concept.

If you want to use explicit variable name you have to make that they are only the same for the elements which you want to have the same set of candidates otherwise that have to be unique for the lc elements.

[kordjamshidi]

Thank you @auszok for the fix. Does it make sense to add your points somewhere in the documentation for constraint definition and usage of variable naming?

[hfaghihi15]

Hi @auszok, I don't think the issue is the x because here all the candidates are actually supposed to be the same.

Can you explain how you verified that this change fixed the issue?

[hfaghihi15]

Additional information:

X is the image and the labels are different for the same image.

[auszok]

When x variable name was used for all elements of the constraints then they have the same set of ILP variables (the first usage of variable name x determined the set). When no variable names are used then a new variable name is created for each element of the constraints and the new set of ILP variable is collected based on the default set of data nodes candidates. If the variable names are to be used then they have to be different for each element of the constraint. See https://github.com/HLR/DomiKnowS/blob/develop/docs/developer/KNOWLEDGE.md#logical-constraints-lc

I verified the correct set of ILP variables for constraints by breakpoint in line 306 of logicalConstrain.py and inspecting contain of variable v.