search

KichangKim / DeepDanbooru

AI based multi-label girl image classification system, implemented by using TensorFlow.
MIT License
2.58k stars 258 forks source link

Checkered pictures confuse the model #54

Open Aloxaf opened 2 years ago

Aloxaf commented 2 years ago

Example:

example

its tags ``` (0.981) 1girl (0.999) ! (0.969) !! (1.000) argyle (1.000) argyle_background (1.000) argyle_legwear (0.634) ball (0.674) bandaid (0.595) bandaid_on_arm (0.881) bat_print (0.554) bathtub (0.953) bishop_(chess) (0.872) blonde_hair (1.000) board_game (0.664) body_writing (1.000) checkerboard_cookie (1.000) checkered (1.000) checkered_background (1.000) checkered_flag (1.000) checkered_floor (1.000) checkered_kimono (1.000) checkered_legwear (0.899) checkered_neckwear (0.881) checkered_obi (1.000) checkered_scarf (1.000) checkered_shirt (1.000) checkered_skirt (0.633) cherry (1.000) chess_piece (0.935) clown (0.959) club_(shape) (0.789) cocktail_glass (0.994) cookie (0.999) copyright (0.990) cow_print (0.972) crystal (1.000) diamond_(shape) (0.730) dice (1.000) flag (0.976) floor (0.984) gohei (0.968) hairpods (0.811) halftone_background (1.000) holding_flag (0.973) holding_umbrella (0.890) jester_cap (1.000) king_(chess) (1.000) knight_(chess) (0.643) leopard_tail (0.956) on_floor (0.902) one_eye_closed (0.829) parasol (1.000) perspective (1.000) plaid_background (0.997) plaid_legwear (0.949) prison_clothes (0.983) queen_(chess) (1.000) race_queen (0.769) red_dress (0.933) red_eyes (0.681) red_footwear (0.556) red_nails (0.664) red_umbrella (0.994) reflection (0.970) reflective_floor (0.570) restroom (1.000) rook_(chess) (0.996) shide (0.706) shimenawa (0.573) shoes (0.618) short_sleeves (0.804) shower_(place) (0.852) side_ponytail (0.527) skull (0.624) smile (0.876) soccer (1.000) soccer_ball (0.944) solo (0.910) spade_(shape) (0.911) spoken_exclamation_mark (0.737) sticker (0.940) striped_tail (1.000) telstar (0.831) thighhighs (0.898) tiger (0.768) tiger_boy (0.836) tiger_ears (0.994) tiger_stripes (0.999) tiger_tail (1.000) tile_floor (1.000) tile_wall (1.000) tiles (0.885) torn_clothes (0.671) torn_dress (0.963) torn_legwear (0.730) torn_skirt (0.992) trading_card (0.998) umbrella (1.000) vanishing_point (0.578) wheel (0.997) wings (0.995) yagasuri (0.995) black_rock_shooter_(character) (0.926) female_saniwa_(touken_ranbu) (1.000) flandre_scarlet (0.996) himekaidou_hatate (0.988) kamado_tanjirou (0.998) motoori_kosuzu (0.998) ouma_kokichi (0.676) saniwa_(touken_ranbu) (0.796) rating:safe ```

An extreme example: photo_2022-02-10_22-29-47

its tags ``` (0.681) 0_0 (0.777) 1boy (1.000) 1girl (0.941) 2010 (1.000) 2021 (1.000) ! (1.000) !! (0.995) +++ (0.502) :> (0.732) =3 (0.995) ? (0.978) adapted_turret (0.693) after_anal (0.522) after_vaginal (0.996) afterimage (0.531) akeome (1.000) alice_(alice_in_wonderland)_(cosplay) (0.795) america (0.995) ammunition_belt (0.989) anchor_hair_ornament (0.690) anchor_print (0.544) angel_wings (0.966) animal_nose (0.668) anime_coloring (0.950) aqua_background (0.697) aqua_theme (1.000) argyle (1.000) argyle_background (1.000) argyle_legwear (0.987) arm_cannon (0.933) arm_grab (0.907) arm_guards (0.867) armband (0.992) armchair (0.581) back-seamed_legwear (0.990) backlighting (0.867) baggy_clothes (1.000) ball (0.954) bandeau (0.635) bangs (1.000) bat_print (0.996) bathroom (1.000) bathtub (0.556) bent_over (0.995) between_legs (0.974) biceps (0.813) big_belly (0.699) bikini (0.933) bikini_skirt (1.000) bishop_(chess) (0.690) black_cape (1.000) blanket (0.695) blindfold (0.994) blue_eyeshadow (1.000) blue_fire (0.998) blue_hairband (0.640) blue_theme (0.830) blunt_bangs (0.617) blush (1.000) board_game (0.583) book_stack (0.998) bookshelf (0.726) boots (0.674) bow_panties (0.507) bra (0.925) bra_lift (0.675) breast_bondage (0.948) breast_lift (0.992) breast_milk (0.511) breasts (0.590) brother_and_sister (0.993) brown_hair (0.688) bukkake (0.991) bun_cover (1.000) burger (0.999) button_gap (0.995) calico (0.688) cameltoe (0.722) cameo (0.995) camera_phone (0.996) camouflage_headwear (1.000) camouflage_pants (0.508) candy (0.978) candy_cane (0.981) candy_hair_ornament (0.552) capelet (1.000) card (0.556) casual_one-piece_swimsuit (0.610) cat_hat (0.936) cat_teaser (0.904) cephalopod_eyes (0.986) chained (0.972) chair (0.880) champagne (0.864) champion_uniform (1.000) chandelier (0.989) character_sheet (1.000) checkerboard_cookie (1.000) checkered (1.000) checkered_background (1.000) checkered_flag (1.000) checkered_floor (1.000) checkered_kimono (1.000) checkered_legwear (1.000) checkered_necktie (1.000) checkered_neckwear (1.000) checkered_obi (1.000) checkered_scarf (1.000) checkered_shirt (1.000) checkered_skirt (0.868) chef (1.000) cherry (0.998) cherry_blossoms (1.000) chess_piece (0.980) chibi (0.997) chibi_inset (1.000) chinese_zodiac (0.875) cleavage (0.954) clenched_hands (0.821) clock (0.589) clothed_male_nude_female (0.908) clothed_sex (0.764) clothes_tug (0.529) clothes_writing (0.553) clothing_cutout (1.000) clown (1.000) club_(shape) (1.000) cocktail_glass (0.947) collarbone (0.514) color_connection (1.000) color_guide (0.741) colored_inner_hair (0.999) colorful (1.000) combat_boots (0.999) company_name (1.000) compass (1.000) confetti (1.000) cookie (1.000) copyright (0.999) corded_phone (0.689) covered_nipples (1.000) cow (0.996) cow_ears (1.000) cow_girl (1.000) cow_print (0.895) cowboy_shot (0.936) creature (0.981) crescent_moon (0.943) cropped_jacket (0.934) cropped_legs (0.999) cross-laced_legwear (0.999) crossed_legs (1.000) crosswalk (0.982) crotch (0.999) crystal (0.999) cube (0.554) cutting_board (0.693) dappled_sunlight (0.973) dark (0.944) dark-skinned_female (1.000) deerstalker (0.974) denim_skirt (1.000) diamond_(shape) (1.000) diamond_(symbol) (1.000) dice (1.000) different_reflection (0.994) digital_dissolve (0.964) drawstring (0.995) dressing (0.764) drink (0.923) drunk (0.983) duffel_coat (1.000) elbow_rest (0.959) expressions (0.998) eyeball (0.894) eyebrows_behind_hair (0.924) eyeshadow (0.586) eyewear_on_head (0.925) facial_mark (0.896) facial_tattoo (0.993) fake_screenshot (0.962) father_and_son (0.707) female_orgasm (0.998) fish (1.000) flag (0.973) flaming_eye (1.000) floor (0.983) flower-shaped_pupils (0.811) foam (0.909) folding_fan (0.848) fox_shadow_puppet (1.000) frilled_bikini (0.989) frilled_bra (0.948) fucked_silly (0.784) fundoshi (0.623) furrowed_brow (1.000) gatling_gun (0.768) gekkoukan_high_school_uniform (0.561) girl_on_top (1.000) goblet (1.000) gohei (0.964) grabbing (1.000) green_hakama (0.999) grey-framed_eyewear (0.999) grey_sailor_collar (0.667) hair_between_eyes (0.989) hair_ornament (0.571) hair_ribbon (0.981) hair_spread_out (1.000) hairpods (0.630) hakama (0.545) half-closed_eyes (0.865) halftone (1.000) halftone_background (0.981) handjob (0.950) happy (0.650) hat (0.663) hat_feather (0.548) hat_ribbon (0.750) have_to_pee (0.972) head_back (0.982) head_chain (0.933) head_rest (0.999) headphones (0.812) heart_eyes (0.999) heart_lock_(kantai_collection) (0.934) heart_pasties (0.954) heart_tattoo (0.612) highleg_panties (0.783) holding_card (0.794) holding_dagger (1.000) holding_flag (0.943) holding_fork (0.975) honeycomb_background (1.000) houndstooth (0.991) humanoid_robot (0.957) indoors (0.875) infinity (1.000) jester_cap (0.958) jewelry (0.919) k/da_(league_of_legends) (0.926) katana (0.978) kerchief (0.889) keyboard_(instrument) (1.000) keystone (0.973) kinchaku (1.000) king_(chess) (0.977) kitchen (0.591) knees_to_chest (0.567) knees_up (1.000) knight_(chess) (0.821) kouhaku_nawa (0.999) large_bow (0.512) latex_bodysuit (0.978) leg_belt (1.000) leopard_ears (1.000) leopard_tail (0.901) licking_nipple (1.000) lifebuoy (0.601) light_bulb (0.861) light_particles (0.999) limited_palette (0.746) looking_to_the_side (0.582) low_ponytail (0.826) luggage (0.987) lying (0.999) machine_gun (0.905) makeup (0.703) map (0.943) marker_(medium) (0.953) mascara (0.963) mascot (0.850) mast (0.997) mechanical_tail (0.863) medium_breasts (1.000) meiji_schoolgirl_uniform (0.580) microskirt (0.844) miniskirt (0.999) mirror (0.524) moon (0.920) mop (0.920) motion_blur (0.975) motorcycle (0.570) mouse_ears (0.746) multicolored_background (0.951) multicolored_bow (0.807) multicolored_scarf (0.732) multiple_piercings (0.899) music (0.782) musical_note (0.939) navel_piercing (0.946) necktie_grab (0.897) neckwear_grab (0.998) nejiri_hachimaki (0.994) new_school_swimsuit (0.949) new_year (0.907) no_nose (0.966) nose_piercing (1.000) official_style (0.950) on_back (1.000) on_chair (1.000) on_floor (1.000) one-hour_drawing_challenge (1.000) oonusa (0.942) open_door (0.616) oral_invitation (0.801) orange_headwear (0.991) orange_legwear (0.974) orange_necktie (0.998) over_shoulder (0.949) overalls (0.996) overcoat (0.576) oversized_object (0.929) page_number (1.000) panda (0.976) paper_airplane (0.954) parody (0.608) partially_visible_vulva (1.000) pastel_colors (0.558) person_on_head (1.000) perspective (0.999) petals (1.000) picnic (0.995) picnic_basket (0.869) pillarboxed (0.590) pink_leotard (0.897) pink_neckerchief (0.987) pipe (1.000) pixel_art (1.000) pixelated (0.995) pixiv_id (1.000) plaid_background (1.000) plaid_legwear (0.998) plaid_pants (1.000) playboy_bunny (1.000) playing_card (0.864) playing_games (0.960) playing_instrument (0.980) pocky (0.999) pointy_footwear (1.000) poke_ball_symbol (1.000) poker_chip (1.000) pole_dancing (0.636) polka_dot_headwear (0.913) polka_dot_ribbon (0.972) popped_collar (1.000) pov_across_table (0.998) power_symbol (0.653) print_sarong (1.000) prison_clothes (0.674) product_placement (0.992) purple_shorts (1.000) queen_(chess) (0.985) rabbit_ears (0.982) raccoon_tail (1.000) race_queen (0.911) raimon_soccer_uniform (1.000) rainbow_background (0.945) reading (0.665) red_choker (0.764) red_coat (0.638) red_eyes (0.963) red_swimsuit (1.000) reflection (1.000) reflective_floor (1.000) restaurant (1.000) restroom (1.000) reverse_cowgirl_position (0.881) ribbed_sleeves (1.000) rising_sun (1.000) role_reversal (1.000) rook_(chess) (1.000) rope (0.865) rubbing_eyes (0.534) sailor_moon_redraw_challenge (0.958) sandals_removed (0.819) scar_on_forehead (0.999) scowl (0.961) scythe (0.542) see-through_silhouette (0.756) self_hug (0.997) shell_casing (1.000) shide (1.000) shimenawa (0.574) short_hair (0.904) short_ponytail (1.000) shower_(place) (0.609) shushing (1.000) side_braids (0.994) sideways (0.522) signature (0.800) single_bare_shoulder (1.000) skeleton (1.000) sketchbook (0.935) skull (0.943) sleeve_cuffs (0.944) smell (0.737) smile (1.000) soap_bottle (1.000) soccer (1.000) soccer_ball (0.986) soccer_uniform (0.989) solo (1.000) spade_(shape) (0.969) sparkle (0.990) speaker (0.651) splatter (1.000) spoken_exclamation_mark (0.972) spoken_sweatdrop (0.655) spread_legs (1.000) sticker (0.988) straitjacket (0.784) strapless_bikini (0.999) striped_hoodie (1.000) striped_scarf (1.000) striped_tail (0.999) stripper_pole (0.999) sweater_vest (0.981) sword_of_hisou (0.928) table (0.963) tablecloth (1.000) teardrop (0.649) teeth (0.992) television (1.000) telstar (0.983) testicles (1.000) tiger (1.000) tiger_boy (1.000) tiger_ears (1.000) tiger_girl (1.000) tiger_print (1.000) tiger_stripes (1.000) tiger_tail (1.000) tile_floor (1.000) tile_wall (1.000) tiles (0.874) tire (0.729) toilet (0.646) torn_cape (0.748) torogao (1.000) trading_card (0.546) traditional_media (0.992) traffic_cone (0.957) tree (0.905) trembling (0.891) triforce (0.981) two-tone_gloves (0.745) two-tone_hair (1.000) two-tone_legwear (0.984) unmoving_pattern (0.994) used_condom (1.000) vanishing_point (0.747) veins (0.971) veiny_penis (1.000) violin (1.000) voyakiloid (1.000) washing_machine (0.995) water (0.755) weibo_username (0.633) wet_clothes (0.998) wet_shirt (1.000) wheel (0.735) white_hairband (0.708) white_headwear (0.562) white_panties (0.898) white_skin (1.000) white_tiger (0.928) widescreen (1.000) window_shade (0.822) wings (1.000) yagasuri (1.000) year_of_the_ox (0.937) yellow_apron (0.999) yellow_bodysuit (0.587) yellow_hairband (0.995) yellow_wings (0.988) yin_yang (1.000) yokozuwari (0.599) zombie (0.939) admiral_(kancolle) (0.999) african_wild_dog_(kemono_friends) (1.000) akemi_homura (0.666) akiyama_yukari (1.000) akuma_homura (1.000) alice_(alice_in_wonderland) (0.607) arch_bishop_(ragnarok_online) (0.999) atago_(stunning_speedster)_(azur_lane) (0.675) barnaby_brooks_jr. (0.889) bb_(swimsuit_mooncancer)_(fate) (1.000) black_rock_shooter_(character) (0.637) bruno_buccellati (1.000) caesar_anthonio_zeppeli (0.672) celestia_ludenberg (0.992) common_raccoon_(kemono_friends) (1.000) dead_master (0.808) doremy_sweet (0.938) endou_mamoru (0.788) failure_penguin (0.991) fairy_(kancolle) (1.000) female_saniwa_(touken_ranbu) (0.918) fubuki_(kancolle) (0.943) futatsuiwa_mamizou (0.742) giorno_giovanna (1.000) gotland_(kancolle) (1.000) guido_mista (1.000) himekaidou_hatate (0.999) hinanawi_tenshi (0.992) i-class_destroyer (0.648) inaba_tewi (0.782) iris_(pokemon) (0.827) izayoi_sakuya (0.659) jonathan_joestar (1.000) joseph_joestar (0.693) joseph_joestar_(old) (0.953) joseph_joestar_(young) (1.000) kamado_tanjirou (0.624) kanzaki_ranko (0.745) kazami_yuuka_(pc-98) (0.913) keebo (0.984) kijin_seija (0.853) konno_junko (0.721) leon_(pokemon) (1.000) lum (0.535) megurine_luka (1.000) motoori_kosuzu (0.995) nakano_azusa (0.999) narukami_yuu (0.981) nazrin (1.000) nyarlathotep_(nyaruko-san) (0.773) oozora_subaru (1.000) ouma_kokichi (0.615) piers_(pokemon) (0.882) pramanix_(arknights) (1.000) saniwa_(touken_ranbu) (0.966) saria_(arknights) (0.901) snivy (1.000) strength_(black_rock_shooter) (0.675) tippy_(gochiusa) (0.978) tsuchinoko_(kemono_friends) (0.798) watanabe_you (1.000) white_rabbit_(alice_in_wonderland) (0.999) yowane_haku ```
KichangKim commented 2 years ago

Thanks for reporting. I found that latest model has some issues when estimating repeated patterns (like checker, polka dots). I will change loss function to focal loss for the next model (although I'm not sure the issue will be solved).

Aloxaf commented 2 years ago

Thanks for the great proejct :)