search

pytorch / vision

Datasets, Transforms and Models specific to Computer Vision
https://pytorch.org/vision
BSD 3-Clause "New" or "Revised" License
15.79k stars 6.89k forks source link

torchvision.datasets.Kinetics broken #6862

Open kyleliang919 opened 1 year ago

kyleliang919 commented 1 year ago

🐛 Describe the bug

from torchvision.datasets import Kinetics
dataset = Kinetics(root='./data/', frames_per_clip = 40, num_classes = '700', download = True)

error:

FileNotFoundError: Found no valid file for the classes acting_in_play, adjusting_glasses, air_drumming, alligator_wrestling, answering_questions, applying_cream, archaeological_excavation, arm_wrestling, arranging_flowers, assembling_bicycle, assembling_computer, attending_conference, baby_waking_up, backflip_human, baking_cookies, base_jumping, bathing_dog, battle_rope_training, bee_keeping, being_excited, being_in_zero_gravity, belly_dancing, bench_pressing, bending_back, bending_metal, biking_through_snow, blasting_sand, blending_fruit, blowdrying_hair, blowing_bubble_gum, blowing_glass, blowing_leaves, blowing_nose, blowing_out_candles, bouncing_ball_not_juggling, bouncing_on_bouncy_castle, bouncing_on_trampoline, braiding_hair, breading_or_breadcrumbing, breaking_boards, breaking_glass, breathing_fire, brush_painting, brushing_floor, brushing_hair, brushing_teeth, building_cabinet, building_lego, building_sandcastle, building_shed, bungee_jumping, canoeing_or_kayaking, card_stacking, card_throwing, carrying_baby, carrying_weight, carving_ice, carving_marble, carving_pumpkin, carving_wood_with_a_knife, casting_fishing_line, catching_fish, catching_or_throwing_baseball, catching_or_throwing_frisbee, catching_or_throwing_softball, changing_gear_in_car, changing_oil, changing_wheel_not_on_bike, checking_tires, checking_watch, chewing_gum, chiseling_stone, chiseling_wood, chopping_meat, chopping_wood, clam_digging, clay_pottery_making, clean_and_jerk, cleaning_gutters, cleaning_pool, cleaning_shoes, cleaning_toilet, cleaning_windows, climbing_a_rope, climbing_ladder, climbing_tree, closing_door, coloring_in, combing_hair, contact_juggling, cooking_chicken, cooking_egg, cooking_on_campfire, cooking_sausages_not_on_barbeque, cooking_scallops, counting_money, country_line_dancing, cracking_back, cracking_knuckles, cracking_neck, crawling_baby, crossing_eyes, crossing_river, curling_eyelashes, curling_hair, curling_sport, cutting_apple, cutting_cake, cutting_nails, cutting_orange, cutting_pineapple, cutting_watermelon, dancing_ballet, dancing_charleston, dancing_gangnam_style, dancing_macarena, dealing_cards, decorating_the_christmas_tree, delivering_mail, directing_traffic, disc_golfing, diving_cliff, docking_boat, doing_aerobics, doing_jigsaw_puzzle, doing_laundry, doing_nails, doing_sudoku, dribbling_basketball, drinking_shots, driving_car, driving_tractor, drop_kicking, drumming_fingers, dumpster_diving, dunking_basketball, dyeing_eyebrows, dyeing_hair, eating_burger, eating_cake, eating_carrots, eating_chips, eating_doughnuts, eating_hotdog, eating_ice_cream, eating_nachos, eating_spaghetti, eating_watermelon, egg_hunting, entering_church, exercising_arm, exercising_with_an_exercise_ball, extinguishing_fire, falling_off_bike, falling_off_chair, feeding_birds, feeding_fish, feeding_goats, fencing_sport, filling_cake, filling_eyebrows, finger_snapping, fixing_bicycle, fixing_hair, flint_knapping, flipping_bottle, flipping_pancake, fly_tying, flying_kite, folding_clothes, folding_napkins, folding_paper, front_raises, frying_vegetables, getting_a_haircut, getting_a_piercing, getting_a_tattoo, giving_or_receiving_award, gold_panning, golf_chipping, golf_driving, golf_putting, gospel_singing_in_church, grinding_meat, grooming_cat, grooming_dog, grooming_horse, gymnastics_tumbling, hammer_throw, hand_washing_clothes, head_stand, helmet_diving, herding_cattle, high_fiving, high_jump, high_kick, historical_reenactment, hitting_baseball, hockey_stop, holding_snake, home_roasting_coffee, hugging_baby, hugging_not_baby, hula_hooping, hurling_sport, ice_climbing, ice_fishing, ice_skating, ice_swimming, inflating_balloons, installing_carpet, ironing_hair, javelin_throw, juggling_balls, juggling_fire, juggling_soccer_ball, jumping_bicycle, jumping_into_pool, jumping_jacks, jumping_sofa, jumpstyle_dancing, kicking_field_goal, kicking_soccer_ball, land_sailing, lawn_mower_racing, laying_bricks, laying_concrete, laying_decking, laying_stone, laying_tiles, letting_go_of_balloon, lifting_hat, lighting_candle, lighting_fire, listening_with_headphones, lock_picking, long_jump, looking_at_phone, looking_in_mirror, making_a_cake, making_a_sandwich, making_balloon_shapes, making_bubbles, making_cheese, making_horseshoes, making_jewelry, making_latte_art, making_paper_aeroplanes, making_pizza, making_slime, making_snowman, making_sushi, making_tea, making_the_bed, marriage_proposal, massaging_back, massaging_feet, massaging_legs, massaging_neck, massaging_persons_head, metal_detecting, milking_cow, milking_goat, mixing_colours, moon_walking, mopping_floor, mosh_pit_dancing, mountain_climber_exercise, moving_baby, moving_child, moving_furniture, mowing_lawn, mushroom_foraging, needle_felting, news_anchoring, opening_bottle_not_wine, opening_coconuts, opening_door, opening_present, opening_refrigerator, opening_wine_bottle, passing_American_football_in_game, passing_American_football_not_in_game, passing_soccer_ball, peeling_apples, peeling_banana, peeling_potatoes, person_collecting_garbage, petting_animal_not_cat, petting_cat, petting_horse, picking_apples, picking_blueberries, pillow_fight, planing_wood, planting_trees, playing_accordion, playing_american_football, playing_badminton, playing_bagpipes, playing_basketball, playing_bass_guitar, playing_beer_pong, playing_billiards, playing_blackjack, playing_cards, playing_cello, playing_checkers, playing_chess, playing_clarinet, playing_controller, playing_cricket, playing_cymbals, playing_darts, playing_didgeridoo, playing_dominoes, playing_drums, playing_field_hockey, playing_flute, playing_gong, playing_guitar, playing_hand_clapping_games, playing_harmonica, playing_harp, playing_ice_hockey, playing_keyboard, playing_kickball, playing_laser_tag, playing_lute, playing_mahjong, playing_maracas, playing_marbles, playing_monopoly, playing_netball, playing_nose_flute, playing_oboe, playing_ocarina, playing_organ, playing_paintball, playing_pan_pipes, playing_piano, playing_piccolo, playing_pinball, playing_ping_pong, playing_poker, playing_polo, playing_recorder, playing_road_hockey, playing_rounders, playing_rubiks_cube, playing_saxophone, playing_scrabble, playing_shuffleboard, playing_slot_machine, playing_squash_or_racquetball, playing_tennis, playing_trombone, playing_trumpet, playing_ukulele, playing_violin, playing_volleyball, playing_with_trains, playing_xylophone, poaching_eggs, poking_bellybutton, pole_vault, polishing_furniture, polishing_metal, popping_balloons, pouring_beer, pouring_milk, pouring_wine, preparing_salad, presenting_weather_forecast, pretending_to_be_a_statue, pull_ups, pulling_espresso_shot, pulling_rope_game, pumping_fist, pumping_gas, punching_bag, punching_person_boxing, push_up, pushing_car, pushing_cart, pushing_wheelbarrow, pushing_wheelchair, putting_in_contact_lenses, putting_on_eyeliner, putting_on_foundation, putting_on_lipstick, putting_on_mascara, putting_on_sari, putting_on_shoes, putting_wallpaper_on_wall, raising_eyebrows, reading_book, reading_newspaper, recording_music, repairing_puncture, riding_a_bike, riding_camel, riding_elephant, riding_mechanical_bull, riding_mule, riding_or_walking_with_horse, riding_scooter, riding_snow_blower, riding_unicycle, ripping_paper, roasting_marshmallows, roasting_pig, robot_dancing, rock_climbing, rock_scissors_paper, roller_skating, rolling_eyes, rolling_pastry, rope_pushdown, running_on_treadmill, salsa_dancing, sanding_floor, sanding_wood, sausage_making, sawing_wood, scrambling_eggs, scrubbing_face, scuba_diving, seasoning_food, separating_eggs, setting_table, shaking_hands, shaking_head, shaping_bread_dough, sharpening_knives, sharpening_pencil, shaving_head, shaving_legs, shearing_sheep, shining_flashlight, shining_shoes, shoot_dance, shooting_basketball, shooting_goal_soccer, shooting_off_fireworks, shot_put, shoveling_snow, shredding_paper, shucking_oysters, shuffling_cards, shuffling_feet, side_kick, sign_language_interpreting, silent_disco, sipping_cup, ski_ballet, ski_jumping, skiing_crosscountry, skiing_mono, skiing_slalom, skipping_rope, skipping_stone, sled_dog_racing, slicing_onion, smelling_feet, smoking_hookah, smoking_pipe, snatch_weight_lifting, spinning_plates, spinning_poi, splashing_water, spray_painting, springboard_diving, square_dancing, squeezing_orange, stacking_cups, stacking_dice, standing_on_hands, steer_roping, steering_car, sticking_tongue_out, stomping_grapes, stretching_arm, stretching_leg, sucking_lolly, surfing_crowd, surfing_water, sweeping_floor, swimming_backstroke, swimming_breast_stroke, swimming_butterfly_stroke, swimming_front_crawl, swimming_with_dolphins, swimming_with_sharks, swing_dancing, swinging_baseball_bat, swinging_on_something, sword_fighting, sword_swallowing, tagging_graffiti, tai_chi, taking_photo, talking_on_cell_phone, tango_dancing, tap_dancing, tapping_guitar, tapping_pen, tasting_beer, tasting_food, tasting_wine, threading_needle, throwing_axe, throwing_ball_not_baseball_or_American_football, throwing_discus, throwing_knife, throwing_snowballs, throwing_tantrum, throwing_water_balloon, tie_dying, tightrope_walking, tossing_coin, tossing_salad, training_dog, treating_wood, trimming_or_shaving_beard, trimming_shrubs, trimming_trees, triple_jump, twiddling_fingers, tying_bow_tie, tying_knot_not_on_a_tie, tying_necktie, tying_shoe_laces, uncorking_champagne, unloading_truck, using_a_microscope, using_a_paint_roller, using_a_power_drill, using_a_sledge_hammer, using_a_wrench, using_atm, using_bagging_machine, using_circular_saw, using_inhaler, using_megaphone, using_puppets, using_remote_controller_not_gaming, using_segway, vacuuming_car, vacuuming_floor, visiting_the_zoo, wading_through_mud, wading_through_water, waiting_in_line, waking_up, walking_on_stilts, walking_the_dog, walking_through_snow, walking_with_crutches, washing_dishes, washing_feet, washing_hair, washing_hands, watching_tv, water_skiing, water_sliding, watering_plants, waving_hand, waxing_armpits, waxing_back, waxing_chest, waxing_eyebrows, waxing_legs, weaving_basket, weaving_fabric, wood_burning_art, wrapping_present, yarn_spinning. Supported extensions are: avi, mp4

Versions

PyTorch version: 1.12.1+cu102 Is debug build: False CUDA used to build PyTorch: 10.2 ROCM used to build PyTorch: N/A

OS: Ubuntu 20.04.2 LTS (x86_64) GCC version: (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0 Clang version: Could not collect CMake version: version 3.16.3 Libc version: glibc-2.2.5

Python version: 3.7.6 (default, Feb 18 2020, 21:28:31) [GCC 9.3.0] (64-bit runtime) Python platform: Linux-5.4.0-70-generic-x86_64-with-debian-bullseye-sid Is CUDA available: True CUDA runtime version: Could not collect CUDA_MODULE_LOADING set to: GPU models and configuration: GPU 0: NVIDIA A100 80GB PCIe GPU 1: NVIDIA A100 80GB PCIe GPU 2: NVIDIA A100 80GB PCIe GPU 3: NVIDIA A100 80GB PCIe

Nvidia driver version: 510.47.03 cuDNN version: Could not collect HIP runtime version: N/A MIOpen runtime version: N/A Is XNNPACK available: True

Versions of relevant libraries: [pip3] numpy==1.21.4 [pip3] torch==1.12.1 [pip3] torchaudio==0.8.1 [pip3] torchvision==0.13.1 [conda] Could not collect

cc @pmeier

kyleliang919 commented 1 year ago

I believe this is due to something like a simlink not being setup properly automatically or folders not being renamed correctly in the script.

haosome6 commented 1 year ago

Did you solve this issue or find a way to avoid the error?

haosome6 commented 1 year ago

In my case, under the main data directory, each class in the error message has two directories, one contains videos, and another is empty. After I delete empty directories, the error is solved. But I got a new issue that loading the dataset will fail at the same point because of DataLoader worker fails.