Can not load robotics dataset

yepw commented 6 months ago

/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET

Short description Could not load robotics datasets such as berkeley_autolab_ur5

Environment information

Operating System: Ubuntu
Python version: 3.8
tensorflow-datasets/tfds-nightly version: nightly 4.9.2.dev202308090034
tensorflow/tf-nightly version: tensorflow 2.13.1
Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) ? Yes

Reproduction instructions

import tensorflow_datasets as tfds
import tensorflow as tf

tfds = tfds.load('berkeley_autolab_ur5')

Expected behavior It starts downloading the dataset.

Actual behavior

Traceback (most recent call last):
  File "dataset.py", line 11, in <module>
    tfds = tfds.load('berkeley_autolab_ur5')
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
    return function(*args, **kwargs)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 633, in load
    dbuilder = _fetch_builder(
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 488, in _fetch_builder
    return builder(name, data_dir=data_dir, try_gcs=try_gcs, **builder_kwargs)
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
    return function(*args, **kwargs)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 215, in builder
    raise not_found_error
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 196, in builder
    cls = builder_cls(str(name))
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 121, in builder_cls
    cls = registered.imported_builder_cls(str(ds_name))
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/registered.py", line 301, in imported_builder_cls
    raise DatasetNotFoundError(f'Dataset {name} not found.')
tensorflow_datasets.core.registered.DatasetNotFoundError: Dataset berkeley_autolab_ur5 not found.
Available datasets:
        - abstract_reasoning
        - accentdb
        - aeslc
        - aflw2k3d
        - ag_news_subset
        - ai2_arc
        ...
       - youtube_vis

Check that:
    - if dataset was added recently, it may only be available
      in `tfds-nightly`
    - the dataset name is spelled correctly
    - dataset class defines all base class abstract methods
    - the module defining the dataset class is imported

The builder directory /home/yepw/tensorflow_datasets/berkeley_autolab_ur5 doesn't contain any versions.
No builder could be found in the directory: /home/yepw/tensorflow_datasets for the builder: berkeley_autolab_ur5.
No registered data_dirs were found in:
        - /home/yepw/tensorflow_datasets

marcenacp commented 6 months ago

Hi @yepw, are you sure you use the latest version of TFDS? I could successfully start downloading the dataset with:

$ git clone git@github.com:tensorflow/datasets.git
$ cd datasets
$ pip install -e .
$ python -c "import tensorflow_datasets as tfds; tfds = tfds.load('berkeley_autolab_ur5')"
Downloading and preparing dataset Unknown size (download: Unknown size, generated: 76.39 GiB, total: 76.39 GiB) to /usr/local/google/home/pierremarcenac/tensorflow_datasets/berkeley_autolab_ur5/0.1.0...

marcenacp commented 6 months ago

Closing the PR, feel free to re-open if the problem persists. :)

yepw commented 5 months ago

Thanks, @marcenacp I was following the steps, but still having the same problem. I started everything from a new and clean conda environment.

This is strange, perhaps I am missing something. Other than import tensorflow_datasets as tfds;, do I need to import other libraries for robotics dataset?

Operating System: Ubuntu Python version: 3.10.14 tensorflow-datasets/tfds-nightly version: 4.9.4+nightly

Entire error

python -c "import tensorflow_datasets as tfds; tfds = tfds.load('berkeley_autolab_ur5')"

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/logging/__init__.py", line 168, in __call__
    return function(*args, **kwargs)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 643, in load
    dbuilder = _fetch_builder(
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 498, in _fetch_builder
    return builder(name, data_dir=data_dir, try_gcs=try_gcs, **builder_kwargs)
  File "/home/yeping/anaconda3/envs/py310/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/logging/__init__.py", line 168, in __call__
    return function(*args, **kwargs)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 225, in builder
    raise not_found_error
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 202, in builder
    cls = builder_cls(str(name))
  File "/home/yeping/anaconda3/envs/py310/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 124, in builder_cls
    cls = registered.imported_builder_cls(str(ds_name))
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/registered.py", line 296, in imported_builder_cls
    raise DatasetNotFoundError(f'Dataset {name} not found.')
tensorflow_datasets.core.registered.DatasetNotFoundError: Dataset berkeley_autolab_ur5 not found.
Available datasets:
    - abstract_reasoning
    - accentdb
    - aeslc
    - aflw2k3d
    - ag_news_subset
    - ai2_arc
    - ai2_arc_with_ir
    - amazon_us_reviews
    - anli
    - answer_equivalence
    - arc
    - asqa
    - asset
    - assin2
    - bair_robot_pushing_small
    - bccd
    - beans
    - bee_dataset
    - beir
    - big_patent
    - bigearthnet
    - billsum
    - binarized_mnist
    - binary_alpha_digits
    - ble_wind_field
    - blimp
    - booksum
    - bool_q
    - bot_adversarial_dialogue
    - bucc
    - caltech101
    - caltech_birds2010
    - caltech_birds2011
    - cardiotox
    - cars196
    - cassava
    - cats_vs_dogs
    - celeb_a
    - celeb_a_hq
    - chexpert
    - cifar10
    - cifar100
    - cifar100_n
    - cifar10_1
    - cifar10_corrupted
    - cifar10_h
    - cifar10_n
    - citrus_leaves
    - cityscapes
    - clevr
    - clic
    - cmaterdb
    - coco
    - coco_captions
    - coil100
    - colorectal_histology
    - colorectal_histology_large
    - common_voice
    - controlled_noisy_web_labels
    - corr2cause
    - crema_d
    - curated_breast_imaging_ddsm
    - cycle_gan
    - databricks_dolly
    - deep_weeds
    - dementiabank
    - diabetic_retinopathy_detection
    - dices
    - div2k
    - dmlab
    - domainnet
    - downsampled_imagenet
    - dsprites
    - dtd
    - duke_ultrasound
    - e2e_cleaned
    - efron_morris75
    - emnist
    - eurosat
    - fashion_mnist
    - flic
    - food101
    - fuss
    - geirhos_conflict_stimuli
    - groove
    - gtzan
    - gtzan_music_speech
    - horses_or_humans
    - i_naturalist2017
    - i_naturalist2018
    - i_naturalist2021
    - imagenet2012
    - imagenet2012_corrupted
    - imagenet2012_fewshot
    - imagenet2012_multilabel
    - imagenet2012_real
    - imagenet2012_subset
    - imagenet_a
    - imagenet_lt
    - imagenet_pi
    - imagenet_r
    - imagenet_resized
    - imagenet_sketch
    - imagenet_v2
    - imagenette
    - imagewang
    - imdb_reviews
    - irc_disentanglement
    - kddcup99
    - kitti
    - kmnist
    - lambada
    - lfw
    - librispeech
    - librispeech_lm
    - libritts
    - ljspeech
    - lm1b
    - lost_and_found
    - lsun
    - lvis
    - malaria
    - math_dataset
    - math_qa
    - mctaco
    - media_sum
    - mlqa
    - mnist
    - mnist_corrupted
    - natural_instructions
    - natural_questions
    - natural_questions_open
    - newsroom
    - nsynth
    - nyu_depth_v2
    - ogbg_molpcba
    - omniglot
    - open_images_challenge2019_detection
    - open_images_v4
    - openbookqa
    - opinion_abstracts
    - opinosis
    - opus
    - oxford_flowers102
    - oxford_iiit_pet
    - para_crawl
    - pass
    - patch_camelyon
    - paws_wiki
    - paws_x_wiki
    - penguins
    - pet_finder
    - pg19
    - piqa
    - places365_small
    - placesfull
    - plant_leaves
    - plant_village
    - plantae_k
    - protein_net
    - qa4mre
    - qasc
    - qm9
    - quac
    - quality
    - quickdraw_bitmap
    - race
    - radon
    - real_toxicity_prompts
    - reddit
    - reddit_disentanglement
    - reddit_tifu
    - ref_coco
    - resisc45
    - robomimic_mg
    - robomimic_mh
    - robomimic_ph
    - robonet
    - rock_paper_scissors
    - rock_you
    - s3o4d
    - salient_span_wikipedia
    - samsum
    - savee
    - scan
    - scene_parse150
    - schema_guided_dialogue
    - sci_tail
    - scicite
    - scientific_papers
    - segment_anything
    - sentiment140
    - shapes3d
    - sift1m
    - simpte
    - siscore
    - smallnorb
    - smartwatch_gestures
    - snli
    - so2sat
    - speech_commands
    - spoken_digit
    - squad
    - stanford_dogs
    - stanford_online_products
    - star_cfq
    - starcraft_video
    - stl10
    - story_cloze
    - summscreen
    - sun397
    - svhn_cropped
    - symmetric_solids
    - tatoeba
    - ted_hrlr_translate
    - ted_multi_translate
    - tedlium
    - tf_flowers
    - the300w_lp
    - tiny_shakespeare
    - titanic
    - trec
    - trivia_qa
    - uc_merced
    - universal_dependencies
    - user_libri_audio
    - vctk
    - visual_domain_decathlon
    - voc
    - voxceleb
    - voxforge
    - waymo_open_dataset
    - webvid
    - wider_face
    - xtreme_pos
    - xtreme_s
    - yes_no

Check that:
    - if dataset was added recently, it may only be available
      in `tfds-nightly`
    - the dataset name is spelled correctly
    - dataset class defines all base class abstract methods
    - the module defining the dataset class is imported

The builder directory /home/yeping/tensorflow_datasets/berkeley_autolab_ur5 doesn't contain any versions.
No builder could be found in the directory: /home/yeping/tensorflow_datasets for the builder: berkeley_autolab_ur5.
No registered data_dirs were found in:
    - /home/yeping/tensorflow_datasets

yepw commented 5 months ago

After updating Tensorflow, the error was fixed, but I encountered another error: https://github.com/tensorflow/datasets/issues/5360

tensorflow / datasets

Can not load robotics dataset #5295