tensorflow / datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
https://www.tensorflow.org/datasets
Apache License 2.0
4.28k stars 1.53k forks source link

[data request] LVIS #1073

Closed netw0rkf10w closed 3 years ago

netw0rkf10w commented 4 years ago

Folks who would also like to see this dataset in tensorflow/datasets, please thumbs-up so the developers can know which requests to prioritize.

And if you'd like to contribute the dataset (thank you!), see our guide to adding a dataset.

Player0109 commented 4 years ago

I am a deep learning enthusiast, so I want to work on this dataset. Can I do so? @netw0rkf10w

Marvin182 commented 3 years ago

LVIS is now included in TFDS. github.com/tensorflow/datasets/pull/2836

Conchylicultor commented 3 years ago

Thanks Marvin for your contribution! Closing this

XinyueZ commented 2 years ago

How to load this dataset, I still cannot see it in the tfds..... ? Fire errors with following, even tried !pip install tfds-nightly before running all imports. 😅

train_data, info = tfds.load('lvis', split='train', as_supervised=True, with_info=True)
validation_data = tfds.load('lvis', split='validation', as_supervised=True)
test_data = tfds.load('lvis', split='test', as_supervised=True)
Conchylicultor commented 2 years ago

What is the stacktrace ?

XinyueZ commented 2 years ago

What is the stacktrace ?

@Conchylicultor

---------------------------------------------------------------------------
NotFoundError                             Traceback (most recent call last)
/usr/local/lib/python3.7/dist-packages/tensorflow_datasets/core/utils/py_utils.py in try_reraise(*args, **kwargs)
    391   try:
--> 392     yield
    393   except Exception as e:  # pylint: disable=broad-except

15 frames
NotFoundError: /usr/local/lib/python3.7/dist-packages/tensorflow_datasets/object_detection/lvis/lvis_classes.txt; No such file or directory

The above exception was the direct cause of the following exception:

RuntimeError                              Traceback (most recent call last)
/usr/local/lib/python3.7/dist-packages/tensorflow_datasets/core/utils/py_utils.py in reraise(e, prefix, suffix)
    359     else:
    360       exception = RuntimeError(f'{type(e).__name__}: {msg}')
--> 361     raise exception from e
    362   # Otherwise, modify the exception in-place
    363   elif len(e.args) <= 1:

RuntimeError: NotFoundError: Failed to construct dataset lvis: /usr/local/lib/python3.7/dist-packages/tensorflow_datasets/object_detection/lvis/lvis_classes.txt; No such file or directory

Full code

import os
import tensorflow as tf

!pip install tfds-nightly
import tensorflow_datasets as tfds

train_data, info = tfds.load('lvis', split='train', as_supervised=True, with_info=True)
validation_data = tfds.load('lvis', split='validation', as_supervised=True)
test_data = tfds.load('lvis', split='test', as_supervised=True)

Or my approach is not correct ?