TFDS now supports the Croissant 🥐 format! Read the documentation to know more.

open_images_v4

Description:

Open Images is a dataset of ~9M images that have been annotated with image-level labels and object bounding boxes.

The training set of V4 contains 14.6M bounding boxes for 600 object classes on 1.74M images, making it the largest existing dataset with object location annotations. The boxes have been largely manually drawn by professional annotators to ensure accuracy and consistency. The images are very diverse and often contain complex scenes with several objects (8.4 per image on average). Moreover, the dataset is annotated with image-level labels spanning thousands of classes.

Additional Documentation: Explore on Papers With Code
Homepage: https://storage.googleapis.com/openimages/web/index.html
Source code: tfds.datasets.open_images_v4.Builder
Versions:
- 2.0.0 (default): New split API (https://tensorflow.org/datasets/splits)
Download size: 565.11 GiB
Auto-cached (documentation): No
Splits:

Split	Examples
`'test'`	125,436
`'train'`	1,743,042
`'validation'`	41,620

Feature structure:

FeaturesDict({
    'bobjects': Sequence({
        'bbox': BBoxFeature(shape=(4,), dtype=float32),
        'is_depiction': int8,
        'is_group_of': int8,
        'is_inside': int8,
        'is_occluded': int8,
        'is_truncated': int8,
        'label': ClassLabel(shape=(), dtype=int64, num_classes=601),
        'source': ClassLabel(shape=(), dtype=int64, num_classes=6),
    }),
    'image': Image(shape=(None, None, 3), dtype=uint8),
    'image/filename': Text(shape=(), dtype=string),
    'objects': Sequence({
        'confidence': int32,
        'label': ClassLabel(shape=(), dtype=int64, num_classes=19995),
        'source': ClassLabel(shape=(), dtype=int64, num_classes=6),
    }),
    'objects_trainable': Sequence({
        'confidence': int32,
        'label': ClassLabel(shape=(), dtype=int64, num_classes=7186),
        'source': ClassLabel(shape=(), dtype=int64, num_classes=6),
    }),
})

Feature documentation:

Feature	Class	Shape	Dtype
	FeaturesDict
bobjects	Sequence
bobjects/bbox	BBoxFeature	(4,)	float32
bobjects/is_depiction	Tensor		int8
bobjects/is_group_of	Tensor		int8
bobjects/is_inside	Tensor		int8
bobjects/is_occluded	Tensor		int8
bobjects/is_truncated	Tensor		int8
bobjects/label	ClassLabel		int64
bobjects/source	ClassLabel		int64
image	Image	(None, None, 3)	uint8
image/filename	Text		string
objects	Sequence
objects/confidence	Tensor		int32
objects/label	ClassLabel		int64
objects/source	ClassLabel		int64
objects_trainable	Sequence
objects_trainable/confidence	Tensor		int32
objects_trainable/label	ClassLabel		int64
objects_trainable/source	ClassLabel		int64

Supervised keys (See as_supervised doc): None
Citation:

@article{OpenImages,
  author = {Alina Kuznetsova and
            Hassan Rom and
            Neil Alldrin and
            Jasper Uijlings and
            Ivan Krasin and
            Jordi Pont-Tuset and
            Shahab Kamali and
            Stefan Popov and
            Matteo Malloci and
            Tom Duerig and
            Vittorio Ferrari},
  title = {The Open Images Dataset V4: Unified image classification,
           object detection, and visual relationship detection at scale},
  year = {2018},
  journal = {arXiv:1811.00982}
}
@article{OpenImages2,
  author = {Krasin, Ivan and
            Duerig, Tom and
            Alldrin, Neil and
            Ferrari, Vittorio
            and Abu-El-Haija, Sami and
            Kuznetsova, Alina and
            Rom, Hassan and
            Uijlings, Jasper and
            Popov, Stefan and
            Kamali, Shahab and
            Malloci, Matteo and
            Pont-Tuset, Jordi and
            Veit, Andreas and
            Belongie, Serge and
            Gomes, Victor and
            Gupta, Abhinav and
            Sun, Chen and
            Chechik, Gal and
            Cai, David and
            Feng, Zheyun and
            Narayanan, Dhyanesh and
            Murphy, Kevin},
  title = {OpenImages: A public dataset for large-scale multi-label and
           multi-class image classification.},
  journal = {Dataset available from
             https://storage.googleapis.com/openimages/web/index.html},
  year={2017}
}