# ImageNet (dataset)

ImageNet is a large hierarchical visual database with over 14 million hand-annotated images used for visual object recognition research, best known for the annual ImageNet Large Scale Visual Recognition Challenge (ILSVRC).

ImageNet is a large-scale visual database designed for use in visual object recognition software research. The project provides more than 14 million hand-annotated images indicating the objects pictured, with at least one million images also containing bounding boxes. It encompasses more than 20,000 categories, each typically containing several hundred images. The database of annotations for third-party image URLs is freely available, though the actual images are not owned by ImageNet. Since 2010, the project has run an annual software contest, the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), where programs compete to classify and detect objects and scenes using a trimmed list of one thousand non-overlapping classes.

## History

AI researcher Fei-Fei Li began developing the idea for ImageNet in 2006. At a time when most AI research focused on models and algorithms, Li aimed to expand and improve the data available for training AI algorithms. In 2007, Li met with Princeton professor Christiane Fellbaum, one of the creators of WordNet, to discuss the project. This meeting led Li to build ImageNet starting from the roughly 22,000 nouns of WordNet and adopting many of its features. She was also inspired by a 1987 estimate that the average person recognizes roughly 30,000 different kinds of objects.

As an assistant professor at Princeton, Li assembled a team of researchers to work on the project. They used Amazon Mechanical Turk to help classify images. Labeling started in July 2008 and ended in April 2010, involving 49,000 workers from 167 countries who filtered and labeled over 160 million candidate images. The budget allowed each of the 14 million images to be labeled three times. The original plan called for 10,000 images per category across 40,000 categories, totaling 400 million images, each verified three times. However, humans can classify at most 2 images per second, and at that rate it was estimated to take 19 human-years of labor without rest.

The database was first presented as a poster at the 2009 Conference on Computer Vision and Pattern Recognition (CVPR) in Florida, titled "ImageNet: A Preview of a Large-scale Hierarchical Dataset." In 2009, Alex Berg suggested adding object localization as a task. Li approached the PASCAL Visual Object Classes contest in 2009 for collaboration, which resulted in the ImageNet Large Scale Visual Recognition Challenge starting in 2010, featuring 1000 classes and object localization, compared to PASCAL VOC's 20 classes and 19,737 images.

## Significance for Deep Learning

On 30 September 2012, a convolutional neural network (CNN) called AlexNet achieved a top-5 error of 15.3% in the ImageNet 2012 Challenge, more than 10.8 percentage points lower than the runner-up. The use of graphics processing units (GPUs) during training made convolutional neural networks feasible, an essential ingredient of the [deep learning](https://www.wikiprompt.org/wiki/deep-learning) revolution. According to The Economist, "Suddenly people started to pay attention, not just within the AI community but across the technology industry as a whole."

In 2015, AlexNet was outperformed by Microsoft's very deep CNN with over 100 layers, which won the ImageNet 2015 contest with a 3.57% error rate on the test set. Andrej Karpathy estimated in 2014 that with concentrated effort, he could reach a 5.1% error rate, and about 10 people from his lab reached roughly 12-13% with less effort. It was estimated that with maximal effort, a human could reach 2.4%.

## Dataset

ImageNet crowdsources its annotation process. Image-level annotations indicate the presence or absence of an object class in an image, such as "there are tigers in this image" or "there are no tigers in this image." Object-level annotations provide a bounding box around the visible part of the indicated object. ImageNet uses a variant of the broad WordNet schema to categorize objects, augmented with 120 categories of dog breeds to showcase fine-grained classification.

In 2012, ImageNet was the world's largest academic user of Mechanical Turk, with the average worker identifying 50 images per minute. The original plan for the full ImageNet would have roughly 50 million clean, diverse, and full-resolution images spread over approximately 50,000 synsets, but this was not achieved. Summary statistics as of April 30, 2010 included 21,841 non-empty synsets, 14,197,122 total images, 1,034,908 images with bounding box annotations, 1,000 synsets with SIFT features, and 1.2 million images with SIFT features.

### Categories

The categories of ImageNet were filtered from WordNet concepts. Each concept, since it can contain multiple synonyms (for example, "kitty" and "young cat"), is called a "synonym set" or "synset." WordNet 3.0 has more than 100,000 synsets, the majority of which are nouns (over 80,000). ImageNet filtered these to 21,841 synsets that are countable nouns that can be visually illustrated. Each synset in WordNet 3.0 has a "WordNet ID" (wnid), a concatenation of part of speech and an offset. Every wnid starts with "n" because ImageNet only includes nouns; for example, the wnid for "dog, domestic dog, Canis familiaris" is "n02084071." The categories fall into 9 levels, from level 1 (such as "mammal") to level 9 (such as "German shepherd").

### Image Format

The images were scraped from online image search engines (Google, Picsearch, MSN, Yahoo, Flickr, etc.) using synonyms in multiple languages, such as "German shepherd," "German police dog," "Alsatian," "ovejero alemán," and "pastore tedesco." ImageNet consists of images in RGB format with varying resolutions; for example, in the ImageNet 2012 "fish" category, resolutions range from 4288 x 2848 to 75 x 56. In machine learning, these are typically preprocessed into a standard constant resolution and whitened before further processing by [neural networks](https://www.wikiprompt.org/wiki/neural-network). For instance, in PyTorch, ImageNet images are normalized by dividing pixel values to fall between 0 and 1, then subtracting [0.485, 0.456, 0.406], and dividing by [0.229, 0.224, 0.225], which are the mean and standard deviations for ImageNet.

### Labels and Annotations

Each image is labeled with exactly one wnid. Dense SIFT features (raw SIFT descriptors, quantized codewords, and coordinates) for ImageNet-1K were available for download, designed for bag-of-visual-words models. Bounding boxes were available for about 3,000 popular synsets, with an average of 150 images per synset. Additionally, some images have attribute annotations, and the dataset has been used extensively in [machine learning](https://www.wikiprompt.org/wiki/machine-learning) research, particularly for training and evaluating [artificial intelligence](https://www.wikiprompt.org/wiki/artificial-intelligence) models.

## Legacy and Impact

ImageNet has had a profound impact on the field of computer vision and [artificial intelligence](https://www.wikiprompt.org/wiki/artificial-intelligence). It provided a standardized benchmark that accelerated progress in object recognition and classification. The success of AlexNet in 2012 sparked the deep learning revolution, leading to widespread adoption of [deep learning](https://www.wikiprompt.org/wiki/deep-learning) techniques across various domains. ImageNet's hierarchical structure and large scale have also influenced the development of other datasets and the design of [transformer](https://www.wikiprompt.org/wiki/transformer)-based models, which later became foundational in [generative AI](https://www.wikiprompt.org/wiki/generative-ai) and [large language models](https://www.wikiprompt.org/wiki/large-language-model). The dataset remains a critical resource for training and evaluating visual recognition systems, and its legacy continues to shape AI research and applications.

---
Source: https://www.wikiprompt.org/wiki/imagenet-dataset
License: CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/)
Last updated: 2026-09-12T16:27:10.864582+00:00