Datasets

9,767 machine learning datasets
🔔   Share your dataset with the ML community!
Filter by Modality
Texts 205 Images 73 Audio 18 Videos 18 Medical 14 Speech 14 3D 7 Graphs 5 LiDAR 4 Time series 4 Point cloud 3 3d meshes 2 Actions 2 Environment 2 Interactive 2 RGB Video 2 RGB-D 2 Tabular 2 Biomedical 1 Lyrics 1 MRI 1 Parallel 1 Ranking 1 Stereo 1 6D 0 Biology 0 Cad 0 Dialog 0 EEG 0 Financial 0 Hyperspectral images 0 Midi 0 Music 0 PSG 0 Physics 0 Replay data 0 Tables 0 Tracking 0 fMRI 0
Filter by Task
Question Answering 22 Language Modelling 15 Machine Translation 15 Reading Comprehension 14 Text Generation 14 Machine Reading Comprehension 10 Named Entity Recognition (NER) 10 Text Summarization 9 Scene Text Detection 8 Speech Recognition 8 Text Classification 8 Dialogue Generation 7 Image Classification 7 Natural Language Inference 7 Semantic Segmentation 7 Task-Oriented Dialogue Systems 7 Cross-Lingual Transfer 6 Sentiment Analysis 6 Chinese Named Entity Recognition 5 Domain Adaptation 5 Misinformation 5 Natural Language Understanding 5 Object Detection 5 Relation Extraction 5 SSTOD 5 Slot Filling 5 Translation 5 Word Embeddings 5 Chinese Reading Comprehension 4 Classification 4 Cloze (multi-choices) (Few-Shot) 4 Cloze (multi-choices) (One-Shot) 4 Cloze (multi-choices) (Zero-Shot) 4 Conversational Response Selection 4 Cross-Lingual NER 4 Data Augmentation 4 License Plate Detection 4 License Plate Recognition 4 Multi-Label Classification 4 Open-Domain Dialog 4 Optical Character Recognition (OCR) 4 Part-Of-Speech Tagging 4 Question Generation 4 Reading Comprehension (Few-Shot) 4 Reading Comprehension (One-Shot) 4 Reading Comprehension (Zero-Shot) 4 Style Transfer 4 Token Classification 4 Video Captioning 4 Visual Question Answering (VQA) 4 Abstractive Text Summarization 3 Chinese Word Segmentation 3 Code Generation 3 Coreference Resolution 3 Cross-Lingual Question Answering 3 Document Summarization 3 Entity Alignment 3 Fake News Detection 3 Food Recognition 3 Gesture Generation 3 Grammatical Error Correction 3 Image Generation 3 Instance Segmentation 3 Intent Detection 3 Link Prediction 3 Math Word Problem Solving 3 Mathematical Reasoning 3 Medical Image Segmentation 3 Multi-Task Learning 3 Neural Architecture Search 3 Open-Domain Question Answering 3 Pose Estimation 3 Scene Text Recognition 3 Semantic Similarity 3 Speaker Diarization 3 Visual Reasoning 3 Zero-Shot Cross-Lingual Transfer 3 Zero-Shot Learning 3 3D Lane Detection 2 Adversarial Robustness 2 Automatic Post-Editing 2 Chinese Sentence Pair Classification 2 Class-agnostic Object Detection 2 Computed Tomography (CT) 2 Conversational Response Generation 2 Cross-Lingual Natural Language Inference 2 Cross-Lingual POS Tagging 2 Cross-Modal Retrieval 2 Depth Estimation 2 Dialogue Understanding 2 Emotion Recognition 2 Emotion Recognition in Conversation 2 Entity Linking 2 Entity Typing 2 Event Detection 2 Event Extraction 2 FLUE 2 Hate Speech Detection 2 Image Captioning 2 Image Dehazing 2 Image Inpainting 2 Image Retrieval 2 Image Super-Resolution 2 Intent Classification 2 Knowledge Distillation 2 Knowledge Graphs 2 Language Identification 2 Max-Shot Cross-Lingual Visual Reasoning 2 Meta-Learning 2 Multi-Document Summarization 2 Multi-Person Pose Estimation 2 Multi-modal Entity Alignment 2 Multilingual Named Entity Recognition 2 Multimodal Emotion Recognition 2 Multiple-choice 2 Node Classification 2 Novel View Synthesis 2 Object Localization 2 Object Proposal Generation 2 Object Recognition 2 Panoptic Segmentation 2 Paraphrase Generation 2 Quantization 2 Real-Time Object Detection 2 Real-time Instance Segmentation 2 Recommendation Systems 2 Relation Classification 2 Robotic Grasping 2 Speaker Recognition 2 Speech Separation 2 Speech-to-Text Translation 2 Spelling Correction 2 Spoken Language Understanding 2 Text Matching 2 Text Spotting 2 Text-To-Speech Synthesis 2 Time Series Forecasting 2 Unsupervised Domain Adaptation 2 Vehicle Re-Identification 2 Visual Question Answering 2 Weakly Supervised Object Detection 2 Zero-Shot Composed Image Retrieval (ZS-CIR) 2 Zero-Shot Cross-Lingual Visual Reasoning 2 Zero-Shot Cross-Modal Retrieval 2 2D Object Detection 1 2D Semantic Segmentation 1 3D Anomaly Detection 1 3D Depth Estimation 1 3D Face Animation 1 3D Multi-Object Tracking 1 3D Multi-Person Pose Estimation 1 3D Multi-Person Pose Estimation (absolute) 1 3D Multi-Person Pose Estimation (root-relative) 1 3D Object Classification 1 3D Object Detection 1 3D Object Detection From Stereo Images 1 3D Object Recognition 1 3D Object Retrieval 1 3D Object Tracking 1 3D Point Cloud Classification 1 3D Point Cloud Data Augmentation 1 3D Point Cloud Linear Classification 1 3D Single Object Tracking 1 A-VB Culture 1 A-VB High 1 A-VB Two 1 Abusive Language 1 Action Recognition 1 Action Segmentation 1 Active Object Detection 1 Activeness Detection 1 Adversarial Defense 1 Age Estimation 1 Anchor link prediction 1 Anomaly Detection 1 Answer Generation 1 Arithmetic Reasoning 1 Aspect-Based Sentiment Analysis (ABSA) 1 Aspect-Category-Opinion-Sentiment Quadruple Extraction 1 Attribute 1 Audio Classification 1 Audio Source Separation 1 Audio-Visual Speech Recognition 1 Automatic Phoneme Recognition 1 Automatic Speech Recognition 1 Automatic Speech Recognition (ASR) 1 Autonomous Driving 1 Bias Detection 1 Binarization 1 Birds Eye View Object Detection 1 Box-supervised Instance Segmentation 1 Catalog Extraction 1 Causal Inference 1 Chinese Landscape Painting Generation 1 Citation Recommendation 1 Classification with Binary Neural Network 1 Clinical Concept Extraction 1 Code Search 1 Colon Cancer Detection In Confocal Laser Microscopy Images 1 Colorectal Gland Segmentation: 1 Colorectal Polyps Characterization 1 Common Sense Reasoning 1 Common Sense Reasoning (Few-Shot) 1 Common Sense Reasoning (One-Shot) 1 Common Sense Reasoning (Zero-Shot) 1 Complex Query Answering 1 Conditional Image Generation 1 Connective Detection 1 Conversational Sentiment Quadruple Extraction 1 Core Psychological Reasoning 1 Cross-Lingual ASR 1 Cross-Lingual Abstractive Summarization 1 Cross-Lingual Bitext Mining 1 Cross-Lingual Document Classification 1 Cross-Lingual Entity Linking 1 Cross-Lingual Paraphrase Identification 1 Cross-Lingual Sentiment Classification 1 Cross-lingual zero-shot dependency parsing 1 Cultural Vocal Bursts Intensity Prediction 1 Curved Text Detection 1 Decipherment 1 Dense Pixel Correspondence Estimation 1 Dependency Parsing 1 Depth Completion 1 Depth Prediction 1 Dialog Act Classification 1 Dialog Relation Extraction 1 Dialogue Act Classification 1 Dialogue State Tracking 1 Dimensionality Reduction 1 Discourse Parsing 1 Discourse Segmentation 1 Document AI 1 Document Classification 1 Document Level Machine Translation 1 Document Translation 1 Document-level Event Extraction 1 Domain Generalization 1 Egocentric Pose Estimation 1 Emotion-Cause Pair Extraction 1 Emotional Dialogue Acts 1 End-To-End Dialogue Modelling 1 Entity Disambiguation 1 Entity Resolution 1 Event data classification 1 Explainable Artificial Intelligence (XAI) 1 Explainable artificial intelligence 1 Explanation Generation 1 FG-1-PG-1 1 Face Age Editing 1 Face Generation 1 Face Swapping 1 Face Transfer 1 Feature Upsampling 1 Few Shot Open Set Object Detection 1 Few-Shot 3D Point Cloud Classification 1 Few-Shot Audio Classification 1 Few-Shot Image Classification 1 Few-Shot Learning 1 Few-Shot Object Detection 1 Few-Shot Point Cloud Classification 1 Few-shot NER 1 Fine-Grained Action Detection 1 Fine-Grained Image Recognition 1 Font Generation 1 Gaze Estimation 1 Generalized Zero-Shot Learning 1 Generalized Zero-Shot Object Detection 1 Genre classification 1 Gesture Recognition 1 Gloss-free Sign Language Translation 1 Grammatical Error Detection 1 Hallucination Evaluation 1 Handwritten Chinese Text Recognition 1 Histopathological Image Classification 1 Homography Estimation 1 Horizon Line Estimation 1 Image Classification with Differential Privacy 1 Image Clustering 1 Image Colorization 1 Image Compressed Sensing 1 Image Deblurring 1 Image Outpainting 1 Image to Point Cloud Registration 1 Image-level Supervised Instance Segmentation 1 Image-to-Image Translation 1 Image-to-Text Retrieval 1 Implicit Discourse Relation Classification 1 Information Retrieval 1 Intent Recognition 1 Interactive Segmentation 1 JPEG Decompression 1 Key Information Extraction 1 Keypoint Detection 1 Keyword Extraction 1 Knowledge Graph Completion 1 LABELED_DEPENDENCIES 1 LEMMA 1 Layout-to-Image Generation 1 Learning with noisy labels 1 Lesion Classification 1 Lesion Segmentation 1 Liver Segmentation 1 Low-Resource Neural Machine Translation 1 Lung Nodule Detection 1 MORPH 1 Max-Shot Cross-Lingual Image-to-Text Retrieval 1 Max-Shot Cross-Lingual Text-to-Image Retrieval 1 Max-Shot Cross-Lingual Visual Natural Language Inference 1 Max-Shot Cross-Lingual Visual Question Answering 1 Medical Concept Normalization 1 Medical Diagnosis 1 Medical Image Classification 1 Medical Relation Extraction 1 Medical Visual Question Answering 1 Metric Learning 1 Micro-Expression Recognition 1 Micro-expression Generation 1 Model Compression 1 Monocular 3D Object Detection 1 Monocular Cross-View Road Scene Parsing(Road) 1 Monocular Cross-View Road Scene Parsing(Vehicle) 1 Monocular Depth Estimation 1 Morphological Analysis 1 Multi-Choice MRC 1 Multi-Label Image Classification 1 Multi-Label Learning 1 Multi-Label Text Classification 1 Multi-Object Tracking 1 Multi-agent Reinforcement Learning 1 Multi-modal Dialogue Generation 1 Multi-object discovery 1 Multi-task Language Understanding 1 Multilingual Machine Comprehension in English Hindi 1 Multilingual NLP 1 Multilingual text classification 1 Multimodal Sentiment Analysis 1 Multiple Instance Learning 1 Multiple Object Tracking 1 Multivariate Time Series Forecasting 1 Music Information Retrieval 1 Music Source Separation 1 NER 1 Named Entity Recognition 1 Natural Language Inference (Few-Shot) 1 Natural Language Inference (One-Shot) 1 Natural Language Inference (Zero-Shot) 1 Natural Questions 1 Network Pruning 1 Node Clustering 1 Object Counting 1 Object Detection In Aerial Images 1 Object Tracking 1 Offline Handwritten Chinese Character Recognition 1 Offline RL 1 One-Shot Instance Segmentation 1 One-Shot Object Detection 1 One-stage Anchor-free Oriented Object Detection 1 Open Information Extraction 1 Open Vocabulary Object Detection 1 Open World Object Detection 1 Open-set video tagging 1 Optical Flow Estimation 1 Outlier Detection 1 POS 1 Paraphrase Identification 1 Passage Retrieval 1 Pedestrian Attribute Recognition 1 Person Re-Identification 1 Personality Recognition in Conversation 1 Personality Trait Recognition 1 Personalized and Emotional Conversation 1 Phrase Grounding 1 Point Cloud Classification 1 Point Cloud Registration 1 Point Cloud Segmentation 1 Point-Supervised Instance Segmentation 1 Poll Generation 1 Polyphone disambiguation 1 Prediction Of Occupancy Grid Maps 1 Pretrained Multilingual Language Models 1 Prompt Engineering 1 Propaganda detection 1 Propaganda technique identification 1 Question Similarity 1 Real-Time Semantic Segmentation 1 Record linking 1 Region Proposal 1 Relation Linking 1 Retrieval 1 Road Damage Detection 1 Robust Object Detection 1 SENTS 1 Scene Flow Estimation 1 Scene Graph Generation 1 Segmentation 1 Self-Supervised Image Classification 1 Self-Supervised Learning 1 Semantic Frame Parsing 1 Semantic Parsing 1 Semantic Role Labeling 1 Semantic Textual Similarity 1 Semi Supervised Learning for Image Captioning 1 Semi-Supervised Image Classification 1 Sentence Classification 1 Sentence Embeddings 1 Short-Text Conversation 1 Sign Language Recognition 1 Sign Language Retrieval 1 Sign Language Translation 1 Single-object discovery 1 Span-Extraction MRC 1 Sparse Learning 1 Spatio-Temporal Forecasting 1 Speaker Verification 1 Speech Emotion Recognition 1 Speech Synthesis 1 Speech-to-Speech Translation 1 Stereo Depth Estimation 1 Stereo Disparity Estimation 1 Stereo Image Super-Resolution 1 Stock Market Prediction 1 Stock Prediction 1 Stock Price Prediction 1 Stock Trend Prediction 1 Story Completion 1 Super-Resolution 1 TAG 1 Term Extraction 1 Text Effects Transfer 1 Text Simplification 1 Text Style Transfer 1 Text to Video Retrieval 1 Text-Based Stock Prediction 1 Text-To-SQL 1 Text-to-Image Generation 1 Text-to-video search 1 Time Series 1 Training-free 3D Point Cloud Classification 1 Trajectory Prediction 1 Transfer Learning 1 Tumor Segmentation 1 UNLABELED_DEPENDENCIES 1 Univariate Time Series Forecasting 1 Unsupervised 3D Multi-Person Pose Estimation 1 Unsupervised Image Classification 1 Unsupervised Monocular Depth Estimation 1 Unsupervised Object Detection 1 Unsupervised Object Localization 1 Unsupervised Pre-training 1 Unsupervised Semantic Segmentation 1 Unsupervised Semantic Segmentation with Language-image Pre-training 1 Unsupervised Vehicle Re-Identification 1 Urdu Speech Recognition 1 Vehicle Pose Estimation 1 Video Inpainting 1 Video Prediction 1 Video Question Answering 1 Video Retrieval 1 Video-Text Retrieval 1 Vietnamese Machine Reading Comprehension 1 Vision-Language Navigation 1 Visual Odometry 1 Visual Place Recognition 1 Vocal Bursts Intensity Prediction 1 Vocal Bursts Type Prediction 1 Vocal Bursts Valence Prediction 1 Voice Conversion 1 Weakly Supervised Action Localization 1 Weakly-Supervised Named Entity Recognition 1 Weakly-Supervised Object Localization 1 Weakly-supervised instance segmentation 1 Weather Forecasting 1 Word Sense Disambiguation 1 XLM-R 1 Zero-Shot Cross-Lingual Image-to-Text Retrieval 1 Zero-Shot Cross-Lingual Text-to-Image Retrieval 1 Zero-Shot Cross-Lingual Visual Natural Language Inference 1 Zero-Shot Cross-Lingual Visual Question Answering 1 Zero-Shot Object Detection 1 Zero-Shot Transfer 3D Point Cloud Classification 1 Zero-Shot Transfer Image Classification 1 Zero-Shot Video Retrieval 1 Zero-shot 3D Point Cloud Classification 1 Zero-shot Classification (unified classes) 1 Zero-shot Image Retrieval 1 Zero-shot Text-to-Image Retrieval 1 coreference-resolution 1 multi-word expression embedding 1 multi-word expression sememe prediction 1 speech-recognition 1 text annotation 1 text2text-generation 1
Filter by Language (clear)
Chinese English 2882 German 169 French 145 Spanish 122 Russian 111 Arabic 84 Japanese 83 Italian 79 Portuguese 75 Hindi 68 Vietnamese 57 Korean 54 Turkish 50 Bengali 45 Persian 44 Tamil 41 Dutch 40 Polish 37 Czech 34 Indonesian 34 Danish 31 Finnish 30 Telugu 30 Romanian 29 Multilingual 28 Urdu 27 Marathi 25 Hungarian 23 Swedish 23 Malayalam 22 Mandarin Chinese 22 Thai 22 Greek 21 Gujarati 20 Basque 19 Estonian 19 Hebrew 19 Bulgarian 18 Kannada 18 Punjabi 17 Slovak 16 Ukrainian 16 Swahili 15 Catalan 14 Croatian 14 Norwegian 14 Slovenian 14 Latvian 13 Assamese 12 Iranian Persian 12 Kazakh 12 Lithuanian 12 Serbian 12 Amharic 11 Kurdish 10 Albanian 9 Armenian 9 Irish 9 Maltese 9 Oriya (macrolanguage) 9 Welsh 9 American Sign Language 8 Georgian 8 Mongolian 8 Sanskrit 8 Sinhala 8 Tagalog 8 Yoruba 8 Azerbaijani 7 Breton 7 Burmese 7 Hausa 7 Icelandic 7 Igbo 7 Macedonian 7 Serbo-Croatian 7 Somali 7 Uzbek 7 Afrikaans 6 Central Kurdish 6 Esperanto 6 Galician 6 Guarani 6 Haitian 6 Odia 6 Oromo 6 Sindhi 6 Bambara 5 Belarusian 5 Egyptian Arabic 5 Filipino 5 Javanese 5 Latin 5 Malagasy 5 Malay (individual language) 5 Nepali (macrolanguage) 5 Norwegian Bokmål 5 Norwegian Nynorsk 5 Quechua 5 Scottish Gaelic 5 Standard Arabic 5 Sundanese 5 Tibetan 5 Tigrinya 5 Wolof 5 Bangala 4 Cebuano 4 Central Khmer 4 Chechen 4 Dhivehi 4 Fulah 4 Ganda 4 Iloko 4 Kabyle 4 Kinyarwanda 4 Kirghiz 4 Lao 4 Lingala 4 Nigerian Pidgin 4 Nyanja 4 South Azerbaijani 4 Tatar 4 Upper Sorbian 4 Western Panjabi 4 Aragonese 3 Bashkir 3 Bavarian 3 Bishnupriya 3 Bosnian 3 Chuvash 3 Erzya 3 Faroese 3 Fon 3 German Sign Language 3 Goan Konkani 3 Maithili 3 Malay (macrolanguage) 3 Romansh 3 Russia Buriat 3 Swati 3 Swiss German 3 Tajik 3 Tsonga 3 Tswana 3 Twi 3 Uighur 3 Waray (Philippines) 3 Xhosa 3 Yiddish 3 Argentine Sign Language 2 Asturian 2 Avaric 2 Aymara 2 Bangladeshi Sign Language 2 Bhojpuri 2 Central Bikol 2 Cherokee 2 Church Slavic 2 Cornish 2 Dimli (individual language) 2 Eastern Mari 2 Ewe 2 Gothic 2 Gulf Arabic 2 Ido 2 Interlingue 2 Inuktitut 2 Jejueo 2 Kalaallisut 2 Kalmyk 2 Karachay-Balkar 2 Komi 2 Komi-Permyak 2 Lezghian 2 Limburgan 2 Livvi 2 Lojban 2 Lombard 2 Low German 2 Lower Sorbian 2 Luo (Kenya and Tanzania) 2 Luxembourgish 2 Manipuri 2 Manx 2 Maori 2 Mazanderani 2 Minangkabau 2 Mingrelian 2 Mirandese 2 Modern Greek 2 Moksha 2 Moroccan Arabic 2 Naxi 2 Neapolitan 2 Nepali (individual language) 2 Newari 2 Northern Frisian 2 Northern Kurdish 2 Northern Luri 2 Northern Sami 2 Occitan (post 1500) 2 Ossetian 2 Pampanga 2 Pedi 2 Piemontese 2 Pushto 2 Rundi 2 Sardinian 2 Shona 2 Sichuan Yi 2 Sicilian 2 Southern Sotho 2 Swiss-German Sign Language 2 Tai 2 Tosk Albanian 2 Turkish Sign Language 2 Turkmen 2 Tuvinian 2 Udmurt 2 Venetian 2 Volapük 2 Walloon 2 Western Frisian 2 Western Mari 2 Wu Chinese 2 Yakut 2 Yue Chinese 2 Zulu 2 Abkhazian 1 Achinese 1 Adyghe 1 Afar 1 Akan 1 Akkadian 1 Akuntsu 1 Ancient Greek 1 Ancient Hebrew 1 Apurinã 1 Arpitan 1 Assyrian Neo-Aramaic 1 Banjar 1 Bemba (Zambia) 1 Bislama 1 Bodo (India) 1 Buginese 1 Central Pashto 1 Chamorro 1 Chavacano 1 Cheyenne 1 Choctaw 1 Chukot 1 Congo Swahili 1 Coptic 1 Corsican 1 Cree 1 Creek 1 Crimean Tatar 1 Dogri (macrolanguage) 1 Dzongkha 1 Extremaduran 1 Fiji Hindi 1 Fijian 1 Friulian 1 Gagauz 1 Gan Chinese 1 Geez 1 Gilaki 1 Greek Sign Language 1 Hakha Chin 1 Hakka Chinese 1 Halh Mongolian 1 Hawaiian 1 Herero 1 Hiri Motu 1 Interlingua (International Auxiliary Language Association) 1 Inupiaq 1 Jamaican Creole English 1 Kabardian 1 Kabuverdianu 1 Kachin 1 Kanuri 1 Kara-Kalpak 1 Karelian 1 Kashmiri 1 Kashubian 1 Khunsari 1 Kikuyu 1 Komi-Zyrian 1 Kongo 1 Krio 1 Kuanyama 1 Kölsch 1 Ladino 1 Lak 1 Latgalian 1 Ligurian 1 Literary Chinese 1 Lozi 1 Lunda 1 Luo (Cameroon) 1 Lushai 1 Marshallese 1 Mbyá Guaraní 1 Mesopotamian Arabic 1 Min Dong Chinese 1 Modern Greek (1453-) 1 Mundurukú 1 Najdi Arabic 1 Narom 1 Nauru 1 Navajo 1 Nayini 1 Ndonga 1 Nigerian Fulfulde 1 North Azerbaijani 1 North Levantine Arabic 1 Northern Uzbek 1 Novial 1 Official Aramaic (700-300 BCE) 1 Old English (ca. 450-1100) 1 Old French 1 Old Russian 1 Old Turkish 1 Pali 1 Pangasinan 1 Papiamento 1 Pennsylvania German 1 Pfaelzisch 1 Picard 1 Pitcairn-Norfolk 1 Plateau Malagasy 1 Pontic 1 Rajasthani 1 Rusyn 1 Samoan 1 Sango 1 Saterfriesisch 1 Scots 1 Shan 1 Silesian 1 Skolt Sami 1 Soi 1 South Levantine Arabic 1 Southern Pashto 1 Sranan Tongo 1 Standard Latvian 1 Swahili (macrolanguage) 1 Swedish Sign Language 1 Tahitian 1 Tetum 1 Tok Pisin 1 Tonga (Tonga Islands) 1 Tonga (Zambia) 1 Tulu 1 Tumbuka 1 Tunisian Arabic 1 Tupinambá 1 Venda 1 Veps 1 Vlaams 1 Vlax Romani 1 Votic 1 Warlpiri 1 West Central Oromo 1 Zaza 1 Zeeuws 1 Zhuang 1 Dogri (individual language) 0 Northern Huishui Hmong 0 Portuguse 0 Saidi Arabic 0 Santali 0

324 dataset results for Chinese

ImageNet

The ImageNet dataset contains 14,197,122 annotated images according to the WordNet hierarchy. Since 2010 the dataset is used in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), a benchmark in image classification and object detection. The publicly released dataset contains a set of manually annotated training images. A set of test images is also released, with the manual annotations withheld. ILSVRC annotations fall into one of two categories: (1) image-level annotation of a binary label for the presence or absence of an object class in the image, e.g., “there are cars in this image” but “there are no tigers,” and (2) object-level annotation of a tight bounding box and class label around an object instance in the image, e.g., “there is a screwdriver centered at position (20,25) with width of 50 pixels and height of 30 pixels”. The ImageNet project does not own the copyright of the images, therefore only thumbnails and URLs of images are provided.

13,433 PAPERS • 40 BENCHMARKS

MS COCO (Microsoft Common Objects in Context)

The MS COCO (Microsoft Common Objects in Context) dataset is a large-scale object detection, segmentation, key-point detection, and captioning dataset. The dataset consists of 328K images.

10,147 PAPERS • 92 BENCHMARKS

KITTI

KITTI (Karlsruhe Institute of Technology and Toyota Technological Institute) is one of the most popular datasets for use in mobile robotics and autonomous driving. It consists of hours of traffic scenarios recorded with a variety of sensor modalities, including high-resolution RGB, grayscale stereo cameras, and a 3D laser scanner. Despite its popularity, the dataset itself does not contain ground truth for semantic segmentation. However, various researchers have manually annotated parts of the dataset to fit their necessities. Álvarez et al. generated ground truth for 323 images from the road detection challenge with three classes: road, vertical, and sky. Zhang et al. annotated 252 (140 for training and 112 for testing) acquisitions – RGB and Velodyne scans – from the tracking challenge for ten object categories: building, sky, road, vegetation, sidewalk, car, pedestrian, cyclist, sign/pole, and fence. Ros et al. labeled 170 training images and 46 testing images (from the visual odome

3,219 PAPERS • 141 BENCHMARKS

NeRF
NeRF (Neural Radiance Fields)

Neural Radiance Fields (NeRF) is a method for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. The dataset contains three parts with the first 2 being synthetic renderings of objects called Diffuse Synthetic 360◦ and Realistic Synthetic 360◦ while the third is real images of complex scenes. Diffuse Synthetic 360◦ consists of four Lambertian objects with simple geometry. Each object is rendered at 512x512 pixels from viewpoints sampled on the upper hemisphere. Realistic Synthetic 360◦ consists of eight objects of complicated geometry and realistic non-Lambertian materials. Six of them are rendered from viewpoints sampled on the upper hemisphere and the two left are from viewpoints sampled on a full sphere with all of them at 800x800 pixels. The real images of complex scenes consist of 8 forward-facing scenes captured with a cellphone at a size of 1008x756 pixels.

2,635 PAPERS • 1 BENCHMARK

ModelNet

The ModelNet40 dataset contains synthetic object point clouds. As the most widely used benchmark for point cloud analysis, ModelNet40 is popular because of its various categories, clean shapes, well-constructed dataset, etc. The original ModelNet40 consists of 12,311 CAD-generated meshes in 40 categories (such as airplane, car, plant, lamp), of which 9,843 are used for training while the rest 2,468 are reserved for testing. The corresponding point cloud data points are uniformly sampled from the mesh surfaces, and then further preprocessed by moving to the origin and scaling into a unit sphere.

1,241 PAPERS • 16 BENCHMARKS

ImageNet-C

ImageNet-C is an open source data set that consists of algorithmically generated corruptions (blur, noise) applied to the ImageNet test-set.

510 PAPERS • 3 BENCHMARKS

CheXpert

The CheXpert dataset contains 224,316 chest radiographs of 65,240 patients with both frontal and lateral views available. The task is to do automated chest x-ray interpretation, featuring uncertainty labels and radiologist-labeled reference standard evaluation sets.

508 PAPERS • 1 BENCHMARK

Universal Dependencies

The Universal Dependencies (UD) project seeks to develop cross-linguistically consistent treebank annotation of morphology and syntax for multiple languages. The first version of the dataset was released in 2015 and consisted of 10 treebanks over 10 languages. Version 2.7 released in 2020 consists of 183 treebanks over 104 languages. The annotation consists of UPOS (universal part-of-speech tags), XPOS (language-specific part-of-speech tags), Feats (universal morphological features), Lemmas, dependency heads and universal dependency labels.

505 PAPERS • 12 BENCHMARKS

FB15k-237
FB15k-237

FB15k-237 is a link prediction dataset created from FB15k. While FB15k consists of 1,345 relations, 14,951 entities, and 592,213 triples, many triples are inverses that cause leakage from the training to testing and validation splits. FB15k-237 was created by Toutanova and Chen (2015) to ensure that the testing and evaluation datasets do not have inverse relation test leakage. In summary, FB15k-237 dataset contains 310,116 triples with 14,541 entities and 237 relation types.

402 PAPERS • 3 BENCHMARKS

XNLI (Cross-lingual Natural Language Inference)

The Cross-lingual Natural Language Inference (XNLI) corpus is the extension of the Multi-Genre NLI (MultiNLI) corpus to 15 languages. The dataset was created by manually translating the validation and test sets of MultiNLI into each of those 15 languages. The English training set was machine translated for all languages. The dataset is composed of 122k train, 2490 validation and 5010 test examples.

328 PAPERS • 10 BENCHMARKS

SICK (Sentences Involving Compositional Knowledge)

The Sentences Involving Compositional Knowledge (SICK) dataset is a dataset for compositional distributional semantics. It includes a large number of sentence pairs that are rich in the lexical, syntactic and semantic phenomena. Each pair of sentences is annotated in two dimensions: relatedness and entailment. The relatedness score ranges from 1 to 5, and Pearson’s r is used for evaluation; the entailment relation is categorical, consisting of entailment, contradiction, and neutral. There are 4439 pairs in the train split, 495 in the trial split used for development and 4906 in the test split. The sentence pairs are generated from image and video caption datasets before being paired up using some algorithm.

322 PAPERS • 4 BENCHMARKS

Common Voice

Common Voice is an audio dataset that consists of a unique MP3 and corresponding text file. There are 9,283 recorded hours in the dataset. The dataset also includes demographic metadata like age, sex, and accent. The dataset consists of 7,335 validated hours in 60 languages.

314 PAPERS • 164 BENCHMARKS

OntoNotes 5.0
OntoNotes 5.0

OntoNotes 5.0 is a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, usenet newsgroups, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference).

237 PAPERS • 11 BENCHMARKS

MELD (Multimodal EmotionLines Dataset)

Multimodal EmotionLines Dataset (MELD) has been created by enhancing and extending EmotionLines dataset. MELD contains the same dialogue instances available in EmotionLines, but it also encompasses audio and visual modality along with text. MELD has more than 1400 dialogues and 13000 utterances from Friends TV series. Multiple speakers participated in the dialogues. Each utterance in a dialogue has been labeled by any of these seven emotions -- Anger, Disgust, Sadness, Joy, Neutral, Surprise and Fear. MELD also has sentiment (positive, negative and neutral) annotation for each utterance.

208 PAPERS • 2 BENCHMARKS

MuST-C

MuST-C currently represents the largest publicly available multilingual corpus (one-to-many) for speech translation. It covers eight language directions, from English to German, Spanish, French, Italian, Dutch, Portuguese, Romanian and Russian. The corpus consists of audio, transcriptions and translations of English TED talks, and it comes with a predefined training, validation and test split.

194 PAPERS • 2 BENCHMARKS

XQuAD

XQuAD (Cross-lingual Question Answering Dataset) is a benchmark dataset for evaluating cross-lingual question answering performance. The dataset consists of a subset of 240 paragraphs and 1190 question-answer pairs from the development set of SQuAD v1.1 (Rajpurkar et al., 2016) together with their professional translations into ten languages: Spanish, German, Greek, Russian, Turkish, Arabic, Vietnamese, Thai, Chinese, and Hindi. Consequently, the dataset is entirely parallel across 11 languages.

170 PAPERS • 1 BENCHMARK

ETT (Electricity Transformer Temperature)

The Electricity Transformer Temperature (ETT) is a crucial indicator in the electric power long-term deployment. This dataset consists of 2 years data from two separated counties in China. To explore the granularity on the Long sequence time-series forecasting (LSTF) problem, different subsets are created, {ETTh1, ETTh2} for 1-hour-level and ETTm1 for 15-minutes-level. Each data point consists of the target value ”oil temperature” and 6 power load features. The train/val/test is 12/4/4 months.

165 PAPERS • 1 BENCHMARK

Hate Speech
Hate Speech

Dataset of hate speech annotated on Internet forum posts in English at sentence-level. The source forum in Stormfront, a large online community of white nacionalists. A total of 10,568 sentence have been been extracted from Stormfront and classified as conveying hate speech or not.

161 PAPERS • 1 BENCHMARK

PAWS-X

PAWS-X contains 23,659 human translated PAWS evaluation pairs and 296,406 machine translated training pairs in six typologically distinct languages: French, Spanish, German, Chinese, Japanese, and Korean. All translated pairs are sourced from examples in PAWS-Wiki.

160 PAPERS • 2 BENCHMARKS

MLQA (MultiLingual Question Answering)

MLQA (MultiLingual Question Answering) is a benchmark dataset for evaluating cross-lingual question answering performance. MLQA consists of over 5K extractive QA instances (12K in English) in SQuAD format in seven languages - English, Arabic, German, Spanish, Hindi, Vietnamese and Simplified Chinese. MLQA is highly parallel, with QA instances parallel between 4 different languages on average.

151 PAPERS • 1 BENCHMARK

Total-Text

Total-Text is a text detection dataset that consists of 1,555 images with a variety of text types including horizontal, multi-oriented, and curved text instances. The training split and testing split have 1,255 images and 300 images, respectively.

142 PAPERS • 2 BENCHMARKS

JFT-300M

JFT-300M is an internal Google dataset used for training image classification models. Images are labeled using an algorithm that uses complex mixture of raw web signals, connections between web-pages and user feedback. This results in over one billion labels for the 300M images (a single image can have multiple labels). Of the billion image labels, approximately 375M are selected via an algorithm that aims to maximize label precision of selected images.

119 PAPERS • 1 BENCHMARK

MSRA-TD500 (MSRA Text Detection 500 Database)

The MSRA-TD500 dataset is a text detection dataset that contains 300 training images and 200 test images. Text regions are arbitrarily orientated and annotated at sentence level. Different from the other datasets, it contains both English and Chinese text.

118 PAPERS • 1 BENCHMARK

Microsoft Academic Graph
Microsoft Academic Graph

The Microsoft Academic Graph is a heterogeneous graph containing scientific publication records, citation relationships between those publications, as well as authors, institutions, journals, conferences, and fields of study.

116 PAPERS • 1 BENCHMARK

GTEA (Georgia Tech Egocentric Activity)

The Georgia Tech Egocentric Activities (GTEA) dataset contains seven types of daily activities such as making sandwich, tea, or coffee. Each activity is performed by four different people, thus totally 28 videos. For each video, there are about 20 fine-grained action instances such as take bread, pour ketchup, in approximately one minute.

105 PAPERS • 2 BENCHMARKS

CC100
CC100

This corpus comprises of monolingual data for 100+ languages and also includes data for romanized languages. This was constructed using the urls and paragraph indices provided by the CC-Net repository by processing January-December 2018 Commoncrawl snapshots. Each file comprises of documents separated by double-newlines and paragraphs within the same document separated by a newline. The data is generated using the open source CC-Net repository.

96 PAPERS • NO BENCHMARKS YET

VATEX (Video And TEXt)

VATEX is multilingual, large, linguistically complex, and diverse dataset in terms of both video and natural language descriptions. It has two tasks for video-and-language research: (1) Multilingual Video Captioning, aimed at describing a video in various languages with a compact unified captioning model, and (2) Video-guided Machine Translation, to translate a source language description into the target language using the video information as additional spatiotemporal context.

95 PAPERS • 3 BENCHMARKS

Math23K
Math23K (Math23K for Math Word Problem Solving)

Math23K is a dataset created for math word problem solving, contains 23, 162 Chinese problems crawled from the Internet. Refer to our paper for more details: The dataset is originally introduced in the paper Deep Neural Solver for Math Word Problems. The original files are originally split into train/test split, while other research efforts (https://github.com/2003pro/Graph2Tree) perform the train/dev/test split.

89 PAPERS • 1 BENCHMARK

CrowdPose

The CrowdPose dataset contains about 20,000 images and a total of 80,000 human poses with 14 labeled keypoints. The test set includes 8,000 images. The crowded images containing homes are extracted from MSCOCO, MPII and AI Challenger.

85 PAPERS • 2 BENCHMARKS

Kvasir (The Kvasir Dataset)

The KVASIR Dataset was released as part of the medical multimedia challenge presented by MediaEval. It is based on images obtained from the GI tract via an endoscopy procedure. The dataset is composed of images that are annotated and verified by medical doctors, and captures 8 different classes. The classes are based on three anatomical landmarks (z-line, pylorus, cecum), three pathological findings (esophagitis, polyps, ulcerative colitis) and two other classes (dyed and lifted polyps, dyed resection margins) related to the polyp removal process. Overall, the dataset contains 8,000 endoscopic images, with 1,000 image examples per class.

85 PAPERS • 3 BENCHMARKS

ASPEC (Asian Scientific Paper Excerpt Corpus)

ASPEC, Asian Scientific Paper Excerpt Corpus, is constructed by the Japan Science and Technology Agency (JST) in collaboration with the National Institute of Information and Communications Technology (NICT). It consists of a Japanese-English paper abstract corpus of 3M parallel sentences (ASPEC-JE) and a Japanese-Chinese paper excerpt corpus of 680K parallel sentences (ASPEC-JC). This corpus is one of the achievements of the Japanese-Chinese machine translation project which was run in Japan from 2006 to 2010.

84 PAPERS • NO BENCHMARKS YET

LUNA16

The LUNA16 (LUng Nodule Analysis) dataset is a dataset for lung segmentation. It consists of 1,186 lung nodules annotated in 888 CT scans.

83 PAPERS • 1 BENCHMARK

DVS128 Gesture
DVS128 Gesture

Comprises 11 hand gesture categories from 29 subjects under 3 illumination conditions.

77 PAPERS • 5 BENCHMARKS

Douban
Douban (Douban Conversation Corpus)

We release Douban Conversation Corpus, comprising a training data set, a development set and a test set for retrieval based chatbot. The statistics of Douban Conversation Corpus are shown in the following table.

77 PAPERS • 4 BENCHMARKS

MPIIGaze

MPIIGaze is a dataset for appearance-based gaze estimation in the wild. It contains 213,659 images collected from 15 participants during natural everyday laptop use over more than three months. It has a large variability in appearance and illumination.

75 PAPERS • 1 BENCHMARK

CoNLL 2002

The shared task of CoNLL-2002 concerns language-independent named entity recognition. The types of named entities include: persons, locations, organizations and names of miscellaneous entities that do not belong to the previous three groups. The participants of the shared task were offered training and test data for at least two languages. Information sources other than the training data might have been used in this shared task.

69 PAPERS • 3 BENCHMARKS

MuPoTS-3D (Multiperson Pose Test Set in 3DMulti-person Pose estimation Test Set in 3D)

MuPoTs-3D (Multi-person Pose estimation Test Set in 3D) is a dataset for pose estimation composed of more than 8,000 frames from 20 real-world scenes with up to three subjects. The poses are annotated with a 14-point skeleton model.

67 PAPERS • 4 BENCHMARKS

CoNaLa
CoNaLa (CMU CoNaLa, the Code/Natural Language Challenge)

The CMU CoNaLa, the Code/Natural Language Challenge dataset is a joint project from the Carnegie Mellon University NeuLab and Strudel labs. Its purpose is for testing the generation of code snippets from natural language. The data comes from StackOverflow questions. There are 2379 training and 500 test examples that were manually annotated. Every example has a natural language intent and its corresponding python snippet. In addition to the manually annotated dataset, there are also 598,237 mined intent-snippet pairs. These examples are similar to the hand-annotated ones except that they contain a probability if the pair is valid.

64 PAPERS • 1 BENCHMARK

CN-CELEB
CN-CELEB

CN-Celeb is a large-scale speaker recognition dataset collected `in the wild'. This dataset contains more than 130,000 utterances from 1,000 Chinese celebrities, and covers 11 different genres in real world.

63 PAPERS • 1 BENCHMARK

CMRC (Chinese Machine Reading Comprehension)

CMRC is a dataset is annotated by human experts with near 20,000 questions as well as a challenging set which is composed of the questions that need reasoning over multiple clues.

62 PAPERS • 11 BENCHMARKS

DBP15K
DBP15K

DBP15k contains four language-specific KGs that are respectively extracted from English (En), Chinese (Zh), French (Fr) and Japanese (Ja) DBpedia, each of which contains around 65k-106k entities. Three sets of 15k alignment labels are constructed to align entities between each of the other three languages and En.

61 PAPERS • 3 BENCHMARKS

DuReader

DuReader is a large-scale open-domain Chinese machine reading comprehension dataset. The dataset consists of 200K questions, 420K answers and 1M documents. The questions and documents are based on Baidu Search and Baidu Zhidao. The answers are manually generated. The dataset additionally provides question type annotations – each question was manually annotated as either Entity, Description or YesNo and one of Fact or Opinion.

61 PAPERS • 4 BENCHMARKS

VeRi-776

VeRi-776 is a vehicle re-identification dataset which contains 49,357 images of 776 vehicles from 20 cameras. The dataset is collected in the real traffic scenario, which is close to the setting of CityFlow. The dataset contains bounding boxes, types, colors and brands.

61 PAPERS • 2 BENCHMARKS

LIP (Look into Person)

The LIP (Look into Person) dataset is a large-scale dataset focusing on semantic understanding of a person. It contains 50,000 images with elaborated pixel-wise annotations of 19 semantic human part labels and 2D human poses with 16 key points. The images are collected from real-world scenarios and the subjects appear with challenging poses and view, heavy occlusions, various appearances and low resolution.

59 PAPERS • 1 BENCHMARK

LCSTS

LCSTS is a large corpus of Chinese short text summarization dataset constructed from the Chinese microblogging website Sina Weibo, which is released to the public. This corpus consists of over 2 million real Chinese short texts with short summaries given by the author of each text. The authors also manually tagged the relevance of 10,666 short summaries with their corresponding short texts 10,666 short summaries with their corresponding short texts.

57 PAPERS • 2 BENCHMARKS

WikiANN
WikiANN (PAN-X)

WikiANN, also known as PAN-X, is a multilingual named entity recognition dataset. It consists of Wikipedia articles that have been annotated with LOC (location), PER (person), and ORG (organization) tags in the IOB2 format¹². This dataset serves as a valuable resource for training and evaluating named entity recognition models across various languages.

57 PAPERS • 3 BENCHMARKS

OSCAR

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.

55 PAPERS • NO BENCHMARKS YET

DRCD (Delta Reading Comprehension Dataset)

Delta Reading Comprehension Dataset (DRCD) is an open domain traditional Chinese machine reading comprehension (MRC) dataset. This dataset aimed to be a standard Chinese machine reading comprehension dataset, which can be a source dataset in transfer learning. The dataset contains 10,014 paragraphs from 2,108 Wikipedia articles and 30,000+ questions generated by annotators.

52 PAPERS • 5 BENCHMARKS

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy