Datasets

9,767 machine learning datasets
🔔   Share your dataset with the ML community!
Filter by Modality
Images 28 3D 17 Videos 15 RGB Video 6 RGB-D 3 3d meshes 2 Actions 2 Biomedical 2 LiDAR 2 Point cloud 2 Time series 2 Tracking 2 Graphs 1 Medical 1 6D 0 Audio 0 Biology 0 Cad 0 Dialog 0 EEG 0 Environment 0 Financial 0 Hyperspectral images 0 Interactive 0 Lyrics 0 MRI 0 Midi 0 Music 0 PSG 0 Parallel 0 Physics 0 Ranking 0 Replay data 0 Speech 0 Stereo 0 Tables 0 Tabular 0 Texts 0 fMRI 0
Filter by Task (clear)
3D Human Pose Estimation Question Answering 360 Semantic Segmentation 311 Object Detection 261 Image Classification 240 Language Modelling 157 Text Generation 150 Text Classification 148 Classification 125 Named Entity Recognition (NER) 122 Pose Estimation 113 Visual Question Answering (VQA) 112 Action Recognition 105 Anomaly Detection 95 Reading Comprehension 95 Sentiment Analysis 93 Domain Adaptation 88 Speech Recognition 87 Text Summarization 87 Information Retrieval 82 Instance Segmentation 82 Natural Language Inference 77 Machine Translation 76 Image Retrieval 75 Relation Extraction 74 Natural Language Understanding 71 Depth Estimation 70 Node Classification 69 Image Generation 67 Autonomous Driving 66 Image Captioning 65 Data Augmentation 63 Link Prediction 63 Face Recognition 61 Object Tracking 61 2D Object Detection 57 2D Semantic Segmentation 57 Person Re-Identification 57 Multi-Task Learning 55 3D Reconstruction 54 Recommendation Systems 54 Common Sense Reasoning 52 Word Embeddings 52 3D Object Detection 48 Abstractive Text Summarization 48 Graph Classification 46 Emotion Recognition 45 Code Generation 43 Coreference Resolution 43 Medical Image Segmentation 43 Scene Understanding 43 Object Recognition 42 Optical Character Recognition (OCR) 42 Semantic Parsing 42 Temporal Action Localization 42 Video Understanding 42 Few-Shot Learning 41 Knowledge Graphs 41 Machine Reading Comprehension 41 Self-Supervised Learning 41 Visual Reasoning 41 Hate Speech Detection 39 Image Super-Resolution 39 Decision Making 38 Entity Linking 38 Misinformation 38 Multi-Object Tracking 37 Face Detection 36 Fine-Grained Image Classification 36 Audio Classification 34 Trajectory Prediction 34 Action Detection 33 Novel View Synthesis 33 Optical Flow Estimation 33 Panoptic Segmentation 32 Video Captioning 32 Video Question Answering 32 3D Semantic Segmentation 31 Dialogue Generation 31 Metric Learning 31 Stance Detection 31 Unsupervised Domain Adaptation 31 Video Retrieval 31 Action Classification 30 3D Pose Estimation 29 Activity Recognition 29 Continual Learning 29 Facial Expression Recognition (FER) 29 Image-to-Image Translation 29 Skeleton Based Action Recognition 29 Zero-Shot Learning 29 Document Summarization 28 Time Series Forecasting 28 Token Classification 28 Autonomous Vehicles 27 Emotion Classification 27 Multi-Label Classification 27 Neural Architecture Search 27 Scene Text Recognition 27 Monocular Depth Estimation 26 Open-Domain Question Answering 26 Part-Of-Speech Tagging 26 Sequence-to-sequence Language Modeling 26 Visual Object Tracking 26 Visual Tracking 26 Domain Generalization 25 Fake News Detection 25 Question Generation 25 Retrieval 25 Drug Discovery 24 Music Generation 24 NER 24 Video Prediction 24 Automatic Speech Recognition (ASR) 23 Few-Shot Image Classification 23 Music Information Retrieval 23 Object Counting 23 Unsupervised Anomaly Detection 23 2D Human Pose Estimation 22 Data-to-Text Generation 22 Hand Pose Estimation 22 Human-Object Interaction Detection 22 Relation Classification 22 Face Verification 21 Low-Light Image Enhancement 21 Out-of-Distribution Detection 21 Visual Odometry 21 Cross-Modal Retrieval 20 Denoising 20 Fairness 20 Handwriting Recognition 20 Image Clustering 20 Image Segmentation 20 Intent Detection 20 Scene Classification 20 Slot Filling 20 Time Series Analysis 20 Age Estimation 19 Crowd Counting 19 Meta-Learning 19 Molecular Property Prediction 19 Speech Synthesis 19 Super-Resolution 19 Task-Oriented Dialogue Systems 19 Text Simplification 19 Visual Localization 19 Visual Place Recognition 19 Visual Question Answering 19 Aspect-Based Sentiment Analysis (ABSA) 18 Cell Segmentation 18 DeepFake Detection 18 Imitation Learning 18 Language Identification 18 Quantization 18 Sign Language Recognition 18 Simultaneous Localization and Mapping 18 Sound Event Detection 18 Speech Emotion Recognition 18 Speech Enhancement 18 Text-to-Image Generation 18 Traffic Prediction 18 6D Pose Estimation 17 Action Recognition In Videos 17 Animal Pose Estimation 17 Binarization 17 Face Alignment 17 Face Anti-Spoofing 17 Graph Clustering 17 Graph Regression 17 Motor Imagery Decoding (left-hand vs right-hand) 17 Multimodal Deep Learning 17 Paraphrase Identification 17 SMAC+ 17 Semantic Textual Similarity 17 Stereo Matching 17 Text-To-Speech Synthesis 17 Video Classification 17 3D Hand Pose Estimation 16 Action Segmentation 16 Cross-Lingual Transfer 16 Image Dehazing 16 Image Inpainting 16 Knowledge Graph Completion 16 Long-tail Learning 16 Math Word Problem Solving 16 Object Localization 16 Paraphrase Generation 16 Prompt Engineering 16 RGB Salient Object Detection 16 Robotic Grasping 16 Salient Object Detection 16 Speech Separation 16 Style Transfer 16 Time Series Classification 16 Video Object Segmentation 16 Visual Navigation 16 Active Learning 15 Document Classification 15 Facial Landmark Detection 15 Gaze Estimation 15 Grammatical Error Correction 15 Image Denoising 15 Image Enhancement 15 Mathematical Reasoning 15 Medical Diagnosis 15 Multiple Object Tracking 15 Node Classification on Non-Homophilic (Heterophilic) Graphs 15 Reinforcement Learning (RL) 15 Scene Recognition 15 Scene Text Detection 15 Translation 15 3D Action Recognition 14 Change Detection 14 Computed Tomography (CT) 14 Deblurring 14 Dependency Parsing 14 Fact Verification 14 Instruction Following 14 Joint Entity and Relation Extraction 14 Lane Detection 14 Multi-Document Summarization 14 Node Clustering 14 Self-Driving Cars 14 Semantic Role Labeling 14 Spoken Language Understanding 14 Text-To-SQL 14 Trajectory Forecasting 14 Word Sense Disambiguation 14 Zero-shot Text Search 14 3D Human Reconstruction 13 3D Instance Segmentation 13 Audio Source Separation 13 Clustering Algorithms Evaluation 13 Density Estimation 13 Emotion Recognition in Conversation 13 Event Extraction 13 Hand Gesture Recognition 13 Intent Classification 13 License Plate Recognition 13 Motion Synthesis 13 Open Information Extraction 13 Pedestrian Detection 13 Robot Navigation 13 Sarcasm Detection 13 Semi-Supervised Video Object Segmentation 13 Sentence Classification 13 Transfer Learning 13 Video Generation 13 Activity Detection 12 Binary Classification 12 Disentanglement 12 Entity Disambiguation 12 Gesture Recognition 12 Human Detection 12 Image Quality Assessment 12 Learning with noisy labels 12 Lesion Segmentation 12 Semi-Supervised Image Classification 12 Single-View 3D Reconstruction 12 Text Retrieval 12 Topic Models 12 Video Quality Assessment 12 Video Summarization 12 Video Super-Resolution 12 Vision and Language Navigation 12 Weakly Supervised Object Detection 12 Weather Forecasting 12 3D Classification 11 3D Face Reconstruction 11 3D Object Tracking 11 Automatic Speech Recognition 11 Community Detection 11 Conversational Response Selection 11 Dialogue State Tracking 11 Entity Resolution 11 Entity Typing 11 Image Registration 11 Image Restoration 11 Keypoint Detection 11 Logical Reasoning 11 Motion Forecasting 11 Multi-Label Text Classification 11 Multi-class Classification 11 Network Intrusion Detection 11 Open-Domain Dialog 11 Real-Time Semantic Segmentation 11 Relational Reasoning 11 Saliency Detection 11 Semantic Similarity 11 Semi-Supervised Semantic Segmentation 11 Sign Language Translation 11 Stochastic Optimization 11 Surface Normals Estimation 11 Video Frame Interpolation 11 Zero-Shot Video Question Answer 11 motion prediction 11 Acoustic Scene Classification 10 Answer Selection 10 Boundary Detection 10 COVID-19 Diagnosis 10 Code Search 10 Column Type Annotation 10 Contrastive Learning 10 Depth Completion 10 Dimensionality Reduction 10 Facial Attribute Classification 10 Federated Learning 10 Graph Embedding 10 Image Compression 10 Imputation 10 Named Entity Recognition 10 Nested Named Entity Recognition 10 Object Detection In Indoor Scenes 10 Outlier Detection 10 Referring Expression Segmentation 10 Sentence Embeddings 10 Small Object Detection 10 Table annotation 10 Time Series Prediction 10 Unsupervised Object Segmentation 10 Video Object Tracking 10 Virtual Try-on 10 3D Medical Imaging Segmentation 9 Abusive Language 9 Adversarial Robustness 9 Automatic Post-Editing 9 Citation Recommendation 9 Code Completion 9 Continuous Control 9 Conversational Question Answering 9 Cross-Lingual NER 9 Dialogue Understanding 9 Edge Detection 9 Few-Shot Audio Classification 9 Fine-Grained Image Recognition 9 Fraud Detection 9 Gait Recognition 9 Graph Matching 9 Handwriting generation 9 Head Pose Estimation 9 Incremental Learning 9 License Plate Detection 9 Material Recognition 9 Medical Image Classification 9 News Classification 9 Opinion Mining 9 Point Cloud Registration 9 Sentiment Classification 9 Speaker Diarization 9 Unsupervised Person Re-Identification 9 Video Inpainting 9 Video Object Detection 9 Video Recognition 9 Visual Dialog 9 2D Pose Estimation 8 3D Depth Estimation 8 Ad-hoc video search 8 Adversarial Attack 8 Audio Generation 8 Audio Tagging 8 Automated Theorem Proving 8 Causal Inference 8 Chart Question Answering 8 Code Translation 8 Color Image Denoising 8 Defect Detection 8 Discourse Parsing 8 Document Layout Analysis 8 ECG Classification 8 Entity Alignment 8 Event-based vision 8 Explanation Generation 8 Face Swapping 8 Fact Checking 8 Font Recognition 8 General Classification 8 Generalizable Person Re-identification 8 Generalized Zero-Shot Learning 8 Handwritten Text Recognition 8 Human Activity Recognition 8 Key Information Extraction 8 Medical Image Registration 8 Multi-Label Image Classification 8 Multi-Label Learning 8 Multi-agent Reinforcement Learning 8 Music Transcription 8 Online Multi-Object Tracking 8 Person Search 8 Pose Tracking 8 Referring Expression Comprehension 8 Scene Generation 8 Segmentation 8 Temporal Tagging 8 Text-to-Video Generation 8 Time Series 8 Tumor Segmentation 8 Unsupervised Video Object Segmentation 8 Vehicle Re-Identification 8 Video Segmentation 8 regression 8 3D Human Shape Estimation 7 3D Multi-Object Tracking 7 3D Object Recognition 7 3D Shape Reconstruction 7 Action Anticipation 7 Action Quality Assessment 7 AutoML 7 Bias Detection 7 Blind Super-Resolution 7 Change Point Detection 7 Chatbot 7 Chinese Reading Comprehension 7 Code Summarization 7 Colorectal Polyps Characterization 7 Conditional Image Generation 7 Data Integration 7 Dense Video Captioning 7 Dialogue Act Classification 7 Disaster Response 7 Dynamic Link Prediction 7 Electroencephalogram (EEG) 7 Event Detection 7 Explainable artificial intelligence 7 Food Recognition 7 Formation Energy 7 Human Part Segmentation 7 KG-to-Text Generation 7 Keyword Spotting 7 Knowledge Base Question Answering 7 Multimodal Activity Recognition 7 Multimodal Emotion Recognition 7 Multiple-choice 7 Multiview Detection 7 Passage Retrieval 7 Physical Simulations 7 Product Recommendation 7 Program Repair 7 Remote Sensing Image Classification 7 Robust Object Detection 7 Single Image Dehazing 7 Skin Lesion Classification 7 Source Code Summarization 7 Stance Classification 7 Table Detection 7 Text Segmentation 7 Traffic Sign Recognition 7 Translation deu-eng 7 Translation eng-deu 7 Unsupervised Semantic Segmentation with Language-image Pre-training 7 Video Anomaly Detection 7 Video Grounding 7 Video Semantic Segmentation 7 Zero-Shot Transfer Image Classification 7 3D Absolute Human Pose Estimation 6 3D Face Animation 6 3D Object Classification 6 3D Object Reconstruction 6 3D Part Segmentation 6 3D Point Cloud Classification 6 6D Pose Estimation using RGB 6 6D Pose Estimation using RGBD 6 Argument Mining 6 Atari Games 6 Audio-Visual Speech Recognition 6 Band Gap 6 Bayesian Inference 6 Body Detection 6 Breast Cancer Detection 6 Camouflaged Object Segmentation 6 Click-Through Rate Prediction 6 Code Classification 6 Code Repair 6 Colorization 6 Compositional Zero-Shot Learning 6 Constituency Parsing 6 Cross-Domain Few-Shot 6 Cross-Lingual Question Answering 6 Dialogue Evaluation 6 Dictionary Learning 6 Egocentric Pose Estimation 6 Emotion Recognition in Context 6 Environmental Sound Classification 6 Extreme Summarization 6 Facial Emotion Recognition 6 Few-Shot Object Detection 6 Gesture Generation 6 Graph Learning 6 Heart rate estimation 6 Hierarchical Multi-label Classification 6 Human Interaction Recognition 6 Hyperspectral Image Classification 6 Lesion Classification 6 Medical Visual Question Answering 6 Motion Estimation 6 Multi-Person Pose Estimation 6 Multiple Instance Learning 6 Multivariate Time Series Forecasting 6 Multivariate Time Series Imputation 6 Person Identification 6 Real-Time Object Detection 6
Filter by Language
English 7 Abkhazian 0 Achinese 0 Adyghe 0 Afar 0 Afrikaans 0 Akan 0 Akkadian 0 Akuntsu 0 Albanian 0 American Sign Language 0 Amharic 0 Ancient Greek 0 Ancient Hebrew 0 Apurinã 0 Arabic 0 Aragonese 0 Argentine Sign Language 0 Armenian 0 Arpitan 0 Assamese 0 Assyrian Neo-Aramaic 0 Asturian 0 Avaric 0 Aymara 0 Azerbaijani 0 Bambara 0 Bangala 0 Bangladeshi Sign Language 0 Banjar 0 Bashkir 0 Basque 0 Bavarian 0 Belarusian 0 Bemba (Zambia) 0 Bengali 0 Bhojpuri 0 Bishnupriya 0 Bislama 0 Bodo (India) 0 Bosnian 0 Breton 0 Buginese 0 Bulgarian 0 Burmese 0 Catalan 0 Cebuano 0 Central Bikol 0 Central Khmer 0 Central Kurdish 0 Central Pashto 0 Chamorro 0 Chavacano 0 Chechen 0 Cherokee 0 Cheyenne 0 Chinese 0 Choctaw 0 Chukot 0 Church Slavic 0 Chuvash 0 Congo Swahili 0 Coptic 0 Cornish 0 Corsican 0 Cree 0 Creek 0 Crimean Tatar 0 Croatian 0 Czech 0 Danish 0 Dhivehi 0 Dimli (individual language) 0 Dogri (individual language) 0 Dogri (macrolanguage) 0 Dutch 0 Dzongkha 0 Eastern Mari 0 Egyptian Arabic 0 Erzya 0 Esperanto 0 Estonian 0 Ewe 0 Extremaduran 0 Faroese 0 Fiji Hindi 0 Fijian 0 Filipino 0 Finnish 0 Fon 0 French 0 Friulian 0 Fulah 0 Gagauz 0 Galician 0 Gan Chinese 0 Ganda 0 Geez 0 Georgian 0 German 0 German Sign Language 0 Gilaki 0 Goan Konkani 0 Gothic 0 Greek 0 Greek Sign Language 0 Guarani 0 Gujarati 0 Gulf Arabic 0 Haitian 0 Hakha Chin 0 Hakka Chinese 0 Halh Mongolian 0 Hausa 0 Hawaiian 0 Hebrew 0 Herero 0 Hindi 0 Hiri Motu 0 Hungarian 0 Icelandic 0 Ido 0 Igbo 0 Iloko 0 Indonesian 0 Interlingua (International Auxiliary Language Association) 0 Interlingue 0 Inuktitut 0 Inupiaq 0 Iranian Persian 0 Irish 0 Italian 0 Jamaican Creole English 0 Japanese 0 Javanese 0 Jejueo 0 Kabardian 0 Kabuverdianu 0 Kabyle 0 Kachin 0 Kalaallisut 0 Kalmyk 0 Kannada 0 Kanuri 0 Kara-Kalpak 0 Karachay-Balkar 0 Karelian 0 Kashmiri 0 Kashubian 0 Kazakh 0 Khunsari 0 Kikuyu 0 Kinyarwanda 0 Kirghiz 0 Komi 0 Komi-Permyak 0 Komi-Zyrian 0 Kongo 0 Korean 0 Krio 0 Kuanyama 0 Kurdish 0 Kölsch 0 Ladino 0 Lak 0 Lao 0 Latgalian 0 Latin 0 Latvian 0 Lezghian 0 Ligurian 0 Limburgan 0 Lingala 0 Literary Chinese 0 Lithuanian 0 Livvi 0 Lojban 0 Lombard 0 Low German 0 Lower Sorbian 0 Lozi 0 Lunda 0 Luo (Cameroon) 0 Luo (Kenya and Tanzania) 0 Lushai 0 Luxembourgish 0 Macedonian 0 Maithili 0 Malagasy 0 Malay (individual language) 0 Malay (macrolanguage) 0 Malayalam 0 Maltese 0 Mandarin Chinese 0 Manipuri 0 Manx 0 Maori 0 Marathi 0 Marshallese 0 Mazanderani 0 Mbyá Guaraní 0 Mesopotamian Arabic 0 Min Dong Chinese 0 Minangkabau 0 Mingrelian 0 Mirandese 0 Modern Greek 0 Modern Greek (1453-) 0 Moksha 0 Mongolian 0 Moroccan Arabic 0 Multilingual 0 Mundurukú 0 Najdi Arabic 0 Narom 0 Nauru 0 Navajo 0 Naxi 0 Nayini 0 Ndonga 0 Neapolitan 0 Nepali (individual language) 0 Nepali (macrolanguage) 0 Newari 0 Nigerian Fulfulde 0 Nigerian Pidgin 0 North Azerbaijani 0 North Levantine Arabic 0 Northern Frisian 0 Northern Huishui Hmong 0 Northern Kurdish 0 Northern Luri 0 Northern Sami 0 Northern Uzbek 0 Norwegian 0 Norwegian Bokmål 0 Norwegian Nynorsk 0 Novial 0 Nyanja 0 Occitan (post 1500) 0 Odia 0 Official Aramaic (700-300 BCE) 0 Old English (ca. 450-1100) 0 Old French 0 Old Russian 0 Old Turkish 0 Oriya (macrolanguage) 0 Oromo 0 Ossetian 0 Pali 0 Pampanga 0 Pangasinan 0 Papiamento 0 Pedi 0 Pennsylvania German 0 Persian 0 Pfaelzisch 0 Picard 0 Piemontese 0 Pitcairn-Norfolk 0 Plateau Malagasy 0 Polish 0 Pontic 0 Portuguese 0 Portuguse 0 Punjabi 0 Pushto 0 Quechua 0 Rajasthani 0 Romanian 0 Romansh 0 Rundi 0 Russia Buriat 0 Russian 0 Rusyn 0 Saidi Arabic 0 Samoan 0 Sango 0 Sanskrit 0 Santali 0 Sardinian 0 Saterfriesisch 0 Scots 0 Scottish Gaelic 0 Serbian 0 Serbo-Croatian 0 Shan 0 Shona 0 Sichuan Yi 0 Sicilian 0 Silesian 0 Sindhi 0 Sinhala 0 Skolt Sami 0 Slovak 0 Slovenian 0 Soi 0 Somali 0 South Azerbaijani 0 South Levantine Arabic 0 Southern Pashto 0 Southern Sotho 0 Spanish 0 Sranan Tongo 0 Standard Arabic 0 Standard Latvian 0 Sundanese 0 Swahili 0 Swahili (macrolanguage) 0 Swati 0 Swedish 0 Swedish Sign Language 0 Swiss German 0 Swiss-German Sign Language 0 Tagalog 0 Tahitian 0 Tai 0 Tajik 0 Tamil 0 Tatar 0 Telugu 0 Tetum 0 Thai 0 Tibetan 0 Tigrinya 0 Tok Pisin 0 Tonga (Tonga Islands) 0 Tonga (Zambia) 0 Tosk Albanian 0 Tsonga 0 Tswana 0 Tulu 0 Tumbuka 0 Tunisian Arabic 0 Tupinambá 0 Turkish 0 Turkish Sign Language 0 Turkmen 0 Tuvinian 0 Twi 0 Udmurt 0 Uighur 0 Ukrainian 0 Upper Sorbian 0 Urdu 0 Uzbek 0 Venda 0 Venetian 0 Veps 0 Vietnamese 0 Vlaams 0 Vlax Romani 0 Volapük 0 Votic 0 Walloon 0 Waray (Philippines) 0 Warlpiri 0 Welsh 0 West Central Oromo 0 Western Frisian 0 Western Mari 0 Western Panjabi 0 Wolof 0 Wu Chinese 0 Xhosa 0 Yakut 0 Yiddish 0 Yoruba 0 Yue Chinese 0 Zaza 0 Zeeuws 0 Zhuang 0 Zulu 0

46 dataset results for 3D Human Pose Estimation

Human3.6M

The Human3.6M dataset is one of the largest motion capture datasets, which consists of 3.6 million human poses and corresponding images captured by a high-speed motion capture system. There are 4 high-resolution progressive scan cameras to acquire video data at 50 Hz. The dataset contains activities by 11 professional actors in 17 scenarios: discussion, smoking, taking photo, talking on the phone, etc., as well as provides accurate 3D joint positions and high-resolution videos.

715 PAPERS • 16 BENCHMARKS

Waymo Open Dataset

The Waymo Open Dataset is comprised of high resolution sensor data collected by autonomous vehicles operated by the Waymo Driver in a wide variety of conditions.

373 PAPERS • 12 BENCHMARKS

3DPW

The 3D Poses in the Wild dataset is the first dataset in the wild with accurate 3D poses for evaluation. While other datasets outdoors exist, they are all restricted to a small recording volume. 3DPW is the first one that includes video footage taken from a moving phone camera.

340 PAPERS • 5 BENCHMARKS

AMASS

AMASS is a large database of human motion unifying different optical marker-based motion capture datasets by representing them within a common framework and parameterization. AMASS is readily useful for animation, visualization, and generating training data for deep learning.

281 PAPERS • 1 BENCHMARK

MPI-INF-3DHP

MPI-INF-3DHP is a 3D human body pose estimation dataset consisting of both constrained indoor and complex outdoor scenes. It records 8 actors performing 8 activities from 14 camera views. It consists on >1.3M frames captured from the 14 cameras.

257 PAPERS • 6 BENCHMARKS

DensePose (DensePose-COCO)

DensePose-COCO is a large-scale ground-truth dataset with image-to-surface correspondences manually annotated on 50K COCO images and train DensePose-RCNN, to densely regress part-specific UV coordinates within every human region at multiple frames per second.

230 PAPERS • NO BENCHMARKS YET

LSP (Leeds Sports Pose)

The Leeds Sports Pose (LSP) dataset is widely used as the benchmark for human pose estimation. The original LSP dataset contains 2,000 images of sportspersons gathered from Flickr, 1000 for training and 1000 for testing. Each image is annotated with 14 joint locations, where left and right joints are consistently labelled from a person-centric viewpoint. The extended LSP dataset contains additional 10,000 images labeled for training.

197 PAPERS • 1 BENCHMARK

Panoptic (CMU Panoptic Studio)

CMU Panoptic is a large scale dataset providing 3D pose annotations (1.5 millions) for multiple people engaging social activities. It contains 65 videos (5.5 hours) with multi-view annotations, but only 17 of them are in multi-person scenario and have the camera parameters.

112 PAPERS • 4 BENCHMARKS

AGORA

AGORA is a synthetic human dataset with high realism and accurate ground truth. It consists of around 14K training and 3K test images by rendering between 5 and 15 people per image using either image-based lighting or rendered 3D environments, taking care to make the images physically plausible and photoreal. In total, AGORA contains 173K individual person crops. AGORA provides (1) SMPL/SMPL-X parameters and (2) segmentation masks for each subject in images.

55 PAPERS • 4 BENCHMARKS

TotalCapture

The TotalCapture dataset consists of 5 subjects performing several activities such as walking, acting, a range of motion sequence (ROM) and freestyle motions, which are recorded using 8 calibrated, static HD RGB cameras and 13 IMUs attached to head, sternum, waist, upper arms, lower arms, upper legs, lower legs and feet, however the IMU data is not required for our experiments. The dataset has publicly released foreground mattes and RGB images. Ground-truth poses are obtained using a marker-based motion capture system, with the markers are <5mm in size. All data is synchronised and operates at a framerate of 60Hz, providing ground truth poses as joint positions.

48 PAPERS • 2 BENCHMARKS

PosePrior

Accurate modeling of priors over 3D human pose is fundamental to many problems in computer vision.

44 PAPERS • NO BENCHMARKS YET

RICH (Real scenes, Interaction, Contact and Humans)

Inferring human-scene contact (HSC) is the first step toward understanding how humans interact with their surroundings. While detecting 2D human-object interaction (HOI) and reconstructing 3D human pose and shape (HPS) have enjoyed significant progress, reasoning about 3D human-scene contact from a single image is still challenging. Existing HSC detection methods consider only a few types of predefined contact, often reduce body and scene to a small number of primitives, and even overlook image evidence. To predict human-scene contact from a single image, we address the limitations above from both data and algorithmic perspectives. We capture a new dataset called RICH for “Real scenes, Interaction, Contact and Humans.” RICH contains multiview outdoor/indoor video sequences at 4K resolution, ground-truth 3D human bodies captured using markerless motion capture, 3D body scans, and high resolution 3D scene scans. A key feature of RICH is that it also contains accurate vertex-level contact

39 PAPERS • 1 BENCHMARK

MuCo-3DHP

MuCo-3DHP is a large scale training data set showing real images of sophisticated multi-person interactions and occlusions.

34 PAPERS • NO BENCHMARKS YET

JTA (Joint Track Auto)

JTA is a dataset for people tracking in urban scenarios by exploiting a photorealistic videogame. It is up to now the vastest dataset (about 500.000 frames, almost 10 million body poses) of human body parts for people tracking in urban scenarios.

32 PAPERS • 1 BENCHMARK

ExPose (EXpressive POse and Shape rEgression)

Curates a dataset of SMPL-X fits on in-the-wild images.

29 PAPERS • NO BENCHMARKS YET

Deep Fashion3D

A novel benchmark and dataset for the evaluation of image-based garment reconstruction systems. Deep Fashion3D contains 2078 models reconstructed from real garments, which covers 10 different categories and 563 garment instances. It provides rich annotations including 3D feature lines, 3D body pose and the corresponded multi-view real images. In addition, each garment is randomly posed to enhance the variety of real clothing deformations.

24 PAPERS • NO BENCHMARKS YET

HPS (Human POSEitioning System Dataset)

HPS Dataset is a collection of 3D humans interacting with large 3D scenes (300-1000 $m^2$, up to 2500 $m^2$). The dataset contains images captured from a head-mounted camera coupled with the reference 3D pose and location of the person in a pre-scanned 3D scene. 7 people in 8 large scenes are captured performing activities such as exercising, reading, eating, lecturing, using a computer, making coffee, dancing. The dataset provides more than 300K synchronized RGB images coupled with the reference 3D pose and location.

18 PAPERS • NO BENCHMARKS YET

BEDLAM

BEDLAM is a large-scale synthetic video dataset designed to train and test algorithms on the task of 3D human pose and shape estimation (HPS). It contains diverse body shapes, skin tones, and motions. The clothing is realistically simulated on the moving bodies using commercial clothing physics simulation.

17 PAPERS • NO BENCHMARKS YET

AIST++

AIST++ is a 3D dance dataset which contains 3D motion reconstructed from real dancers paired with music. The AIST++ Dance Motion Dataset is constructed from the AIST Dance Video DB. With multi-view videos, an elaborate pipeline is designed to estimate the camera parameters, 3D human keypoints and 3D human dance motion sequences:

15 PAPERS • 2 BENCHMARKS

EMDB

EMDB contains in-the-wild videos of human activity recorded with a hand-held iPhone. It features reference SMPL body pose and shape parameters, as well as global body root and camera trajectories. The reference 3D poses were obtained by jointly fitting SMPL to 12 body-worn electromagnetic sensors and image data. For the latter we fit a neural implicit avatar model to allow for a dense pixel-wise fitting objective.

15 PAPERS • 2 BENCHMARKS

SSP-3D (Sports Shape and Pose 3D)

SSP-3D is an evaluation dataset consisting of 311 images of sportspersons in tight-fitted clothes, with a variety of body shapes and poses. The images were collected from the Sports-1M dataset. SSP-3D is intended for use as a benchmark for body shape prediction methods. Pseudo-ground-truth 3D shape labels (using the SMPL body model) were obtained via multi-frame optimisation with shape consistency between frames, as described here.

14 PAPERS • 1 BENCHMARK

Ski-Pose PTZ-Camera

This multi-view pant-tilt-zoom-camera (PTZ) dataset features competitive alpine skiers performing giant slalom runs. It provides labels for the skiers’ 3D poses in each frame, their projected 2D pose in all 20k images, and accurate per-frame calibration of the PTZ cameras. The dataset was collected by Spörri and Colleagues within his Habilitation at the Department of Sport Science and Kinesiology of the University of Salzburg [Spörri16], and was previously used as a reference in different methodological studies [Gilgien13, Gilgien14, Gilgien 15, Fasel16, Fasel18, Rhodin18]. Moreover, upon request the dataset would be available to interested researchers for further methodological-orientated research purposes.

12 PAPERS • 1 BENCHMARK

MoVi (Large Multipurpose Motion and Video Dataset)

Contains 60 female and 30 male actors performing a collection of 20 predefined everyday actions and sports movements, and one self-chosen movement.

10 PAPERS • 1 BENCHMARK

SIZER
SIZER

Dataset of clothing size variation which includes different subjects wearing casual clothing items in various sizes, totaling to approximately 2000 scans. This dataset includes the scans, registrations to the SMPL model, scans segmented in clothing parts, garment category and size labels.

10 PAPERS • NO BENCHMARKS YET

MVOR
MVOR (Multi-View Operating Room)

Multi-View Operating Room (MVOR) is a dataset recorded during real clinical interventions. It consists of 732 synchronized multi-view frames recorded by three RGB-D cameras in a hybrid OR. It also includes the visual challenges present in such environments, such as occlusions and clutter.

9 PAPERS • NO BENCHMARKS YET

UBody

UBody is a large-scale Upper-Body dataset with the following annotations:

9 PAPERS • 1 BENCHMARK

Unite the People

Unite The People is a dataset for 3D body estimation. The images come from the Leeds Sports Pose dataset and its extended version, as well as the single person tagged people from the MPII Human Pose Dataset. The images are labeled with different types of annotations such as segmentation labels, pose or 3D.

9 PAPERS • NO BENCHMARKS YET

4D-OR

4D-OR includes a total of 6734 scenes, recorded by six calibrated RGB-D Kinect sensors 1 mounted to the ceiling of the OR, with one frame-per-second, providing synchronized RGB and depth images. We provide fused point cloud sequences of entire scenes, automatically annotated human 6D poses and 3D bounding boxes for OR objects. Furthermore, we provide SSG annotations for each step of the surgery together with the clinical roles of all the humans in the scenes, e.g., nurse, head surgeon, anesthesiologist.

8 PAPERS • 1 BENCHMARK

HUMAN4D

HUMAN4D is a large and multimodal 4D dataset that contains a variety of human activities simultaneously captured by a professional marker-based MoCap, a volumetric capture and an audio recording system. By capturing 2 female and $2$ male professional actors performing various full-body movements and expressions, HUMAN4D provides a diverse set of motions and poses encountered as part of single- and multi-person daily, physical and social activities (jumping, dancing, etc. ), along with multi-RGBD (mRGBD), volumetric and audio data.

8 PAPERS • NO BENCHMARKS YET

EgoCap

EgoCap is a dataest of 100,000 egocentric images of eight people in different clothing, with 75,000 images from six people used for training. The images have been captured with two fisheye cameras.

7 PAPERS • NO BENCHMARKS YET

GPA (Geometric Pose Affordance)

multi-view imagery of people interacting with a variety of rich 3D environments

7 PAPERS • 2 BENCHMARKS

3DOH50K

3DOH50K is the first real 3D human dataset for the problem of human reconstruction and pose estimation in occlusion scenarios. It contains 51600 images with accurate 2D pose and 3D pose, SMPL parameters, and binary mask.

6 PAPERS • 1 BENCHMARK

Human-Art
Human-Art

Human-Art is a versatile human-centric dataset to bridge the gap between natural and artificial scenes. It includes twenty high-quality human scenes, including natural and artificial humans in both 2D representation and 3D representation. It includes 50,000 images including more than 123,000 human figures in 20 scenarios, with annotations of human bounding box, 21 2D human keypoints, human self-contact keypoints, and description text.

6 PAPERS • 1 BENCHMARK

SLOPER4D

SLOPER4D is a novel scene-aware dataset collected in large urban environments to facilitate the research of global human pose estimation (GHPE) with human-scene interaction in the wild. It consists of 15 sequences of human motions, each of which has a trajectory length of more than 200 meters (up to 1,300 meters) and covers an area of more than 2,000 (up to 13,000), including more than 100K LiDAR frames, 300k video frames, and 500K IMU-based motion frames. With SLOPER4D, we provide a detailed and thorough analysis of two critical tasks, including camera-based 3D HPE and LiDAR-based 3D HPE in urban environments, and benchmark a new task, GHPE.

6 PAPERS • 1 BENCHMARK

H3WB (Human 3.6M 3D WholeBody)

Human3.6M 3D WholeBody (H3WB) is a large scale dataset with 133 whole-body keypoint annotations on 100K images, made possible by a new multi-view pipeline. It is designed for the three new tasks : i) 3D whole-body pose lifting from 2D complete whole-body pose, ii) 3D whole-body pose lifting from 2D incomplete whole-body pose, iii) 3D whole-body pose estimation from a single RGB image.

3 PAPERS • 3 BENCHMARKS

HSPACE (Human-SPACE)

HSPACE (Human-SPACE) is a large-scale photo-realistic dataset of animated humans placed in complex synthetic indoor and outdoor environments. For all frames the dataset provides 3d pose and shape ground truth, as well as other rich image annotations including human segmentation, body part localisation semantics, and temporal correspondences.

3 PAPERS • 1 BENCHMARK

SportsPose
SportsPose (SportsPose - A Dynamic 3D sports pose dataset)

Accurate 3D human pose estimation is essential for sports analytics, coaching, and injury prevention. However, existing datasets for monocular pose estimation do not adequately capture the challenging and dynamic nature of sports movements. In response, we introduce SportsPose, a large-scale 3D human pose dataset consisting of highly dynamic sports movements. With more than 176,000 3D poses from 24 different subjects performing 5 different sports activities, SportsPose provides a diverse and comprehensive set of 3D poses that reflect the complex and dynamic nature of sports movements. Contrary to other markerless datasets we have quantitatively evaluated the precision of SportsPose by comparing our poses with a commercial marker-based system and achieve a mean error of 34.5 mm across all evaluation sequences. This is comparable to the error reported on the commonly used 3DPW dataset. We further introduce a new metric, local movement, which describes the movement of the wrist and ankle

3 PAPERS • NO BENCHMARKS YET

DHP19 (Dynamic Vision Sensor 3D Human Pose Dataset)

DHP19 is the first human pose dataset with data collected from DVS event cameras.

2 PAPERS • 1 BENCHMARK

UBC3V Dataset
UBC3V Dataset

~6 million synthetic depth frames for pose estimation from multiple cameras.

2 PAPERS • NO BENCHMARKS YET

COCO-MEBOW (Monocular Estimation of Body Orientation In the Wild)

COCO-MEBOW (Monocular Estimation of Body Orientation in the Wild) is a new large-scale dataset for orientation estimation from a single in-the-wild image. The body-orientation labels for 133380 human bodies within 55K images from the COCO dataset have been collected using an efficient and high-precision annotation pipeline. There are 127844 human instance in training set and 5536 human instance in validation set.

1 PAPER • NO BENCHMARKS YET

FreeMan

FreeMan is the first large-scale multi-view human motion dataset under real scenarios. FreeMan was captured by synchro- nizing 8 smartphones across diverse scenarios. It comprises 11M frames from 8000 sequences, viewed from different perspectives. These sequences cover 40 subjects across 10 different scenarios, each with varying lighting conditions.

1 PAPER • NO BENCHMARKS YET

RePoGen

Synthetic humans generated by the RePoGen method.

1 PAPER • NO BENCHMARKS YET

InfiniteRep

InfiniteRep is a synthetic, open-source dataset for fitness and physical therapy (PT) applications. It includes 1k videos of diverse avatars performing multiple repetitions of common exercises. It includes significant variation in the environment, lighting conditions, avatar demographics, and movement trajectories. From cadence to kinematic trajectory, each rep is done slightly differently -- just like real humans. InfiniteRep videos are accompanied by a rich set of pixel-perfect labels and annotations, including frame-specific repetition counts.

0 PAPER • NO BENCHMARKS YET

Parkour-dataset (LAAS Parkour dataset)

The LAAS Parkour dataset contains 28 RGB videos capturing human subjects performing four typical parkour techniques: safety-vault, kong vault, pull-up and muscle-up. These are highly dynamic motions with rich contact interactions with the environment. The dataset is provided with the ground truth 3D positions of 16 pre-defined human joints, together with the contact forces at the human subjects' hand and foot joints exerted by the environment.

0 PAPER • NO BENCHMARKS YET

UNIPD-BPE (University of Padova Body Pose Estimation)

The University of Padova Body Pose Estimation dataset (UNIPD-BPE) is an extensive dataset for multi-sensor body pose estimation containing both single-person and multi-person sequences with up to 4 interacting people A network with 5 Microsoft Azure Kinect RGB-D cameras is exploited to record synchronized high-definition RGB and depth data of the scene from multiple viewpoints, as well as to estimate the subjects’ poses using the Azure Kinect Body Tracking SDK. Simultaneously, full-body Xsens MVN Awinda inertial suits allow obtaining accurate poses and anatomical joint angles, while also providing raw data from the 17 IMUs required by each suit. All the cameras and inertial suits are hardware synchronized, while the relative poses of each camera with respect to the inertial reference frame are calibrated before each sequence to ensure maximum overlap of the two sensing systems outputs.

0 PAPER • NO BENCHMARKS YET

VIDIMU: Multimodal video and IMU kinematic dataset on daily life activities using affordable devices
VIDIMU: Multimodal video and IMU kinematic dataset on daily life activities using affordable devices (https://zenodo.org/record/8210563)

Human activity recognition and clinical biomechanics are challenging problems in physical telerehabilitation medicine. However, most publicly available datasets on human body movements cannot be used to study both problems in an out-of-the-lab movement acquisition setting. The objective of the VIDIMU dataset is to pave the way towards affordable patient tracking solutions for remote daily life activities recognition and kinematic analysis.

0 PAPER • NO BENCHMARKS YET

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy