Out-of-Distribution Detection

326 papers with code • 50 benchmarks • 22 datasets

Detect out-of-distribution or anomalous examples.

Benchmarks

Add a Result

These leaderboards are used to track progress in Out-of-Distribution Detection

Dataset	Best Model	Compare
ImageNet-1k vs Textures	ViM (BiT-S-R101×1)	See all
ImageNet-1k vs iNaturalist	NNGuide (RegNet)	See all
ImageNet-1k vs Places	LINe (ResNet50)	See all
ImageNet-1k vs SUN	LINe (ResNet50)	See all
ImageNet-1k vs Curated OODs (avg.)	NNGuide (RegNet)	See all
CIFAR-100 vs CIFAR-10	DHM	See all
CIFAR-10 vs CIFAR-100	DHM	See all
CIFAR-10	DHM	See all
STL-10	Mixup (Imagenet)	See all
CIFAR-100 vs SVHN	OECC + MD	See all
ImageNet-1k vs OpenImage-O	NNGuide (RegNet)	See all
CIFAR-100	Wide ResNet 40x2	See all
MS-1M vs. IJB-C	ResNeXt50 + FSSD	See all
ImageNet dogs vs ImageNet non-dogs	ResNet34 + FSSD	See all
ImageNet-1K vs ImageNet-O	NNGuide-ViM (ViT-B/16)	See all
ImageNet-1k vs NINCO	ViT-B-384 Mahalanobis (pre-trained on IN-21k)	See all
20 Newsgroups	2-Layered GRU	See all
Fashion-MNIST	PAE	See all
CIFAR-100 vs iSUN	DenseNet-BC-100	See all
CIFAR-100 vs LSUN (C)	ResNet-34	See all
CIFAR-100 vs LSUN (R)	DenseNet-BC-100	See all
CIFAR-100 vs ImageNet (R)	DenseNet-BC-100	See all
CIFAR-100 vs ImageNet (C)	DenseNet-BC-100	See all
CIFAR-100 vs Uniform	DenseNet-BC-100	See all
CIFAR-100 vs Gaussian	DenseNet-BC-100	See all
CIFAR-10 vs SVHN	DenseNet-BC-100	See all
CIFAR-10 vs LSUN (C)	DenseNet-BC-100	See all
SVHN vs LSUN (C)	DenseNet-BC-100	See all
CIFAR-10 vs iSUN	DenseNet-BC-100	See all
CIFAR-10 vs ImageNet (R)	DenseNet-BC-100	See all
CIFAR-10 vs ImageNet (C)	DenseNet-BC-100	See all
CIFAR-10 vs Uniform	DenseNet-BC-100	See all
CIFAR-10 vs Gaussian	DenseNet-BC-100	See all
SVHN vs iSUN	DenseNet-BC-100	See all
SVHN vs LSUN (R)	DenseNet-BC-100	See all
SVHN vs ImageNet (R)	DenseNet-BC-100	See all
SVHN vs ImageNet (C)	DenseNet-BC-100	See all
SVHN vs Uniform	DenseNet-BC-100	See all
SVHN vs Gaussian	DenseNet-BC-100	See all
SVHN vs CIFAR-10	DenseNet-BC-100	See all
SVHN vs CIFAR-100	DenseNet-BC-100	See all
CIFAR-10 vs LSUN (R)	ResNet-34	See all
Near-OOD	ISH (ResNet50)	See all
Far-OOD	ISH (ResNet50)	See all
TREC-NEWS	2-Layered GRU	See all
SST	2-Layered GRU	See all
CIFAR-10 vs CIFAR-10.1	ERD (ResNet18)	See all
CIFAR10	Wide ResNet 40x2	See all
cifar10	Wideresnet 40	See all
cifar100	Wide Resnet 40x2	See all

Show all 50 benchmarks

Collapse benchmarks

Libraries

Use these libraries to find Out-of-Distribution Detection models and implementations

jingkang50/openood

6 papers

749

kingjamessong/rankfeat

5 papers

lancopku/avg-avg

5 papers

dlmacedo/entropic-out-of-distributi…

4 papers

See all 9 libraries.

Datasets

Most implemented papers

Most implemented Social Latest No code

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

clovaai/CutMix-PyTorch • • ICCV 2019

Regional dropout strategies have been proposed to enhance the performance of convolutional neural network classifiers.

Paper
Code

A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks

hendrycks/error-detection • • 7 Oct 2016

We consider the two related problems of detecting if an example is misclassified or out-of-distribution.

Paper
Code

Deep Anomaly Detection with Outlier Exposure

hendrycks/outlier-exposure • • ICLR 2019

We also analyze the flexibility and robustness of Outlier Exposure, and identify characteristics of the auxiliary dataset that improve performance.

Paper
Code

Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks

facebookresearch/odin • • ICLR 2018

We show in a series of experiments that ODIN is compatible with diverse network architectures and datasets.

Paper
Code

Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices

VectorInstitute/gram-ood-detection • • 28 Dec 2019

We find that characterizing activity patterns by Gram matrices and identifying anomalies in gram matrix values can yield high OOD detection rates.

Paper
Code

Energy-based Out-of-distribution Detection

wetliu/energy_ood • • NeurIPS 2020

We propose a unified framework for OOD detection that uses an energy score.

Paper
Code

Learning Confidence for Out-of-Distribution Detection in Neural Networks

uoguelph-mlrg/confidence_estimation • • 13 Feb 2018

Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong.

Paper
Code

A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks

pokaxpoka/deep_Mahalanobis_detector • • NeurIPS 2018

Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applications.

Paper
Code