Dataset Condensation Atlas

Selection baseline · Coreset selection

Herding

Herding Dynamical Weights to Learn

Max Welling

ICML 2009 · first public 2009-01

paper ↗notable✓ metadata verified

In one paragraph

Defines herding, a deterministic weakly-chaotic dynamical system that converts a set of observed moments directly into a sequence of pseudo-samples respecting those moments, without first fitting a joint probability model over the data. Used in the coreset-selection literature as the mean-matching baseline: samples are added greedily to minimize the distance between the running average of selected samples' features and the true class-mean feature.

Where it sits

BibTeX (generated; prefer the venue's official entry)
@article{welling2009herding,
  title   = {Herding Dynamical Weights to Learn},
  author  = {Max Welling},
  journal = {ICML 2009},
  year    = {2009}
}

Nearby in Coreset selection

2025-07

D2C — Accelerating Diffusion Model Training under Minimal Budgets: A Condensation-Based Perspective

Rui Huang, Shitong Shao, Zikai Zhou et al. · CVPR 2026notablePre-training & transferpaper ↗

2025-06

OD3 — OD3: Optimization-free Dataset Distillation for Object Detection

Salwa K. Al Khatib, Ahmed ElHagry, Shitong Shao et al. · ICLR 2026notableDense predictionpaper ↗code ↗

2024-05

SelMatch — SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching

Yongmin Lee, Hye Won Chung · ICML 2024notablepaper ↗code ↗

2018-12

Forgetting — An Empirical Study of Example Forgetting during Deep Neural Network Learning

Mariya Toneva, Alessandro Sordoni, Remi Tachet des Combes et al. · ICLR 2019notablepaper ↗

2017-08

k-Center coreset — Active Learning for Convolutional Neural Networks: A Core-Set Approach

Ozan Sener, Silvio Savarese · ICLR 2018notablepaper ↗