Dataset Condensation Atlas

Method · The generator as the distilled artifact

MGDD

MGDD: A Meta Generator for Fast Dataset Distillation

Songhua Liu, Xinchao Wang

NeurIPS 2023 · first public 2023-01

paper ↗catalogued✓ abstract read

In one paragraph

Produces synthetic images from a generator network conditioned on a dataset-distillation initialization, with synthetic labels solved in closed form via least squares in feature space, and meta-trains the generator across many datasets so that adapting to a new target needs only a few steps; reports parity with state-of-the-art distillation baselines at 22x less computation and strong generalization to synthetic-set sizes unseen during adaptation.

Where it sits

Design choices

What is storedgenerator-weights
Optimization regimegenerator-fine-tuning
BibTeX (generated; prefer the venue's official entry)
@article{liu2023mgdd,
  title   = {MGDD: A Meta Generator for Fast Dataset Distillation},
  author  = {Songhua Liu and Xinchao Wang},
  journal = {NeurIPS 2023},
  year    = {2023}
}

Nearby in The generator as the distilled artifact

2025-01

Point Cloud DD — Point Cloud Dataset Distillation

Deyu Bo, Xinchao Wang · ICML 2025notableOther datapaper ↗

2023-03

DiM — DiM: Distilling Dataset into Generative Model

Kai Wang, Jianyang Gu, Daquan Zhou et al. · arXiv 2023corepaper ↗code ↗

2019-12

GTN — Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data

Felipe Petroski Such, Aditya Rawal, Joel Lehman et al. · ICML 2020notablepaper ↗code ↗