Method · The generator as the distilled artifact
MGDD
MGDD: A Meta Generator for Fast Dataset Distillation
Songhua Liu, Xinchao Wang
NeurIPS 2023 · first public 2023-01
In one paragraph
Produces synthetic images from a generator network conditioned on a dataset-distillation initialization, with synthetic labels solved in closed form via least squares in feature space, and meta-trains the generator across many datasets so that adapting to a new target needs only a few steps; reports parity with state-of-the-art distillation baselines at 22x less computation and strong generalization to synthetic-set sizes unseen during adaptation.
Where it sits
- The generator as the distilled artifact (Generative priors)
- Setting: Image classification
Design choices
| What is stored | generator-weights |
| Optimization regime | generator-fine-tuning |
BibTeX (generated; prefer the venue's official entry)
@article{liu2023mgdd,
title = {MGDD: A Meta Generator for Fast Dataset Distillation},
author = {Songhua Liu and Xinchao Wang},
journal = {NeurIPS 2023},
year = {2023}
}Nearby in The generator as the distilled artifact
2025-01
Point Cloud DD — Point Cloud Dataset Distillation
Deyu Bo, Xinchao Wang · ICML 2025notableOther datapaper ↗
2023-03