Dataset Condensation Atlas

Method · Gradient matching

Graph Data Condensation via Self-expressive Graph Structure Reconstruction

Zhanyu Liu, Chaolv Zeng, Guanjie Zheng

KDD 2024 · first public 2024-03-12 · arXiv 2403.07294

paper ↗code ↗catalogued✓ abstract read

In one paragraph

GCSR (GCSR) condenses a graph by reconstructing an interpretable, closed-form self-expressive adjacency for the condensed nodes (each node reconstructed from a sparse combination of the others in its feature subspace) instead of learning a structure generator or dropping structure entirely, while node features are refined by multi-step gradient matching against the full graph's training trajectories. The paper reports the best average cross-architecture GNN accuracy among graph condensation baselines, attributing the gain to keeping explicit structural information.

Where it sits

Design choices

What is storedgraph-structure

Builds on

Abstract (verbatim from arXiv)

With the increasing demands of training graph neural networks (GNNs) on large-scale graphs, graph data condensation has emerged as a critical technique to relieve the storage and time costs during the training phase. It aims to condense the original large-scale graph to a much smaller synthetic graph while preserving the essential information necessary for efficiently training a downstream GNN. However, existing methods concentrate either on optimizing node features exclusively or endeavor to independently learn node features and the graph structure generator. They could not explicitly leverage the information of the original graph structure and failed to construct an interpretable graph structure for the synthetic dataset. To address these issues, we introduce a novel framework named \textbf{G}raph Data \textbf{C}ondensation via \textbf{S}elf-expressive Graph Structure \textbf{R}econstruction (\textbf{GCSR}). Our method stands out by (1) explicitly incorporating the original graph structure into the condensing process and (2) capturing the nuanced interdependencies between the condensed nodes by reconstructing an interpretable self-expressive graph structure. Extensive experiments and comprehensive analysis validate the efficacy of the proposed method across diverse GNN models and datasets. Our code is available at \url{https://github.com/zclzcl0223/GCSR}.

BibTeX (generated; prefer the venue's official entry)
@article{liu2024graph,
  title   = {Graph Data Condensation via Self-expressive Graph Structure Reconstruction},
  author  = {Zhanyu Liu and Chaolv Zeng and Guanjie Zheng},
  journal = {KDD 2024},
  year    = {2024}
}

Nearby in Gradient matching

2025-11

Linear Gradient Matching — Dataset Distillation for Pre-Trained Self-Supervised Vision Models

George Cazenavette, Antonio Torralba, Vincent Sitzmann · NeurIPS 2025notablePre-training & transferpaper ↗code ↗

2025-05

PRISM — PRISM: Video Dataset Condensation with Progressive Refinement and Insertion for Sparse Motion

Jaehyun Choi, Jiwan Hur, Gyojin Han et al. · CVPR 2026notableVideopaper ↗

2025-02

GRADMM — Synthetic Text Generation for Training Large Language Models via Gradient Matching

Dang Nguyen, Zeman Li, Mohammadhossein Bateni et al. · ICML 2025notableTextpaper ↗code ↗

2024-04

Distilled Datamodel with Reverse Gradient Matching

Jingwen Ye, Ruonan Yu, Songhua Liu et al. · CVPR 2024notablepaper ↗

2023-12

Static-dynamic video DD — Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement

Ziyu Wang, Yue Xu, Cewu Lu et al. · CVPR 2024coreVideopaper ↗code ↗