Method · Gradient matching
Graph Data Condensation via Self-expressive Graph Structure Reconstruction
Zhanyu Liu, Chaolv Zeng, Guanjie Zheng
KDD 2024 · first public 2024-03-12 · arXiv 2403.07294
In one paragraph
GCSR (GCSR) condenses a graph by reconstructing an interpretable, closed-form self-expressive adjacency for the condensed nodes (each node reconstructed from a sparse combination of the others in its feature subspace) instead of learning a structure generator or dropping structure entirely, while node features are refined by multi-step gradient matching against the full graph's training trajectories. The paper reports the best average cross-architecture GNN accuracy among graph condensation baselines, attributing the gain to keeping explicit structural information.
Where it sits
- Gradient matching (Surrogate matching)
- Setting: Graphs
Design choices
| What is stored | graph-structure |
Builds on
Abstract (verbatim from arXiv)
With the increasing demands of training graph neural networks (GNNs) on large-scale graphs, graph data condensation has emerged as a critical technique to relieve the storage and time costs during the training phase. It aims to condense the original large-scale graph to a much smaller synthetic graph while preserving the essential information necessary for efficiently training a downstream GNN. However, existing methods concentrate either on optimizing node features exclusively or endeavor to independently learn node features and the graph structure generator. They could not explicitly leverage the information of the original graph structure and failed to construct an interpretable graph structure for the synthetic dataset. To address these issues, we introduce a novel framework named \textbf{G}raph Data \textbf{C}ondensation via \textbf{S}elf-expressive Graph Structure \textbf{R}econstruction (\textbf{GCSR}). Our method stands out by (1) explicitly incorporating the original graph structure into the condensing process and (2) capturing the nuanced interdependencies between the condensed nodes by reconstructing an interpretable self-expressive graph structure. Extensive experiments and comprehensive analysis validate the efficacy of the proposed method across diverse GNN models and datasets. Our code is available at \url{https://github.com/zclzcl0223/GCSR}.
BibTeX (generated; prefer the venue's official entry)
@article{liu2024graph,
title = {Graph Data Condensation via Self-expressive Graph Structure Reconstruction},
author = {Zhanyu Liu and Chaolv Zeng and Guanjie Zheng},
journal = {KDD 2024},
year = {2024}
}Nearby in Gradient matching
Linear Gradient Matching — Dataset Distillation for Pre-Trained Self-Supervised Vision Models
George Cazenavette, Antonio Torralba, Vincent Sitzmann · NeurIPS 2025notablePre-training & transferpaper ↗code ↗
Distilled Datamodel with Reverse Gradient Matching
Jingwen Ye, Ruonan Yu, Songhua Liu et al. · CVPR 2024notablepaper ↗
Static-dynamic video DD — Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement
Ziyu Wang, Yue Xu, Cewu Lu et al. · CVPR 2024coreVideopaper ↗code ↗