Method · Gradient matching
SR-GM
Decoupling and Damping: Structurally-Regularized Gradient Matching for Multimodal Graph Condensation
Lian Shen, Zhendan Chen, Meijia Song, Yinhui jiang, Ziming Su, Juan Liu, Xiangrong Liu
arXiv 2025 · first public 2025-11-25 · arXiv 2511.20222
In one paragraph
Condenses multimodal graphs, where node features integrate sources such as vision and text, by decoupling per-modality gradients before matching so that semantic misalignment between modalities does not create gradient conflicts, and adds a structural damping regularizer that suppresses gradient noise the message-passing mechanism would otherwise amplify through the topology. Reports state-of-the-art results and cross-architecture generalization on four multimodal graph datasets.
Where it sits
- Gradient matching (Surrogate matching)
- Setting: Graphs
Abstract (verbatim from arXiv)
In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses a significant computational bottleneck for training. Graph condensation methods provide a feasible path forward by synthesizing compact and representative datasets. Nevertheless, existing condensation approaches generally suffer from performance limitations in multimodal scenarios, mainly due to two reasons: (1) semantic misalignment between different modalities leads to gradient conflicts; (2) the message-passing mechanism of graph neural networks further structurally amplifies such gradient noise. Based on this, we propose Structural Regularized Gradient Matching (SR-GM), a condensation framework for multimodal graphs. This method alleviates gradient conflicts between modalities through a gradient decoupling mechanism and introduces a structural damping regularizer to suppress the propagation of gradient noise in the topology, thereby transforming the graph structure from a noise amplifier into a training stabilizer. Extensive experiments on four multimodal graph datasets demonstrate the effectiveness of SR-GM, highlighting its state-of-the-art performance and cross-architecture generalization capabilities in multimodal graph dataset condensation.
BibTeX (generated; prefer the venue's official entry)
@article{shen2025decoupling,
title = {Decoupling and Damping: Structurally-Regularized Gradient Matching for Multimodal Graph Condensation},
author = {Lian Shen and Zhendan Chen and Meijia Song and Yinhui jiang and Ziming Su and Juan Liu and Xiangrong Liu},
journal = {arXiv preprint arXiv:2511.20222},
year = {2025}
}Nearby in Gradient matching
Linear Gradient Matching — Dataset Distillation for Pre-Trained Self-Supervised Vision Models
George Cazenavette, Antonio Torralba, Vincent Sitzmann · NeurIPS 2025notablePre-training & transferpaper ↗code ↗
Distilled Datamodel with Reverse Gradient Matching
Jingwen Ye, Ruonan Yu, Songhua Liu et al. · CVPR 2024notablepaper ↗
Static-dynamic video DD — Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement
Ziyu Wang, Yue Xu, Cewu Lu et al. · CVPR 2024coreVideopaper ↗code ↗