Dataset Condensation Atlas

Method · Optimization and training recipes

DDTime

DDTime: Dataset Distillation with Spectral Alignment and Information Bottleneck for Time-Series Forecasting

Yuqi Li, Kuiye Ding, Chuanguang Yang, Hao Wang, Haoxuan Wang, Huiran Duan, Junming Liu, Yingli Tian

arXiv 2025 · first public 2025-11-20 · arXiv 2511.16715

paper ↗catalogued✓ abstract read

In one paragraph

Proposes DDTime, a lightweight plug-in for time-series-forecasting dataset distillation that corrects autocorrelation-induced value-alignment bias with a frequency-domain alignment mechanism and increases synthetic-sample diversity with an information-bottleneck-inspired inter-sample regularizer; reports about 30% relative accuracy gains over prior distillation methods across 20 benchmark datasets and several forecasting architectures, at roughly 2.49% computational overhead.

Where it sits

Abstract (verbatim from arXiv)

Time-series forecasting is fundamental across many domains, yet training accurate models often requires large-scale datasets and substantial computational resources. Dataset distillation offers a promising alternative by synthesizing compact datasets that preserve the learning behavior of full data. However, extending dataset distillation to time-series forecasting is non-trivial due to two fundamental challenges: 1.temporal bias from strong autocorrelation, which leads to distorted value-term alignment between teacher and student models; and 2.insufficient diversity among synthetic samples, arising from the absence of explicit categorical priors to regularize trajectory variety. In this work, we propose DDTime, a lightweight and plug-in distillation framework built upon first-order condensation decomposition. To tackle Challenge 1, it revisits value-term alignment through temporal statistics and introduces a frequency-domain alignment mechanism to mitigate autocorrelation-induced bias, ensuring spectral consistency and temporal fidelity. To address Challenge 2, we further design an inter-sample regularization inspired by the information bottleneck principle, which enhances diversity and maximizes information density across synthetic trajectories. The combined objective is theoretically compatible with a wide range of condensation paradigms and supports stable first-order optimization. Extensive experiments on 20 benchmark datasets and diverse forecasting architectures demonstrate that DDTime consistently outperforms existing distillation methods, achieving about 30% relative accuracy gains while introducing about 2.49% computational overhead. All code and distilled datasets will be released.

BibTeX (generated; prefer the venue's official entry)
@article{li2025ddtime,
  title   = {DDTime: Dataset Distillation with Spectral Alignment and Information Bottleneck for Time-Series Forecasting},
  author  = {Yuqi Li and Kuiye Ding and Chuanguang Yang and Hao Wang and Haoxuan Wang and Huiran Duan and Junming Liu and Yingli Tian},
  journal = {arXiv preprint arXiv:2511.16715},
  year    = {2025}
}

Nearby in Optimization and training recipes

2026-05

C^2R — Mind Your Margin and Boundary: Are Your Distilled Datasets Truly Robust?

Muquan Li, Yingyi Ma, Yihong Huang et al. · ICML 2026notablepaper ↗

2026-04

COBRA — Fair Dataset Distillation via Cross-Group Barycenter Alignment

Mohammad Hossein Moslemi, Nima Hosseini Dashtbayaz, Zhimin Mei et al. · ICML 2026notablepaper ↗code ↗

2026-03

PTM-ST — Multimodal Dataset Distillation via Phased Teacher Models

Shengbin Guo, Hang Zhao, Senqiao Yang et al. · ICLR 2026notableVision–languagepaper ↗code ↗

2026-03

FD2 — FD$^2$: A Dedicated Framework for Fine-Grained Dataset Distillation

Hongxu Ma, Guang Li, Shijie Wang et al. · ECCV 2026notablepaper ↗

2025-05

PRISM — PRISM: Video Dataset Condensation with Progressive Refinement and Insertion for Sparse Motion

Jaehyun Choi, Jiwan Hur, Gyojin Han et al. · CVPR 2026notableVideopaper ↗