Dataset Condensation Atlas

Application · Meta-learning through unrolled training

Gastric SLDD

Soft-Label Anonymous Gastric X-ray Image Distillation

Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

ICIP 2020 · first public 2021-04-07 · arXiv 2104.02857

paper ↗code ↗catalogued✓ abstract read

In one paragraph

Applies gradient-descent dataset distillation, jointly optimizing distilled images, distilled soft labels and the learning rate, to gastric X-ray images so the resulting tiny distilled set both compresses the dataset and anonymizes the original patient images by construction. Reports the compressed images no longer carry identifiable patient information while remaining useful for training.

Where it sits

Design choices

Labelslearned
Abstract (verbatim from arXiv)

This paper presents a soft-label anonymous gastric X-ray image distillation method based on a gradient descent approach. The sharing of medical data is demanded to construct high-accuracy computer-aided diagnosis (CAD) systems. However, the large size of the medical dataset and privacy protection are remaining problems in medical data sharing, which hindered the research of CAD systems. The idea of our distillation method is to extract the valid information of the medical dataset and generate a tiny distilled dataset that has a different data distribution. Different from model distillation, our method aims to find the optimal distilled images, distilled labels and the optimized learning rate. Experimental results show that the proposed method can not only effectively compress the medical dataset but also anonymize medical images to protect the patient's private information. The proposed approach can improve the efficiency and security of medical data sharing.

BibTeX (generated; prefer the venue's official entry)
@article{li2021soft,
  title   = {Soft-Label Anonymous Gastric X-ray Image Distillation},
  author  = {Guang Li and Ren Togo and Takahiro Ogawa and Miki Haseyama},
  journal = {ICIP 2020},
  year    = {2021}
}

Nearby in Meta-learning through unrolled training

2024-10

Offline Behavior Distillation

Shiye Lei, Sen Zhang, Dacheng Tao · NeurIPS 2024notableOther datapaper ↗code ↗

2023-11

RaT-BPTT — Embarassingly Simple Dataset Distillation

Yunzhen Feng, Ramakrishna Vedantam, Julia Kempe · ICLR 2024notablepaper ↗code ↗

2019-12

GTN — Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data

Felipe Petroski Such, Aditya Rawal, Joel Lehman et al. · ICML 2020notablepaper ↗code ↗

2018-11

DD — Dataset Distillation

Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba et al. · arXiv 2018landmarkpaper ↗code ↗