core
STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation
Cho, Jeong, Lim, Yoon · DEEPNOID Inc. · 2026-06 · arXiv:2606.07036
Why it matters
The first genuine representation-space generator in medical imaging: it runs Riemannian flow matching directly inside a pretrained histopathology foundation model's patch-token feature space, which is L2-normalized and therefore lives on a hypersphere, with a custom anisotropic decoder back to pixels. Its stated motivation mirrors RAE's: conditioning on foundation features (as PixCell does) causes conditioning collapse, and using that space as the generative substrate is proposed as the fix.
What this paper does
read: full textBefore this
Latent diffusion dominates histopathology image generation, and recent state-of-the-art models such as ZoomLDM and PixCell use pretrained pathology vision foundation models, but only as a conditioning signal layered on top of a separate VAE latent space, not as the generative space itself.
The problem
Conditioning a VAE-latent diffusion model on a foundation-model embedding causes what the paper calls conditioning collapse, where the conditioning signal accounts for 62 to 76 percent of output diversity rather than the learned latent space. This both weakens unconditional generation and forces the model to depend on access to the foundation model at inference time.
The idea
Instead of conditioning on a foundation model's features, generate directly inside them. Because pathology foundation-model patch-token features are L2-normalized and lie on a hypersphere with strong angular structure, the generative process should use a Riemannian formulation native to that geometry rather than assuming a flat Euclidean latent.
How it works
The generation space is the frozen UNI pathology foundation model's patch-token feature space itself, 256 tokens of dimension 1024 lying on the unit hypersphere, not a VAE latent or pixel space. The paper's explicit reason is geometric. It measures these features as L2-normalized with strong angular dominance (an angular-dominance score above 0.97), high intrinsic curvature and effective rank around 252 to 265, and argues a Euclidean latent diffusion formulation is mismatched to that structure, making a Riemannian formulation the natural fit. A LightningDiT-XL model of roughly 676 million parameters is trained with a novel stochastic bridge Riemannian flow matching, using a noise schedule that vanishes at both endpoints so per-token rectifiability holds on the sphere, and a separate anisotropic ViT-XL decoder maps generated tokens back to pixels with noise shaped by the SVD of the trained model's velocity-field Jacobian, applying small noise along directions the generator is sensitive to and larger noise elsewhere.
Evidence
The paper reports only distribution metrics; it offers no downstream clinical task and no reader study, and it concedes this directly. On TCGA-BRCA, reconstruction FID is 2.42 for STREAM versus 4.88 for ZoomLDM and 2.88 for PixCell, and generation FID is 6.61 versus 7.43 and 104.18. PixCell's unconditional generation FID of 104.18 is offered as direct confirmation of conditioning collapse once the foundation-model conditioning is removed. Generation FvD, computed with a pathology-specific feature extractor, is 78.04 for STREAM versus 196.41 for ZoomLDM and 1298.00 for PixCell. On TCGA-COADREAD, generation FID is 7.68 for STREAM versus 8.09 for ZoomLDM. An ablation shows the two contributions are superadditive, reaching reconstruction FID 3.52 and generation FID 6.86 combined, where the bridge component alone gives marginal or slightly worse generation FID and the anisotropic decoder alone gives a modest reconstruction gain.
Limitations
The paper concedes that its core rectifiability guarantee, Theorem 3, is a population-level result under a per-token assumption and does not formally extend to cross-token dynamics on the full product manifold. It also concedes that the anisotropic decoder mechanism is validated only indirectly, through Lipschitz-contrast experiments, rather than proven directly, and that its benefit is largely erased when the domain-matched UNI encoder is swapped for a natural-image encoder such as DINOv2-L, so the method depends on having a high-quality pathology-pretrained foundation model. Most importantly, every reported result is a distribution metric; there is no diagnostic-task evaluation and no pathologist assessment of any kind.
Why it matters
This is presented as the first genuine representation-space generator in medical imaging, breaking the usual reconstruction-generation tradeoff by improving both simultaneously and removing the need for foundation-model access at inference. But its evidence is entirely distribution-metric, and the companion challenge paper in this line shows that foundation-model-latent gains measured internally can evaporate under independent evaluation, so STREAM's strong FID and FvD numbers are not yet the kind of downstream evidence this atlas treats as decisive.
Abstract, in the authors' own words
Synthetic histopathology image generation addresses critical challenges in computational pathology, including patient privacy and the growing need for large-scale training data for foundation models. Latent diffusion models have dominated the image generation domain, with recent works emphasizing that the choice of latent space is critical to the quality of generated images. Existing state-of-the-art generative models in histopathology use pretrained Vision Foundation Models (VFMs) as conditioning signals, and we observe that this leads to "conditioning collapse," where the conditioning signal dominates the latent space and lowers the quality and diversity of generated samples. Therefore, we instead use pretrained histopathology VFMs as the latent space itself, leveraging their patch-token features that encode rich semantic information. We empirically show that these features are $\ell_2$-normalized and lie on the unit hypersphere $\mathcal{S}^{d-1}$ with strong angular dominance and intrinsic curvature, making them naturally suited for a Riemannian formulation. We therefore present STREAM, the first framework to apply Riemannian flow matching in the pathology domain. STREAM consists of two stages: 1) a bridge-type stochastic perturbation that establishes per-token rectifiability on $\mathcal{S}^{d-1}$ for training a Diffusion Transformer (DiT) in latent space, and 2) a novel anisotropic decoder that allocates robustness to low-energy directions of the velocity-field Jacobian while preserving fidelity along its high-energy directions. Together, STREAM achieves state-of-the-art reconstruction and generation performance on breast and colorectal cancer datasets. The code will be publicly released upon acceptance.
Research line
Problem
- Most medical image generation runs inside an autoencoder trained on natural photographs, and nobody has tested whether that latent preserves clinically relevant detail.
Method note — the shared flow-matching interpolation
Every flow-matching / rectified-flow paper in this atlas trains toward a straight-line path between a noise sample x₀ and a data sample x₁:
Builds on
Nothing recorded yet.
Built on by
Nothing recorded yet.