Sample Space Partitioning and Spatiotemporal Resampling for Specular Manifold Sampling

Pengpei Hong Meng Duan Beibei Wang Cem Yuksel Tizian Zeltner Daqi Lin

SIGGRAPH Asia 2025 (Conference Track)

A comparison between our method, our method with ReSTIR, path tracing (PT), and specular manifold sampling (SMS) in a scene containing a two-sided refractive slab and a metallic reflective plane, both with normal variation to create caustic patterns. The scene is lit by two different-colored area lights. With only 1 sample per pixel, our method significantly reduces the variance and the frame time compared to SMS. Combining our method with ReSTIR's spatiotemporal resampling produces a more converged rendering in real time. Our sample space partitioning uses 32x32 tiles and 3x3 trust regions.

Abstract

Caustics rendering remains a long-standing challenge in Monte Carlo rendering because high-energy specular paths occupy only a small region of path space, making them difficult to sample effectively. Recent work such as Specular Manifold Sampling (SMS) [Zeltner et al. 2020] can stochastically sample these specular paths and estimate their unbiased weights using Bernoulli trials. However, applying SMS in interactive rendering is non-trivial because it is slow and delivers noisy images given a very limited time budget.

In this work, we extend SMS for high-quality caustic rendering in interactive settings using sample space partitioning. Our insight is that Newton iterations, the main performance bottleneck of SMS, can be restricted to the vicinity of the seed path, which can dramatically improve the performance. We achieve this with tile-based sample space partitioning, which bounds the manifold walk region and allows building a per-frame prior distribution that concentrates initial guesses around solutions. This reduces the cost of SMS and improves its sampling quality. Applying spatiotemporal reuse (ReSTIR) further amortizes the sample generation cost, greatly increasing the effective sample count. As a result, we achieve significant variance reduction compared to SMS in interactive rendering scenarios.

Video

Downloads

Publication

Code

BibTeX Reference

@inproceedings{Hong2025Sample,
    author = {Hong, Pengpei and Duan, Meng and Wang, Beibei and Yuksel, Cem and Zeltner, Tizian and Lin, Daqi},
    title = {Sample Space Partitioning and Spatiotemporal Resampling for Specular Manifold Sampling},
    year = {2025},
    publisher = {Association for Computing Machinery},
    address = {New York, NY, USA},
    doi = {10.1145/3757377.3763927},
    booktitle = {Proceedings of the SIGGRAPH Asia 2025 Conference Papers},
    articleno = {13},
    numpages = {10},
    series = {SA Conference Papers '25}
}