Physics-based efficient full projector compensation using only natural images


IEEE Transactions on Visualization and Computer Graphics

Published on June 02, 2023 by Y. Li, W. Yin, J. Li, and X. Xie

Full Projector Compensation Projector Display Matrix Factorization

1 min READ

Achieving practical full projector compensation requires the projection display to adapt quickly to textured projection surfaces and unexpected movements without interrupting the display procedure. A possible solution to achieve this involves using a projector and an RGB camera and correcting both color and geometry by directly capturing and analyzing the projected natural image content, without the need for additional patterns. In this study, we approach full projector compensation as a numerical optimization problem and present a physics-based framework that can handle both geometric calibration and radiometric compensation for a Projector-camera system (Procams), using only a few sampling natural images. Our related code is available at GitHub, and paper at PDF.


The physical model of the Procams displaying images on textured surfaces:
structure

The temporary compensated images and simulated results of our compensation algorithm with the different number of iterations (iter=5, 10, 15, 20):
structure

The comparisons of the compensation results of our method and CompenNeSt++ on the projection surface:
structure