Refractive Multi-view Stereo

Matthew Cassidy (1) , Jean Mélou (2) , Yvain Quéau (3) , François Lauze (4) , Jean-Denis Durou (2)

1 ENSEEIHT - Ecole Nationale Supérieure d'Electrotechnique, d'Electronique, d'Informatique, d'Hydraulique et de Télécommunications
2 IRIT-REVA - Real Expression Artificial Life
3 Equipe Image - Laboratoire GREYC - UMR6072
4 DIKU - Department of Computer Science [Copenhagen]

In this article we show how to extend the multi-view stereo technique when the object to be reconstructed is inside a transparent-but refractive-material, which causes distortions in the images. We provide a theoretical formulation of the problem accounting for a general, non-planar shape of the refractive interface, then a discrete solving method, which are validated by tests on synthetic and real data.

Mots clés: 3D- reconstruction; Multi-view Stereo; Refraction

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Matthew Cassidy, Jean Mélou, Yvain Quéau, François Lauze, Jean-Denis Durou. Refractive Multi-view Stereo. International Conference on 3D Vision (3DV 2020), Nov 2020, Fukuoka (on line), Japan. pp.384-393, ⟨10.1109/3DV50981.2020.00048⟩. ⟨hal-02964852⟩