Rxivist logo

Computational model for human 3D shape perception from a single specular image

By Takeaki Shimokawa, Akiko Nishio, Masa-aki Sato, Mitsuo Kawato, Hidehiko Komatsu

Posted 02 Aug 2018
bioRxiv DOI: 10.1101/383174 (published DOI: 10.3389/fncom.2019.00010)

In natural conditions the human visual system can estimate the 3D shape of specular objects even from a single image. Although previous studies suggested that the orientation field plays a key role for 3D shape perception from specular reflections, its computational plausibility and possible mechanisms have not been investigated. In this study, to complement the orientation field information, we first add prior knowledge that objects are illuminated from above and utilize the vertical polarity of the intensity gradient. Then we construct an algorithm that incorporates these two image cues to estimate 3D shapes from a single specular image. We evaluated the algorithm with glossy and mirrored surfaces and found that 3D shapes can be recovered with a high correlation coefficient of around 0.8 with true surface shapes. Moreover, under a specific condition, the algorithm's errors resembled those made by human observers. These findings show that the combination of the orientation field and the vertical polarity of the intensity gradient is computationally sufficient and probably reproduces essential representations used in human shape perception from specular reflections.

Download data

  • Downloaded 340 times
  • Download rankings, all-time:
    • Site-wide: 142,188
    • In neuroscience: 20,614
  • Year to date:
    • Site-wide: 179,631
  • Since beginning of last month:
    • Site-wide: 110,042

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide