Proceedings of the International Display Workshops Volume 29 (IDW '22)

Proceedings of the International Display Workshops Volume 29 (IDW '22)

Dec 14 - Dec 16, 2022Fukuoka International Congress Center
The International Display Workshops
Proceedings of the International Display Workshops Volume 29 (IDW '22)

Proceedings of the International Display Workshops Volume 29 (IDW '22)

Dec 14 - Dec 16, 2022Fukuoka International Congress Center

[MVS1-1]PBR Textures Capture by CNN Trained in Virtual 3D Scene

*Chih Yang1, Tzung-Han Lin1(1.National Taiwan University of Science and Technology (Taiwan))
https://doi.org/10.36463/idw.2022.1173

Keywords:

physically based rendering,BRDF,deep learning,CNN

This study proposes a PBR (physically based rendering) texture capturing system using CNN (convolutional neural network). To obtain training data, we built a virtual capturing system in computer graphics environment. The final trained CNN was able to generate a set of PBR texture after inputting 4 photos of different lighting conditions.