3D Reconstruction of Tongue Surface Based on Photometric Stereo Method

Cai Yi-heng; Zhang Lin-lin; Sheng Nan; Zhang Xin-feng; Wang Li-na

doi:10.11999/JEIT150124

Volume 37 Issue 11

Nov. 2015

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2015 > 37(11): 2564-2570

Cai Yi-heng, Zhang Lin-lin, Sheng Nan, Zhang Xin-feng, Wang Li-na. 3D Reconstruction of Tongue Surface Based on Photometric Stereo Method[J]. Journal of Electronics & Information Technology, 2015, 37(11): 2564-2570. doi: 10.11999/JEIT150124

Citation:

Cai Yi-heng, Zhang Lin-lin, Sheng Nan, Zhang Xin-feng, Wang Li-na. 3D Reconstruction of Tongue Surface Based on Photometric Stereo Method[J]. Journal of Electronics & Information Technology, 2015, 37(11): 2564-2570. doi: 10.11999/JEIT150124

Citation:

PDF( 10435 KB)

3D Reconstruction of Tongue Surface Based on Photometric Stereo Method

doi: 10.11999/JEIT150124

Funds:

The National Natural Science Foundation of China(61201360)

Received Date: 2015-01-22
Rev Recd Date: 2015-07-15
Publish Date: 2015-11-19

Abstract

Abstract

In the process of the objective research in traditional Chinese medicine tongue diagnosis, the tongue information obtained from the analysis of 2D tongue image is limited. It restricts the development of tongue diagnosis. Based on the feasibility of photometric stereo method to reconstruct the static tongue mode, for reconstructing the 3D surface of the real tongue, a dynamic information collection system is designed for image information acquisition. Then the normal vectors, texture reflectance and depth values are obtained with photometric stereo method, and the 3D surface of tongue is displayed based on DirectX. Finally, a highlight excluding algorithm is used to reduce the effects of the highlight areas on the reconstruction results. After the highlight excluding, it performs better in the reconstruction accuracy and robustness aspects. Experimental results indicate that the average relative error of this algorithm is of 7.24%. The results can express the tongue surface morphology and details such as tooth marks visually.
- Image processing,
- Photometric stereo method,
- 3D reconstruction,
- Highlight,
- Surface normal,
- Tongue characterization

FullText(HTML)

References(30)

References

陈雪姣, 王玉臣, 王德才. 中医舌诊客观化研究的发展概况[J]. 江西中医药, 2012, 43(1): 72-75.

Chen Xue-jiao, Wang Yu-chen, and Wang De-cai. The overview of the development of traditional Chinese medicine tongue diagnosis[J]. Jiangxi Journal of Traditional and Chinese Medicine, 2012, 43(1): 72-75.

叶长明, 蒋建国, 詹曙. 基于三维人脸成像系统的复数域人脸识别方法[J]. 电子测量与仪器学报, 2011, 25(5): 420-426.

Ye Chang-ming, Jiang Jian-guo, and Zhan Shu. Face recognition in complex domain based on 3D facial imaging system[J]. Journal of Electronic Meeasurement and Instrument, 2011, 25(5): 420-426.

王昕, 郭宝锋, 尚朝轩. 基于二维ISAR图像序列的雷达目标三维重建方法[J]. 电子与信息学报, 2013, 35(10): 2475-2480.

Wang Xin, Guo Bao-feng, and Shang Chao-xuan. 3D reconstruction of target geometry based on 2D data of inverse synthetic aperture radar images[J]. Journal of Electronics Information Technology, 2013, 35(10): 2475-2480.

李自力, 朱光喜, 朱耀庭. 一种基于会聚双目立体视觉的用户化身模型[J]. 电子与信息学报,?2003, 25(6):?763-770.

Li Zi-li, Zhu Guang-xi, and Zhu Yao-ting. A user avatar model based-on convergent binocular stereo vision[J]. Journal of Electronics Information Technology, 2003, 25(6): 763-770.

陈宇峰, 谭文静, 王海涛. 光度立体三维重建算法[J]. 计算机辅助设计与图形学学报, 2005, 17(11): 2408-2414.

Chen Yu-feng, Tan Wen-jing, and Wang Hai-tao. Photometric stereo 3D reconstruction and application[J]. Journal of Computer-Aided Design Computer Graphics, 2005, 17(11): 2408-2414.

Woodham R J. Photometric method for determining surface orientation from multiple images[J]. Optical Engineering, 1980, 19(1): 191139.

Coleman E Jr and Jain R. Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry [J]. Computer Graphics and?Image Processing, 1982, 18(4): 309-328.

L H, Cai Y, and Guo S. 3D reconstruction of tongue surface based on photometric stereo[C]. 2007 IEEE 11th International Conference on Signal Processing (ICSP), Barcelona, Spain, 2012, 3: 1668-1671.

朱穆朗玛, 燕海霞, 钱鹏. 基于图像信息采集的中医舌诊仪器硬件设计研究进展[J]. 世界科学技术中医药现代化, 2014, 16(2): 433-437.

Zhu Mulangma, Yan Hai-xia, and Qian Peng. Study progress on designs of acquisition instrument with image capturing in tongue inspection[J]. Modernization of Traditional Chinese Medicine and Materia MedicaWorld Science and Technology, 2014, 16(2): 433-437.

Park J I, Lee M H, Grossberg M D, et al.. Multispectral imaging using multiplexed illumination[C]. 2007 IEEE 11th International Conference on Computer Vision, Rio De Janeiro, Brazil, 2007: 1-8.

徐庆相. 基于光度立体视觉的表面精细特征三维重建技术研究[D]. [硕士论文], 华中科技大学, 2011.

Xu Qing-xiang. Research on 3D reconstruction of detailed features based on photometri stereo[D]. [Master dissertation], Huazhong University of Science Technology, 2011.

张彦. 基于光度立体视觉的三维重建的研究[D]. [硕士论文], 吉林大学, 2013.

Zhang Yan. The research of three-dimensional reconstruction based on photometric stereo[D]. [Master dissertation], Jilin University, 2013.

Georghiades A S. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo[C]. Ninth IEEE International Conference on Computer Vision (ICCV?2003), Nice, France, 2003: 816-823.

Barsky S and Petrou M. The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(10): 1239-1252.

张珊珊, 吕东辉, 孙九爱. 近光源光度立体三维重建误差分析[J]. 计算机技术与发展, 2015(1): 168-172.

Zhang Shan-shan, L Dong-hui, and Sun Jiu-ai. Reconstruction error analysis on photometric stereo with nearby light sources[J]. Computer Technology and Development, 2015(1): 168-172.

张屹凌. 基于光度立体算法的图像建模系统的设计及实现[D]. [硕士论文], 浙江大学, 2006.

Zhang Yi-ling. Design and implementation of image-based modeling system based on photometric stereo[D]. [Master dissertation], Zhejiang University, 2006.

桂思怡, 林国顺. 基于DirectX的立体装箱三维可视化辅助模块技术[J]. 计算机与现代化, 2014(2): 15-19.

Gui Si-yi and Lin Guo-shun. DirectX-based techniques of stereo loading systems 3D visualized auxiliary module[J]. Computer and Modernization, 2014(2): 15-19.

许家佗, 张志枫, 任宏福, 等. 基于图像处理的舌形胖瘦分析方法[C]. 第二次全国中西医结合诊断学术研讨会论文集. 2008: 43-47.

Xu Jia-tuo, Zhang Zhi-feng, Ren Hong-fu, et al.. Analysis of fat/thin tongue based on image processing method[C]. The Second National Integrated Traditional Chinese and Western Medicine Diagnosis of Academic Symposium, Lijiang, 2008: 43-47.

Relative Articles

Supplements(0)

Cited By

Proportional views