基于Leap Motion和Unity3D的虚拟沙画手势识别及交互

基于Leap Motion和Unity3D的虚拟沙画手势识别及交互宁亚楠;杨晓文;韩燮
【期刊名称】《计算机工程与应用》
【年(卷),期】2017(053)024
【摘要】Rapid development of virtual simulation technology and constantly updated somatosensory equipments bring new inspiration for sand painting animation which is a creative art form. Because of the complex process of live sand painting, this paper combines Leap Motion devices and Unity3D development environments to accomplish hand gesture recognition, and then successfully performs live sand painting in virtual environments. Firstly, hand key points of coordi-nate and direction are extracted according to the gesture information captured by Leap Motion. Then the method of angle domain segmentation is proposed and a new set of feature vector is added, which is in series with fetched information as the basis of hand classification. Finally, defined gestures are utilized to drive virtual hand to complete sand painting. The experiments show that gesture recognition by Leap Motion in close range performs more accurate than other methods, ges-ture tracking is stable with high real-time performance and the virtual sand painting system has a much stronger sense of immersion.%虚拟仿真技术的快速发展及体感设备的不断更新为沙画动画这一全新的艺术创作形式带来新的灵感.针对沙画现场作画工序复杂的问题,结合Leap Motion设备和Unity3D开发环境完成手势识别并驱动虚拟手实
现虚拟沙画效果.首先,依据Leap Motion捕捉到的手势坐标及方向信息提取手部关键点;然后提出角域划分的方法并引入新的特征向量,将其与提取信息串联作为手势分类依据;最后,根据自行定义的沙画手势语义驱动虚拟手完成虚拟沙画创作.实验证明,利用Leap Motion完成近距离手势识别效果较其他方法结果更加精准,实时性较高,手势跟踪稳定,虚拟沙画绘画过程沉浸感强.
【总页数】5页(P202-206)
【作者】宁亚楠;杨晓文;韩燮
【作者单位】中北大学计算机与控制工程学院,太原 030051;中北大学计算机与控制工程学院,太原 030051;中北大学计算机与控制工程学院,太原 030051
【正文语种】中文
【中图分类】TP391.9
【相关文献】
1.基于Leap Motion手势交互的虚拟装配培训的研究 [J], 杜宝江;李酬;林灵;查亮
2.基于Leap Motion和Unity3D的体感游戏开发与集成 [J], 袁田琛;胡新荣;赵俭辉
3.基于Leap Motion的手势识别在虚拟交互中的研究 [J], 黄俊;景红
4.基于Leap Motion的虚拟农作物人机交互系统设计 [J], 吴福理;丁胤;丁维龙;谢涛
5.基于Leap Motion手势识别方法在树木交互的应用 [J], 王红全;淮永建
因版权原因，仅展示原文概要，查看原文内容请购买。