期刊文献+

一种大屏幕人机交互系统的实现方法 被引量:11

Implementation method of human-computer interaction system with large screen
下载PDF
导出
摘要 针对利用双目立体视觉技术实现大屏幕人机交互系统时摄像头标定复杂的问题,提出一种大屏幕人机交互系统的实现方法。由两个摄像头负责采集用户手部的图像,获取指尖的二维图像位置坐标,通过透视投影模型,由测量所得的两个摄像头之间的距离、大屏幕左边与摄像头之间的距离、摄像头离地面的高度、大屏幕底边离地面的高度等数据,求出地面上与指尖成像在同一位置的地面坐标,由摄像头的位置及地面坐标求出一条直线,两条直线相交获取指尖空间坐标,由指尖空间坐标选取与屏幕对应的二维平面坐标,经物理坐标到逻辑坐标转换求出手指指向屏幕的实际坐标,实现大屏幕的定位。定位完成后,采用指尖检测方法检测视频图像中指尖是否存在,以此判断食指弯曲和伸开的点击操作。指尖空间坐标的计算方法虽然存在误差,但由于用户在操作过程中能够实时看到鼠标的位置,因此该误差对用户是透明的,而这种方法以简单的、近似的求解避免了复杂的摄像头标定过程,便于系统工程的实施。 To avoid camera calibration in the implementation of human-computer interaction system with large screen based on binocular stereo vision, one approximate and easy method is proposed. The distance between two cameras, left camera and the left side of screen, cameras and floor, the bottom side of screen and floor are measured to find the point of floor which is imaged as the same point with fingertip based on perspective projection model. One camera is connected with the point of floor as one space line. Two lines are intersected at the three-dimension spatial coordinate of fingertip served to position two-dimensional coordinate in the large screen. Mouse click is simulated by bend and stretch of index finger achieved by fingertip detection algorithm. Users are not aware of error even if position pointed by finger is inaccurate because mouse is seen by users when they move the hand. The method proposed is easier and more convenient than calibration method due to inaccurate position not seen by users so that system can be rapidly accomplished.
出处 《计算机工程与应用》 CSCD 2012年第1期176-179,共4页 Computer Engineering and Applications
基金 安徽省自然基金青年基金项目(No.11040606Q07) 高校省级重点自然科学研究项目(No.kj2010A023) 安徽大学青年科学研究基金(No.2009QN0019B) 安徽大学青年骨干教师培养对象经费资助
关键词 大屏幕 人机交互 双目视觉 透视投影 large screen human-computer interaction binocular vision perspective projection
  • 相关文献

参考文献12

  • 1Cheng K, Pulo K.Direct interaction with large-scale display systems using infrared laser tracking devices[C]//Australasian Symposium on Information Visualisation, Adelaide,Australia, 2003 : 67-74.
  • 2Cavens D,Vogt F,Fels S,et al.Interacting with the big screen: pointers to ponder[C]//ACM SIGCHI'02 Conference on Human Factors in Computing Systems,Minneapolis,Minnesota, USA, 2002: 678-679.
  • 3Hamana A, Yokoyama J.Presentation system using laser point: US,US2003/0067441A1[P].2003-04-10.
  • 4吴建国,刘政怡.一种红外激光笔遥指虚拟触摸系统:中国,CNl01419513A[P].2009-04-29.
  • 5Hung Yiping, Yang Yaostrong, Chen Yongsheng, et al.Free-hand pointer by use of an active stereo vision system[C]//Proceedings 14th International Conference on Pattern Recognition, Brisbane, 1998:1244-1246.
  • 6Cheng K, Takatsuka M.Real-time monocular tracking of view frustum for large screen human-computer interaction[C]//Proceedings of the 28th Australasian Computer Science Conference, the University of Newcastle,Australia, 2005:125-133.
  • 7Cheng K, Takatsuka M.Estimating virtual touchscreen for finger- tip interaction with large displays[C]//Proceedings of the 18th Australia Conference on ComputerHuman Interaction, Sydney, Australia. 2006,397-400.
  • 8Chang K,Takatsuka M.Initial evaluation of a bare-hand interaction technique for large displays using a webcam[C]//Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems,New York,USA,2009:291-296.
  • 9肖志勇,秦华标.基于视线跟踪和手势识别的人机交互[J].计算机工程,2009,35(15):198-200. 被引量:21
  • 10卢如西,钟杰婷.一种基于摄像头的三维定位触摸装置及其定位方法:中国,CNl01520700A[P].2009-09-02.

二级参考文献39

  • 1杨端端,金连文,尹俊勋.手指书写汉字识别系统中的指尖检测方法[J].华南理工大学学报(自然科学版),2007,35(1):58-63. 被引量:14
  • 2Viola P,Jones M.Rapid Object Detection Using a Boosted Cascade of Simple Features[C]//Proc.of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Hawaii,USA:[s.n.],2001:511-518.
  • 3Hong Tianyi,Qin Huabiao.Drivers' Drowsiness Detection in Embedded System[C]//Proc.of the IEEE International Control on Vehicular Electronics and Safety.Guangzhou,China:[s.n.],2007:1-5.
  • 4Stamer T,Weaver J,Pentland A.Real-time American sign language recognition using desk and wearable computer based video[J].IEEE Transations on Pattern Analysis and Machine Intelligence(S0162-8828),1998,20(12):1371-1375.
  • 5Hyeon Kyu Lee,Jin H Kim.An HMM-based threshold model approach for gesture recognition[J].IEEE Transations on Pattern Analysis and Machine Intelligence(S0162-8828),1999,21(10):961-973.
  • 6Oka K,Sato Y,Koike H.Real-time fingertip tracking and gesture recognition[J].Computer Graphics and Appfications (S0272-1716),2002,22(6):64-71.
  • 7Sato Y,Kobayashi Y,Koike H.Fast tracking of hands and fingertip s in infrared images for augmented desk interface[C] //Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition,Grenoble,Grenoble,France,March 28-30,2000:462-467.
  • 8Zeng Jian-chao,Wang Yue,Turner R,et al.Vision based finger tracking of breast palpation for improving breast self examination[C] //Proceedings of the 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society,Amsterdam,Netherlands,Oct 31-Nov 3,1996:148-149.
  • 9Davis J,Shah M.Visual gesture recognition[J].Visual Image Signal Process(S1350-245X),1994,141(2):101-106.
  • 10Klans Dorfmuller-Ulhaas,Dieter Schmalstieg.Finger tracking for interaction in augmented environments[C] // Proceedings of IEEE and ACM International Symposium on Augmented Reality,New York,USA,October 29-30,2001:29-30.

共引文献47

同被引文献98

引证文献11

二级引证文献39

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部