162 Hits in 3.8 sec

Template-Based Eye and Mouth Detection for 3D Video Conferencing [chapter]

Jürgen Rurainsky, Peter Eisert
2003 Lecture Notes in Computer Science  
We have developed an automatic method for face feature detection using synthetic deformable templates. The algorithm does not require a training procedure or parameter set.  ...  Iris-pupil centers, mouth corners and mouth inner lip line are robustly found with high accuracy from one still image.  ...  Face Animation A model-based video conferencing system is animating the 3D head model of a person.  ... 
doi:10.1007/978-3-540-39798-4_6 fatcat:pflkw6ye6zfnri7zdey77jnecy

Gaze awareness for video-conferencing: a software approach

S. Seitz, T. Kang, C.L. Zitnick, K. Toyama, J. Gemmell
2000 IEEE Multimedia  
Here, we superimposed the eyes and nose onto the face-at first glance, the head appears to be turned to the right.  ...  While waiting for computer vision to come up to speed, we might work with infrared-based vision systems so that we can push ahead with research on our virtual 3D conferencing environment.  ...  If a head model has an incorrect mouth curvature, for example, the subject's mouth might look either happy or sad when the head model rotates up and down.  ... 
doi:10.1109/93.895152 fatcat:xppoh5h7zrb4vhdism5ytbmahm

Facial Feature Extraction Using a 4D Stereo Camera System [chapter]

Soumya Kanti Datta, Philip Morrow, Bryan Scotney
2012 Studies in Computational Intelligence  
The algorithm developed for this purpose is inspired from the natural biological shape and structure of human face.  ...  The algorithm is able to identify the tip of the nose, the point where nose meets the forehead, and near corners of both the eyes from the faces acquired by the camera system.  ...  Stuart Henry, Miss Deborah Rankins and Dr. Cathryn Peoples for their participation in this work to build the facial database and make the work successful.  ... 
doi:10.1007/978-3-642-25507-6_18 fatcat:366bu5afhrbupo65nuh54qakmy

Facial Feature Extraction Using a 4D Stereo Camera System

Soumya Kanti Datta, Dr. Philip Morrow, Prof. Bryan Scotney
2011 International Journal of Electronics Signals and Systems  
The algorithm developed for this purpose is inspired from the natural biological shape and structure of human face.  ...  The algorithm is able to identify the tip of the nose, the point where nose meets the forehead, and near corners of both the eyes from the faces acquired by the camera system.  ...  Stuart Henry, Miss Deborah Rankins and Dr. Cathryn Peoples for their participation in this work to build the facial database and make the work successful.  ... 
doi:10.47893/ijess.2011.1005 fatcat:kvshlzyitfcrvkjehnh5m524yi

Facial tracking in video transfer using watershed segmentation

Mayilvahanan P, Purushothaman S, Rajeswari P
2014 International Journal of Engineering & Technology  
This paper presents the implementation of watershed segmentation for facial tracking. It focuses on tracking face of human in a continuous video transfer.  ...  Tracking is also necessary for 3D model-based recognition systems where the 3D model is estimated from the input video.  ...  Introduction Human face processing techniques are used for broadcast video, including face detection, tracking, and recognition has attracted a lot of research interest because of its value in various  ... 
doi:10.14419/ijet.v3i4.3633 fatcat:dnxvb2u7x5dajd7at5iol7zrye

Speech-assisted facial expression analysis and synthesis for virtual conferencing systems

Yao-Jen Chang, Chao-Kuei Heish, Pei-Wei Hsu, Yung-Chang Chen
2003 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698)  
In this way, a virtual conferencing system with video realistic avatars can be realized to meet realtime requirement.  ...  From the input speech, the mouth shape can be estimated from the audio-visual model. Thus, the large search space of mouth appearance can be reduced for mouth tracking.  ...  Audio Feature Extraction Speech Mouth Shape Extraction GMM-based A-to-V Conversion Mouth Shape Interpretation Lip FAP Mouth Model Adaptation A-V GMM Adaptation Video Figure 1 .  ... 
doi:10.1109/icme.2003.1221365 dblp:conf/icmcs/ChangHHC03 fatcat:6tlmll7ndrfilitmka4elkbpsm

Gaze correction for home video conferencing

Claudia Kuster, Tiberiu Popa, Jean-Charles Bazin, Craig Gotsman, Markus Gross
2012 ACM Transactions on Graphics  
Figure 1 : Top: frames recorded during video-conferencing. Note the lack of eye contact because of the disparity between the locations of the participant and the camera.  ...  Our method is suitable for mainstream home video conferencing: it uses inexpensive consumer hardware, achieves real-time performance and requires just a simple and short setup.  ...  The authors thank the persons appearing in the figures and video. Thanks to Michal Nir, Saar Gross and Omri Azencot of Technion for developing the Skype plugin.  ... 
doi:10.1145/2366145.2366193 fatcat:3qecwxjsj5agpidvlpw4eynlzu


Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Niessner
2018 ACM Transactions on Graphics  
We propose HeadOn, the first real-time source-to-target reenactment approach for complete human portrait videos that enables transfer of torso and head motion, face expression, and eye gaze.  ...  On top of the coarse geometric proxy, we propose a video-based rendering technique that composites the modified target portrait video via view- and pose-dependent texturing, and creates photo-realistic  ...  For mouth interior synthesis, image-based [Kawai et al. 2014; Thies et al. 2016 ] and template-based [Thies et al. 2015] approaches have been proposed.  ... 
doi:10.1145/3197517.3201350 fatcat:r5dqfe24wnc4zpztn3kqn2pl2y

Detection of Mouth Movements and its Applications to Cross-Modal Analysis of Planning Meetings

Yingen Xiong, Bing Fang, Francis Quek
2009 2009 International Conference on Multimedia Information Networking and Security  
A real-time system has been implemented to track speaker's mouth positions and detection mouth movements. Applications also include video conferencing and improving human computer interaction (HCI).  ...  We detect face regions for all participants in the meeting. Second, We create a mouth template and perform image matching to find candidates of the mouth in each face region.  ...  Detection of human mouths from Video In related work on detection of facial features, there are template-based approaches [3] ; wavelet-based approaches [4] .  ... 
doi:10.1109/mines.2009.258 fatcat:dkpswkczvngxfiqxplzdugw7si

FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality [article]

Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner
2018 arXiv   pre-print
Based on reenactment of a prerecorded stereo video of the person without the HMD, FaceVR incorporates photo-realistic re-rendering in real time, thus allowing artificial modifications of face and eye appearances  ...  We propose FaceVR, a novel image-based method that enables video teleconferencing in VR based on self-reenactment.  ...  ACKNOWLEDGMENTS We thank Angela Dai for the video voice over and all actors for the VR reenactment. The facial landmark tracker was kindly provided by TrueVisionSolution.  ... 
arXiv:1610.03151v2 fatcat:pnx2nfjqrrgpbcpaarsrg6ykwi


2002 Advances in Image Processing and Understanding  
Capturing real facial motions from videos enables automatic creation of dynamic models for facial animation.  ...  The magnitudes of these action units can be estimated from real videos using a model-based tracking algorithm.  ...  These volumes are formed based on the facial feature points such as eye corners, mouth corners, etc. Each Bézier volume consists of two layers: the external layer and the internal layer.  ... 
doi:10.1142/9789812776952_0002 fatcat:2jqttzavibcihdvqlwguewearu

Talking Faces: Audio-to-Video Face Generation [chapter]

Yuxin Wang, Linsen Song, Wayne Wu, Chen Qian, Ran He, Chen Change Loy
2022 Advances in Computer Vision and Pattern Recognition  
Despite great research efforts in talking face generation, the problem remains challenging due to the need for fine-grained control of face components and the generalization to arbitrary sentences.  ...  In addition, we introduce some widely used datasets and performance metrics. Finally, we discuss open questions, potential future directions, and ethical considerations in this task.  ...  When it comes to generation techniques, the movements of the eyes are generally modeled as part of the emotional coefficients in 3D-based methods and as eye landmarks in 2D-based methods. Shu et al.  ... 
doi:10.1007/978-3-030-87664-7_8 fatcat:5qh2bxrthrbthgjwjzlmm3je4i

Image-Based 3D Face Modeling System

In Kyu Park, Hui Zhang, Vladimir Vezhnevets
2005 EURASIP Journal on Advances in Signal Processing  
The frontal and profile feature detection modules automatically extract the facial parts such as the eye, nose, mouth, and ear.  ...  This paper describes an automatic system for 3D face modeling using frontal and profile images taken by an ordinary digital camera.  ...  ACKNOWLEDGMENTS We would like to thank Eugene Lisitsin, Anna Degtiareva, Denis Krasavin, Stanislav Soldatov, and Alla Andreeva in Moscow State University for their contribution to the development and the  ... 
doi:10.1155/asp.2005.2072 fatcat:b5y4vkzqorfkxciybvfpinrnci

Nouse 'use your nose as a mouse' perceptual vision technology for hands-free games and interfaces

Dmitry O. Gorodnichy, Gerhard Roth
2004 Image and Vision Computing  
Supplemented by the mechanism for detecting multiple eye blinks, this technology provides a complete solution for building intelligent hands-free input devices.  ...  3D with low resolution cameras.  ...  The authors are also thankful to Shazad Mallik for his help in developing the programs.  ... 
doi:10.1016/j.imavis.2004.03.021 fatcat:7tgpohav2falhn2clwv3ik7x3m

Eye Gaze Techniques for Human Computer Interaction: A Research Survey

Anjana Sharma, Pawanesh Abrol
2013 International Journal of Computer Applications  
The eye gaze detection techniques can be classified on the basis of direct eye detection, appearance, template, shape, feature, motion, hybrid, regression, 3D methods etc.  ...  efficiency and effectiveness of the eye gaze detection.  ...  Real-time systems for iris recognition, eye contact correction in video conferencing etc. also use eye detection techniques [12] .  ... 
doi:10.5120/12386-8738 fatcat:3yheb75eqngxnev57rvgjwkndy
« Previous Showing results 1 — 15 out of 162 results