Vision Interfaces and Systems Laboratory
| Contact: Francis Quek The Vision Interfaces and Systems Laboratory is engaged in research along three themes: advanced human computer interaction, computer vision, and medical imaging. Ongoing projects in VISLab are: multimodal human-computer interaction, multimodal meeting analysis of planning meetings, conversational interaction, vision-based hand gesture interaction; vision-based gaze tracking, multimedia databases; automated segmentation of video; registration of aerial video/photography from Unmanned Aerial Vehicles, extraction of the neurovascular tree from multimodal medical images; and, three-dimensional alignment of multimodal medical images. The fundamental vision of the VISLab is that Computer Science and Engineering, in general, and HCI and Computer Vision, in particular, have an important role to play in a vast array of arts and sciences. Most of the research in the VISLab is collaborative with other fields. In return, the real challenges of these real projects enrich and focus our research. |
"The effects of spatial layout and view control on cognitive processing",
Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA '11, Vancouver, BC, Canada, ACM Press, pp. 2005, 2011.
"Data-driven motion estimation with low-cost sensors",
Proceedings of the Fifth International Conference on Visual Information Engineering, July -Aug, 2008.
"MIND-MERGING",
Expressing Oneself / Expressing One's Self: Communication, Language, Cognition, and Identity: A Festschrift in honor of Robert M. Krauss (11/8/07), 2008.
"A Service-Oriented Multimedia componentization Model",
Modern Technologies in Web Services Research, 2008.
"A Multimodal Communication with A Haptic Glove: On the Fusion of Speech and Deictic Over a Raised Line Drawing",
International Conference on PErvasive Technologies Related to Assistive Environments, Athens, Greece, 2008.
"MirrorTrack – A Vision Based Multi-Touch System for Glossy Display Surfaces",
The 5th IET Visual Information Engineering 2008 Conference (VIE'08), Xi'an, China, July-August, 2008.
"Hand Tracking Using Agent-Based Framework",
The 5th IET Visual Information Engineering 2008 Conference (VIE'08), Xi'an, China, July-August, 2008.
"Hand Motion Oscillatory Gestures and Multimodal Discourse Analysis",
International Journal of Human-Computer Interaction, vol. 21, no. 3, 2007.
"CARDTABLE: An Embodied Tool For Analysis Of Historical Information",
Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TableTop 2007., 2007.
"Extraction of Hand Motion Trajectories and Its Application to Meeting Analysis",
3rd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI), Washington DC, USA, May, 2006.
"Embodiment and Multimodality",
ACM International Conference on Multimodal Interfaces, Banff, Canada, 2006.
"Enabling Multimodal Communication for Enhancing the Ability of Learning for the Visually Impaired",
ACM International Conference on Multimodal Interfaces, Banff Canada, 2006.
"Applying Embodied Interaction and Usability Engineering to Visualization on Large Displays",
ACM British HCI - Workshop on Visualization and Interaction, 2006.
"A Review of Vessel Extraction Techniques and Algorithms",
ACM Computing Surveys, vol. 36, no. 2, pp. 81-121, June, 2005.
"Agent-Based Gesture Tracking",
IEEE Transactions on Systems, Man, and Cybernetics. Part A: Systems and Humans, vol. 35, no. 6, pp. 795-810, November, 2005.
"Multimodal Meeting Analysis",
2005 International Conference on Intelligence Analysis, 2005.
"VACE Multimodal Meeting Corpus",
2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms, Royal College of Physicians, Edinburgh, UK, July, 2005.
"Meeting Room Configuration and Multiple Camera Calibration in Meeting Analysis",
Seventh International Conference on Multimodal Interfaces (ICMI’05), October, 2005.
"Head Tracking with 3D Texture Map Model in Planning Meeting Analysis",
International Workshop on Multimodal Multiparty Meeting Processing (ICMI-MMMP'05), Trento, Italy, October, 2005.
"The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge Between Signal and Sense",
EURASIP Journal of Applied Signal Processing, vol. 2004, no. 11, pp. 1619-1636, September, 2004.
"Gesture and Interaction",
Encyclopedia of Human-Computer Interaction, vol. 1, pp. 288-292, 2004.
"Surface Parameterization in Volumetric Images for Curvature-Based Feature Classification",
IEEE Transactions on Systems, Man, and Cybernetics, vol. 33, no. 5, pp. 758-765, October, 2003.
"Attribute Bagging: Improving Accuracy of Classifier Ensembles by Using Random Feature Subsets",
Pattern Recognition, vol. 36, no. 6, pp. 1291-1302, June, 2003.
"Oscillatory Gestures and Discourse",
International Conference on Accoustic Speech and Signal Processing (ICASSP), 2003.
"Wavelet-based Gestural Oscillations Detection for in Multimodal Discourse Analysis",
1st IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction (CVPRHCI), Monona Terrace Convention Center, Madison, Wisconsin, June, 2003.
"A multimedia database system for temporally situated perceptual psycholinguistic analysis",
Multimedia Tools and Applications, Kluwer Academic Publishers, vol. 18, pp. 91-113, August , 2002.
"Catchments, Prosody and Discourse",
Gesture, vol. 1, no. 1, pp. 9-33, 2002.
"Multimodal Human Discourse: Gesture and Speech",
ACM Transactions on Computer-Human Interaction, vol. 9, no. 3, pp. 171-193, September, 2002.
"Dynamic Imagery in Speech and Gesture",
Multimodality in Language and Speech Systems, pp. 27–44, 2002.
"Speech and Gesture Analysis for Evaluation of Progress in LSVT Treatment in Parkinson Disease",
Eleventh Biennial Conference on Motor Speech: Motor Speech Disorders, Williamsburg, VA, March, 2002.
"Temporal Correlation of Speech and Gestures Focal Points",
Sixth Multi Conference on Systemics, Cybernetics and Informatics (SCI 2002), Orlando, Florida, July, 2002.
"Multimodal Signal Analysis of Prosody and Hand Motion: Temporal Correlation of Speech and Gestures",
EUSIPCO 2002 Conference, Tolouse, France, September, 2002.
"Gestural Spatialization in Natural Discourse Segmentation",
Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002.
"Gestural Trajectory Symmetries and Discourse Segmentation",
Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002.
"Speech Pauses and Gestural Holds in Parkinson's Disease",
Seventh International Conference on Spoken Language Processing: Denver, CO, September, 2002.
"VisSTA: A Tool for Analyzing Multimodal Discourse Data",
Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002.
"Gesture Patterns During Speech Repairs”,",
IEEE International Conference Multimodal Interaction, Pittsburg, PA, October, 2002.
"Hand Gesture Symmetric Behavior Detection in Natural Conversation",
IEEE International Conference Multimodal Interaction, Pittsburg, PA, October, 2002.
"3D Wave Propagation and Traceback in Vascular Extraction",
IEEE Engineering in Medicine and Biology, and IEEE Biomedical Engineering Society (Abstract & CD-ROM Proceedings), Houston, TX, October, 2002.
"Vessel Extraction in Medical Images by Wave Propagation and Traceback",
IEEE Transactions on Medical Imaging, vol. 20, no. 2, pp. 117-131, February, 2001.
"Catchments, Prosody and Discourse",
Oralité et Gestualité, ORAGE 2001 (Speech and Gesture 2001), Aix-en-Provence, France, C. Cavé, I. Guaïtella and S. Santi (eds.), June, 2001.
"Simulated Wave Propagation and Traceback in Vascular Extraction",
Proceedings of the IEEE Medical Imaging and Augmented Reality 2001 Conference, Hong Kong, pp. 229-234, June , 2001.
"Optimal Parameters in Neural Network Models",
The 12-th Italian Workshop on Neural Nets (WIRN 2001), Vietri Sul Mare, Salerno ITALY, May, 2001.
"Instrumental Access to Natural Multimodal Discourse",
IEEE International Conference on Multimedia and Expo (ICME2001), Waseda University Tokyo, Japan, August , 2001.
"Gestural Origo and Loci-Transitions in Natural Discourse Segmentation",
IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001.
"Toward Vision and Gesture Based Evaluation of Parkinson Disease from Discourse Video",
IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001.
"Automatic Hold Detection in Natural Conversation",
IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001.
"Disfluencies in gesture: Gestural correlates to speech silent and filled pauses",
IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001.
"A Conversational Paradigm for Multimodal Human Interaction",
Applied Imagery and Pattern Recognition, AIPR 2001, October, 2001.
"Audio and Vision-Based Evaluation of Parkinson’s Disease from Discourse Video",
IEEE International Symposium of Bio-Informatics and Bio-Engineering, BIBE 2001, Bethesda, MA, November, 2001.
"Holds as Gestural Correlates to Empty and Filled Speech Pauses",
Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2001.
"An algorithm for the rapid computation of boundaries in run length encoded regions",
Pattern Recognition Journal, vol. 33, pp. 1637-1649, 2000.
"Gesture, Speech, and Gaze Cues for Discourse Segmentation",
IEEE Conference on Computer Vision and Pattern Recognition (CVPR’2000), Hilton Head Island, South Carolina, June, 2000.
"Neurovascular Image Interpretation with an Attentionally-Based Interaction Model (AIM)",
Computer Aided Radiology and Surgery (CARS), San Francisco, CA, June-July, 2000.
"Gesture and Speech multimodal conversational interaction in monocular video",
Proceedings of the 3rd International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2000, pp. 215, August, 2000.
"A multimedia system for temporally situated perceptual psycholinguistic analysis",
Proceedings of the 3rd International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2000., Nijmegen, The Netherlands, pp. 257, August, 2000.
"Bunshin: A Believable Avatar Surrogate for Both Scripted and On-the-Fly Pen-Based Control in a Presentation Environment",
Emerging Technologies, SIGGRAPH 2000, New Orleans, Lousiana, July, 2000.
"Surface Parameterization in Volumetric Images for Feature Classification",
IEEE International Symposium of Bio-Informatics and Bio-Engineering, BIBE 2000, Washington D.C., November, 2000.
