Vision Interfaces and Systems Laboratory

URL: http://vislab.cs.vt.edu/

Contact: Francis Quek

The Vision Interfaces and Systems Laboratory is engaged in research along three themes: advanced human computer interaction, computer vision, and medical imaging. Ongoing projects in VISLab are: multimodal human-computer interaction, multimodal meeting analysis of planning meetings, conversational interaction, vision-based hand gesture interaction; vision-based gaze tracking, multimedia databases; automated segmentation of video; registration of aerial video/photography from Unmanned Aerial Vehicles, extraction of the neurovascular tree from multimodal medical images; and, three-dimensional alignment of multimodal medical images. The fundamental vision of the VISLab is that Computer Science and Engineering, in general, and HCI and Computer Vision, in particular, have an important role to play in a vast array of arts and sciences. Most of the research in the VISLab is collaborative with other fields. In return, the real challenges of these real projects enrich and focus our research.

2008
Xie L., Kumar M., Cao Y., Gracanin D., Quek F., "Data-driven motion estimation with low-cost sensors", Proceedings of the Fifth International Conference on Visual Information Engineering, July -Aug, 2008. Tagged BibTex xml
McNeill D., Duncan S., Franklin A., Goss J., Kimbara I., Parrill F., Welji H., Chen L., Harper M., Quek F., "MIND-MERGING", Expressing Oneself / Expressing One's Self: Communication, Language, Cognition, and Identity: A Festschrift in honor of Robert M. Krauss (11/8/07), 2008. Tagged BibTex xml
Zhang J., Zhang L -J., Quek F., Chung J -Y., "A Service-Oriented Multimedia componentization Model", Modern Technologies in Web Services Research, 2008. Tagged BibTex xml
Oliveira F., Quek F., "A Multimodal Communication with A Haptic Glove: On the Fusion of Speech and Deictic Over a Raised Line Drawing", International Conference on PErvasive Technologies Related to Assistive Environments, Athens, Greece, 2008. Tagged BibTex xml
Chung P -K., Fang B., Quek F., "MirrorTrack – A Vision Based Multi-Touch System for Glossy Display Surfaces", The 5th IET Visual Information Engineering 2008 Conference (VIE'08), Xi'an, China, July-August, 2008. Tagged BibTex xml
Fang B., Chung P -K., Francis Quek F., "Hand Tracking Using Agent-Based Framework", The 5th IET Visual Information Engineering 2008 Conference (VIE'08), Xi'an, China, July-August, 2008. Tagged BibTex xml
2007
Xiong Y., Quek F., "Hand Motion Oscillatory Gestures and Multimodal Discourse Analysis", International Journal of Human-Computer Interaction, vol. 21, no. 3, 2007. Tagged BibTex xml
Andrews C., Miller C., Henry T., Quek F., "CARDTABLE: An Embodied Tool For Analysis Of Historical Information", Second IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TableTop 2007., 2007. Tagged BibTex xml
2006
Wathugala D., Fang B., Rose T., Xiong Y., Quek F., "Extraction of Hand Motion Trajectories and Its Application to Meeting Analysis", 3rd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI), Washington DC, USA, May, 2006. Tagged BibTex xml
Quek F., "Embodiment and Multimodality", ACM International Conference on Multimodal Interfaces, Banff, Canada, 2006. Tagged BibTex xml
Quek F., McNeill D., Oliviera F., "Enabling Multimodal Communication for Enhancing the Ability of Learning for the Visually Impaired", ACM International Conference on Multimodal Interfaces, Banff Canada, 2006. Tagged BibTex xml
Ball R., DellaNoce M., Ni T., Quek F., North C., "Applying Embodied Interaction and Usability Engineering to Visualization on Large Displays", ACM British HCI - Workshop on Visualization and Interaction, 2006. Tagged BibTex xml
2005
Kirbas C., Quek F., "A Review of Vessel Extraction Techniques and Algorithms", ACM Computing Surveys, vol. 36, no. 2, pp. 81-121, June, 2005. Tagged BibTex xml
Bryll R., Rose T., Quek F., "Agent-Based Gesture Tracking", IEEE Transactions on Systems, Man, and Cybernetics. Part A: Systems and Humans, vol. 35, no. 6, pp. 795-810, November, 2005. Tagged BibTex xml
Quek F., Rose T.R., "Multimodal Meeting Analysis", 2005 International Conference on Intelligence Analysis, 2005. Tagged BibTex xml
Chen L., Rose T., Perill F., Han X., Tu J., Huang Z., Happer M., Quek F., McNeill D., Tuttle R., "VACE Multimodal Meeting Corpus", 2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms, Royal College of Physicians, Edinburgh, UK, July, 2005. Tagged BibTex xml
Xiong Y., Quek F., "Meeting Room Configuration and Multiple Camera Calibration in Meeting Analysis", Seventh International Conference on Multimodal Interfaces (ICMI’05), October, 2005. Tagged BibTex xml
Xiong Y., Quek F., "Head Tracking with 3D Texture Map Model in Planning Meeting Analysis", International Workshop on Multimodal Multiparty Meeting Processing (ICMI-MMMP'05), Trento, Italy, October, 2005. Tagged BibTex xml
2004
Quek F., "The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge Between Signal and Sense", EURASIP Journal of Applied Signal Processing, vol. 2004, no. 11, pp. 1619-1636, September, 2004. Tagged BibTex xml
Quek F., "Gesture and Interaction", Encyclopedia of Human-Computer Interaction, vol. 1, pp. 288-292, 2004. Tagged BibTex xml
2003
Quek F., Yarger R., Kirbas C., "Surface Parameterization in Volumetric Images for Curvature-Based Feature Classification", IEEE Transactions on Systems, Man, and Cybernetics, vol. 33, no. 5, pp. 758-765, October, 2003. Tagged BibTex xml
Bryll R., Osuna-Guttierez R., Quek F., "Attribute Bagging: Improving Accuracy of Classifier Ensembles by Using Random Feature Subsets", Pattern Recognition, vol. 36, no. 6, pp. 1291-1302, June, 2003. Tagged BibTex xml
Quek F., Xiong Y., "Oscillatory Gestures and Discourse", International Conference on Accoustic Speech and Signal Processing (ICASSP), 2003. Tagged BibTex xml
Xiong Y., Quek F., McNeill D., "Wavelet-based Gestural Oscillations Detection for in Multimodal Discourse Analysis", 1st IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction (CVPRHCI), Monona Terrace Convention Center, Madison, Wisconsin, June, 2003. Tagged BibTex xml
2002
Quek F., Bryll R., Arslan H., Kirbas C., McNeill D., "A multimedia database system for temporally situated perceptual psycholinguistic analysis", Multimedia Tools and Applications, Kluwer Academic Publishers, vol. 18, pp. 91-113, August , 2002. Tagged BibTex xml
McNeill, D. Q., F. M., K.-E D., S. F., N. B., R. M., F X -., Ansari. R., "Catchments, Prosody and Discourse", Gesture, vol. 1, no. 1, pp. 9-33, 2002. Tagged BibTex xml
Quek F., McNeill D., Bryll B., Duncan S., Ma X., Kirbas C., McCullough K-E., Ansari R., "Multimodal Human Discourse: Gesture and Speech", ACM Transactions on Computer-Human Interaction, vol. 9, no. 3, pp. 171-193, September, 2002. Tagged BibTex xml
McNeill D., Quek F., McCullough K-E., Duncan S., Furuyama N., Bryll R., Ma X - F., Ansari. R., "Dynamic Imagery in Speech and Gesture", Multimodality in Language and Speech Systems, pp. 27–44, 2002. Tagged BibTex xml
Quek F., Bryll R., Harper M., Chen L., Ramig L., "Speech and Gesture Analysis for Evaluation of Progress in LSVT Treatment in Parkinson Disease", Eleventh Biennial Conference on Motor Speech: Motor Speech Disorders, Williamsburg, VA, March, 2002. Tagged BibTex xml
Valbonesi L., Ansari R., McNeill D., Quek F., Duncan S., McCullough K E., Bryll R., "Temporal Correlation of Speech and Gestures Focal Points", Sixth Multi Conference on Systemics, Cybernetics and Informatics (SCI 2002), Orlando, Florida, July, 2002. Tagged BibTex xml
Valbonesi L., Ansari R., McNeill D., Quek F., Duncan S., McCullough K E., Bryll R., "Multimodal Signal Analysis of Prosody and Hand Motion: Temporal Correlation of Speech and Gestures", EUSIPCO 2002 Conference, Tolouse, France, September, 2002. Tagged BibTex xml
Quek F., McNeill D., Bryll R., Harper M., "Gestural Spatialization in Natural Discourse Segmentation", Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002. Tagged BibTex xml
Quek F., Xiong Y., McNeill D., "Gestural Trajectory Symmetries and Discourse Segmentation", Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002. Tagged BibTex xml
Quek F., Harper M., Haciahmetoglu Y., Chen L., Ramig L., "Speech Pauses and Gestural Holds in Parkinson's Disease", Seventh International Conference on Spoken Language Processing: Denver, CO, September, 2002. Tagged BibTex xml
Quek F., Shi Y., Kirbas C., Wu S., "VisSTA: A Tool for Analyzing Multimodal Discourse Data", Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2002. Tagged BibTex xml
Chen L., Harper M., Quek F., "Gesture Patterns During Speech Repairs”,", IEEE International Conference Multimodal Interaction, Pittsburg, PA, October, 2002. Tagged BibTex xml
Xiong Y., Quek F., McNeill D., "Hand Gesture Symmetric Behavior Detection in Natural Conversation", IEEE International Conference Multimodal Interaction, Pittsburg, PA, October, 2002. Tagged BibTex xml
Kirbas C., Quek F., "3D Wave Propagation and Traceback in Vascular Extraction", IEEE Engineering in Medicine and Biology, and IEEE Biomedical Engineering Society (Abstract & CD-ROM Proceedings), Houston, TX, October, 2002. Tagged BibTex xml
2001
Quek F., Cemil Kirbas C., "Vessel Extraction in Medical Images by Wave Propagation and Traceback", IEEE Transactions on Medical Imaging, vol. 20, no. 2, pp. 117-131, February, 2001. Tagged BibTex xml
McNeill D., Quek F., McCullough K-E., Duncan S., Furuyama N., Bryll R., Ansari R., "Catchments, Prosody and Discourse", Oralité et Gestualité, ORAGE 2001 (Speech and Gesture 2001), Aix-en-Provence, France, C. Cavé, I. Guaïtella and S. Santi (eds.), June, 2001. Tagged BibTex xml
Quek F K H., Kirbas C., Gong X., "Simulated Wave Propagation and Traceback in Vascular Extraction", Proceedings of the IEEE Medical Imaging and Augmented Reality 2001 Conference, Hong Kong, pp. 229-234, June , 2001. Tagged BibTex xml
Esposito A., Aversano G., Quek F., "Optimal Parameters in Neural Network Models", The 12-th Italian Workshop on Neural Nets (WIRN 2001), Vietri Sul Mare, Salerno ITALY, May, 2001. Tagged BibTex xml
Quek F., "Instrumental Access to Natural Multimodal Discourse", IEEE International Conference on Multimedia and Expo (ICME2001), Waseda University Tokyo, Japan, August , 2001. Tagged BibTex xml
Quek F., Bryll R., McNeill D., Harper M., "Gestural Origo and Loci-Transitions in Natural Discourse Segmentation", IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001. Tagged BibTex xml
Quek F., Bryll R., Ramig L., "Toward Vision and Gesture Based Evaluation of Parkinson Disease from Discourse Video", IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001. Tagged BibTex xml
Bryll R., Quek F., Esposito A., "Automatic Hold Detection in Natural Conversation", IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001. Tagged BibTex xml
Esposito A., McCullough K-E., Quek F., "Disfluencies in gesture: Gestural correlates to speech silent and filled pauses", IEEE Workshop on Cues in Communication, Kauai, Hawaii, December , 2001. Tagged BibTex xml
Quek F., "A Conversational Paradigm for Multimodal Human Interaction", Applied Imagery and Pattern Recognition, AIPR 2001, October, 2001. Tagged BibTex xml
Quek F., Bryll R., Harper M., Chen L., Ramig L., "Audio and Vision-Based Evaluation of Parkinson’s Disease from Discourse Video", IEEE International Symposium of Bio-Informatics and Bio-Engineering, BIBE 2001, Bethesda, MA, November, 2001. Tagged BibTex xml
Esposito A., Duncan S., Quek F., "Holds as Gestural Correlates to Empty and Filled Speech Pauses", Seventh International Conference on Spoken Language Processing, Denver, CO, September, 2001. Tagged BibTex xml
2000
Quek F., "An algorithm for the rapid computation of boundaries in run length encoded regions", Pattern Recognition Journal, vol. 33, pp. 1637-1649, 2000. Tagged BibTex xml
Quek F., McNeill D., Bryll R., Kirbas C., Arslan H., McCullough K-E., Furuyama N., Ansari R., "Gesture, Speech, and Gaze Cues for Discourse Segmentation", IEEE Conference on Computer Vision and Pattern Recognition (CVPR’2000), Hilton Head Island, South Carolina, June, 2000. Tagged BibTex xml
Quek F., Kirbas C., Charbel F., "Neurovascular Image Interpretation with an Attentionally-Based Interaction Model (AIM)", Computer Aided Radiology and Surgery (CARS), San Francisco, CA, June-July, 2000. Tagged BibTex xml
McNeill D., Quek F., "Gesture and Speech multimodal conversational interaction in monocular video", Proceedings of the 3rd International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2000, pp. 215, August, 2000. Tagged BibTex xml
Quek F., McNeill D., "A multimedia system for temporally situated perceptual psycholinguistic analysis", Proceedings of the 3rd International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2000., Nijmegen, The Netherlands, pp. 257, August, 2000. Tagged BibTex xml
Quek F., Yarger R., Hachiahmetoglu, Y. Ohya J., Shinjiro K., Nakatsu R., "Bunshin: A Believable Avatar Surrogate for Both Scripted and On-the-Fly Pen-Based Control in a Presentation Environment", Emerging Technologies, SIGGRAPH 2000, New Orleans, Lousiana, July, 2000. Tagged BibTex xml
Yarger R., Quek F., "Surface Parameterization in Volumetric Images for Feature Classification", IEEE International Symposium of Bio-Informatics and Bio-Engineering, BIBE 2000, Washington D.C., November, 2000. Tagged BibTex xml