Describes recent advances in multimedia interaction and intelligent user interfaces, with applications for consumer electronics Covers different techniques in computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology Contains contributions from leading researchers in industry, with an emphasis on practical issues of multimedia interaction Uniquely combines multimedia content analysis and human-machine interaction
Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience.This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.|
With the development of silicon technologies, consumer electronics (CE) devices (such as personal computers, HDTV, mobile phones, digital cameras and game consoles) have become ubiquitous in daily life. These devices can provide multimedia sources for entertainment, communication, and so on. To interact with this equipment, consumers currently rely on devices such as remote controls, keyboards or control panels, which are often inconvenient, ambiguous and non-interactive. The question of how to design user interfaces for CE products that enable natural, intuitive and fun interaction is one of the main challenges the CE industry is facing. Many companies and institutes are working on advanced user interfaces.
User interface technologies has been studied in various disciplines for decades. Considering that modern CE products are usually supplied with both microphones and cameras, the challenge to employ both audio and visual information in interactive multimedia has recently received much attention in both academia and industry. Yet interactive multimedia is still an under-explored field. Many challenges exist when moving to multimodal interaction, for example: how to annotate and search huge amounts of data acquired by using multiple sensors, especially in the unconstrained end-user environments; how to effectively extract and select representative multimedia features for human behavior recognition; and how to select the fusion strategy of multimodal data for a given application. To address these challenges, existing approaches must be adapted or new solutions suitable for multimedia interaction must be found.
This book brings together high-quality and up-to-date research advances in the areas of multimedia interaction, user interfaces, and applications of consumer electronics.
Retrieving Human Actions Using Spatio-temporal Features and Relevance FeedbackRui Jin and Ling ShaoComputationally Efficient Clustering of Audio-Visual Meeting DataHayley Hung, Gerald Friedland, and Chuohao YeoCognitive-aware Modality Allocation in Intelligent Multimodal Information PresentationYujia Cao, Mariët Theune and Anton NijholtNatural Human-Computer InteractionGianpaolo D'Amico, Alberto Del Bimbo, Farizio Dini, Lea Landucci, and Nicola TorpeiGesture Control for Consumer ElectronicsCaifeng ShanEmpirical Study of a Complete System for Real-time Face Pose EstimationTommaso GrittiEvolution-based Virtual Content Insertion with Visually Virtual Interactions in VideosChia-Hu Chang and Ja-Ling WuPhysical Activity Recognition on Mobile Phones: Challenges, Methods and ApplicationsJun Yang, Hong Lu, Zhigang Liu and Péter Pál BodaGestures in an Intelligent User InterfaceWim Fikkert, Paul van der Vet and Anton NijholtVideo Summary Quality Evaluation based on 4C Assessment and User InteractionTongwei Ren, Yan Liu and Gangshan WuMultimedia Experience on Web-Connected CE DevicesDan Tretter, Jerry Liu, Xuemei Zhang, Yuli Gao, Brian Atkins, Hui Chao, Jun Xiao, Peng Wu, and Qian Lin
Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable natural interactions that are convenient, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.
Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.
Topics and features:
- Introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events
- Investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing
- Provides an overview on gesture control technologies for CE
- Presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval
- Examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation
- Describes features that characterize the new generation of CE and examines how web services can be integrated for improved user experience
This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find it a beneficial and a useful reference.
Dr. Ling Shao is a Senior Lecturer in the Department of Electronic and Electrical Engineering at the University of Sheffield, UK. Dr. Caifeng Shan is a Senior Scientist with Philips Research, Eindhoven, The Netherlands. Dr. Jiebo Luo is a Senior Principal Scientist with Kodak Research Laboratories in Rochester, NY, USA. Dr. Minoru Etoh is Managing Director of the Service & Solution Development Department of NTT DOCOMO, Yokosuka, Japan.
Covering multimedia content analysis and human-machine interaction, this book assembles contributions from leading international experts to examine a range of relevant techniques from computer vision and machine learning to emerging AI technology.
Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience.This book is an essential resource for researchers and practitionersfrom both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.
Retrieving Human Actions Using Spatio-Temporal Features and Relevance Feedback.- Computationally Efficient Clustering of Audio-Visual Meeting Data.- Cognitive-Aware Modality Allocation in Intelligent Multimodal Information Presentation.- Natural Human-Computer Interaction.- Gesture Control for Consumer Electronics.- Empirical Study of a Complete System for Real-Time Face Pose Estimation.- Evolution-based Virtual Content Insertion with Visually Virtual Interactions in Videos.- Physical Activity Recognition with Mobile Phones: Challenges, Methods, and Applications.- Gestures in an Intelligent User Interface.- Video Summary Quality Evaluation Based on 4C Assessment and User Interaction.- Multimedia Experience on Web-Connected CE Devices.
Inhaltsverzeichnis
Retrieving Human Actions Using Spatio-temporal Features and Relevance Feedback
Rui Jin and Ling Shao
Computationally Efficient Clustering of Audio-Visual Meeting Data
Hayley Hung, Gerald Friedland, and Chuohao Yeo
Cognitive-aware Modality Allocation in Intelligent Multimodal Information Presentation
Yujia Cao, Mariët Theune and Anton Nijholt
Natural Human-Computer Interaction
Gianpaolo D'Amico, Alberto Del Bimbo, Farizio Dini, Lea Landucci, and Nicola Torpei
Gesture Control for Consumer Electronics
Caifeng Shan
Empirical Study of a Complete System for Real-time Face Pose Estimation
Tommaso Gritti
Evolution-based Virtual Content Insertion with Visually Virtual Interactions in Videos
Chia-Hu Chang and Ja-Ling Wu
Physical Activity Recognition on Mobile Phones: Challenges, Methods and Applications
Jun Yang, Hong Lu, Zhigang Liu and Péter Pál Boda
Gestures in an Intelligent User Interface
Wim Fikkert, Paul van der Vet and Anton Nijholt
Video Summary Quality Evaluation based on 4C Assessment and User Interaction
Tongwei Ren, Yan Liu and Gangshan Wu
Multimedia Experience on Web-Connected CE Devices
Dan Tretter, Jerry Liu, Xuemei Zhang, Yuli Gao, Brian Atkins, Hui Chao, Jun Xiao, Peng Wu, and Qian Lin
Klappentext
Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.
Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.
Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience.
This book is an essential resource for researchers and practitionersfrom both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.
Describes recent advances in multimedia interaction and intelligent user interfaces, with applications for consumer electronics Covers different techniques in computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology Contains contributions from leading researchers in industry, with an emphasis on practical issues of multimedia interaction Uniquely combines multimedia content analysis and human-machine interaction
Includes supplementary material: sn.pub/extras
