Multimedia Content Analysis

Multimedia Content Analysis: Theory and Applications covers the latest in multimedia content analysis and applications based on such analysis. As research has progressed, it has become clear that this field has to appeal to other disciplines such as psycho-physics, media production, etc. This book consists of invited chapters that cover the entire range of the field. Some of the topics covered include low-level audio-visual analysis based retrieval and indexing techniques, the TRECVID effort, video browsing interfaces, content creation and content analysis, and multimedia analysis-based applications, among others. The chapters are written by leading researchers in the multimedia field.

This volume introduces machine learning techniques that are particularly powerful and effective for modeling multimedia data and common tasks of multimedia content analysis. It systematically covers key machine learning techniques in an intuitive fashion and demonstrates their applications through case studies. Coverage includes examples of unsupervised learning, generative models and discriminative models. In addition, the book examines Maximum Margin Markov (M3) networks, which strive to combine the advantages of both the graphical models and Support Vector Machines (SVM).

This book presents a summary of the multimodal analysis of user-generated multimedia content (UGC). Several multimedia systems and their proposed frameworks are also discussed. First, improved tag recommendation and ranking systems for social media photos, leveraging both content and contextual information, are presented. Next, we discuss the challenges in determining semantics and sentics information from UGC to obtain multimedia summaries. Subsequently, we present a personalized music video generation system for outdoor user-generated videos. Finally, we discuss approaches for multimodal lecture video segmentation techniques. This book also explores the extension of these multimedia system with the use of heterogeneous continuous streams.

Content analysis is a complex research methodology. This book provides an accessible text for upper level undergraduates and graduate students, comprising step-by-step instructions and practical advice.

Video Content Analysis Using Multimodal Information For Movie Content Extraction, Indexing and Representation is on content-based multimedia analysis, indexing, representation and applications with a focus on feature films. Presented are the state-of-art techniques in video content analysis domain, as well as many novel ideas and algorithms for movie content analysis based on the use of multimodal information. The authors employ multiple media cues such as audio, visual and face information to bridge the gap between low-level audiovisual features and high-level video semantics. Based on sophisticated audio and visual content processing such as video segmentation and audio classification, the original video is re-represented in the form of a set of semantic video scenes or events, where an event is further classified as a 2-speaker dialog, a multiple-speaker dialog, or a hybrid event. Moreover, desired speakers are simultaneously identified from the video stream based on either a supervised or an adaptive speaker identification scheme. All this information is then integrated together to build the video's ToC (table of content) as well as the index table. Finally, a video abstraction system, which can generate either a scene-based summary or an event-based skim, is presented by exploiting the knowledge of both video semantics and video production rules. This monograph will be of great interest to research scientists and graduate level students working in the area of content-based multimedia analysis, indexing, representation and applications as well s its related fields.

Analyzing Media Messages provides a comprehensive and comprehensible guide to conducting content analysis research. It establishes a formal definition of quantitative content analysis; gives step-by-step instruction on designing a content analysis study; and explores in depth research questions that recur in content analysis, in such areas as measurement, sampling, reliability, data analysis, validity, and technology. This Second Edition maintains the concise, accessible approach of the first edition while offering an updated discussion and new examples. The goal of this resource is to make content analysis understandable, and to produce a useful guide for novice and experienced researchers alike. Accompanied by detailed, practical examples of current and classic applications, this volume is appropriate for use as a primary text for content analysis coursework, or as a supplemental text in research methods courses. It is also an indispensable reference for researchers in mass communication fields, political science, and other social and behavioral sciences.

Analyzing Media Messages, Fourth Edition provides a comprehensive guide to conducting content analysis research. It establishes a formal definition of quantitative content analysis; gives step-by-step instructions on designing a content analysis study; and explores in depth several recurring questions that arise in such areas as measurement, sampling, reliability, data analysis, and the use of digital technology in the content analysis process. The fourth edition maintains the concise, accessible approach of the first three editions while offering updated discussions and examples. It examines in greater detail the use of computers to analyze content and how that process varies from human coding of content, incorporating more literature about technology and content analysis throughout. Updated topics include sampling in the digital age, computerized content analysis as practiced today, and incorporating social media in content analysis. Each chapter contains useful objectives and chapter summaries to cement core concepts.

The rapid advancement of digital multimedia technologies has not only revolutionized the production and distribution of audiovisual content, but also created the need to efficiently analyze TV programs to enable applications for content managers and consumers. Leaving no stone unturned, TV Content Analysis: Techniques and Applications provides a de