Multimedia Information Retrieval

At its very core multimedia information retrieval means the process of searching for and finding multimedia documents; the corresponding research field is concerned with building the best possible multimedia search engines. The intriguing bit here is that the query itself can be a multimedia excerpt: For example, when you walk around in an unknown place and stumble across an interesting landmark, would it not be great if you could just take a picture with your mobile phone and send it to a service that finds a similar picture in a database and tells you more about the building -- and about its significance, for that matter? This book goes further by examining the full matrix of a variety of query modes versus document types. How do you retrieve a music piece by humming? What if you want to find news video clips on forest fires using a still image? The text discusses underlying techniques and common approaches to facilitate multimedia search engines from metadata driven retrieval, via piggy-back text retrieval where automated processes create text surrogates for multimedia, automated image annotation and content-based retrieval. The latter is studied in great depth looking at features and distances, and how to effectively combine them for efficient retrieval, to a point where the readers have the ingredients and recipe in their hands for building their own multimedia search engines. Supporting users in their resource discovery mission when hunting for multimedia material is not a technological indexing problem alone. We look at interactive ways of engaging with repositories through browsing and relevance feedback, roping in geographical context, and providing visual summaries for videos. The book concludes with an overview of state-of-the-art research projects in the area of multimedia information retrieval, which gives an indication of the research and development trends and, thereby, a glimpse of the future world. Table of Contents: What is Multimedia Information Retrieval? / Basic Multimedia Search Technologies / Content-based Retrieval in Depth / Added Services / Multimedia Information Retrieval Research / Summary

Everything you ever wanted to know about multimedia retrieval and management. This comprehensive book offers a full picture of the cutting-edge technologies necessary for a profound introduction to the field. Leading experts also cover a broad range of practical applications.

Foreword by Karen Spärck Jones Intelligent multimedia information retrieval lies at the intersection of artificial intelligence, information retrieval, human-computer interaction, and multimedia computing. Its systems enable users to create, process, summarize, present, interact with, and organize information within and across different media such as text, speech, graphics, imagery, and video. These systems go beyond traditional hypermedia and hypertext environments to analyze and generate media, and support intelligent interaction with or via multiple media. The chapters of this volume, which grew out of the 1995 International Joint Conference on Artificial Intelligence Workshop on Intelligent Multimedia Information Retrieval, span a broad range of topics. The book is organized into seven sections: Content-Based Retrieval of Imagery, Content-Based Retrieval of Graphics and Audio, Content-Based Retrieval of Video, Speech and Language Processing for Video Retrieval, Architectures and Tools, Intelligent Hypermedia Retrieval, and Empirical Evaluations. Contributors Robert Adams, Phillipe Aigrain, Jonathan Ashley, Thom Blum, Shih-Fu Chang, Mei C. Chuah, W. Bruce Croft, Byron Dom, Ann Doubleday, Florence Dubois, Josef Fink, Myron Flickner, Jonathan Foote, Brian Frew, Monika Gorkani, Morgan Green, James Griffioen, Jon Alte Gulla, Jim Hafner, Qian Hang, Matt Hare, Alexander G. Hauptman, Stacie Hibino, Helmut Horacek, David House, Takafumi Inoue, Philippe Joly, Gareth Jones, Karen Spärck Jones, Douglas Keislaer, Stephen Kerpedjiev, Alfred Kobsa, Denis Lee, Véronique Longueville, Chien Yong Low, R. Manmatha, Inderjeet Mani, Mark T. Maybury, Bernard Mérialdo, Adrian Müller, Wayne Niblac, Andreas Nill, Alex Pentland, Dragutin Petkovic, Steven F. Roth, Neil C. Rowe, Elke A. Rundensteiner, Harpreet Sawhney, John R. Smith, Stephen W. Smoliar, David Steele, Adelheit Stein, Oliviero Stock, Carlo Strapparava, Alistair Sutcliffe, Atshushi Takeshita, Kazuo Tanaka, Ulrich Thiel, Michele Ryan, Julita Vassileva, James Wheaton, Michael J. Witbrock, Erling Wold, JianHua Wu, Peter Yanker, Rajendra Yavatkar, Steven J. Young, Massimo Zancanaro, HongJiang Zhang

Multimedia Information Retrieval: Content-Based Information Retrieval from Large Text and Audio Databases addresses the future need for sophisticated search techniques that will be required to find relevant information in large digital data repositories, such as digital libraries and other multimedia databases. Because of the dramatically increasing amount of multimedia data available, there is a growing need for new search techniques that provide not only fewer bits, but also the most relevant bits, to those searching for multimedia digital data. This book serves to bridge the gap between classic ranking of text documents and modern information retrieval where composite multimedia documents are searched for relevant information. Multimedia Information Retrieval: Content-Based Information Retrieval from Large Text and Audio Databases begins to pave the way for speech retrieval; only recently has the search for information in speech recordings become feasible. This book provides the necessary introduction to speech recognition while discussing probabilistic retrieval and text retrieval, key topics in classic information retrieval. The book then discusses speech retrieval, which is even more challenging than retrieving text documents because word boundaries are difficult to detect, and recognition errors affect the retrieval effectiveness. This book also addresses the problem of integrating information retrieval and database functions, since there is an increasing need for retrieving information from frequently changing data collections which are organized and managed by a database system. Multimedia Information Retrieval: Content-Based Information Retrieval from Large Text and Audio Databases serves as an excellent reference source and may be used as a text for advanced courses on the topic.

Novel processing and searching tools for the management of new multimedia documents have developed. Multimedia Information Retrieval (MIR) is an organic system made up of Text Retrieval (TR); Visual Retrieval (VR); Video Retrieval (VDR); and Audio Retrieval (AR) systems. So that each type of digital document may be analysed and searched by the elements of language appropriate to its nature, search criteria must be extended. Such an approach is known as the Content Based Information Retrieval (CBIR), and is the core of MIR. This novel content-based concept of information handling needs to be integrated with more traditional semantics. Multimedia Information Retrieval focuses on the tools of processing and searching applicable to the content-based management of new multimedia documents. Translated from Italian by Giles Smith, the book is divided into two parts. Part one discusses MIR and related theories, and puts forward new methodologies; part two reviews various experimental and operating MIR systems, and presents technical and practical conclusions. Gives a complete, organic picture of MIR and CBIR Proposes a novel conceptualisation around the ideas of Information Retrieval (IR) and digital document management in the context of Library and Information Science (LIS) Relevant for both library and information science and information technology specialists

Due to increasing globalization and the explosion of media available on the Internet, computer techniques to organize, classify, and find desired media are becoming more and more relevant. One such technique to extract semantic information from multimedia data sources is Multimedia Information Retrieval (MMIR or MIR). MIR is a broad area covering both structural issues and intelligent content analysis and retrieval. These aspects must be integrated into a seamless whole, which involves expertise from a wide variety of fields. This book presents recent applications of MIR for content-based image retrieval, bioinformation analysis and processing, forensic multimedia retrieval techniques, and audio and music classification.

Based on more than 10 years of teaching experience, Blanken and his coeditors have assembled all the topics that should be covered in advanced undergraduate or graduate courses on multimedia retrieval and multimedia databases. The single chapters of this textbook explain the general architecture of multimedia information retrieval systems and cover various metadata languages such as Dublin Core, RDF, or MPEG. The authors emphasize high-level features and show how these are used in mathematical models to support the retrieval process. For each chapter, there’s detail on further reading, and additional exercises and teaching material is available online.

Multimedia Information Systems brings together in one place important contributions and up-to-date research results in this fast moving area. Multimedia Information Systems serves as an excellent reference, providing insight into some of the most challenging research issues in the field.