The Finely Tuned Approach

This open access book provides a comprehensive overview of the state of the art in research and applications of Foundation Models and is intended for readers familiar with basic Natural Language Processing (NLP) concepts. Over the recent years, a revolutionary new paradigm has been developed for training models for NLP. These models are first pre-trained on large collections of text documents to acquire general syntactic knowledge and semantic information. Then, they are fine-tuned for specific tasks, which they can often solve with superhuman accuracy. When the models are large enough, they can be instructed by prompts to solve new tasks without any fine-tuning. Moreover, they can be applied to a wide range of different media and problem domains, ranging from image and video processing to robot control learning. Because they provide a blueprint for solving many tasks in artificial intelligence, they have been called Foundation Models. After a brief introduction to basic NLP models the main pre-trained language models BERT, GPT and sequence-to-sequence transformer are described, as well as the concepts of self-attention and context-sensitive embedding. Then, different approaches to improving these models are discussed, such as expanding the pre-training criteria, increasing the length of input texts, or including extra knowledge. An overview of the best-performing models for about twenty application areas is then presented, e.g., question answering, translation, story generation, dialog systems, generating images from text, etc. For each application area, the strengths and weaknesses of current models are discussed, and an outlook on further developments is given. In addition, links are provided to freely available program code. A concluding chapter summarizes the economic opportunities, mitigation of risks, and potential developments of AI.

This book constitutes the refereed proceedings of the 6th International Symposium on Advances in Signal Processing and Intelligent Recognition Systems, SIRS 2020, held in Chennai, India, in October 2020. Due to the COVID-19 pandemic the conference was held online. The 22 revised full papers and 5 revised short papers presented were carefully reviewed and selected from 50 submissions. The papers cover wide research fields including information retrieval, human-computer interaction (HCI), information extraction, speech recognition.

This book is a collection of best selected research papers presented at the International Conference on Communication and Artificial Intelligence (ICCAI 2021), held in the Department of Electronics & Communication Engineering, GLA University, Mathura, India, during 19–20 November 2021. The primary focus of the book is on the research information related to artificial intelligence, networks, and smart systems applied in the areas of industries, government sectors, and educational institutions worldwide. Diverse themes with a central idea of sustainable networking solutions are discussed in the book. The book presents innovative work by leading academics, researchers, and experts from industry.

This unique volume reviews the latest advances in domain adaptation in the training of machine learning algorithms for visual understanding, offering valuable insights from an international selection of experts in the field. The text presents a diverse selection of novel techniques, covering applications of object recognition, face recognition, and action and event recognition. Topics and features: reviews the domain adaptation-based machine learning algorithms available for visual understanding, and provides a deep metric learning approach; introduces a novel unsupervised method for image-to-image translation, and a video segment retrieval model that utilizes ensemble learning; proposes a unique way to determine which dataset is most useful in the base training, in order to improve the transferability of deep neural networks; describes a quantitative method for estimating the discrepancy between the source and target data to enhance image classification performance; presents a technique for multi-modal fusion that enhances facial action recognition, and a framework for intuition learning in domain adaptation; examines an original interpolation-based approach to address the issue of tracking model degradation in correlation filter-based methods. This authoritative work will serve as an invaluable reference for researchers and practitioners interested in machine learning-based visual recognition and understanding.

This book constitutes the refereed proceedings of the 19th International Conference on Advanced Data Mining and Applications, ADMA 2023, held in Shenyang, China, during August 21–23, 2023. The 216 full papers included in this book were carefully reviewed and selected from 503 submissions. They were organized in topical sections as follows: Data mining foundations, Grand challenges of data mining, Parallel and distributed data mining algorithms, Mining on data streams, Graph mining and Spatial data mining.