Metaheuristics For Big Data

Big Data is a new field, with many technological challenges to be understood in order to use it to its full potential. These challenges arise at all stages of working with Big Data, beginning with data generation and acquisition. The storage and management phase presents two critical challenges: infrastructure, for storage and transportation, and conceptual models. Finally, to extract meaning from Big Data requires complex analysis. Here the authors propose using metaheuristics as a solution to these challenges; they are first able to deal with large size problems and secondly flexible and therefore easily adaptable to different types of data and different contexts. The use of metaheuristics to overcome some of these data mining challenges is introduced and justified in the first part of the book, alongside a specific protocol for the performance evaluation of algorithms. An introduction to metaheuristics follows. The second part of the book details a number of data mining tasks, including clustering, association rules, supervised classification and feature selection, before explaining how metaheuristics can be used to deal with them. This book is designed to be self-contained, so that readers can understand all of the concepts discussed within it, and to provide an overview of recent applications of metaheuristics to knowledge discovery problems in the context of Big Data.

Big Data is a new field, with many technological challenges to be understood in order to use it to its full potential. These challenges arise at all stages of working with Big Data, beginning with data generation and acquisition. The storage and management phase presents two critical challenges: infrastructure, for storage and transportation, and conceptual models. Finally, to extract meaning from Big Data requires complex analysis. Here the authors propose using metaheuristics as a solution to these challenges; they are first able to deal with large size problems and secondly flexible and therefore easily adaptable to different types of data and different contexts. The use of metaheuristics to overcome some of these data mining challenges is introduced and justified in the first part of the book, alongside a specific protocol for the performance evaluation of algorithms. An introduction to metaheuristics follows. The second part of the book details a number of data mining tasks, including clustering, association rules, supervised classification and feature selection, before explaining how metaheuristics can be used to deal with them. This book is designed to be self-contained, so that readers can understand all of the concepts discussed within it, and to provide an overview of recent applications of metaheuristics to knowledge discovery problems in the context of Big Data.

Cognitive Big Data Intelligence with a Metaheuristic Approach presents an exact and compact organization of content relating to the latest metaheuristics methodologies based on new challenging big data application domains and cognitive computing. The combined model of cognitive big data intelligence with metaheuristics methods can be used to analyze emerging patterns, spot business opportunities, and take care of critical process-centric issues in real-time. Various real-time case studies and implemented works are discussed in this book for better understanding and additional clarity. This book presents an essential platform for the use of cognitive technology in the field of Data Science. It covers metaheuristic methodologies that can be successful in a wide variety of problem settings in big data frameworks. Provides a unique opportunity to present the work on the state-of-the-art of metaheuristics approach in the area of big data processing developing automated and intelligent models Explains different, feasible applications and case studies where cognitive computing can be successfully implemented in big data analytics using metaheuristics algorithms Provides a snapshot of the latest advances in the contribution of metaheuristics frameworks in cognitive big data applications to solve optimization problems

The amount of data shared and stored on the web and other document repositories is steadily on the rise. Unfortunately, this growth increases inefficiencies and difficulties when trying to find the most relevant and up-to-date information due to unstructured data. Advanced Metaheuristic Methods in Big Data Retrieval and Analytics examines metaheuristic techniques as an important alternative model for solving complex problems that are not treatable by deterministic methods. Recent studies suggest that IR and biomimicry can be used together for several application problems in big data and internet of things, especially when conventional methods would be too expensive or difficult to implement. Featuring coverage on a broad range of topics such as ontology, plagiarism detection, and machine learning, this book is ideally designed for engineers, graduate students, IT professionals, and academicians seeking an overview of new trends in information retrieval in big data.

The main purpose of this book is to investigate, explore and describe approaches and methods to facilitate data understanding through analytics solutions based on its principles, concepts and applications. But analyzing data is also about involving the use of software. For this, and in order to cover some aspect of data analytics, this book uses software (Excel, SPSS, Python, etc) which can help readers to better understand the analytics process in simple terms and supporting useful methods in its application.

In this book, differential evolution and its modified variants are applied to the clustering of data and images. Metaheuristics have emerged as potential algorithms for dealing with complex optimization problems, which are otherwise difficult to solve using traditional methods. In this regard, differential evolution is considered to be a highly promising technique for optimization and is being used to solve various real-time problems. The book studies the algorithms in detail, tests them on a range of test images, and carefully analyzes their performance. Accordingly, it offers a valuable reference guide for all researchers, students and practitioners working in the fields of artificial intelligence, optimization and data analytics.

Using metaheuristics to enhance machine learning techniques has become trendy and has achieved major successes in both supervised (classification and regression) and unsupervised (clustering and rule mining) problems. Furthermore, automatically generating programs via metaheuristics, as a form of evolutionary computation and swarm intelligence, has now gained widespread popularity. This book investigates different ways of integrating metaheuristics into machine learning techniques, from both theoretical and practical standpoints. It explores how metaheuristics can be adapted in order to enhance machine learning tools and presents an overview of the main metaheuristic programming methods. Moreover, real-world applications are provided for illustration, e.g., in clustering, big data, machine health monitoring, underwater sonar targets, and banking.

A comprehensive introduction to the theory and practice of contemporary data science analysis for railway track engineering Featuring a practical introduction to state-of-the-art data analysis for railway track engineering, Big Data and Differential Privacy: Analysis Strategies for Railway Track Engineering addresses common issues with the implementation of big data applications while exploring the limitations, advantages, and disadvantages of more conventional methods. In addition, the book provides a unifying approach to analyzing large volumes of data in railway track engineering using an array of proven methods and software technologies. Dr. Attoh-Okine considers some of today’s most notable applications and implementations and highlights when a particular method or algorithm is most appropriate. Throughout, the book presents numerous real-world examples to illustrate the latest railway engineering big data applications of predictive analytics, such as the Union Pacific Railroad’s use of big data to reduce train derailments, increase the velocity of shipments, and reduce emissions. In addition to providing an overview of the latest software tools used to analyze the large amount of data obtained by railways, Big Data and Differential Privacy: Analysis Strategies for Railway Track Engineering: • Features a unified framework for handling large volumes of data in railway track engineering using predictive analytics, machine learning, and data mining • Explores issues of big data and differential privacy and discusses the various advantages and disadvantages of more conventional data analysis techniques • Implements big data applications while addressing common issues in railway track maintenance • Explores the advantages and pitfalls of data analysis software such as R and Spark, as well as the Apache™ Hadoop® data collection database and its popular implementation MapReduce Big Data and Differential Privacy is a valuable resource for researchers and professionals in transportation science, railway track engineering, design engineering, operations research, and railway planning and management. The book is also appropriate for graduate courses on data analysis and data mining, transportation science, operations research, and infrastructure management. NII ATTOH-OKINE, PhD, PE is Professor in the Department of Civil and Environmental Engineering at the University of Delaware. The author of over 70 journal articles, his main areas of research include big data and data science; computational intelligence; graphical models and belief functions; civil infrastructure systems; image and signal processing; resilience engineering; and railway track analysis. Dr. Attoh-Okine has edited five books in the areas of computational intelligence, infrastructure systems and has served as an Associate Editor of various ASCE and IEEE journals.