Practical Augmented Reality

The most comprehensive and up-to-date guide to the technologies, applications and human factors considerations of Augmented Reality (AR) and Virtual Reality (VR) systems and wearable computing devices. Practical Augmented Reality is ideal for practitioners and students concerned with any application, from gaming to medicine. It brings together comprehensive coverage of both theory and practice, emphasizing leading-edge displays, sensors, and DIY tools that are already available commercially or will be soon. Beginning with a Foreword by NASA research scientist Victor Luo, this guide begins by explaining the mechanics of human sight, hearing and touch, showing how these perceptual mechanisms (and their performance ranges) directly dictate the design and use of wearable displays, 3-D audio systems, and tactile/force feedback devices. Steve Aukstakalnis presents revealing case studies of real-world applications from gaming, entertainment, science, engineering, aeronautics and aerospace, defense, medicine, telerobotics, architecture, law enforcement, and geophysics. Readers will find clear, easy-to-understand explanations, photos, and illustrations of devices including the Atheer AiR, HTC Vive, DAQRI Smart Helmet, Oculus (Facebook) CV1, Sony PlayStation VR, Vuzix M300, Google Glass, and many more. Functional diagrams and photographs clearly explain how these devices operate, and link directly to relevant theoretical and practical content. Practical Augmented Reality thoroughly considers the human factors of these systems, including sensory and motor physiology constraints, monocular and binocular depth cues, elements contributing to visually-induced motion sickness and nausea, and vergence–accommodation conflicts. It concludes by assessing both the legal and societal implications of new and emerging AR, VR, and wearable technologies as well as provides a look next generation systems.

This is the most comprehensive and up-to-date guide to the technologies, applications and human factors considerations of Augmented Reality (AR) and Virtual Reality (VR) systems and wearable computing devices. Ideal for practitioners and students alike, it brings together comprehensive coverage of both theory and practice, emphasizing leading-edge displays, sensors, and other enabling technologies and tools that are already commercially available or will be soon.

Build exciting AR applications on mobile and wearable devices with Unity 3D, Vuforia, ARToolKit, Microsoft Mixed Reality HoloLens, Apple ARKit, and Google ARCore About This Book Create unique AR applications from scratch, from beginning to end, with step-by-step tutorials Use Unity 3D to efficiently create AR apps for Android, iOS, and Windows platforms Use Vuforia, ARTookKit, Windows Mixed Reality, and Apple ARKit to build AR projects for a variety of markets Learn best practices in AR user experience, software design patterns, and 3D graphics Who This Book Is For The ideal target audience for this book is developers who have some experience in mobile development, either Android or iOS. Some broad web development experience would also be beneficial. What You Will Learn Build Augmented Reality applications through a step-by-step, tutorial-style project approach Use the Unity 3D game engine with the Vuforia AR platform, open source ARToolKit, Microsoft's Mixed Reality Toolkit, Apple ARKit, and Google ARCore, via the C# programming language Implement practical demo applications of AR including education, games, business marketing, and industrial training Employ a variety of AR recognition modes, including target images, markers, objects, and spatial mapping Target a variety of AR devices including phones, tablets, and wearable smartglasses, for Android, iOS, and Windows HoloLens Develop expertise with Unity 3D graphics, UIs, physics, and event systems Explore and utilize AR best practices and software design patterns In Detail Augmented Reality brings with it a set of challenges that are unseen and unheard of for traditional web and mobile developers. This book is your gateway to Augmented Reality development—not a theoretical showpiece for your bookshelf, but a handbook you will keep by your desk while coding and architecting your first AR app and for years to come. The book opens with an introduction to Augmented Reality, including markets, technologies, and development tools. You will begin by setting up your development machine for Android, iOS, and Windows development, learning the basics of using Unity and the Vuforia AR platform as well as the open source ARToolKit and Microsoft Mixed Reality Toolkit. You will also receive an introduction to Apple's ARKit and Google's ARCore! You will then focus on building AR applications, exploring a variety of recognition targeting methods. You will go through multiple complete projects illustrating key market sectors including business marketing, education, industrial training, and gaming. By the end of the book, you will have gained the necessary knowledge to make quality content appropriate for a range of AR devices, platforms, and intended uses. Style and approach This book adopts a practical, step-by-step, tutorial-style approach. The design principles and methodology will be explained by creating different modules of the AR app.

Today’s Comprehensive and Authoritative Guide to Augmented Reality By overlaying computer-generated information on the real world, augmented reality (AR) amplifies human perception and cognition in remarkable ways. Working in this fast-growing field requires knowledge of multiple disciplines, including computer vision, computer graphics, and human-computer interaction. Augmented Reality: Principles and Practice integrates all this knowledge into a single-source reference, presenting today’s most significant work with scrupulous accuracy. Pioneering researchers Dieter Schmalstieg and Tobias Höllerer carefully balance principles and practice, illuminating AR from technical, methodological, and user perspectives. Coverage includes Displays: head-mounted, handheld, projective, auditory, and haptic Tracking/sensing, including physical principles, sensor fusion, and real-time computer vision Calibration/registration, ensuring repeatable, accurate, coherent behavior Seamless blending of real and virtual objects Visualization to enhance intuitive understanding Interaction–from situated browsing to full 3D interaction Modeling new geometric content Authoring AR presentations and databases Architecting AR systems with real-time, multimedia, and distributed elements This guide is indispensable for anyone interested in AR, including developers, engineers, students, instructors, researchers, and serious hobbyists.

New technologies and ongoing developments in the fields of Virtual reality, augmented reality and artificial intelligence are changing the ways in which we facilitate learning. Recognising the positive role these technologies can play in the learning and progress of students assessed as having special educational needs, this practical guide explains the characteristics, benefits, risks and potential applications of new technologies in the classroom. An innovative and timely resource, Virtual Reality, Augmented Reality and Artificial Intelligence in Special Education offers a background in the evidence-based theory and practice of using new technologies in an educational context. Accessible and free of complex jargon, chapters provide information on the development, intended uses and most current terminology used in relation to technologies, and explains how modern equipment, approaches and possibilities can be used to promote improved communication skills, independent learning and heightened self-esteem amongst students diagnosed with SEND. Offering a wealth of practical tips, downloadable resources and ideas for engaging with technology in the classroom, the text will support teachers to ensure that students can benefit from exciting technological advances and learn to use them appropriately. Demystifying a complex and varied field, this practical resource will inspire and inform teachers, SENCOs and practitioners working with children and students with SEND as they harness the use of technology in the classroom.

Despite popular forays into augmented and virtual reality in recent years, spatial computing still sits on the cusp of mainstream use. Developers, artists, and designers looking to enter this field today have few places to turn for expert guidance. In this book, Erin Pangilinan, Steve Lukas, and Vasanth Mohan examine the AR and VR development pipeline and provide hands-on practice to help you hone your skills. Through step-by-step tutorials, you’ll learn how to build practical applications and experiences grounded in theory and backed by industry use cases. In each section of the book, industry specialists, including Timoni West, Victor Prisacariu, and Nicolas Meuleau, join the authors to explain the technology behind spatial computing. In three parts, this book covers: Art and design: Explore spatial computing and design interactions, human-centered interaction and sensory design, and content creation tools for digital art Technical development: Examine differences between ARKit, ARCore, and spatial mapping-based systems; learn approaches to cross-platform development on head-mounted displays Use cases: Learn how data and machine learning visualization and AI work in spatial computing, training, sports, health, and other enterprise applications

The new realities are here. Virtual and Augmented realities and 360 video technologies are rapidly entering our homes and office spaces. Good quality audio has always been important to the user experience, but in the new realities, it is more than important, it’s essential. If the audio doesn’t work, the immersion of the experience fails and the cracks in the new reality start to show. This practical guide helps you navigate the challenges and pitfalls of designing audio for these new realities. This technology is different from anything we’ve seen before and requires an entirely new approach; this book will introduce the broad concepts you need to know before delving into the practical detail you need. Key Features This book covers audio for all types of new reality technology. At the moment, VR and 360 video are getting a lot of press, but in a few years we will be hearing a lot more about Augmented and Mixed reality technologies as well. A practical guide to creating, designing and implementing audio for this new technology by a leading sound design and implementation expert. Conceptual explanations address the new approaches necessary to designing effective audio for the new realities. Real-world examples and analysis of what does and does not work including detailed case study discussions.

Augmented reality (AR) is regarding embedding digital information to the real world. It is another medium for communication between people and machines. Augmented reality is presently going through a massive international hype. Although augmented reality has been around for years, it wasn't until Android and iOS smartphones came equipped with GPS, camera and AR capability that augmented reality came into its own with the public. This technology combines virtual reality with the real world in the type of live video imagery that is digitally improved with computer-generated graphics. AR can be experienced through headsets that people wear and through displays on mobile devices. AR applications can become the backbone of the education industry. Apps are being developed which embed text, images, and videos, in addition to real-world curriculums. Printing and advertising industries are developing apps to display digital content on top of real world magazines. With help of AR, travelers can access real-time information of historical places just by pointing their camera viewfinder to subjects. AR is helpful in development of translation apps that can interpret text in other languages for you.Practical Augmented Reality aims to understand the practical aspects in augmented reality and see how it fits into real world applications. It presents an approach for developing Augmented Reality systems for Art, Design & Cultural Heritage and integrated E-learning systems, helping to carry out the practical work by establishing a virtual laboratory that all tools and products can be manipulated by learners and teachers like in real practical activity, based on an augmented reality system. It will present examples of state-of-the-art display configurations, appropriate real-time rendering techniques, details about hardware and software implementations, and current areas of application. Furthermore, it presents techniques for projector based augmentation of geometrically complex and textured display surfaces, and methods for achieving consistent illumination and occlusion effects. Emerging technologies that have the potential of enhancing future augmented reality displays will be surveyed.