Unsettled Issues Regarding Visual Communication Between Automated Vehicles And Other Road Users

As automated road vehicles begin their deployment into public traffic, they will need to interact with human driven vehicles, pedestrians, bicyclists, etc. This requires some form of communication between those automated vehicles (AVs) and other road users. Some of these communication modes (e.g., auditory, motion) were previously addressed in 0́−Unsettled Issues Regarding Communication of Automated Vehicles with Other Road Users.0́+ Unsettled Issues Regarding Visual Communication Between Automated Vehicles and Other Road Users focuses on visual communication and its balance of reach, clarity, and intuitiveness, and discusses how different visual modes (e.g., simple lights, rich text) can be used between AVs and other road users. A particular emphasis is put on standardization to highlight how uniformity and mass adoption increase communication efficacy.

The impending deployment of automated vehicles (AVs) represents a major shift in the traditional approach to ground transportation; its effects will inevitably be felt by parties directly involved with the vehicle manufacturing and use (e.g., automotive original equipment manufacturers (OEMs), public transportation systems, heavy goods transportation providers) and those that play roles in the mobility ecosystem (e.g., aftermarket and maintenance industries, infrastructure and planning organizations, automotive insurance providers, marketers, telecommunication companies). The focus of this SAE EDGE Research Report is to address a topic overlooked by many who choose to view automated driving systems and AVs from a "10,000-foot perspective: " the topic of how AVs will communicate with other road users such as conventional (human-driven) vehicles, bicyclists, and pedestrians while in operation. This unsettled issue requires assessing the spectrum of existing modes of communication - both implicit and explicit, both biological and technological - employed by road users today. NOTE: SAE EDGE(TM) Research Reports are intended to identify and illuminate key issues in emerging, but still unsettled, technologies of interest to the mobility industry. The goal of SAE EDGE(TM) Research Reports is to stimulate discussion and work in the hope of promoting and speeding resolution of identified issues. SAE EDGE(TM) Research Reports are not intended to resolve the challenges they identify or close any topic to further scrutiny.

The technological development in recent years is currently reflected in the implementation of more and more advanced driver assistance systems (ADAS). A clear example is found in the automated driving systems being marketed today. Some of these systems are capable of controlling crucial driving tasks such as keeping the vehicle within the lane or maintaining speed and the distance with the front vehicle constant. While this technology is still not mature enough to allow fully autonomous driving, current systems allow partially automated driving, or Level 2 (SAE, 2016). Level 2 automation enables feet-free, and for short periods hands-free driving, under specific situations. Yet, the driver is still expected to monitor the road and the system and be ready to intervene when required by the system. Regarding this, studies from the driving and other domains have warned about potential performance problems associated with placing operators in such monitoring role. Factors such as vigilance decrements or proneness to engage in other activities have been proposed to explain these problems; however, their role in the context of Level 2 automation remains to be further investigated. In this context, the main aims of this thesis were to understand the attentional effects of monitoring a Level 2 automated system and to investigate drivers’ strategies to integrate additional tasks while using such system. In particular, the following research questions were established: 1) Does monitoring a Level 2 system affect driver attention after short driving periods?; 2) Does Level 2 automation facilitate the performance of additional tasks?; 3) How do drivers integrate additional tasks into their monitoring responsibilities, and how is that influenced by automation trust and experience?. A complementary aim of this thesis was to explore the applicability of the event-related potentials (ERPs) technique to detect the effects of different types of ADAS, i.e. Level 2 automation and a visual in-vehicle information system (IVIS), on drivers’ attention and on specific processing resources. Three studies were conducted to address the aforementioned research questions. In Study I and III, the participants were asked to drive Level 2 automated and manually while performing an auditory oddball task (Study I) or a visuomotor task (Study III). In Study II, the participants were instructed to perform a computer tracking task with or without the support of an artificial visual IVIS while executing a secondary auditory oddball task. Measurements included performance indicators from the primary and secondary tasks, as well as subjective and psychophysiological measures. ERPs (N1 and P3 amplitude and latencies) elicited by the auditory oddball task were used to assess the participants’ attentional resource allocation. Glance behaviour was also recorded to analyse drivers’ visual monitoring strategies in Study III. In addition, subjective measures of mental workload, vigilance or automation trust were collected. Last, driving parameters such as speed, time spent on the left lane or number overtakings were used to account for driving strategies to integrate an additional task while driving Level 2 automated or manually (Study III). As hypothesized, monitoring a Level 2 automated system for short periods led to lower perceived demands and to reductions in the allocation of attentional resources to the auditory oddball task, as shown by lower amplitudes in the P3 component (Study I). In Study III, driving Level 2 automated led to worse performances on an additional visuomotor task, compared to when driving manually, which contradicted our expectations. Additionally, when the system was active, drivers tended to look less to the road and more to the dashboard; however, only drivers with automation experience or who perceived the system as more robust increased their visual attention to the additional task. Furthermore, the results from Study II showed that some specific ERPs parameters, namely N1 latency and P3 amplitude, were also sensitive to the demands of IVIS while performing the tracking task. Based on previous studies (Young and Stanton, 2002), the lower attentional resource allocation observed in Study I could reflect a cognitive underload effect induced by the Level 2 automated driving. Cognitive underload is proposed as one of the explaining mechanisms for the observed worse performances in the additional visuomotor task during the automated conditions in Study III. However, other effects such as overload or task interferences could also explain this. Finally, the results revealed by the ERPs in Studies I and II suggest that this could be a useful technique to detect alterations in drivers’ attention due to the excessive high or low demands placed by different ADAS. ERPs also showed a greater diagnosticity than other measures in the detection of specific task requirements of perceptual and cognitive resources. Thus, ERPs may be useful as a complementary tool to other mental workload measures. Given that drivers need to remain attentive at all times while interacting with a Level 2 automated vehicle, the use of countermeasures to mitigate the negative attentional effects reported in this thesis is highly recommended. Specific training programs enhancing drivers’ knowledge of the system or the implementation of systems that inform about the system reliability or detect inadequate driver states could be promising solutions. Ägare av fordon med nivå 2-automation har nu möjlighet att köra utan att använda pedalerna, och under korta perioder, även utan att behöva styra i specifika trafiksituationer. Emellertid förblir de fortfarande ansvariga för att kontinuerligt övervaka den omgivande trafikmiljön liksom det automatiserade systemet. Även om automatiserade fordon har potential att öka säkerheten, har tidigare studier visat på betydande problem förknippade med förares svårigheter att övervaka automatiserade system en längre tid. Denna avhandlings huvudsakliga syfte var att förstå vilken inverkan nivå 2- automatiserad körning har på förares uppmärksamhet och beteende under två situationer: a) då föraren övervakar trafiken och systemet, b) då föraren övervakar trafiken och systemet, och samtidigt utför en sidouppgift av visumotorisk karaktär. Dessutom undersöktes även vilken inverkan tillit till och erfarenhet av nivå 2-automation hade på förarens övervakningsstrategier av och användning av systemet. Ett ytterligare, kompletterande syfte med denna avhandling, var att undersöka användbarheten av event-related potentials (ERP) -tekniken för att bättre kunna detektera eventuella förändringar som förknippas med nivå 2-automation. Specifikt analyserades N1 och P3 ERP-komponenterna. Dessutom användes denna teknik i avhandlingen för att upptäcka ökning av den mentala arbetsbelastningen i samband med förarens interaktion med andra vanliga stödsystem, exempelvis fordonets informationssystem. Tre olika studier genomfördes. I Studie I (simulatorstudie) observerades att körning med nivå 2- automation under korta perioder medförde generella minskningar av uppmärksamhetsresursallokering. Denna effekt upptäcktes som en minskning av amplituden hos P3-komponenten, framkallad av utförandet av en sekundär auditiv uppgift. I Studie III (på väg) upptäcktes sämre prestation på en sidouppgift av visumotorisk karaktär under körning med nivå-2 automation jämfört med manuell körning. Det observerades även att förare med större erfarenhet av systemet och/eller högre skattningar av systemets robusthet, tenderade att titta mindre på vägen och mer på sidouppgiften. Slutligen, i Studie II (laboratoriestudie), upptäcktes att ERP var användbart för att detektera ökningar av krav associerade med utförandet av en datoradministrerad spårningsuppgift, baserad på ett artificiellt visuellt IVIS. I allmänhet tyder resultaten i denna avhandling på att nivå 2-automation kan leda till kognitiv underbelastning, en effekt som tidigare har observerats i högre grader av automation. Nedsättning av uppmärksamhet, beroende på kognitiv underbelastning, kan förklara de sämre prestationerna på sidouppgiften under körning med nivå 2-automation som observerades i studie III. Dock behöver resultatet undersökas ytterligare eftersom andra effekter, som överbelastning eller specifik uppgiftskonkurrens, också kan ha skett. I enlighet med avhandlingens kompletterande syfte, uppvisade användningen av ERP, som ett komplementärt verktyg till andra sätt att mäta mental arbetsbelastning, lovande resultat. ERP kan användas för att upptäcka ytterligare effekter av olika stödsystem, som antingen ökar eller minskar de krav som ställs på föraren. Nu finns fordon med nivå 2-automation på vägarna. Trots detta är vissa säkerhetsproblem, förknippade med deras effekter på förarens förmågor och beteende, fortfarande olösta. Det är därför nödvändigt att insatser görs för att mildra sådana problem så att framtida incidenter i trafiken kan förhindras i så stor utsträckning som möjligt. Förhoppningsvis bidrar denna avhandling till att öka förståelsen för de verkliga effekterna av nivå 2-system på förare och uppmuntrar till fler framtida studier inom området.

AUTONOMOUS VEHICLES The companion to Autonomous Vehicles Volume 1: Using Machine Intelligence, this second volume in the two-volume set covers intelligent techniques utilized for designing, controlling, and managing vehicular systems based on advanced algorithms of computing like machine learning, artificial intelligence, data analytics, and Internet of Things (IoT) with prediction approaches to avoid accidental damages, security threats, and theft. Besides communicating with other vehicles, self-driving cars connected to a 5G network will also be able to communicate with different infrastructure elements that make up our roads and other transportation and communication systems. Similarly, an unmanned aerial vehicle (UAV), an aircraft without any human pilot, crew, or passengers on board, can operate under remote control by a human operator, as a remotely-piloted aircraft (RPA), or with various degrees of autonomy. These include autopilot assistance and fully autonomous aircraft that have no provision for human intervention. Transportation is a necessary, but often painful process. With fully autonomous driving, passengers will be freed to accomplish their own goals, turning the dead hours of driving into fruitful hours of learning, working, engaging, and relaxing. Similarly, UAVs can perform functions that human-operated aircraft cannot, whether because of the environment or high-risk situations. The purpose of the book is to present the needs, designs, and applications of autonomous vehicles. The topics covered range from mechanical engineering to computer science engineering, both areas playing vital roles in programming, managing, generating alerts, and GPS position, artificial intelligence-based prediction of path and events, as well as other high-tech tools, are covered in this book, as well. Whether for the student, veteran engineer, or another industry professional, this book, and its companion volume, are must-haves for any library.

This SAE EDGE Research Report addresses the unsettled topic of user acceptance of automated driving, analyzing the user experience for a more intuitive and safe driving experience. Unsettled Topics Concerning User Experience and Acceptance of Automated Vehicles examines the requirements for safer driver/user engagement with driving for the various SAE automation levels. It analyzes consumer sentiment toward automated driving - both consumer excitement about the perceived benefits and dislikes or concerns about the technology. The findings from surveys about drivers' experience with advanced driving assistance technologies and its application to automated driving is also brought to the surface of the discussion, together with driver profiles observed during a user-centric experience in an immersive automated driving cockpit. Unsettled Topics Concerning User Experience and Acceptance of Automated Vehicles proposes - through a trust pyramid representation - a means of gradually increasing user trust through careful human-machine interface (HMI) delivery with appropriate levels of information that communicate safe driving. Ultimately, the goal is to build up user confidence levels in safe automated driving so that their time can be spent on entertainment or other non-driving tasks.

Time-Critical Cooperative Control of Autonomous Air Vehicles presents, in an easy-to-read style, the latest research conducted in the industry, while also introducing a set of novel ideas that illuminate a new approach to problem-solving. The book is virtually self-contained, giving the reader a complete, integrated presentation of the different concepts, mathematical tools, and control solutions needed to tackle and solve a number of problems concerning time-critical cooperative control of UAVs. By including case studies of fixed-wing and multirotor UAVs, the book effectively broadens the scope of application of the methodologies developed. This theoretical presentation is complemented with the results of flight tests with real UAVs, and is an ideal reference for researchers and practitioners from academia, research labs, commercial companies, government workers, and those in the international aerospace industry. Addresses important topics related to time-critical cooperative control of UAVs Describes solutions to the problems rooted in solid dynamical systems theory Applies the solutions developed to fixed-wing and multirotor UAVs Includes the results of field tests with both classes of UAVs

We are delighted to introduce the proceedings of the first edition of the 2022 International Conference on Intelligent Technologies in Security and Privacy for Wireless Communication (ITSPWC 2022). This conference has brought researchers, developers and practitioners around the world who are leveraging and developing the Wireless Communication. The theme of ITSPWC 2022 was “Security and Challenges for Wireless Communication and Power Energy”. The technical program of ITSPWC 2022 consisted of 33 full papers, including 5 invited papers in oral presentation sessions at the main conference tracks. The conference tracks were: Track 1 – Recent Trends in IoT; Track 2 – Recent Trends in Smart Energy Systems and Transmission; Track 3 – Recent Trends in Embedded Systems; and Track 4 – Recent Trends in Communication Systems. Aside from the high quality technical paper presentations, the technical program also featured one invited talk and two technical workshops. The invited talk was presented by Prof. Kaushik Pal from Universidade Federal do Rio de Janeiro, Brazil. The ITSPWC workshop aimed to gain insights into key challenges, understanding and design criteria of employing wireless technologies to develop and implement future related services and applications. It was a great pleasure to work with such an excellent organizing committee team for their hard work in organizing and supporting the conference. In particular, the Technical Program Committee, led by our Co-Chairs, Dr.R.Nagarajan, Dr.George Ghinea, Dr.Alagar Karthick, Dr.Bassim Alhadidi and Prof. Kanagaraj Venusamy who have completed the peer-review process of technical papers and made a high-quality technical program. We are also grateful to all the authors who submitted their papers to the ITSPWC 2022 conference and workshops. We strongly believe that ITSPWC conference provides a good forum for all researcher, developers and practitioners to discuss all science and technology aspects that are relevant to Security and Privacy in Wireless Communication. We also expect that the future Wireless Communication conference will be as successful and stimulating, as indicated by the contributions presented in this volume. Dr.S.Kannadhasan