Design Recommendations For Intelligent Tutoring System Volume 5 Assessment Methods

This book is the fifth in a planned series of books that examine key topics (e.g., learner modeling, instructional strategies, authoring, domain modeling, assessment, impact on learning, team tutoring, machine learning, and potential standards) in intelligent tutoring system (ITS) design through the lens of the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is a modular, service-oriented architecture created to reduce the cost and skill required to author ITSs, manage instruction within ITSs, and evaluate the effect of ITS technologies on learning, performance, retention, transfer of skills, and other instructional outcomes. Along with this volume, the first four books in this series, Learner Modeling (ISBN 978-0-9893923-0-3), Instructional Management (ISBN 978-0-9893923-2-7), Authoring Tools (ISBN 978-0-9893923-6-5) and Domain Modeling (978-0-9893923-9-6) are freely available at www.GIFTtutoring.org and on Google Play.

This book on team tutoring is the sixth in a planned series of books that examine key topics (e.g., learner modeling, instructional strategies, authoring, domain modeling, assessment, impact on learning, team tu-toring, machine learning for self-improving systems, potential standards, and learning effect evaluation methods) in intelligent tutoring system (ITS) design. This book focuses on team tutoring. The discussion chapters in this book examine topics through the lens of the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is a modular, service-oriented architecture created to reduce the cost and skill required to author ITSs, distribute ITSs, manage instruction within ITSs, and evaluate the effect of ITS technologies on learning, performance, retention, transfer of skills, and other instructional outcomes. Along with this volume, the first five books in this series, Learner Modeling (ISBN 978-0-9893923-0-3), Instructional Management (ISBN 978-0-9893923-2-7), Authoring Tools (ISBN 978-0-9893923-6-5), Domain Modeling (978-0-9893923-9-6) and Assessment Methods (ISBN 978-0-9977257-2-8) are freely avail-able at www.GIFTtutoring.org and on Google Play.

Design Recommendations for Intelligent Tutoring Systems explores the impact of intelligent tutoring system design on education and training. Specifically, this volume examines “Instructional Management” techniques, strategies and tactics, and identifies best practices, emerging concepts and future needs to promote efficient and effective adaptive tutoring solutions. Design recommendations include current, projected, and emerging capabilities within the Generalized Intelligent Framework for Tutoring (GIFT), an open source, modular, service-oriented architecture developed to promote simplified authoring, reuse, standardization, automated instructional management and analysis of tutoring technologies.

Design Recommendations for Intelligent Tutoring Systems (ITSs) explores the impact of intelligent tutoring system design on education and training. Specifically, this volume examines “Authoring Tools and Expert Modeling Techniques”. The “Design Recommendations book series examines tools and methods to reduce the time and skill required to develop Intelligent Tutoring Systems with the goal of improving the Generalized Intelligent Framework for Tutoring (GIFT). GIFT is a modular, service-oriented architecture developed to capture simplified authoring techniques, promote reuse and standardization of ITSs along with automated instructional techniques and effectiveness evaluation capabilities for adaptive tutoring tools and methods.

Design Recommendations for Intelligent Tutoring Systems explores the impact of computer-based tutoring system design on education and training. Specifically, this volume, “Learner Modeling” examines the fundamentals of learner modeling and identifies best practices, emerging concepts and future needs to promote efficient and effective tutoring. Part of our design recommendations include current, projected, and needed capabilities within the Generalized Intelligent Framework for Tutoring (GIFT), an open source, modular, service-oriented architecture developed to promote simplified authoring, reuse, standardization, automated instruction and evaluation of tutoring technologies.

Design Recommendations for Intelligent Tutoring Systems (ITSs) explores the impact of intelligent tutoring system design on education and training. Specifically, this volume examines “Domain Modeling”. The “Design Recommendations book series examines tools and methods to reduce the time and skill required to develop Intelligent Tutoring Systems with the goal of improving the Generalized Intelligent Framework for Tutoring (GIFT). GIFT is a modular, service-oriented architecture developed to capture simplified authoring techniques, promote reuse and standardization of ITSs along with automated instructional techniques and effectiveness evaluation capabilities for adaptive tutoring tools and methods.

This book is a resource for those who are new to intelligent tutoring systems (ITSs), as well as those with a great deal of experience with them. This is the tenth book in our Design Recommendations for Intelligent Tutoring Systems book series. The focus of this book is on Strengths, Weaknesses, Opportunities, and Threats (SWOT) Analyses of varying components of ITSs. Each chapter in the book represents a different topic area, and includes a SWOT analysis that is specific to that topic and how it relates to ITSs. This book can be read in order, or a reader can choose a specific topic area and move directly to that chapter. Each SWOT Analysis describes the current state of the topic area, and how the lessons learned from the analysis could be applied to the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare et al., 2012; Sottilare et al., 2017). GIFT is an ITS architecture that is open-source, modular, and domain independent (Sottilare et al., 2017). Each book in the design recommendations series has addressed a different ITS topic area, and how the work in each chapter can relate to and inform the GIFT architecture. GIFT has continually been in development, with features consistently being added to improve functionality, as well as reduce the skill requirement for authoring content in GIFT. GIFT is freely available in both downloadable and Cloud versions at https://www.GIFTtutoring.org.

This book focuses on the topic of competency-based scenario design as it relates to Intelligent Tutoring Systems (ITSs). The current book is the ninth in a series of books that examine key topics in ITSs. The chapters in this book specifically relate the work presented to applications for the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg, & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is an open-source, domain independent, service-oriented, modular architecture for ITSs. GIFT has specifically been designed to allow for reusability of the GIFT architecture, GIFT tools, and instructional content materials. Further, GIFT has been designed with the goals of reducing the amount of time necessary to author ITSs, and reducing the skill level required for the authoring process. GIFT can be used to create ITSs that can be distributed both locally on a computer and virtually in the Cloud. In addition to creating ITSs, GIFT can be used to examine instructional outcomes, and conduct research. The topic of this book, Competency-Based Scenario Design is highly relevant to the development of ITSs. Scenarios are information-rich task/problem contexts that are closely aligned with real-world situations that professionals face in their jobs. The tasks/problems exhibit ecological validity rather than stripped-down abstract simplifications. Developers of ITSs and other adaptive instructional systems need to have principled guidance on how to design these scenarios. An example scenario may be a close match to a particular situation in the past, but not be representative of a large range of situations that professionals experience in their job. An example scenario may be very realistic, but not provide reliable and valid assessments of the learners' performance to guide assessments (summative, formative, or stealth). Research teams that build high quality scenarios need to include expertise in the targeted profession, assessment, learning science, and computer science. The current book brings together experts on ITSs to discuss their work as it applies to Competency-Based Scenario Design. We believe that this book can be used as a resource for those who have an interest in developing Scenarios for ITSs, and who want to learn more about how to do so.