Evaluating Online Learning

How can novice e-learning researchers and postgraduate learners develop rigorous plans to study the effectiveness of technology-enhanced learning environments? How can practitioners gather and portray evidence of the impact of e-learning? How can the average educator who teaches online, without experience in evaluating emerging technologies, build on what is successful and modify what is not? By unpacking the e-learning lifecycle and focusing on learning, not technology, Evaluating e-Learning attempts to resolve some of the complexity inherent in evaluating the effectiveness of e-learning. The book presents practical advice in the form of an evaluation framework and a scaffolded approach to an e-learning research study, using divide-and-conquer techniques to reduce complexity in both design and delivery. It adapts and builds on familiar research methodology to offer a robust and accessible approach that can ensure effective evaluation of a wide range of innovative initiatives, including those covered in other books in the Connecting with e-Learning series. Readers will find this jargon-free guide is a must-have resource that provides the proper tools for evaluating e-learning practices with ease.

Create a more effective system for evaluating online faculty Evaluating Online Teaching is the first comprehensivebook to outline strategies for effectively measuring the quality ofonline teaching, providing the tools and guidance that facultymembers and administrators need. The authors address challengesthat colleges and universities face in creating effective onlineteacher evaluations, including organizational structure,institutional governance, faculty and administrator attitudes, andpossible budget constraints. Through the integration of casestudies and theory, the text provides practical solutions geared toaddress challenges and foster effective, efficient evaluations ofonline teaching. Readers gain access to rubrics, forms, andworksheets that they can customize to fit the needs of their uniqueinstitutions. Evaluation methods designed for face-to-face classrooms, fromstudent surveys to administrative observations, are often appliedto the online teaching environment, leaving reviewers andinstructors with an ill-fitted and incomplete analysis.Evaluating Online Teaching shows how strategies forevaluating online teaching differ from those used in traditionalclassrooms and vary as a function of the nature, purpose, and focusof the evaluation. This book guides faculty members andadministrators in crafting an evaluation process specificallysuited to online teaching and learning, for more accurate feedbackand better results. Readers will: Learn how to evaluate online teaching performance Examine best practices for student ratings of onlineteaching Discover methods and tools for gathering informal feedback Understand the online teaching evaluation life cycle The book concludes with an examination of strategies forfostering change across campus, as well as structures for creatinga climate of assessment that includes online teaching as acomponent. Evaluating Online Teaching helps institutionsrethink the evaluation process for online teaching, with the endgoal of improving teaching and learning, student success, andinstitutional results.

Assessment has provided educational institutions with information about student learning outcomes and the quality of education for many decades. But has it informed practice and been fully incorporated into the learning cycle? Conrad and Openo argue that the potential inherent in many of the new learning environments being explored by educators and students has not been fully realized. In this investigation of a variety of assessment methods and learning approaches, the authors aim to discover the tools that engage learners and authentically evaluate education. They insist that moving to new learning environments, specifically those online and at a distance, afford opportunities for educators to adopt only the best practices of traditional face-to-face assessment while exploring evaluation tools made available by a digital learning environment in the hopes of arriving at methods that capture the widest set of learner skills and attributes.

Education in this country has evolved dramatically from the days of one teacher in a one-room schoolhouse. Today, student learning is no longer confined to a physical space. Computers and the Internet have broken through school walls, giving students greater opportunities to personalise their education, access distant resources, receive extra help or more-challenging assignments, and engage in learning in new and unique ways. This book provides a new look at the relatively new enterprise of online learning in the K-12 arena, which is expanding rapidly, with increasing numbers of providers offering services and more students choosing to participate. As with any education program, online learning initiatives must be held accountable for results. Thus, it is critical for students and their parents, as well as administrators, policymakers, and funders to have data informing them about program and student outcomes and, if relevant, about how well a particular program compares to traditional education models. Rigorous evaluations are essential to this process and are included in this book. They identify whether programs and online resources are performing as promised, and equally important, they can point to areas for improvement.

Create a more effective system for evaluating online faculty Evaluating Online Teaching is the first comprehensive book to outline strategies for effectively measuring the quality of online teaching, providing the tools and guidance that faculty members and administrators need. The authors address challenges that colleges and universities face in creating effective online teacher evaluations, including organizational structure, institutional governance, faculty and administrator attitudes, and possible budget constraints. Through the integration of case studies and theory, the text provides practical solutions geared to address challenges and foster effective, efficient evaluations of online teaching. Readers gain access to rubrics, forms, and worksheets that they can customize to fit the needs of their unique institutions. Evaluation methods designed for face-to-face classrooms, from student surveys to administrative observations, are often applied to the online teaching environment, leaving reviewers and instructors with an ill-fitted and incomplete analysis. Evaluating Online Teaching shows how strategies for evaluating online teaching differ from those used in traditional classrooms and vary as a function of the nature, purpose, and focus of the evaluation. This book guides faculty members and administrators in crafting an evaluation process specifically suited to online teaching and learning, for more accurate feedback and better results. Readers will: Learn how to evaluate online teaching performance Examine best practices for student ratings of online teaching Discover methods and tools for gathering informal feedback Understand the online teaching evaluation life cycle The book concludes with an examination of strategies for fostering change across campus, as well as structures for creating a climate of assessment that includes online teaching as a component. Evaluating Online Teaching helps institutions rethink the evaluation process for online teaching, with the end goal of improving teaching and learning, student success, and institutional results.

With the rapid proliferation of distance education and e-learning courses, the need is growing for a comprehensive, professional approach to evaluating their effectiveness. This indispensable book offers a road map to guide evaluation practice in these innovative learning environments. Providing practical, step-by-step guidelines and tools for conducting evaluation studies—including how to deal with stakeholders, develop surveys and interview protocols, collect other scientific evidence, and analyze and blend mixed-methods data—the work also features a template for writing high-quality reports. The "unfolding model" developed by the authors draws on Messick's influential assessment framework and applies it to program evaluation. Two case studies of actual programs (a distance learning course and an e-learning course) demonstrate the unfolding model in action.

Innovative Learning Analytics for Evaluating Instruction covers the application of a forward-thinking research methodology that uses big data to evaluate the effectiveness of online instruction. Analysis of Patterns in Time (APT) is a practical analytic approach that finds meaningful patterns in massive data sets, capturing temporal maps of students’ learning journeys by combining qualitative and quantitative methods. Offering conceptual and research overviews, design principles, historical examples, and more, this book demonstrates how APT can yield strong, easily generalizable empirical evidence through big data; help students succeed in their learning journeys; and document the extraordinary effectiveness of First Principles of Instruction. It is an ideal resource for faculty and professionals in instructional design, learning engineering, online learning, program evaluation, and research methods.

In the ten years since the inception of the Sloan Consortium, the field of online learning has entered the mainstream of higher education, making online learning a core ingredient of tomorrow¿s educational paradigms. Now that digital natives are coming of age, the blending of on-ground and online education is continuous and unstoppable. Growing demands for wide choice suggest that the blended agenda presses us rapidly into new realms of inquiry. Thus, the title of this collection, the fifth volume in the Sloan-C series on quality, is Elements of Quality Online Education: Into the Mainstream. The 14 peer-reviewed studies in this volume provide guidance for effectively responding to the challenges facing higher education.¿The studies on Student Satisfaction recognize that significant populations remain underserved. Yet asynchronous learning networks (ALNs) are widening access by easing some of the constraints of place-based, synchronous learning, so that many more and many more new kinds of learners can achieve satisfaction and success. ¿The studies on Learning Effectiveness share an emphasis on the ways that ALN exceeds the ¿no significant difference¿ minimum standard for learning outcomes.¿The studies on blending, combining face-to-face and online methods for learning, offer rich possibilities for what many see as the best of both learning modes.¿The studies on assessment go to the core of the Sloan-C quality framework and its emphasis on continuous quality improvement through demonstrating progress towards the overarching goal of affordable access for all in a wide range of disciplines.In our time of ¿profound, rapid, and discontinuous change,¿ these studies envision solutions to the challenges of online, blended and face-to-face education in higher education. Sponsored by the Alfred P. Sloan Foundation, the purpose of the Sloan Consortium (Sloan-C) is to help learning organizations continually improve quality, scale, and breadth according to their own distinctive missions, so that education will become a part of everyday life, accessible and affordable for anyone, anywhere, at any time, in a wide variety of disciplines.