Reliability In Scientific Research

Covering many techniques widely used in research, this book will help researchers in the physical sciences and engineering solve troublesome - and potentially very time consuming - problems in their work. The book deals with technical difficulties that often arise unexpectedly during the use of various common experimental methods, as well as with human error. It provides preventive measures and solutions for such problems, thereby saving valuable time for researchers. Some of the topics covered are: sudden leaks in vacuum systems, electromagnetic interference in electronic instruments, vibrations in sensitive equipment, and bugs in computer software. The book also discusses mistakes in mathematical calculations, and pitfalls in designing and carrying out experiments. Each chapter contains a summary of its key points, to give a quick overview of important potential problems and their solutions in a given area.

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Qualitative research is a sociological and anthropological tradition of inquiry. Most critically, qualitative research involves sustained interaction with the people being studied in their own language, and on their own turf. To see qualitative research as strictly disengaged from any form of counting is to miss the point that its basic strategy depends on the reconciliation of diverse research tactics. It is our view that qualitative research can be performed as social science. Understanding the workings of a scientific endeavor, whether it is of the natural or social variety, entails an appreciation of its objectivity. By this convention, the objectivity of a piece of qualitative research is evaluated in terms of the reliability and validity of its observations - the two concepts to which this monograph is devoted.

Though in the past online learning was considered of poorer professional quality than classroom learning, it has become a useful and, in some cases, vital tool for promoting the inclusivity of education. Some of its benefits include allowing greater accessibility to educational resources previously unattainable by those in rural areas, and in current times, it has proven to be a critical asset as universities shut down due to natural disasters and pandemics. Examining the current state of distance learning and determining online assessment tools and processes that can enhance the online learning experience are clearly crucial for the advancement of modern education. The Handbook of Research on Determining the Reliability of Online Assessment and Distance Learning is a collection of pioneering investigations on the methods and applications of digital technologies in the realm of education. It provides a clear and extensive analysis of issues regarding online learning while also offering frameworks to solve these addressed problems. Moreover, the book reviews and evaluates the present and intended future of distance learning, focusing on the societal and employer perspective versus the academic proposals. While highlighting topics including hybrid teaching, blended learning, and telelearning, this book is ideally designed for teachers, academicians, researchers, educational administrators, and students.

"The book covers thoroughly all that is needed for a full understanding of reliability in terms of classical theory. Ross E. Traub manages to make clear the difference between reliability as a theoretical construct and methods of estimating it in practice. In a useful chapter, he proceeds to examine factors that may affect the reliability of a test, including time limits, test length, item characteristics, subjectively scored items, and heterogeneity of the population taking the test. . . . The book is a useful reference for those with some understanding of reliability theory and would probably make a reasonable textbook (including copious exercises) for those studying the subject from scratch, provided their mathematical background was adequate." --Ian Schagen in Educational Research How can social scientists assess the reliability of the measures derived from tests and questionnaires? Through a careful and illustrative review of the principles of classical reliability theory, Ross E. Traub explores some general strategies for improving measurement procedures. Beginning with a presentation of random variables and the expected values of a random variable, Reliability for the Social Sciences covers such topics as the definition of reliability as a coefficient and possible uses of a coefficient, the notion of parallel tests so as to make possible the estimation of a reliability coefficient for a set of measurements, what to do when parallel tests are not available, what factors affect the reliability coefficient, and how to estimate the standard error of measurement. Aimed at giving readers a nontechnical treatment of classical reliability theory, the book also includes end-of-chapter exercises, as well as boxes that give more in-depth coverage of major topics or that provide algebraic proofs.

A wide-ranging discussion of factors that impede the cumulation of knowledge in the social sciences, including problems of transparency, replication, and reliability. Rather than focusing on individual studies or methods, this book examines how collective institutions and practices have (often unintended) impacts on the production of knowledge.