The Problem With Survey Research

The Problem with Survey Research makes a case against survey research as a primary source of reliable information. George Beam argues that all survey research instruments, all types of asking—including polls, face-to-face interviews, and focus groups—produce unreliable and potentially inaccurate results. Because those who rely on survey research only see answers to questions, it is impossible for them, or anyone else, to evaluate the results. They cannot know if the answers correspond to respondents’ actual behaviors (objective phenomena) or to their true beliefs and opinions (subjective phenomena). Reliable information can only be acquired by observation, experimentation, multiple sources of data, formal model building and testing, document analysis, and comparison. In fifteen chapters divided into six parts—Ubiquity of Survey Research, The Problem, Asking Instruments, Asking Settings, Askers, and Proper Methods and Research Designs—The Problem with Survey Research demonstrates how asking instruments, settings in which asking and answering take place, and survey researchers themselves skew results and thereby make answers unreliable. The last two chapters and appendices examine observation, other methods of data collection and research designs that may produce accurate or correct information, and shows how reliance on survey research can be overcome, and must be.

The Problem with Survey Research makes a case against survey research as a primary source of reliable information. George Beam argues that all survey research instruments, all types of asking-including polls, face-to-face interviews, and focus groups-produce unreliable and potentially inaccurate results. Because those who rely on survey research only see answers to questions, it is impossible for them, or anyone else, to evaluate the results. They cannot know if the answers correspond to respondents' actual behaviors (objective phenomena) or to their true beliefs and opinions (subjective phenomena). Reliable information can only be acquired by observation, experimentation, multiple sources of data, formal model building and testing, document analysis, and comparison. In fifteen chapters divided into six parts-Ubiquity of Survey Research, The Problem, Asking Instruments, Asking Settings, Askers, and Proper Methods and Research Designs-The Problem with Survey Research demonstrates how asking instruments, settings in which asking and answering take place, and survey researchers themselves skew results and thereby make answers unreliable. The last two chapters and appendices examine observation, other methods of data collection and research designs that may produce accurate or correct information, and shows how reliance on survey research can be overcome, and must be.

Paper and electronic surveys of students and faculty have become increasingly popular in higher education research and are now used in almost all facets of assessment and planning. Yet as the demand for survey research has increased, survey response rates have been falling. Low response rates are problematic because they can call into question the validity of the results, as well as increase survey administration costs. This volume examines an array of survey research problems and best practices, with the aim of providing readers with ways to increase response rates while controlling costs. Many institutional researchers face additional demands such as administering multiple surveys over time, or administering surveys on sensitive subjects such as student alcohol or drug use. New technologies for survey administration also provide many different options. This volume discusses these issues in terms of the survey research literature as well as the experiences of practitioners in the field. This is the 121st volume of the higher education quarterly journal New Directions for Institutional Research.

"This Fourth Edition of Floyd J. Fowler's bestselling Survey Research Methods presents the very latest methodological knowledge on surveys. It provides students and researchers who want to collect, analyze, or read about survey data with a sound basis for evaluating how each aspect of a survey can affect its precision, accuracy, and credibility. Offering a concise overview of the entire survey research process in clear and easy-to-understand language, the book is well suited to a wide range of readers, including those without strong statistical backgrounds." "Survey Research Methods is appropriate for undergraduate courses in research methods in the social sciences, as well as for master degree level research methods courses."--BOOK JACKET.

Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses--Publisher's website.

In 1939, George Gallup's American Institute of Public Opinion published a pamphlet optimistically titled The New Science of Public Opinion Measurement. At the time, though, survey research was in its infancy, and only now, six decades later, can public opinion measurement be appropriately called a science, based in part on the development of the total survey error approach. Herbert F. Weisberg's handbook presents a unified method for conducting good survey research centered on the various types of errors that can occur in surveys—from measurement and nonresponse error to coverage and sampling error. Each chapter is built on theoretical elements drawn from specific disciplines, such as social psychology and statistics, and follows through with detailed treatments of the specific types of error and their potential solutions. Throughout, Weisberg is attentive to survey constraints, including time and ethical considerations, as well as controversies within the field and the effects of new technology on the survey process—from Internet surveys to those completed by phone, by mail, and in person. Practitioners and students will find this comprehensive guide particularly useful now that survey research has assumed a primary place in both public and academic circles.

With chapters on: sampling; measurement; questionnaire construction and question writing; survey implementation and management; survey data analysis; special types of surveys; and integrating surveys with other data collection methods, this title includes topics such as measurement models, the role of cognitive psychology, and surveying networks.