Experimentation Works

Don't fly blind. See how the power of experiments works for you. When it comes to improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. They discover that intuition, experience, and big data alone don't work. What does? Running disciplined business experiments. And what if companies roll out new products or introduce new customer experiences without running these experiments? They fly blind. That's what Harvard Business School professor Stefan Thomke shows in this rigorously researched and eye-opening book. It guides you through best practices in business experimentation, illustrates how these practices work at leading companies, and answers some fundamental questions: What makes a good experiment? How do you test in online and brick-and-mortar businesses? In B2B and B2C? How do you build an experimentation culture? Also, best practice means running many experiments. Indeed, some hugely successful companies, such as Amazon, Booking.com, and Microsoft, run tens of thousands of controlled experiments annually, engaging millions of users. Thomke shows us how these and many other organizations prove that experimentation provides significant competitive advantage. How can managers create this capability at their own companies? Essential is developing an experimentation organization that prizes the science of testing and puts the discipline of experimentation at the center of its innovation process. While it once took companies years to develop the tools for such large-scale experiments, advances in technology have put these tools at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create magical customer experiences, and generate big financial returns. Experimentation Works is your guidebook to a truly new way of thinking and innovating.

Every company's ability to innovate depends on a process of experimentation whereby new products and services are created and existing ones improved. But the cost of experimentation often limits innovation. New technologies--including computer modeling and simulation--promise to lift that constraint by changing the economics of experimentation. Never before has it been so economically feasible to ask "what-if" questions and generate preliminary answers. These technologies amplify the impact of learning, paving the way for higher R&D performance and innovation and new ways of creating value for customers.In Experimentation Matters, Stefan Thomke argues that to unlock such potential, companies must not only understand the power of experimentation and new technologies, but also change their processes, organization, and management of innovation. He explains why experimentation is so critical to innovation, underscores the impact of new technologies, and outlines what managers must do to integrate them successfully. Drawing on a decade of research in multiple industries as diverse as automotive, semiconductors, pharmaceuticals, chemicals, and banking, Thomke provides striking illustrations of how companies drive strategy and value creation by accommodating their organizations to new experimentation technologies.As in the outcome of any effective experiment, Thomke also reveals where that has not happened, and explains why. In particular, he shows managers how to: implement "front-loaded" innovation processes that identify potential problems before resources are committed and design decisions locked in; experiment and test frequently without overloading their organizations; integrate new technologies into the current innovation system; organize for rapid experimentation; fail early and often, but avoid wasteful "mistakes"; and manage projects as experiments.Pointing to the custom integrated circuit industry--a multibillion dollar market--Thomke also shows what happens when new experimentation technologies are taken beyond firm boundaries, thereby changing the way companies create new products and services with customers and suppliers. Probing and thoughtful, Experimentation Matters will influence how both executives and academics think about experimentation in general and innovation processes in particular. Experimentation has always been the engine of innovation, and Thomke reveals how it works today.

Animal Experimentation: Working Towards a Paradigm Change critically appraises current animal use in science and discusses ways in which we can contribute to a paradigm change towards human-biology based approaches.

How tech companies like Google, Airbnb, StubHub, and Facebook learn from experiments in our data-driven world—an excellent primer on experimental and behavioral economics Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world. Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that governments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”

A practical guide to effective business model testing 7 out of 10 new products fail to deliver on expectations. Testing Business Ideas aims to reverse that statistic. In the tradition of Alex Osterwalder’s global bestseller Business Model Generation, this practical guide contains a library of hands-on techniques for rapidly testing new business ideas. Testing Business Ideas explains how systematically testing business ideas dramatically reduces the risk and increases the likelihood of success for any new venture or business project. It builds on the internationally popular Business Model Canvas and Value Proposition Canvas by integrating Assumptions Mapping and other powerful lean startup-style experiments. Testing Business Ideas uses an engaging 4-color format to: Increase the success of any venture and decrease the risk of wasting time, money, and resources on bad ideas Close the knowledge gap between strategy and experimentation/validation Identify and test your key business assumptions with the Business Model Canvas and Value Proposition Canvas A definitive field guide to business model testing, this book features practical tips for making major decisions that are not based on intuition and guesses. Testing Business Ideas shows leaders how to encourage an experimentation mindset within their organization and make experimentation a continuous, repeatable process.

This practical guide for students, researchers and practitioners offers real world guidance for data-driven decision making and innovation.

In the accounts compiled in this book, ethnography occurs through processes of material and social interventions that turn the field into a site for epistemic collaboration. Through creative interventions that unfold what we term as “fieldwork devices”—such as coproduced books, the circulation of repurposed data, co-organized events, authorization protocols, relational frictions, and social rhythms—anthropologists engage with their counterparts in the field in the construction of joint anthropological problematizations. In these situations, the traditional tropes of the fieldwork encounter (i.e. immersion and distance) give way to a narrative of intervention, where the aesthetics of collaboration in the production of knowledge substitutes or intermingles with participant observation. Building on this, the book proposes the concept of “experimental collaborations” to describe and conceptualize this distinctive ethnographic modality.

Essential reading for anyone interested in artistic research applied to music This book is the first anthology of writings about the emerging subject of artistic experimentation in music. This subject, as part of the cross-disciplinary field of artistic research, cuts across boundaries of the conventional categories of performance practice, music analysis, aesthetics, and music pedagogy. The texts, most of them specially written for this volume, have a common genesis in the explorations of the Orpheus Research Centre in Music (ORCiM) in Ghent, Belgium. The book critically examines experimentation in music of different historical eras. It is essential reading for performers, composers, teachers, and others wanting to inform themselves of the issues and the current debates in the new field of artistic research as applied to music. The publication is accompanied by a CD of music discussed in the text, and by an online resource of video illustrations of specific issues. Contributors Paulo de Assis (ORCiM), Richard Barrett (Institute of Sonology, The Hague), Tom Beghin (McGill University), William Brooks (University of York, ORCiM), Nicholas G. Brown (University of East Anglia), Marcel Cobussen (University of Leiden), Kathleen Coessens (Vrije Universiteit Brussel, ORCiM); Paul Craenen (Director Musica, Impulse Centre for Music), Darla Crispin (Norwegian Academy of Music), Stephen Emmerson (Queensland Conservatorium, Griffith University, Brisbane), Henrik Frisk (Malmö Academy of Music), Bob Gilmore (ORCiM), Valentin Gloor (ORCiM), Yolande Harris (Center for Digital Arts and Experimental Media – DXARTS), University of Washington, Seattle), Mieko Kanno (Royal Conservatoire of Scotland), Andrew Lawrence-King (Guildhall School of Music and Drama, London, Royal Danish Academy of Music, Copenhagen, University of Western Australia), Catherine Laws (University of York, ORCiM), Stefan Östersjö (ORCiM), Juan Parra (ORCiM), Larry Polansky (University of California, Santa Cruz), Stephen Preston, Godfried-Willem Raes (Logos Foundation, Ghent), Hans Roels (ORCiM), Michael Schwab (ORCiM, Royal College of Art, London, Zurich University of the Arts), Anna Scott (ORCiM), Steve Tromans (Middlesex University), Luk Vaes (ORCiM), Bart Vanhecke (KU Leuven, ORCiM)