Giving Bodies Back To Data

An examination of the bodily, situated aspects of data-visualization work, looking at visualization practices around the development of MRI technology. Our bodies are scanned, probed, imaged, sampled, and transformed into data by clinicians and technologists. In this book, Silvia Casini reveals the affective relations and materiality that turn data into image--and in so doing, gives bodies back to data. Opening the black box of MRI technology, Casini examines the bodily, situated aspects of visualization practices around the development of this technology. Reframing existing narratives of biomedical innovation, she emphasizes the important but often overlooked roles played by aesthetics, affectivity, and craft practice in medical visualization. Combining history, theory, laboratory ethnography, archival research, and collaborative art-science, Casini retrieves the multiple presences and agencies of bodies in data visualization, mapping the traces of scientists' body work and embodied imagination. She presents an in-depth ethnographic study of MRI development at the University of Aberdeen's biomedical physics laboratory, from the construction of the first whole-body scanner for clinical purposes through the evolution of the FFC-MRI. Going beyond her original focus on MRI, she analyzes a selection of neuroscience- or biomedicine-inspired interventions by artists in media ranging from sculpture to virtual reality. Finally, she presents a methodology for designing and carrying out small-scale art-science projects, describing a collaboration that she herself arranged, highlighting the relational and aesthetic-laden character of data that are the product of craftsmanship and affective labor at the laboratory bench.

How the use of machine learning to analyze art images has revived formalism in art history, presenting a golden opportunity for art historians and computer scientists to learn from one another. Though formalism is an essential tool for art historians, much recent art history has focused on the social and political aspects of art. But now art historians are adopting machine learning methods to develop new ways to analyze the purely visual in datasets of art images. Amanda Wasielewski uses the term “computational formalism” to describe this use of machine learning and computer vision technique in art historical research. At the same time that art historians are analyzing art images in new ways, computer scientists are using art images for experiments in machine learning and computer vision. Their research, says Wasielewski, would be greatly enriched by the inclusion of humanistic issues. The main purpose in applying computational techniques such as machine learning to art datasets is to automate the process of categorization using metrics such as style, a historically fraught concept in art history. After examining a fifteen-year trajectory in image categorization and art dataset creation in the fields of machine learning and computer vision, Wasielewski considers deep learning techniques that both create and detect forgeries and fakes in art. She investigates examples of art historical analysis in the fields of computer and information sciences, placing this research in the context of art historiography. She also raises questions as which artworks are chosen for digitization, and of those artworks that are born digital, which works gain acceptance into the canon of high art.

An “episode of light” in Canada sparked by Expo 67 when new art forms, innovative technologies, and novel institutional and policy frameworks emerged together. Understanding how experimental art catalyzes technological innovation is often prized yet typically reduced to the magic formula of “creativity.” In Northern Sparks, Michael Century emphasizes the role of policy and institutions by showing how novel art forms and media technologies in Canada emerged during a period of political and social reinvention, starting in the 1960s with the energies unleashed by Expo 67. Debunking conventional wisdom, Century reclaims innovation from both its present-day devotees and detractors by revealing how experimental artists critically challenge as well as discover and extend the capacities of new technologies. Century offers a series of detailed cross-media case studies that illustrate the cross-fertilization of art, technology, and policy. These cases span animation, music, sound art and acoustic ecology, cybernetic cinema, interactive installation art, virtual reality, telecommunications art, software applications, and the emergent metadiscipline of human-computer interaction. They include Norman McLaren’s “proto-computational” film animations; projects in which the computer itself became an agent, as in computer-aided musical composition and choreography; an ill-fated government foray into interactive networking, the videotext system Telidon; and the beginnings of virtual reality at the Banff Centre. Century shows how Canadian artists approached new media technologies as malleable creative materials, while Canada undertook a political reinvention alongside its centennial celebrations. Northern Sparks offers a uniquely nuanced account of innovation in art and technology illuminated by critical policy analysis.

An examination of machine learning art and its practice in new media art and music. Over the past decade, an artistic movement has emerged that draws on machine learning as both inspiration and medium. In this book, transdisciplinary artist-researcher Sofian Audry examines artistic practices at the intersection of machine learning and new media art, providing conceptual tools and historical perspectives for new media artists, musicians, composers, writers, curators, and theorists. Audry looks at works from a broad range of practices, including new media installation, robotic art, visual art, electronic music and sound, and electronic literature, connecting machine learning art to such earlier artistic practices as cybernetics art, artificial life art, and evolutionary art. Machine learning underlies computational systems that are biologically inspired, statistically driven, agent-based networked entities that program themselves. Audry explains the fundamental design of machine learning algorithmic structures in terms accessible to the nonspecialist while framing these technologies within larger historical and conceptual spaces. Audry debunks myths about machine learning art, including the ideas that machine learning can create art without artists and that machine learning will soon bring about superhuman intelligence and creativity. Audry considers learning procedures, describing how artists hijack the training process by playing with evaluative functions; discusses trainable machines and models, explaining how different types of machine learning systems enable different kinds of artistic practices; and reviews the role of data in machine learning art, showing how artists use data as a raw material to steer learning systems and arguing that machine learning allows for novel forms of algorithmic remixes.

The first comprehensive history in English of film at the Bauhaus, exploring practices that experimented with film as an adaptable, elastic “polymedium.” With Design in Motion, Laura Frahm proposes an alternate history of the Bauhaus—one in which visual media, and film in particular, are crucial to the Bauhaus’s visionary pursuit of integrating art and technology. In the first comprehensive examination in English of film at the Bauhaus, Frahm shows that experimentation with film spanned a range of Bauhaus practices, from textiles and typography to stage and exhibition design. Indeed, Bauhausler deployed film as an adaptable, elastic “polymedium,” malleable in shape and form, unfolding and refracting into multiple material, aesthetic, and philosophical directions. Frahm shows how the encounter with film imbued the Bauhaus of the 1920s and early 1930s with a flexible notion of design, infusing painting with temporal concepts, sculptures with moving forms, photographs with sequential aesthetics, architectural designs with a choreography of movement. Frahm considers, among other things, student works that explored light and the transparent features of celluloid and cellophane; weaving practices that incorporate cellophane; experimental films, social documentaries, and critical reportage by Bauhaus women; and the proliferation of film strips in posters, book covers, and other typographic work. Viewing the Bauhaus’s engagement with film through a media-theoretic lens, Frahm shows how film became a medium for “design in motion.” Movement and process, rather than stability and fixity, become the defining characteristics of Bauhaus educational, aesthetic, and philosophical ethos.

Longlisted for the 2023 Lumen Prize, a hybrid digital artistic and literary project in the form of an augmented reality book, which retells Dante’s Inferno as if it were set in pandemic-ravaged New York City. Voidopolis is a digital performance about loss and memory presented as an augmented reality (AR) book with a limited lifespan. The book loosely retells the story of Dante’s Inferno as if it were the dystopic experience of wandering through New York City during the pandemic; instead of Virgil, however, the narrator is guided through this modern hellscape by a caustic hobo named Nikita. Voidopolis is meant to culminate in loss. It features images that are created by digitally “wiping” humans from stock photography and text that is generated without the letter “e”—in homage to Oulipo author Georges Perec’s A Void, a 300-page novel written entirely without the letter—by using a modified GPT-2 text generator. The book, adapted from a series of Instagram posts that were ultimately deleted, is likewise designed to disappear: its garbled pages can only be deciphered with an AR app, and they decay at the same rate over a period of one year, after which the decay process restarts and begins again. At the end of this decay cycle, only the printed book, with its unintelligible pages, remains. Each July 1, the date the project first started on Instagram, the book resets again, beginning anew the cycle of its own vanishing. A first-of-its-kind augmented reality book from a major university press, Voidopolis is a unique and deeply affecting artwork that speaks as much to our existential moment as it does to the fragility of experience, reality, and our connection to one another.

The pixel as the organizing principle of all pictures, from cave paintings to Toy Story. The Great Digital Convergence of all media types into one universal digital medium occurred, with little fanfare, at the recent turn of the millennium. The bit became the universal medium, and the pixel--a particular packaging of bits--conquered the world. Henceforward, nearly every picture in the world would be composed of pixels--cell phone pictures, app interfaces, Mars Rover transmissions, book illustrations, videogames. In A Biography of the Pixel, Pixar cofounder Alvy Ray Smith argues that the pixel is the organizing principle of most modern media, and he presents a few simple but profound ideas that unify the dazzling varieties of digital image making. Smith's story of the pixel's development begins with Fourier waves, proceeds through Turing machines, and ends with the first digital movies from Pixar, DreamWorks, and Blue Sky. Today, almost all the pictures we encounter are digital--mediated by the pixel and irretrievably separated from their media; museums and kindergartens are two of the last outposts of the analog. Smith explains, engagingly and accessibly, how pictures composed of invisible stuff become visible--that is, how digital pixels convert to analog display elements. Taking the special case of digital movies to represent all of Digital Light (his term for pictures constructed of pixels), and drawing on his decades of work in the field, Smith approaches his subject from multiple angles--art, technology, entertainment, business, and history. A Biography of the Pixel is essential reading for anyone who has watched a video on a cell phone, played a videogame, or seen a movie. 400 pages of annotations, prepared by the author and available online, provide an invaluable resource for readers.

An intimate foray into the invisible work that made it possible for pictures to circulate in print and online from the 1830s to the 2010s. Picture Research focuses on how pictures were saved, stored, and searched for in a time before scanners, servers, and search engines, and describes the dramatic difference it made when images became scannable, searchable, and distributable via the internet. While the camera, the darkroom, and the printed page are well-known sites of photographic production that have been replaced by cell phones, imaging software, and websites, the cultural intermediaries of mass-circulation photography—picture librarians and researchers, editors, and archivists—are less familiar. In this book, Nina Lager Vestberg artfully details the range of research skills, reproduction machinery, and communication infrastructures that was needed to make pictures available to a public before digitization. Drawing on documents and representations across a range of cultural expressions, Picture Research reveals the intermediation that has been performed by skilled workers in a variety of roles, making use of pre-photographic, photographic, and digital machineries of capture, accumulation, extraction, and transmission. Tracing a history of the modern pictorial economy from the pre-photographic 1830s to the post-digitized 2010s, it makes visible and explicit the invisible labor that has built—and still sustains—the visual commodity culture of everyday life.