The following essay on the instrumented streetscape is one of the oldest surviving passages in The City Is Here For You To Use; parts of what you’re about to read date to 2007 (!). Among other things, this explains why it’s tonally more enthusiastic about the prospect of living in such a city than anything I’d be likely to write from scratch today, and also accounts for the fact that a decent chunk of it bears an unfortunate resemblance to Dan Hill’s great and deservedly foundational 2008 essay “The Street As Platform.” (I like to think my take is sufficiently distinct from Dan’s that it’s still worth publishing as-is, but I’m sure you’ll let me know if you think otherwise.)
Those quibbles aside, I’m pleased with the way it stands up — pleased enough, at any rate, to offer it to you here, now, before any more time goes by. As ever, I hope you enjoy it and find it usefully provocative.
Imagine trying to apprehend everything that happens over the course of a single day, in any of Earth’s great cities: all the flows of matter, energy and information; all the happenstance connections which come into being for a single moment, before passing forever into history; every sensible event which transpires. Even if you could somehow capture all of these passages in a single diagram, how could the result be anything but a writhing hypershape, forever absconding from our ability to comprehend it?
But what if we could perceive the shape of events, even for a moment? Better yet, what if we could somehow decode what it was trying to tell us? What if we could divine the subtle patterns latent in it, haul ashore from this dark sea order, insight…meaning?
Toward the end of his long and productive career, the great sociologist Henri Lefebvre took up just this question, in a project he called “rhythmanalysis.” This was a notion he introduced in an essay called “Seen from the Window,” and a famous passage in which Lefebvre simply stands at his balcony and gives himself up to the tides of the living city.
His view must have been spectacular. From this favored vantage point, he can take up the Centre Pompidou, the Bank of France, the National Archive, “[a]ll of Paris ancient and modern, traditional and creative, active and idle” in a single sweeping gaze. Alongside Lefebvre, we stand at the window long enough to note the diurnal washes of office workers and schoolchildren, the cyclic peaks and troughs of vehicular traffic, the blooms of tourist-friendly mummery in the museum plaza and the slow ebbing of activity into the long stretch of the deep middle night.
This depiction of the great city’s surges and stutters is vivid enough, especially for readers familiar with Paris. But what Lefebvre is trying to call our attention to is what happens when we immerse ourselves in the art of watching. “Seen from the Window” isn’t ultimately concerned with anything that can be captured by a single glance, as much as it is with an order that reveals itself only in time.
What the trained mind perceives in the daily cycling of neighborhood noise and activity, Lefebvre claims, is nothing less than “social organization manifesting itself.” Pushing back against the modernist notion that to see something is to know it completely — a notion which inheres in the very idea of surveillance — “Window” argues that there is a hidden truth of the city, something bound up in patterns of regular activity that unfold only along the t axis: in a word, rhythms. “No camera, no image or sequence of images can show these rhythms,” he insists. “One needs equally attentive eyes and ears, a head, a memory, a heart.”
While it certainly resonates with other attempts to know the city via concerted application of the senses, notably Georges Perec’s lovely 1974 Attempt At Exhausting A Place In Paris, this is something Lefebvre maintains even though “Seen from the Window” apparently postdates a few artifacts demonstrating how much more rewarding this undertaking can be when augmented with appropriate technology. Koyaanisqatsi, for example, which is nothing if not a sequence of images showing the rhythm of urban place and the underlying social order, and an extraordinarily vivid and memorable one at that. Or William H. Whyte’s wonderful 1980 investigations of sidewalk life in New York City, released as a short film called The Social Life of Small Urban Spaces.
It is surely the case, historically, that time-and-motion studies have had unfortunate Taylorist and Fordist resonances, and perhaps Lefebvre was reacting to those in insisting on the primacy of human perception. But Whyte’s work demonstrated that, conscientiously applied, time-lapse photography could reveal patterns of use and activity that would have escaped the unaided human observer; if the value of such techniques wasn’t obvious before his films, it certainly should have been thereafter. So while I’m always tempted to submit to Lefebvre’s passionate humanism, the fact is that any attempt to understand patterns of regular activity in anything as compound in its complexity as a city is likely to fail if the proper tools are not brought to bear on it.
Could it be that we now have access to tools that Lefebvre lacked? Tools that even he might have granted would provide crucial support to his project of rhythmanalysis and, more broadly, other attempts to divine the deeper order in the surging and cycling of things? Certainly those of us with the ordinary endowments of attention and focus have a hard time wrapping our heads around the “organized complexity” Jane Jacobs thought of as emblematic of urban place; I can tell you from long experience that sitting and watching a city, straining to read its traces and signs, is an exercise in head-flexing frustration. I, at least, need help.
Consider that organized complexity, and what it implies about the dynamics of place. In any settlement worthy of the name “city,” a very large number of discrete events will transpire at any given moment. We can think of each as a move in a sprawling, elaborate game — but a game in which every move changes the rules all players must abide by. Each and every event that is seen to occur alters the terms of the shared situation, however incrementally or subtly, and anyone wanting to develop any particularly robust understanding of that situation needs to account for as many of them as possible.
For most of human history, this was well beyond the capabilities of even the most ambitious state, or enterprise. As we’ve seen, however, we are by now collectively well-embarked on the project of installing sensing devices both on our persons, and throughout the urban environment, that can capture these fragile traces before they are lost. These devices operate in a bewildering profusion of registers, and at every scale. They generate the most torrential volumes of data about our bodies, our places, and everything that happens in and between them.
In being uploaded and propagated across a network, the flickering traces of our existence acquire an uncanny persistence. If this persistence isn’t immortality, or anything like it, it is at the very least an extension in time of things we have generally expected to expire and disappear from the world entirely. Whatever is once captured by the network remains available for future retrieval, furnishing us with a repository of collective memory that another French thinker, Bernard Stiegler, thinks of as a “global mnemotechnic apparatus.” And where the flood of sensed impressions easily overwhelms any unaided ability to make meaning of it, we now have access to an array of analytical techniques to help us correlate, synthesize and extract significance from the intake.
Where Lefebvre maintained that only the human eye was capable of registering the city’s rhythms, and only the human heart truly able to make sense of them, we’ve bound ourselves and our cities in a skein of technical mediation that — in this sense, anyway — allows us to transcend the limitations of the merely human. In doing so, we acquire new and almost superhuman capabilities, collectively and individually. We can sift the onrushing flow of events, divine the presence of a signal amidst all the noise, develop a vastly refined understanding of a city’s organized, compound and ramifying complexity…and act upon it.
Lefebvre is gone, but his balcony remains. The city that stretches beneath it is, like all other true cities, a manifold positively shuddering with life and activity at every scale of being. It pulses with flows of matter, energy and information, in patterns that vary from the clockwork-routine to the one-of-a-kind and never-to-be-repeated. What would you miss, if all you could know of these flows was the wedge or cone visible to you during a few hours’ vigil at a window in the 6e?
It’s a few moments before six, on a damp evening in early spring. From Montreuil in the east to Neuilly-sur-Seine in the west, streetlights wink on in a slow wave, as their sensors register the falling dusk. There’s a rush-hour backup approaching the Porte d’Orléans exit on the Périphérique; in front of a BNP Paribas ATM in the Rue de Sèvres, a brief scuffle breaks out between supporters of the Paris Saint-Germain and Olympique de Marseille football clubs. Two friends from Sciences-Po laugh abashedly, as they recognize one another before one of the few tatty multiplexes remaining on the Champs-Élysées — they’re in line to pick up tickets for the 6:15 showing of an American blockbuster. Not far away, in the Avenue Carnot, a flic pins a suspected purse-snatcher to the wall; affecting nonchalance as they wait for a van to come pick them up, he leans into the man’s back, putting all his weight behind the point of his elbow.
A municipal street-cleaner churns slowly through the streets of the Marais, hosing the day’s grit and dust from the asphalt. Across town, on the Boulevard Ney in the 18e Arrondissement, a bored Ghanaian streetwalker seeks shelter from a brief downpour beneath the awning of a pharmacy, her emerald-daubed nails clacking on the screen of her phone as she checks her messages. In the Rue Saint-Honoré, a fashion executive urges her two matched Standard Poodles from the back of the black S600 that has just deposited her in front of her office. An American backpacker on a post-collegiate month abroad strides forth from the marble gate of Père Lachaise with a shoplifted Gide wedged in the cargo pocket of his fatigue pants. And way out in Torcy, there are RER cars being switched in from a siding to the main rail line, bound for Les Halles and the other stations of the center.
In this city, everyone passing by with a mobile phone reveals their location — whether or not the phone is equipped with explicitly locative technology, whether or not the phone is even turned on. Every transaction in the bistros and shops and cafés generates a trail, just as every bus and car and Vélib bicycle throws its own data shadow. Even the joggers in the Bois du Boulogne cast a constant, incrementing tally of miles logged and calories burned.
This is Paris: all of it, all at once. In any previous epoch, all of these events might have transpired unobserved and unmarked — except, perhaps, by a sociologist in the twilight of his life, gazing down from his balcony. Even the most sensitive observer could never hope to witness or impress upon their recollection more than the tiniest fraction of it, however long they watched the city go by. And any information or potential insight bound up in the flow of events fell to the ground like a silent, diffuse drizzle, forever lost to introspection, analysis, and memory.
But now we can trace these flows, at least in principle, and plot them in space and in time. We can turn up latent patterns and unexpected correlations, and in turn suggest points of effective intervention to those with a mind to change. We can determine that there are more rhythms in the living city than even Henri Lefebvre ever dreamed of: anticipations, reversals, slight returns. Stutters, stops, and lags. Doublings and crashes. And we can do this all because of the vast array of data-collecting devices we’ve seeded through the quotidian environment.
Traffic cameras and roadway sensors on the Périphérique log the slowdown, and it shows up as a thick red line splashed across a hundred thousand electronic roadsigns, dashboard navigation units and smartphone screens. Here are the rhythms of daily mobility and, by extension, the broader economy.
The ATM’s security camera captures the precise details of who did what to whom in the scuffle, and when; the identities of the participants can be reconstructed later on, if need be, by a state-sanctioned trawl of the transaction records. (Those identity files will almost certainly note an individual’s allegiance to a particular football club.) As with the traffic, here too we can begin to make correlations, mapping outbreaks of aggression against other observed phenomena — the league schedule, perhaps, or the phase of the moon, or the unemployment index. Or even something comparatively unexpected, like the price of discount-airline tickets. Here are the rhythms of collective mood.
The friends so embarrassed to run into one another at a superhero movie? They reserved their tickets online using their phones, and in so doing broadcast their choice for all to see, at least in aggregate; they might be surprised to learn that those who purchase tickets in this way in the streets around their campus appear to have a marked fondness for Hollywood action flicks. Here are correlated geographical patterns of socialization and consumption, and the rhythms of media consumption.
The Avenue Carnot is nowhere to be found in any official record of the bag-snatching incident. In all the relevant entries, the offense is associated with the location where it was reported, a few blocks away in the rue de Tilsitt, and so that is how it shows up in both the Mairie’s statistics and a citizen-generated online map of risk in Paris; in fact, this kind of slippage between an event that happens in the world and the event’s representation in the networked record is routine. But the arrogant insouciance of the arresting flic’s posture bothers a lycée student passing by, who snaps a picture with her phone and submits it, time- and location-stamped, to the Commission Citoyens Justice Police, a civilian review board. In this constellation of facts, we can see something about the frequency with which particular kinds of crimes are committed in a given location, the type and density of policing resources deployed to address them, and the frictions between the police and the communities in which they operate. Here, then, are the contrapuntal rhythms of crime, its control and the response to that control.
The nature of the streetwalker’s trade could perhaps be inferred from the multiple daily orbits her cellphone describes between her regular patch on the sidewalk and a cheap rented room nearby. If not this, then her frequent purchases of condoms would certainly help to flesh out the picture, even though she pays cash for them — the pharmacy she buys them from retains a service that uses each phone’s unique IMEI number to track customers’ trajectories through the store, and this service maps her path to the Durex display with unerring precision. Here in these ghostly trails are the rhythms of the informal economy, surfacing through seemingly innocuous patterns of fact. (Her phone calls home to Ghana, like the tens of thousands of other calls mediated monthly by the base stations of the 18e, to Nigeria and Sierra Leone, clarify not merely how deeply interconnected any city is with others, but specifically which neighborhoods within them are most associated with other places on Earth. Here are the rhythms of global mobility, global migration and, inevitably, global exploitation.)
The streetcleaner, of course, has a GPS transponder; its moment-to-moment route through the city is mapped by the Mairie itself, and provided to citizens in real time as part of a transparency initiative designed to demonstrate the diligence and integrity of civil servants (and very much resented by the DPE workers’ union). Unless prevented from happening — should those workers, for example, happen to go on strike, or a particularly rowdy manif break out — here are the metronome-reliable rhythms of the municipal.
The fashion executive had her assistant reserve a car online some weeks ago, and so while there’s certainly something to be inferred from whether she splurged on the S600 as usual, or economized with a cheaper booking, there’s probably some lag in what it signifies. (Even if the car hadn’t been booked on the corporate account, it is also, of course, equipped with GPS, and that unit’s accuracy buffer has been set such that it correctly identifies the location at the moment it pulls up to the curb with the name of the house the executive works for.) Here can be gleaned solid, actionable business intelligence: both the cycling of particular enterprises and sectors of the economy, and by extension possibly even some insight into the rhythms of something as inchoate and hard to grasp as taste.
What might we learn from the American backpacker? The pedometer app on his phone is sophisticated enough to understand his dwell of eleven minutes in a location in the Rue de Rivoli as a visit to the W.H. Smith bookstore, but other facets of his activity this day slip through holes in the mesh — that boosted volume of Gide, notably, which will remain an unexplained lacuna on the bookstore’s inventory-tracking software. And, bizarrely, his few hours contemplating greatness and mortality in Père Lachaise, which resolve against a flaky location database as having been passed instead in the aisles of a Franprix market a few blocks to the east. (Indeed, so often does this same error happen that after a few months, the Franprix starts getting recommended to other tourists as a destination frequently visited by people like them, and enjoys a slight but detectable bump in revenues as a result. The manager is pleased, but mystified.) Here are the rhythms of contingency and chance and stochastic noise.
And each commuter passing through the turnstiles of the RER at day’s end, each of them the increment of a register in the capacity-management systems of the RATP, clarifies the contours of one final picture. The city’s population at 4 AM may be half what it is at 4 PM, revealing the true Paris as something that has only a casual relationship with its administrative boundaries. Here is the rhythm of the city itself.
Where previously everything that transpired in the fold of the great city evaporated in the moment it happened, all of these rhythms and processes are captured by the network, and retained for inspection at leisure. We can readily visualize basins of attraction or repulsion, shedding light on the relationships between one kind of flow and another, and in so doing perhaps learning how to shape their evolution with a lighter hand.
By the same token, though, that which had been liminal becomes clear; what was invisible is made self-evident, even painfully obvious; the circumstances we generally prefer to ignore or dissemble stand forth, plain as day. The embarrassing, the informal, the nominally private and the illegal become subject to new and perhaps untenable kinds of scrutiny. The gaze of the state intensifies — but the state may find, to its surprise, that its subjects have many of the same capabilities, and are gazing right back upon it.
On this evening in the City of Light, a hundred million connected devices sing through the wires and the aether. Of the waves that ripple through the urban fabric, at whatever scale, very few escape their ken — escape being captured by them, and represented in bursts of binary data. Enciphered within are billions of discrete choices, millions of lives in motion, the cycling of the entire economy, and, at the very edge of perception, the signs and traces of empire’s slow unwinding.
This is a city Lefebvre never saw from his balcony, and never could — any more than Henry Mayhew could have, in looking down on the wild scrum of Victorian London from the parapet of St. Paul’s, or any observer of any of the great cities of history would have been able to, no matter the perspicacity they brought to the task. It’s ours, the one we live in.
What might we do with it?
Now that we’re finally slouching toward Amazon to be born — i.e. I’m confident that the Kindle edition, at least, will ship within the next ten days — I’m happy to be able to share this final bibliography for “Against the smart city.” I hope, as ever, you find it useful.
Alcatel-Lucent Corporation. “Getting Smart About Smart Cities: Understanding the Market Opportunity in the Cities of Tomorrow,” February 2012.
Alexander, Steve. “IBM wants Minneapolis to become a ‘smarter city,'” Minneapolis Star Tribune, 6 June 2011.
Allease, Eve. “Abu Dhabi, United Arab Emirates: Future Green City Now,” Urban Times, 22 May 2011.
Allianz Open Knowledge Initiative. “Masdar City: a desert utopia,” 30 March 2009.
Alusi, Annissa, Robert G. Eccles, Amy C. Edmondson and Tiona Zuzul. “Sustainable Cities: Oxymoron or the Shape of the Future?,” Harvard Business School Working Paper 11-062, 20 March 2011.
Amnesty International. “Amnesty International Report 2008: Americas Regional Update. Selected events covering the period from January to April 2008,” 28 May 2008.
— “‘We have come to take your souls’: the caveirão and policing in Rio de Janeiro,” 13 March 2006.
Android Open Source Project. “Licenses.”
Beer, Stafford. Platform for Change: A Message from Stafford Beer. Wiley, New York, 1975.
Bell, Genevieve and Paul Dourish. “Yesterday’s Tomorrows: Notes on Ubiquitous Computing’s Dominant Vision,” Personal and Ubiquitous Computing Volume 11 Issue 2, January 2007.
Bettencourt, Luís M.A., et al. “Growth, innovation, scaling, and the pace of life in cities,” Proceedings of the National Academy of Sciences, Volume 104 Number 17, 24 April 2007.
Biddle, Sam. “Racial Profiling: Newest Trend in Silicon Valley?,” Valleywag, 7 August 2013.
Black, Edwin. IBM and the Holocaust: The Strategic Alliance between Nazi Germany and America’s Most Powerful Corporation, Random House, New York, 2001.
Boudreau, John. “Cisco helps build prototype for instant cities,” San Jose Mercury News, 01 June 2010.
Brand, Stewart. How Buildings Learn, Viking Press, New York, 1994.
Brewster, Kent. “Profiling Atherton,” July 2013.
Buro Happold. “Projects: PlanIT Valley.”
Carlisle, Tamsin. “Masdar City clips another $2.5bn from price tag,” The National, 1 December 2010.
Chalmers, Matthew and Ian MacColl. “Seamful and Seamless Design in Ubiquitous Computing,” Technical Report Equator-03-005, 2004.
Chen, David W. “Survey Raises Questions on Data-Driven Policy,” The New York Times, 8 February 2010.
Chomsky, Noam. “The Case Against B.F. Skinner,” New York Review of Books, 30 December 1971.
Cisco Systems. “Cisco and Lake Nona Unite to Create First U.S. Iconic Smart+Connected Community in Orlando, Florida,” 24 October 2012.
— “Cisco Contributes to Open Source.”
— “Cities of the Future: Songdo, South Korea,” 2012.
— “Cities of the Future: Songdo, South Korea – Living,” 2012.
— “Cities of the Future: Songdo, South Korea – Roadmap for a New Community,” 2012.
— “Smart City Framework: A Systematic Process for Enabling Smart+Connected Communities,” September 2012.
— “Smart+Connected Communities.”
City Mayors Foundation. “Largest cities in the world ranked by population density,” 2007.
City Protocol Society. “City Protocol.”
Cohen, Boyd. “Singapore Is On Its Way To Becoming An Iconic Smart City,” Fast Company co.Exist, 14 May 2012.
Le Corbusier. The Athens Charter, Grossman Publishers, New York, 1973.
— La Ville Radieuse. Editions Vincent, Freal & Co., Paris, 1935.
Cotton, Brian (“Ph.D.”!) for Frost & Sullivan. “Intelligent Urban Transportation: Predicting, Managing, and Integrating Traffic Operations in Smarter Cities.
CSIR-Central Road Research Institute. “Evaluating Bus Rapid Transit (BRT) Corridor Performance from Amebedkar Nagar to Mool Chand Intersection,” 13 February 2013.
Davis, Mike and Daniel Bertrand Monk. Evil Paradises: Dreamworlds of Neoliberalism, The New Press, New York, 2008.
De la Peña, Benjamin. “Embracing the Autocatalytic City,” The Atlantic Cities, 11 March 2013.
Deleuze, Gilles. Cinema 1: The Movement-Image, Athlone Press, London, 1986.
Dourish, Paul. Where the Action Is: The Foundations of Embodied Interaction, The MIT Press, Cambridge MA, 2004.
The Economist. “Masdar plan,” Technology Quarterly, 4 December 2008.
Economist Intelligence Unit for Siemens AG. “Managing the city as a ‘living organism,'” Asian Green City Index, 2011.
Emirates Center for Human Rights. “Migrant workers in the United Arab Emirates,” July 2012.
English, Bella. “He’ll Build This City,” Boston Globe, 13 December 2004.
Executive Affairs Authority, Emirate of Abu Dhabi. “Law No. 22: Establishment of Abu Dhabi Future Energy Company and Masdar Institute of Science and Technology,” 2007.
EXP, Research Centre for Experimental Practice at the University of Westminster. “Archigram Archival Project.”
Feuer, Alan. “Occupy Sandy: A Movement Moves to Relief,” The New York Times, 9 November 2012.
Flood, Joe. The Fires: How a Computer Formula Burned Down New York City — And Determined the Future of American Cities. Riverhead Books, New York, 2010.
Forrester, Jay. Urban Dynamics, The MIT Press, Cambridge MA, 1969.
Frayssinet, Fabiana. “Forced Eviction from Rio’s Slums Echoes Dark Past,” Tierramerica, 10 May 2010.
Galbraith, Jay R. “Matrix organization designs: How to combine functional and project forms,” Business Horizons Volume 14 Issue 1, 1971.
Gartner, Inc. “Is ‘Smart Cities’ The Next Big Market?,” 2010.
Gehl, Jan. Life Between Buildings: Using Public Space, trans. Jo Koch, Van Nostrand Reinhold, New York, 1987.
Gibson, William. Neuromancer, Ace Books, New York, 1984.
Green, Jeremy for OVUM. “Digital Urban Renewal,” April 2011.
Greenfield, Adam. “Preliminary Notes to a Diagram of Occupy Sandy,” Speedbird, 21 November 2012.
— Everyware: The dawning age of ubiquitous computing, New Riders, Berkeley, 2006.
Gunther, Marc. “A Photo Tour of Masdar City,” Greenbiz.com, 21 January 2011.
Hatch, David. “Singapore Strives to Become ‘The Smartest City,'” Governing, February 2013.
Hedlund, Jan for Microsoft Corporation. “Smart City 2020: Technology and Society in the Modern City,” March 2011.
Hitachi, Ltd. “Coordination of Urban and Service Infrastructures for Smart Cities,” 2012.
— “Telecommunication Systems for Realizing a Smart City,” 2012.
Howard, Ebenezer. Garden Cities of To-morrow, Faber and Faber, London, 1902.
Human Rights Watch. “World Report 2012: United Arab Emirates,” January 2012.
IBM Corporation. “City Government and IBM Close Partnership to Make Rio de Janeiro a Smarter City,” 27 December 2010.
— “IBM Intelligent Operations Center for Smarter Cities.”
— “Intelligent Operations Center,” 6 March 2012.
— Advertisement: “Mayors Of The World, May We Kindly Have 540 Words With You?”
— “The Smarter City: Traffic.”
— “Smarter Cities: Infrastructure. Operations. People.”
— “Smarter Public Safety: Smarter Cities solutions for law enforcement.”
— “Traffic Prediction Tool.”
— “Welcome to the Smarter City.”
Incheon Free Economic Zone Authority. “Business Outline: Development Plan.”
— “Incheon Free Economic Zone: One-Stop Service.”
— “Investment Incentive, Incheon Free Economic Zone.”
International Data Corporation. “Worldwide Quarterly Enterprise Networks Tracker: Top Five Worldwide Layer 2/3 Ethernet Switch Vendors,” 23 August 2012.
International Telecommunication Union. “Living In a World of 7 Billion People: Digital Cities for a Better Future,” ITU News, August 2011.
— “The World in 2013: ICT Facts and Figures,” February 2013.
Jacobs, Jane. The Death and Life of Great American Cities, Random House, New York, 1961.
Kim, Bongsu. “Subway CCTV was used to watch citizens’ bare skin sneakily,” Asian Business Daily, 16 July 2013. (In Korean.)
Kitchin, Rob and Martin Dodge. Code/Space, The MIT Press, Cambridge MA, 2011.
Koetsier, John. “Cisco helps build first U.S. ‘Smart+Connected’ city of the future in Lake Nona, Florida,” VentureBeat, 23 October 2012.
Kolesar, Peter. “Model for Predicting Average Fire Company Travel Times,” RAND Institute report R-1624-NYC, June 1975.
Koolhaas, Rem. “The Generic City” in S, M, L, XL, The Monacelli Press, New York, 1994.
Lee, Junho and Jeehyun Oh. “New Songdo City and the Value of Flexibility: A Case Study of Implementation and Analysis of a Mega-Scale Project,” MS thesis Massachusetts Institute of Technology, 2008.
LG Electronics. “LG HomNet: Total Solution.”
Lindsay, Greg. “Building a Smarter Favela: IBM Signs Up Rio,” Fast Company, 27 December 2010.
Living PlanIT. Video: “Building efficient urban-scale environments.”
— “Cities in the Cloud: A Living PlanIT Introduction to Future City Technologies,” July 2011.
— “Design Wins.”
— “Living PlanIT at Cisco C-Scape,” July 2011.
– “Living PlanIT’s CEO Steve Lewis selected by the World Economic Forum as a Technology Pioneer 2012.”
– “Living PlanIT Urban Operating System: Introduction to the Living PlanIT UOS Architecture, Open Standards and Protocols.”
— “Planit [sic] Valley, a true innovation in urban development.”
— “Urban Operating System: Overview.”
— “What is Living PlanIT?”
— “Why Become a Living PlanIT Partner Company?”
Masdar (Abu Dhabi Future Energy Company). “Benefits of Setting Up in a Free Zone.”
Masdar City. “Frequently Asked Questions,” 2011.
— “Masdar City: The Global Center of Future Energy,” 2011.
McCullough, Malcolm. Digital Ground: Architecture, Pervasive Computing, and Environmental Knowing, The MIT Press, Cambridge MA, 2004.
Medina, Eden. “Designing Freedom, Regulating a Nation: Socialist Cybernetics in Allende’s Chile,” Journal of Latin American Studies Volume 38 Issue 3, 2006.
Mehta, Suketu. “In the Violent Favelas of Brazil,” New York Review of Books, 11 July 2013.
Microsoft Corporation. “Microsoft and Living PlanIT Partner to Deliver Smart City Technology Via the Cloud,” 22 March 2011.
— “The Smart City: Using IT to Make Cities More Livable,” December 2011.
Migurski, Michal. “Visualizing Urban Data,” in Beautiful Data: The Stories Behind Elegant Data Solutions, Toby Segaran and Jeff Hammerbacher, eds., O’Reilly Media, Sebastopol CA, 2012, pp. 167-182.
— “Oakland Crime Maps X,” tecznotes, 3 March 2008.
Mitleton-Kelly, Eve. “Ten Principles of Complexity & Enabling Infrastructures,” Complex systems and evolutionary perspectives on organisations: the application of complexity theory to organisations, Elsevier Science Ltd, Oxford, 2003.
Mlot, Stephanie. “Microsoft CityNext Aims To Build ‘Smart Cities’,” PC Magazine, 11 July 2013.
Montavon, Marylène, Koen Steemers, Vicky Cheng and Raphaël Compagnon. “‘La Ville Radieuse’ by Le Corbusier once again a case study,” The 23rd Conference on Passive and Low Energy Architecture, 6 September 2006.
Mostashari, Ali, Friedrich Arnold, Mo Mansouri and Matthias Finger. “Cognitive cities and intelligent urban governance,” Network Industries Quarterly Volume 13 Number 3, 2011.
Mumford, Eric. The CIAM Discourse on Urbanism, 1928-1960, The MIT Press, Cambridge MA, 2002.
Mumford, Lewis. The City in History: Its Origins, Its Transformations, and Its Prospects, Harcourt, Brace and World, New York, 1961.
Newman, Oscar. Creating Defensible Space, US Department of Housing and Urban Development Office of Policy Development and Research, Washington DC, 1996.
OFFICE: Jason Schulte Design, Inc. “IBM: Designing a Smarter Planet.”
Patten, Bob. “Standard operating procedures in Intelligent Operations Center Version 1.5,” IBM developerWorks, 10 May 2013.
Paul-Ebhohimhen, Virginia A. and Alison Avenell. “Systematic review of the use of financial incentives in treatments for obesity and overweight,” Obesity Reviews Volume 9 Issue 4, July 2008.
Perrow, Charles. Normal Accidents: Living with High-Risk Technologies, Basic Books, New York, 1984.
Poole, Erika Shehan, Christopher A. Le Dantec, James R. Eagan and W. Keith Edwards. “Reflecting on the invisible: understanding end-user perceptions of ubiquitous computing,” Proceedings of Ubicomp ’08, Volume 344, ACM, New York, 2008.
Quigley, John M. “Urban diversity and economic growth,” Journal of Economic Perspectives Volume 12 Number 2, 1998.
Reporters Without Borders. “Authorities crack down on social networks and activist bloggers,” 30 March 2012.
Rider, Kenneth L. “A Parametric Model for the Allocation of Fire Companies,” RAND Institute report R-1615-NYC/HUD, April 1975.
Riis, Jacob. How the Other Half Lives: Studies among the Tenements of New York, Charles Scribner’s Sons, New York, 1890.
Ross, Andrew. “Human Rights, Academic Freedom, and Offshore Academics,” Academe, January 2011.
Roudman, Sam. “Bank of America’s Toxic Tower,” The New Republic, 28 July 2013.
Rudofsky, Bernard. Streets for People, Doubleday, New York, 1969.
Sadler, Simon. Archigram: Architecture without Architecture, The MIT Press, Cambridge MA, 2005.
Sen, Amartya Kumar. “The impossibility of a Paretian liberal,” Journal of Political Economy Volume 78 Number 1, January 1970.
Schmidt, Harald, Kristin Voigt and Daniel Wikler. “Carrots, sticks, and health care reform: problems with wellness incentives,” New England Journal of Medicine, 4 January 2010.
Schneider, Friedrich, Andreas Buehn and Claudio E. Montenegro. “Shadow Economies All over the World,” World Bank Policy Research Working Paper 5356, July 2010.
Scott, James C. Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed, Yale University Press, New Haven, 1999.
Segel, Arthur I. “New Songdo City,” Harvard Business School case study 9-206-019, 15 June 2006.
Siemens Corporation. “Collective Intelligence: City Cockpit, Real-Time Government,” 2011.
— “Smart City in detail: Intelligent communication solutions for smart cities.”
— “Sustainable Buildings — Networked Technologies: Smart Homes and Cities,” 2008.
— “What is the Siemens City of the Future?,” 2012.
Simon, David, Kia Corthron, Ed Burns and Chris Collins. The Wire, Season 4, Episode 9: “Know Your Place,” first aired 12 November 2006.
Smith, P.D. City: A Guidebook for the Urban Age, Bloomsbury Publishing USA, New York, 2012.
Songdo IBD. “The City: Master Plan.”
Sönmez, Sevil, Yorghos Apostopoulos, Diane Tran and Shantyana Rentrope. “Human rights and health disparities for migrant workers in the UAE,” Health and Human Rights Volume 13 Number 2, 2011.
Spufford, Francis. Red Plenty, Faber and Faber, London, 2011.
Stallman, Richard. “Why ‘Open Source’ misses the point of Free Software,” Communications of the ACM, Volume 52 Issue 6, June 2009.
Sussman, Joseph M. “Collected views on complexity in systems,” MIT Engineering Systems Division Working Paper Series, 30 April 2002.
Tuan, Yi-Fu. Space and Place: The Perspective of Experience, University of Minnesota Press, Minneapolis, 1977.
Ubisoft. Watch Dogs.
Vidal, John. “Masdar City – a glimpse of the future in the desert,” The Guardian, 26 April 2011.
Wakefield, Jane. “Building cities of the future now,” BBC News, 21 February 2013.
Webb, Flemmich. “Sustainable cities: Innovative urban planning in Singapore,” The Guardian, 11 October 2012.
Weiser, Mark. “Creating the invisible interface.” ACM Conference on User Interface Software and Technology (UIST94), 1994.
The White House, Office of the Press Secretary. “President Clinton: Improving the Civilian Global Positioning System (GPS),” 1 May 2000.
Whyte, William H. The Social Life of Small Urban Spaces, Project for Public Spaces, New York, 1980.
Wilken, Rowan. “Calculated Uncertainty: Computers, Chance Encounters, and ‘Community’ in the Work of Cedric Price,” Transformations Issue 14, March 2007.
Woods, Eric. “PlanIT Valley: A Blueprint for the Smart City,” Matter Network, 31 March 2011.
Woyke, Elizabeth. “Very Smart Cities,” Forbes, 3 September 2009.
The following is section 4 of “Against the smart city,” the first part of The City Is Here For You To Use. Our Do projects will be publishing “Against the smart city” in stand-alone POD pamphlet and Kindle editions later on this month.
4 | The smart city pretends to an objectivity, a unity and a perfect knowledge that are nowhere achievable, even in principle.
Of the major technology vendors working in the field, Siemens makes the strongest and most explicit statement of the philosophical underpinnings on which their (and indeed the entire) smart-city enterprise is founded: “Several decades from now cities will have countless autonomous, intelligently functioning IT systems that will have perfect knowledge of users’ habits and energy consumption, and provide optimum service…The goal of such a city is to optimally regulate and control resources by means of autonomous IT systems.”
We’ve already considered what kind of ideological work is being done when efforts like these are positioned as taking place in some proximate future. The claim of perfect competence Siemens makes for its autonomous IT systems, though, is by far the more important part of the passage. It reflects a clear philosophical position, and while this position is more forthrightly articulated here than it is anywhere else in the smart-city literature, it is without question latent in the work of IBM, Cisco and their peers. Given its foundational importance to the smart-city value proposition, I believe it’s worth unpacking in some detail.
What we encounter in this statement is an unreconstructed logical positivism, which, among other things, implicitly holds that the world is in principle perfectly knowable, its contents enumerable, and their relations capable of being meaningfully encoded in the state of a technical system, without bias or distortion. As applied to the affairs of cities, it is effectively an argument there is one and only one universal and transcendently correct solution to each identified individual or collective human need; that this solution can be arrived at algorithmically, via the operations of a technical system furnished with the proper inputs; and that this solution is something which can be encoded in public policy, again without distortion. (Left unstated, but strongly implicit, is the presumption that whatever policies are arrived at in this way will be applied transparently, dispassionately and in a manner free from politics.)
Every single aspect of this argument is problematic.
— Perfectly knowable, without bias or distortion: Collectively, we’ve known since Heisenberg that to observe the behavior of a system is to intervene in it. Even in principle, there is no way to stand outside a system and take a snapshot of it as it existed at time T.
But it’s not as if any of us enjoy the luxury of living in principle. We act in historical space and time, as do the technological systems we devise and enlist as our surrogates and extensions. So when Siemens talks about a city’s autonomous systems acting on “perfect knowledge” of residents’ habits and behaviors, what they are suggesting in the first place is that everything those residents ever do — whether in public, or in spaces and settings formerly thought of as private — can be sensed accurately, raised to the network without loss, and submitted to the consideration of some system capable of interpreting it appropriately. And furthermore, that all of these efforts can somehow, by means unspecified, avoid being skewed by the entropy, error and contingency that mark everything else that transpires inside history.
Some skepticism regarding this scenario would certainly be understandable. It’s hard to see how Siemens, or anybody else, could avoid the slippage that’s bound to occur at every step of this process, even under the most favorable circumstances imaginable.
However thoroughly Siemens may deploy their sensors, to start with, they’ll only ever capture the qualities about the world that are amenable to capture, measure only those quantities that can be measured. Let’s stipulate, for the moment, that these sensing mechanisms somehow operate flawlessly, and in perpetuity. What if information crucial to the formulation of sound civic policy is somehow absent from their soundings, resides in the space between them, or is derived from the interaction between whatever quality of the world we set out to measure and our corporeal experience of it?
Other distortions may creep into the quantification of urban processes. Actors whose performance is subject to measurement may consciously adapt their behavior to produce metrics favorable to them in one way or another. For example, a police officer under pressure to “make quota” may issue citations for infractions she would ordinarily overlook; conversely, her precinct commander, squeezed by City Hall to present the city as an ever-safer haven for investment, may downwardly classify felony assault as a simple misdemeanor. This is the phenomenon known to viewers of The Wire as “juking the stats,” and it’s particularly likely to happen when financial or other incentives are contingent on achieving some nominal performance threshold. Nor is it the only factor likely to skew the act of data collection; long, sad experience suggests that the usual array of all-too-human pressures will continue to condition any such effort. (Consider the recent case in which Seoul Metro operators were charged with using CCTV cameras to surreptitiously ogle women passengers, rather than scan platforms and cars for criminal activity as intended.)
What about those human behaviors, and they are many, that we may for whatever reason wish to hide, dissemble, disguise, or otherwise prevent being disclosed to the surveillant systems all around us? “Perfect knowledge,” by definition, implies either that no such attempts at obfuscation will be made, or that any and all such attempts will remain fruitless. Neither one of these circumstances sounds very much like any city I’m familiar with, or, for that matter, would want to be.
And what about the question of interpretation? The Siemens scenario amounts to a bizarre compound assertion that each of our acts has a single salient meaning, which is always and invariably straightforwardly self-evident — in fact, so much so that this meaning can be recognized, made sense of and acted upon remotely, by a machinic system, without any possibility of mistaken appraisal.
The most prominent advocates of this approach appear to believe that the contingency of data capture is not an issue, nor is any particular act of interpretation involved in making use of whatever data is retrieved from the world in this way. When discussing their own smart-city venture, senior IBM executives argue, in so many words, that “the data is the data”: transcendent, limpid and uncompromised by human frailty. This mystification of “the data” goes unremarked upon and unchallenged not merely in IBM’s material, but in the overwhelming majority of discussions of the smart city. But different values for air pollution in a given location can be produced by varying the height at which a sensor is mounted by a few meters. Perceptions of risk in a neighborhood can be transformed by altering the taxonomy used to classify reported crimes ever so slightly. And anyone who’s ever worked in opinion polling knows how sensitive the results are to the precise wording of a survey. The fact is that the data is never “just” the data, and to assert otherwise is to lend inherently political and interested decisions regarding the act of data collection an unwonted gloss of neutrality and dispassionate scientific objectivity.
The bold claim of perfect knowledge appears incompatible with the messy reality of all known information-processing systems, the human individuals and institutions that make use of them and, more broadly, with the world as we experience it. In fact, it’s astonishing that anyone would ever be so unwary as to claim perfection on behalf of any computational system, no matter how powerful.
— One and only one solution: With their inherent, definitional diversity, layeredness and complexity, we can usefully think of cities as tragic. As individuals and communities, the people who live in them hold to multiple competing and equally valid conceptions of the good, and it’s impossible to fully satisfy all of them at the same time. A wavefront of gentrification can open up exciting new opportunities for young homesteaders, small retailers and craft producers, but tends to displace the very people who’d given a neighborhood its character and identity. An increased police presence on the streets of a district reassures some residents, but makes others uneasy, and puts yet others at definable risk. Even something as seemingly straightforward and honorable as an anticorruption initiative can undo a fabric of relations that offered the otherwise voiceless at least some access to local power. We should know by now that there are and can be no Pareto-optimal solutions for any system as complex as a city.
— Arrived at algorithmically: Assume, for the sake of argument, that there could be such a solution, a master formula capable of resolving all resource-allocation conflicts and balancing the needs of all a city’s competing constituencies. It certainly would be convenient if this golden mean could be determined automatically and consistently, via the application of a set procedure — in a word, algorithmically.
In urban planning, the idea that certain kinds of challenges are susceptible to algorithmic resolution has a long pedigree. It’s already present in the Corbusian doctrine that the ideal and correct ratio of spatial provisioning in a city can be calculated from nothing more than an enumeration of the population, it underpins the complex composite indices of Jay Forrester’s 1969 Urban Dynamics, and it lay at the heart of the RAND Corporation’s (eventually disastrous) intervention in the management of 1970s New York City. No doubt part of the idea’s appeal to smart-city advocates, too, is the familial resemblance such an algorithm would bear to the formulae by which commercial real-estate developers calculate air rights, the land area that must be reserved for parking in a community of a given size, and so on.
In the right context, at the appropriate scale, such tools are surely useful. But the wholesale surrender of municipal management to an algorithmic toolset — for that is surely what is implied by the word “autonomous” — would seem to repose an undue amount of trust in the party responsible for authoring the algorithm. At least, if the formulae at the heart of the Siemens scenario turn out to be anything at all like the ones used in the current generation of computational models, critical, life-altering decisions will hinge on the interaction of poorly-defined and surprisingly subjective values: a “quality of life” metric, a vague category of “supercreative” occupations, or other idiosyncrasies along these lines. The output generated by such a procedure may turn on half-clever abstractions, in which a complex circumstance resistant to direct measurement is represented by the manipulation of some more easily-determined proxy value: average walking speed stands in for the more inchoate “pace” of urban life, while the number of patent applications constitutes an index of “innovation.”
Even beyond whatever doubts we may harbor as to the ability of algorithms constructed in this way to capture urban dynamics with any sensitivity, the element of the arbitrary we see here should give us pause. Given the significant scope for discretion in defining the variables on which any such thing is founded, we need to understand that the authorship of an algorithm intended to guide the distribution of civic resources is itself an inherently political act. And at least as things stand today, neither in the Siemens material nor anywhere else in the smart-city literature is there any suggestion that either algorithms or their designers would be subject to the ordinary processes of democratic accountability.
— Encoded in public policy, and applied transparently, dispassionately and in a manner free from politics: A review of the relevant history suggests that policy recommendations derived from computational models are only rarely applied to questions as politically sensitive as resource allocation without some intermediate tuning taking place. Inconvenient results may be suppressed, arbitrarily overridden by more heavily-weighted decision factors, or simply ignored.
The best-documented example of this tendency remains the work of the New York City-RAND Institute, explicitly chartered to implant in the governance of New York City “the kind of streamlined, modern management that Robert McNamara applied in the Pentagon with such success” during his tenure as Secretary of Defense (1961-1968). The statistics-driven approach that McNamara’s Whiz Kids had so famously brought to the prosecution of the war in Vietnam, variously thought of as “systems analysis” or “operations research,” was first applied to New York in a series of studies conducted between 1973 and 1975, in which RAND used FDNY incident response-time data to determine the optimal distribution of fire stations.
Methodological flaws undermined the effort from the outset. RAND, for simplicity’s sake, chose to use the time a company arrived at the scene of a fire as the basis of their model, rather than the time at which that company actually began fighting the fire; somewhat unbelievably, for anyone with the slightest familiarity with New York City, RAND’s analysts then compounded their error by refusing to acknowledge traffic as a factor in response time. Again, we see some easily-measured value used as a proxy for a reality that is harder to quantify, and again we see the distortion of ostensibly neutral results by the choices made by an algorithm’s designers. But the more enduring lesson for proponents of data-driven policy has to do with how the study’s results were applied. Despite the mantle of coolly “objective” scientism that systems analysis preferred to wrap itself in, RAND’s final recommendations bowed to factionalism within the Fire Department, as well as the departmental leadership’s need to placate critical external constituencies; the exercise, in other words, turned out to be nothing if not political.
The consequences of RAND’s intervention were catastrophic. Following their recommendations, fire battalions in some of the most vulnerable sections of the city were decommissioned, while the department opened other stations in low-density, low-threat areas; the spatial distribution of firefighting assets remaining actually prevented resources from being applied where they were most critically needed. Great swaths of the city’s poorest neighborhoods burned to the ground as a direct result — most memorably the South Bronx, but immense tracts of Manhattan and Brooklyn as well. Hundreds of thousands of residents were displaced, many permanently, and the unforgettable images that emerged fueled perceptions of the city’s nigh-apocalyptic unmanageability that impeded its prospects well into the 1980s. Might a less-biased model, or a less politically-skewed application of the extant findings, have produced a more favorable outcome? This obviously remains unknowable…but the human and economic calamity that actually did transpire is a matter of public record.
Examples like this counsel us to be wary of claims that any autonomous system will ever be entrusted with the regulation and control of civic resources — just as we ought to be wary of claims that the application of some single master algorithm could result in an Pareto-efficient distribution of resources, or that the complex urban ecology might be sufficiently characterized in data to permit the effective operation of such an algorithm in the first place. For all of the conceptual flaws we’ve identified in the Siemens proposition, though, it’s the word “goal” that just leaps off the page. In all my thinking about cities, it has frankly never occurred to me to assert that cities have goals. (What is Cleveland’s goal? Karachi’s?) What is being suggested here strikes me as a rather profound misunderstanding of what a city is. Hierarchical organizations can be said to have goals, certainly, but not anything as heterogeneous in composition as a city, and most especially not a city in anything resembling a democratic society.
By failing to account for the situation of technological devices inside historical space and time, the diversity and complexity of the urban ecology, the reality of politics or, most puzzlingly of all, the “normal accidents” all complex systems are subject to, Siemens’ vision of cities perfectly regulated by autonomous smart systems thoroughly disqualifies itself. But it’s in this depiction of a city as an entity with unitary goals that it comes closest to self-parody.
If it seems like breaking a butterfly on a wheel to subject marketing copy to this kind of dissection, I am merely taking Siemens and the other advocates of the smart city at their word, and this is what they (claim to) really believe. When pushed on the question, of course, some individuals working for enterprises at the heart of the smart-city discourse admit that what their employers actually propose to do is distinctly more modest: they simply mean to deploy sensors on municipal infrastructure, and adjust lighting levels, headway or flow rates to accommodate real-time need. If this is the case, perhaps they ought to have a word with their copywriters, who do the endeavor no favors by indulging in the imperial overreach of their rhetoric. As matters now stand, the claim of perfect competence that is implicit in most smart-city promotional language — and thoroughly explicit in the Siemens material — is incommensurate with everything we know about the way technical systems work, as well as the world they work in. The municipal governments that constitute the primary intended audience for materials like these can only be advised, therefore, to approach all such claims with the greatest caution.
 For example, in New York City, an anonymous survey of “hundreds of retired high-ranking [NYPD] officials” found that “tremendous pressure to reduce crime, year after year, prompted some supervisors and precinct commanders to distort crime statistics” they submitted to the centralized COMPSTAT system. Chen, David W., “Survey Raises Questions on Data-Driven Policy,” The New York Times, 08 February 2010.
 Simon, David, Kia Corthron, Ed Burns and Chris Collins, The Wire, Season 4, Episode 9: “Know Your Place,” first aired 12 November 2006.
 Fletcher, Jim, IBM Distinguished Engineer, and Guruduth Banavar, Vice President and Chief Technology Officer for Global Public Sector, personal communication, 08 June 2011.
 Migurski, Michal. “Visualizing Urban Data,” in Segaran, Toby and Jeff Hammerbacher, Beautiful Data: The Stories Behind Elegant Data Solutions, O’Reilly Media, Sebastopol CA, 2012: pp. 167-182. See also Migurski, Michal. “Oakland Crime Maps X,” tecznotes, 03 March 2008.
 See, as well, Sen’s dissection of the inherent conflict between even mildly liberal values and Pareto optimality. Sen, Amartya Kumar. “The impossibility of a Paretian liberal.” Journal of Political Economy Volume 78 Number 1, Jan-Feb 1970.
 Forrester, Jay. Urban Dynamics, The MIT Press, Cambridge, MA, 1969.
 See Flood, Joe. The Fires: How a Computer Formula Burned Down New York City — And Determined The Future Of American Cities, Riverhead Books, New York, 2010.
 See, e.g. Bettencourt, Luís M.A. et al. “Growth, innovation, scaling, and the pace of life in cities,” Proceedings of the National Academy of Sciences, Volume 104 Number 17, 24 April 2007, pp. 7301-7306.
 Flood, ibid., Chapter Six.
 Rider, Kenneth L. “A Parametric Model for the Allocation of Fire Companies,” New York City-RAND Institute report R-1615-NYC/HUD, April 1975; Kolesar, Peter. “A Model for Predicting Average Fire Company Travel Times,” New York City-RAND Institute report R-1624-NYC, June 1975.
 Perrow, Charles. Normal Accidents: Living with High-Risk Technologies, Basic Books, New York, 1984.
The following is the draft of a section from my forthcoming book, The City Is Here For You To Use, concerning various ways in which networked devices are used to furnish the mobile pedestrian with a layer of location-specific information superimposed onto the forward view — “augmented reality,” in other words. (The context is an extended discussion of four modes in which information is returned from the global network to the world so it may be engaged, considered and acted upon, which is why the bit here starts in medias res.)
As you see it here, the section is not quite in its final form; it hasn’t yet been edited for meter, euphony or flow, and in particular, some of the arguments toward the end remain too telescoped to really stand up to much inspection. Nevertheless, given the speed at which wearable AR is evolving, I thought it would be better to get this out now as-is, to garner your comments and be strengthened by them. I hope you enjoy it.
One seemingly potent way of returning networked information to the world would be if we could layer it directly over that which we perceive. This is the premise of so-called augmented reality, or AR, which proposes to furnish users with some order of knowledge about the world and the objects in it, via an overlay of informational graphics superimposed on the visual field. In principle, this augmentation is agnostic as to the mediating artifact involved, which could be the screen of a phone or tablet, a vehicle’s windshield, or, as Google’s Glass suggests, a lightweight, face-mounted reticle.
AR has its conceptual roots in informational displays developed for military pilots in the early 1960s, at the point when the performance of enemy fighter aircraft began to overwhelm a human pilot’s ability to react. In the fraught regime of jet-age dogfighting, even a momentary dip of the eyes to a dashboard-mounted instrument cluster could mean disaster. The solution was to project information about altitude, airspeed and the status of weapons and other critical aircraft systems onto a transparent pane aligned with the field of vision, a “head-up display.”
This notion turned to have applicability in fields beyond aerial combat, where the issue wasn’t so much reaction time as it was visual complexity. One early AR system was intended to help engineers make sense of the gutty tangle of hydraulic lines, wiring and control mechanisms in the fuselage of an airliner under construction; each component in the otherwise-hopeless confusion was overlaid with a visual tag identifying it by name, and colored according to the system it belonged to.
Other systems were designed to help people manage situations in which both time and the complexity of the environment were sources of pressure — for example, to aid first responders in dispelling the fog and chaos they’re confronted with upon arrival at the scene of an emergency. One prototype furnished firefighters with visors onto which structural diagrams of a burning building were projected, along with symbols indicating egress routes, the position of other emergency personnel, and the presence of electric wiring or other potentially dangerous infrastructural elements.
The necessity of integrating what were then relatively crude and heavy cameras, motion sensors and projectors into a comfortably wearable package limited the success of these early efforts — and this is to say nothing of the challenges posed by the difficulty of establishing a reliable network connection to a mobile unit. But the conceptual heavy lifting done to support these initial forays produced a readymade discourse, waiting for the day augmentation might be reinstantiated in smaller, lighter, more capable hardware.
That is a point we appear to have arrived at with the advent of the smartphone. As we’ve seen, the smartphone handset can be thought of as a lamination together of several different sensing and presentation technologies, subsets of which can be recombined with one another to produce distinctly different ways of engaging networked information. Bundle a camera, accelerometer/gyroscope, and display screen in a single networked handset, and what you have in your hands is indeed an artifact capable of sustaining rudimentary augmentation. Add GPS functionality and a three-dimensional model of the world — either maintained onboard the device, or resident in the cloud — and a viewer can be offered location-specific information, registered with and mapped onto the surrounding urban fabric.
In essence, phone-based AR treats the handset like the transparent pane of a cockpit head-up display: you hold it before you, its camera captures the forward-facing view, and this is rendered on the screen transparently but for whatever overlay of information is applied. Turn and the on-screen view turns with you, tracked (after a momentary stutter) by the grid of overlaid graphics. And those graphics can provide anything the network can: identification, annotation, direction or commentary.
It’s not hard to see why developers and enthusiasts might jump at this potential, even given the sharp limits imposed by the phone as platform. We move through the world and we act in it, but the knowledge we base our movements and actions on is always starkly less than what it might be. And we pay the price for this daily, in increments of waste, frustration, exhaustion and missed opportunity. By contrast, the notion that everything the network knows might be brought to bear on someone or -thing standing before us, directly there, directly present, available to anyone with the wherewithal to sign a two-year smartphone contract and download an app — this is a deeply seductive idea. It offers the same aura of omnipotence, that same frisson of godlike power evoked by our new ability to gather, sift and make meaning of the traces of urban activity, here positioned as a direct extension of our own senses.
Why not take advantage of this capability? After all, the richness and complexity of city life confronts us with any number of occasions on which the human sensorium could do with a little help.
Let a few hundred neurons in the middle fusiform gyrus of the brain’s right hemisphere be damaged, or fail to develop properly in the first place, and the result is a disorder called prosopagnosia, more commonly known as faceblindness. As the name suggests, the condition deprives its victims of the ability to recognize faces and associate them with individuals; at the limit, someone suffering with a severe case may be entirely unable to remember what his or her loved ones look like. So central is the ability to recognize others to human socialization, though, that even far milder cases cause significant problems.
Sadly, this is something I can attest to from firsthand experience. Like an estimated 2.5% of the population, I suffer from the condition, and even in the relatively attenuated form I’m saddled with, my broad inability to recognize people has caused more than a few experiences of excruciating awkwardness. At least once or twice a month I run into people on the street who clearly have some degree of familiarity with me, and find myself unable to come up with even a vague idea of who they might be; I’ll introduce myself to a woman at a party, only to have her remind me (rather waspishly, but who can blame her) that we’d worked together on a months-long project. Deprived of contextual cues — the time and location at which I usually meet someone, a distinctive hairstyle or mode of dress — I generally find myself no more able to recognize former colleagues or students than I can complete strangers. And as uncomfortable as this can be for me, I can only imagine how humiliating it is for the person on the other end of the encounter.
I long ago lost track of the number of times in my life at which I would have been grateful for some subtle intercessionary agent: something that might drop a glowing outline over the face of someone approaching me and remind me of his or her name, the occasion on which we met last, maybe even what we talked about on that occasion. It would spare both of us from mortification, and shield my counterpart from the inadvertent but real insult implied by my failure to recognize them. So the ambition of using AR in this role is lovely — precisely the kind of sensitive technical deployment I believe in, where technology is used to lower the barriers to socialization, and reduce or eliminate the awkwardnesses that might otherwise prevent us from better knowing one another.
But it’s hard to imagine any such thing being accomplished by the act of holding a phone up in front of my face, between us, forcing you to wait first for me to do so and then for the entire chain of technical events that must follow in order to fulfill the aim at the heart of the scenario. The device must acquire an image of your face with the camera, establish the parameters of that face from the image, and upload those parameters to the cloud via the fastest available connection, so they may be compared with a database of facial measurements belonging to known individuals; if a match is found, the corresponding profile must be located, and the appropriate information from that profile piped back down the connection so it may be displayed as an overlay on the screen image.
Too many articulated parts are involved in this interaction, too many dependencies — not least of which is the coöperation of a Facebook, a Google, or some other enterprise with a reasonably robust database of facial biometrics, and that is of course wildly problematic for other reasons. Better I should have confessed my confusion to you in the first place.
Perhaps a less technologically-intensive scenario would be better suited to the phone as platform for augmentation? How about helping a user find their way around the transit system, amidst all the involutions of the urban labyrinth?
Here we can weigh the merits of the use case by considering an actual, shipping product, Acrossair’s Nearest Subway app for the iPhone, first released in 2010. Like its siblings for London and Paris, Nearest Tube and Nearest Metro, Nearest Subway uses open location data made available by the city’s transit authority to specify the positions of transit stops in three-dimensional space. On launch, the app loads a hovering scrim of simple black tiles featuring the name of each station, and icons of the lines that serve it; the tiles representing more distant stations are stacked atop those that are closer. Rotate, and the scrim of tiles rotates with you. Whichever way you face, you’ll see a tile representing the nearest subway station in the direction of view, so long as some outpost of the transit network lies along that bearing in the first place.
Nearest Subway is among the more aesthetically appealing phone-based AR applications, eschewing junk graphics for simple, text-based captions sensitively tuned to the conventions of each city’s transit system. If nothing else, it certainly does what it says on the tin. It is, however, almost completely worthless as a practical aid to urban navigation.
When aimed to align with the Manhattan street grid from the corner of 30th Street and First Avenue, Nearest Subway indicates that the 21st Street G stop in Long Island City is the closest subway station, at a distance of 1.4 miles in a north-northeasterly direction.
As it happens, there are a few problems with this. For starters, from this position the Vernon Boulevard-Jackson Avenue stop on the 7 line is 334 meters, or roughly four New York City blocks, closer than 21st Street, but it doesn’t appear as an option. This is either an exposure of some underlying lacuna in the transit authority’s database — unlikely, but as anyone familiar with the MTA understands implicitly, well within the bounds of possibility — or more probably a failure on Acrossair’s part to write code that retrieves these coordinates properly.
Just as problematically, the claimed bearing is roughly 55 degrees off. If, as will tend to be the case in Manhattan, you align yourself with the street grid, a phone aimed directly uptown will be oriented at 27 degrees east of due north, at which point Nearest Subway suggests that the 21st Street station is directly ahead of you. But it actually lies on an azimuth of 82 degrees; if you took the app at its word, you’d be walking uptown a long time before you hit anything even resembling a subway station. This is most likely to be a calibration error with the iPhone’s compass, but fairly or otherwise Nearest Subway shoulders the greater part of the blame here — as anyone familiar with computational systems has understood since the time of Babbage, if you put garbage in, you’ll get garbage out.
Furthermore, since by design the app only displays those stations roughly aligned with your field of vision, there’s no way for it to notify you that the nearest station may be directly behind your back. Unless you want to rotate a full 360 degrees, then, and make yourself look like a complete idiot in the process, the most practical way to use Nearest Subway is to aim the phone directly down, which makes a reasonably useful ring of directional arrows and distances pop up. (These, of course, could have been superimposed on a conventional map in the first place, without undertaking the effort of capturing the camera image and augmenting it with a hovering overlay of theoretically compass-calibrated information.)
However unfortunate these stumbles may be, they can all be resolved, addressed with tighter code, an improved user interface or a better bearing-determination algorithm. Acrossair could fix them all, though — enter every last issue in a bug tracker, and knock them down one by one — and that still wouldn’t address the primary idiocy of urban AR in this mode: from 30th Street and First Avenue, the 21st Street G stop is across the East River. You need to take a subway to get there in the first place. However aesthetically pleasing an interface may be, using it to find the closest station as the crow flies does you less than no good when you’re separated from it by a thousand meters of water.
Finally, Nearest Subway betrays a root-level misunderstanding of the relationship between a citydweller and a transportation network. In New York City, as in every other city with a complex underground transit system, you almost never find yourself in a situation where you need to find the station that’s nearest in absolute terms to begin with; it’s far more useful to find the nearest station on a line that gets you where you want to go. Even at the cost of cluttering what’s on the screen, then, the very first thing the would-be navigator of the subway system needs is a way to filter the options before them by line.
I raise these points not to park all of the blame at Acrossair’s door, but to suggest that AR itself is badly unsuited to this role, at least when handled in this particular way. It takes less time to load and use a map than it does to retrieve the same information from an augmentive application, and the map provides a great deal more of the context so necessary to orienting yourself in the city. At this point in technological evolution, then, more conventional interface styles will tend to furnish a user with relevant information more efficiently, with less of the latency, error and cruft that inevitably seem to attend the attempt to superimpose it over the field of vision.
If phone-based augmentation performs poorly as social lubricant or aid to urban navigation, what about another role frequently proposed for AR, especially by advocates in the cultural heritage sector? This use case hinges on the argument that by superimposing images or other vestiges of the past of a place directly over its present, AR effectively endows its users with the ability to see through time.
This might not make much sense at all in Songdo, or Masdar, or any of the other new cities now being built from scratch on greenfield sites. But anyone who lives in a place old enough to have felt the passage of centuries knows that history can all too easily be forgotten by the stones of the city. Whatever perturbations from historical events may still be propagating through the various flows of people, matter, energy and information that make a place, they certainly aren’t evident to casual inspection. An augmented view returning the layered past to the present, in such a way as to color our understanding of the things all around us, might certainly prove to be more emotionally resonant than any conventional monument.
Byzantium, old Edo, Roman Londinium, even New Amsterdam: each of these historical sites is rife with traces we might wish to surface in the city occupying the same land at present. Locales overwhelmed by more recent waves of colonization, gentrification or redevelopment, too, offer us potent lenses through which to consider our moment in time. It would surely be instructive to retrieve some record of the jazz- and espresso-driven Soho of the 1950s and layer it over what stands there at present; the same goes for the South Bronx of 1975. But traversed as it was during the twentieth century by multiple, high-intensity crosscurrents of history, Berlin may present the ultimate terrain on which to contemplate recuperation of the past.
This is a place where pain, guilt and a sense of responsibility contend with the simple desire to get on with things; no city I’m familiar with is more obsessively dedicated to the search for a tenable balance between memory and forgetting. The very core of contemporary Berlin is given over to a series of puissant absences and artificially-sustained presences, from the ruins of Gestapo headquarters, now maintained as a museum called Topography of Terror, to the remnants of Checkpoint Charlie. A long walk to the east out leafy Karl-Marx-Allee — Stalinallee, between 1949 and 1961 — takes you to the headquarters of the Stasi, the feared secret police of the former East Germany, also open to the public as a museum. But there’s nowhere in Berlin where the curious cost of remembering can be more keenly felt than in the field of 2,711 concrete slabs at the corner of Ebertstrasse and Hannah-Arendt-Strasse. This is the Memorial to the Murdered Jews of Europe, devised by architect Peter Eisenman, with early conceptual help from the sculptor Richard Serra.
Formally, the grim array is the best thing Eisenman has ever set his hand to, very nearly redemptive of a career dedicated to the elevation of fatuous theory over aesthetic coherence; perhaps it’s the Serra influence. But as a site of memory, the Monument leaves a great deal to be desired. It’s what Michel Foucault called a heterotopia: something set apart from the ordinary operations of the city, physically and semantically, a place of such ponderous gravity that visitors don’t quite know what to make of it. On my most recent visit, the canyons between the slabs rang with the laughter of French schoolchildren on a field trip; the children giggled and flirted and shouted to one another as they leapt between the stones, and whatever the designer’s intent may have been, any mood of elegy or commemoration was impossible to establish, let alone maintain.
Roughly two miles to the northeast, on the sidewalk in front of a doner stand in Mitte, is a memorial of quite a different sort. Glance down, and you’ll see the following words, inscribed into three brass cubes set side by side by side between the cobblestones:
Ermordet in Auschwitz: that is, on specific dates in November of 1942 and March of the next year, the named people living at this address were taken across this very sidewalk and forcibly transported hundreds of miles east by the machinery of their own government, to a country they’d never known and a facility expressly designed to murder them. The looming façades around you were the last thing they ever saw as free people.
It’s in the dissonance between the everyday bustle of Mitte and these implacable facts that the true horror resides — and that’s precisely what makes the brass cubes a true memorial, indescribably more effective than Eisenman’s. The brass cubes, it turns out, are Stolpersteine, or “stumbling blocks,” a project of artist Gunter Demnig; these are but three of what are now over 32,000 that Demnig has arranged to have placed in some 700 cities. The Stolpersteine force us to read this stretch of unremarkable sidewalk in two ways simultaneously: both as a place where ordinary people go placidly about their ordinary business, just as they did in 1942, and as one site of a world-historical, continental-scale ravening.
The stories etched in these stones are the kind of facts about a place that would seem to yield to a strategy of augmentation. The objection could certainly be raised that I found them so resonant precisely because I didn’t see them every day, and that their impact would very likely fade with constant exposure; we might call this the evil of banality. But being compelled to see and interpret the mundane things I did in these streets through the revenant past altered my consciousness, in ways subtler and longer-lasting than anything Eisenman’s sepulchral array of slabs was able to achieve. AR would merely make the metaphor literal — in fact, it’s easy for me to imagine the disorienting, decentering, dis-placing impact of having to engage the world through a soft rain of names, overlaid onto the very places from which their owners were stolen.
But once again, it’s hard to imagine this happening via the intercession of a handset. Nor are the qualities that make smartphone-based AR so catastrophically clumsy, in virtually every scenario of use, particularly likely to change over time.
The first is the nature of functionality on the smartphone. As we’ve seen, the smartphone is a platform on which each discrete mode of operation is engaged via a dedicated, single-purpose app. Any attempt at augmenting the environment, therefore, must be actively and consciously invoked, to the exclusion of other useful functionality. The phone, when used to provide such an overlay, cannot also and at the same time be used to send a message, look up an address, buy a cup of coffee, or do any of the other things we now routinely expect of it.
The second reservation is physical. Providing the user with a display surface for graphic annotation of the forward view simply isn’t what the handset was designed to do. It must be held before the eyes like a pane of glass in order for the augmented overlay to work as intended. It hardly needs to be pointed out that this gesture is not one particularly well-suited to the realities of urban experience. It has the doubly unappealing quality of announcing the user’s distraction and vulnerability to onlookers, while simultaneously ensuring that the device is held in the weak grip of the extended arm — a grasp from which it may be plucked with relative ease.
Taken together, these two impositions strongly undercut the primary ostensible virtue of an augmented view, which is its immediacy. The sole genuine justification for AR is the idea that information is simply there, copresent with that you’re already looking at and able to be assimilated without thought or effort.
That sense of effortlessness is precisely what an emerging class of wearable mediators aims to provide for its users. The first artifact of this class to reach consumers is Google’s Glass, which mounts a high-definition, forward-facing camera, a head-up reticle and the microphone required by the natural-language speech recognition interface on a lightweight aluminum frame. While Glass poses any number of aesthetic, practical and social concerns — all of which remain to be convincingly addressed, by Google or anyone else — it does at least give us a way to compare hands-free, head-mounted AR with the handset-based approach.
Would any of the three augmentation scenarios we explored be improved by moving the informational overlay from the phone to a wearable display?
A system designed to mitigate my prosopagnosia by recognizing faces for me would assuredly be vastly better when accessed via head-mounted interface; in fact, that’s the only scenario of technical intervention in relatively close-range interpersonal encounters that’s credible to me. The delay and physical awkwardness occasioned by having to hold a phone between us goes away, and while there would still be a noticeable saccade or visual stutter as I glanced up to read your details off my display, this might well be preferable to not being remembered at all.
That is, if we can tolerate the very significant threats to privacy involved, which only start with Google’s ownership of or access to the necessary biometric database. There’s also the question of their access to the pattern of my requests, and above all the one fact inescapably inherent to the scenario: that people are being identified as being present in a certain time and place, without any necessity whatsoever of securing consent on their part. By any standard, this is a great deal of risk to take on, all to lubricate social interactions for 2.5% of the population.
Nearest Subway, as is, wouldn’t be improved by presentation in the line of sight. Given what we’ve observed about the way people really use subway networks, information about the nearest station in a given direction wouldn’t be of any greater utility when splashed on a head-up display than it is on the screen of a phone. Whatever the shortcomings of this particular app, though, they probably don’t imply anything in particular about the overall viability of wearable AR in the role of urban navigation, and in many ways the technology does seem rather well-suited to the wayfinding challenges faced by the pedestrian.
Of the three scenarios considered here, though, it’s AR’s potential to offer novel perspectives on the past of a place that would be most likely to benefit from the wearable approach. We would quite literally see the quotidian environment through the lens of a history superimposed onto it. So equipped, we could more easily plumb the psychogeographical currents moving through a given locale, better understand how the uses of a place had changed over time, or hadn’t. And because this layer of information could be selectively surfaced — invoked and banished via voice command, toggled on or off at will — presenting information in this way might well circumvent the potential for banality through overfamiliarization that haunts even otherwise exemplary efforts like Demnig’s Stolpersteine.
And this suggests something about further potentially productive uses for augmentive mediators like Glass. After all, there are many kinds of information that may be germane to our interpretation of a place, yet effectively invisible to us, and historical context is just one of them. If our choices are shaped by dark currents of traffic and pricing, crime and conviviality, it’s easy to understand the appeal of any technology proposing that these dimensions of knowledge be brought to bear on that which is seen, whether singly or in combination. The risk of bodily harm, whatever its source, might be rendered as a red wash over the field of vision; point-by-point directions as a bright and unmistakable guideline reaching into the landscape. In fact any pattern of use and activity, so long as its traces were harvested by some data-gathering system and made available to the network, might be made manifest to us in this way.
Some proposed uses of mediation are more ambitious still, pushing past mere annotation of the forward view to the provision of truly novel modes of perception — for example, the ability to “see” radiation at wavelengths beyond the limits of human vision, or even to delete features of the visual environment perceived as undesirable. What, then, keeps wearable augmentation from being the ultimate way for networked citizens to receive and act on information?
The approach of practical, consumer-grade augmented reality confronts us with a interlocking series of concerns, ranging from the immediately practical to the existential.
A first set of reservations centers on the technical difficulties involved in the articulation of an acceptably high-quality augmentive experience. We’ve so far bypassed discussion of these so we could consider different aspects of the case for AR, but ultimately they’re not of a type that allows anyone to simply wave them away.
At its very core, the AR value proposition subsists in the idea that interactions with information presented in this way are supposed to feel “effortless,” but any such effortlessness would require the continuous (and continuously smooth) interfunctioning of a wild scatter of heterogeneous elements. In order to make good on this promise, a mediation apparatus would need to fuse all of the following elements: a sensitively-designed interface; the population of that interface with accurate, timely, meaningful and actionable information; and a robust, high-bandwidth connection to the networked assets furnishing that information from any point in the city, indoors or out. Even putting questions of interface design to the side, the technical infrastructure capable of delivering the other necessary elements reliably enough that the attempt at augmentation doesn’t constitute a practical and social hazard in its own right does not yet exist — not anywhere in North America, anyway, and not this year or next. The hard fact is that for a variety of reasons having to do with national spectrum policy, a lack of perceived business incentives for universal broadband connectivity, and other seemingly intractable circumstances, these issues are nowhere near being ironed out.
In the context of augmentation, as well, the truth value of representations made about the world acquires heightened significance. By superimposing information directly on its object, AR arrogates to itself a peculiar kind of claim to authority, a claim of a more aggressive sort than that implicit in other modes of representation, and therefore ought to be held to a higher standard of completeness and accuracy. As we saw with Nearest Subway, though, an overlay can only ever be as good as the data feeding it, and the augurs in this respect are not particularly reassuring. Right now, Google’s map of the commercial stretch nearest to my apartment building provides labels for only four of the seven storefront businesses on the block, one of which is inaccurately identified as a restaurant that closed many years ago. If even Google, with all the resources it has at its disposal, struggles to provide its users with a description of the streetscape that is both comprehensive and correct, how much more daunting will other actors find the same task?
Beyond this are the documented problems with visual misregistration and latency that are of over a decade’s standing, and have not been successfully addressed in that time — if anything, have only been exacerbated by the shift to consumer-grade hardware. At issue is the mediation device’s ability to track rapid motions of the head, and smoothly and accurately realign any graphic overlay mapped to the world; any delay in realignment of more than a few tens of milliseconds is conspicuous, and risks causing vertigo, nausea and problems with balance and coordination. The initial release of Glass, at least, wisely shies away from any attempt to superimpose such overlays, but the issue must be reckoned with at some point if useful augmentive navigational applications are ever to be developed.
Another set of concerns centers on the question of how long such a mediator might comfortably be worn, and what happens after it is taken off. This is of especial concern given the prospect that one or another form of wearable AR might become as prominent in the negotiation of everyday life as the smartphone itself. There is, of course, not much in the way of meaningful prognostication that can be made ahead of any mass adoption, but it’s not unreasonable to build our expectations on the few things we do know empirically.
Early users of Google’s Glass report disorientation upon removing the headset, after as few as fifteen minutes of use — a mild one, to be sure, and easily shaken off, from all accounts the sort of uneasy feeling that attends staring overlong at an optical illusion. If this represents the outer limit of discomfort experienced by users, it’s hard for me to believe that it would have much impact on either the desirability of the product or people’s ability to function after using it. But further hints as to the consequences of long-term use can be gleaned from the testimony of pioneering researcher Steve Mann, who has worn a succession of ever-lighter and more-capable mediation rigs all but continuously since the mid-1980s. And his experience would seem to warrant a certain degree of caution: Mann, in his own words, early on “developed a dependence on the apparatus,” and has found it difficult to function normally on the few occasions he has been forcibly prevented from accessing his array of devices.
When deprived of his set-up for even a short period of time, Mann experiences “profound nausea, dizziness and disorientation”; he can neither see clearly nor concentrate, and has difficulty with basic cognitive and motor tasks. He speculates that over many years, his neural wiring has adapted to the continuous flow of sensory information through his equipment, and this is not an entirely ridiculous thing to think. At this point, the network of processes that constitutes Steve Mann’s brain — that in some real albeit reductive sense constitutes Steve Mann — lives partially outside his skull.
The objection could be made that this is always already the case, for all of us — that some nontrivial part of everything that make us what we are lives outside of us, in the world, and that Mann’s situation is only different in that much of his outboard being subsists in a single, self-designed apparatus. But if anything, this makes the prospect of becoming physiologically habituated to something like Google Glass still more worrisome. It’s precisely because Mann developed and continues to manage his own mediation equipment that he can balance his dependency on it with the relative freedom of action enjoyed by someone who for the most part is able to determine the parameters under which that equipment operates.
If Steve Mann has become a radically hybridized consciousness, at least he has a legitimate claim to ownership and control over all of the places where that consciousness is instantiated. By contrast, all of the things a commercial product like Glass can do for the user rely on the ongoing provision of a service — and if there’s anything we know about services, it’s that they can be and are routinely discontinued at will, as the provider fails, changes hands, adopts a new business strategy or simply reprioritizes.
A final set of strictly practical concerns have to do with the collective experience of augmentation, or what implications our own choice to be mediated in this way might hold for the experience of others sharing the environment.
For all it may pretend to transparency, literally and metaphorically, any augmentive mediator by definition imposes itself between the wearer and the phenomenal world. This, of course, is by no means a quality unique to augmented reality. It’s something AR has in common with a great many ways we already buffer and mediate what we experience as we move through urban space, from listening to music to wearing sunglasses. All of these impose a certain distance between us and the full experiential manifold of the street, either by baffling the traces of it that reach our senses, or by offering us a space in which we can imagine and project an alternative narrative of our actions.
But there’s a special asymmetry that haunts our interactions with networked technology, and tends to undermine our psychic investment in the immediate physical landscape; if “cyberspace is where you are when you’re on the phone,” it’s certainly also the “place” you are when you text or tweet someone while walking down the sidewalk. I’ve generally referred to what happens when someone moves through the city while simultaneously engaged in some kind of remote interaction as a condition of “multiple adjacency,” but of course it’s really no such thing: so far, at least, only one mode of spatial experience can be privileged at a given time. And if it’s impossible to participate fully in both of these realms at once, one of them must lose out.
Watch what happens when a pedestrian first becomes conscious of receiving a call or a text message, the immediate damming they cause in the sidewalk flow as they pause to respond to it. Whether the call is made hands-free or otherwise doesn’t really seem to matter; the cognitive and emotional investment in what transpires in the interface is what counts, and this investment is generally so much greater than it is in the surroundings that street life clearly suffers as a result. The risk inherent in this divided attention appears to be showing up in the relevant statistics in the form of an otherwise hard-to-account-for upturn in accidents involving pedestrian fatalities, where such numbers had been falling for years. This is a tendency that is only likely to be exacerbated by augmentive mediation, particularly where content of high inherent emotional involvement is concerned.
At this moment in time, it would be hard to exaggerate the appeal the prospect of wearable augmentation holds for its vocal cohort of enthusiasts within the technology community. This fervor can be difficult to comprehend, so long as AR is simply understood to refer to a class of technologies aimed at overlaying the visual field with information about the objects and circumstances in it.
What the discourse around AR shares with other contemporary trans- and posthuman narratives is a frustration with the limits of the flesh, and a frank interest in transcending them through technical means. To advocates, the true appeal of projects like Google’s Glass is that they are first steps toward the fulfillment of a deeper promise: that of becoming-cyborg. Some suggest that ordinary people mediate the challenges of everyday life via complex informational dashboards, much like those first devised by players of World of Warcraft and similar massively multiplayer online role-playing games. The more fervent dream of a day when their capabilities are enhanced far beyond the merely human by a seamless union of organic consciousness with networked sensing, processing, analytic and storage assets.
Beyond the profound technical and practical challenges involved in achieving any such goal, though, someone not committed to one or another posthuman program may find that they have philosophical reservations with this notion, and what it implies for urban life. These may be harder to quantify than strictly practical objections, but any advocate of augmentation technologies who is also interested in upholding the notion of a city as a shared space will have to come to some reckoning with them.
Anyone who cares about what we might call the full bandwidth of human communication — very much including transmission and reception of those cues vital to understanding, but only present beneath the threshold of conscious perception — ought to be concerned about the risk posed to interpersonal exchanges by augmentive mediation. Wearable devices clearly have the potential to exacerbate existing problems of self-absorption and mutual inconsideration. Although in principle there’s no reason such devices couldn’t be designed to support or even enrich the sense of intersubjectivity, what we’ve seen about the technologically-mediated pedestrian’s unavailability to the street doesn’t leave us much room for optimism on this count. The implication is that if the physical environment doesn’t fully register to a person so equipped, neither will other people.
Nor is the body by any means the only domain that the would-be posthuman subject may wish to transcend via augmentation. Subject as it is to the corrosive effects of entropy and time, forcing those occupying it to contend with the inconvenient demands of others, the built environment is another. Especially given current levels of investment in physical infrastructure in the United States, there is a very real risk that those who are able to do so will prefer retreat behind a wall of mediation to the difficult work of being fully present in public. At its zenith, this tendency implies both a dereliction of public space and an almost total abandonment of any notion of a shared public realm. This is the scenario imagined by science-fiction author Vernor Vinge in Rainbows End (2006), in which people interact with the world’s common furniture through branded thematic overlays of their choice; it’s a world that can be glimpsed in the matter-of-factly dystopian videos of Keiichi Matsuda, in which a succession of squalid environments come to life only when activated by colorful augmentive animations.
The most distressing consequences of such a dereliction would be felt by those left behind in any rush toward augmentation. What happens when the information necessary to comprehend and operate an environment is not immanent to that environment, but has become decoupled from it? When signs, directions, notifications, alerts and all the other instructions necessary to the fullest use of the city appear only in an augmentive overlay, and as is inevitably the case, that overlay is available to some but not others? What happens to the unaugmented human under such circumstances? The perils would surely extend beyond a mere inability to act on information; the non-adopter of a particularly hegemonic technology almost always places themselves at jeopardy of being seen as a willful transgressor of norms, even an ethical offender. Anyone forgoing augmentation, for whatever reason, may find that they are perceived as somehow less than a full member of the community, with everything that implies for the right to be and act in public.
The deepest critique of all those lodged against augmented reality is sociologist Anne Galloway’s, and it is harder to answer. Galloway suggests that the discourse of computational augmentation, whether consciously or otherwise, “position[s] everyday places and social interactions as somewhat lacking or in need of improvement.” Again there’s this Greshamization, this sense of a zero-sum relationship between AR and a public realm already in considerable peril just about everywhere. Maybe the emergence of these systems will spur us to some thought as to what it is we’re trying so hard to augment. Philip K. Dick once defined reality as “that which refuses to go away when you stop believing in it,” and it’s this bedrock quality of universal accessibility — to anyone at all, at any time of his or her choosing — that constitutes its primary virtue. If nothing else, reality is the one platform we all share, a ground we can start from in undertaking the arduous and never-comfortable process of determining what else we might agree upon. To replace this shared space with the million splintered and mutually inconsistent realities of individual augmentation is to give up on the whole pretense that we in any way occupy the same world, and therefore strikes me as being deeply inimical to the urban project as I understand it. A city in which the physical environment has ceased to function as a common reference frame is, at the very least, terribly inhospitable soil for democracy, solidarity or simple fellow-feeling to take root in.
It may well be that this concern is overblown. There is always the possibility that augmented reality never will amount to very much, or that after a brief period of consideration it’s actively rejected by the mainstream audience. Within days of the first significant nonspecialist publicity around Google Glass, Seattle dive bar The 5 Point became the first commercial establishment known to have enacted a ban on the device, and if we can fairly judge from the rather pungent selection of terms used to describe Glass wearers in the early media commentary, it won’t be the last. By the time you read these words, these weak signals may well have solidified into some kind of rough consensus, at least in North America, that wearing anything like Glass in public space constitutes a serious faux pas. Perhaps this and similar AR systems will come to rest in a cultural-aesthetic purgatory like that currently occupied by Bluetooth headsets, and if that does turn out to be the case, any premature worry about the technology’s implications for the practice of urban democracy will seem very silly indeed.
But something tells me that none of the objections we’ve discussed here will prove broadly dissuasive, least of all my own personal feelings on the subject. For all the hesitations anybody may have, and for all the vulnerabilities even casual observers can readily diagnose in the chain of technical articulations that produces an augmentive overlay, it is hard to argue against a technology that glimmers with the promise of transcendence. Over anything beyond the immediate near term, some form of wearable augmentive device does seem bound to take a prominent role in returning networked information to the purview of a mobile user at will, and thereby in mediating the urban experience. The question then becomes what kind(s) of urbanity will be produced by people endowed with this particular set of capabilities, individually and collectively, and how we might help the unmediated contend with cities unlike any they have known, enacted for the convenience of the ambiguously transhuman, under circumstances whose depths have yet to be plumbed.
Notes on this section
 Grüter T, Grüter M, Carbon CC (2008). “Neural and genetic foundations of face recognition and prosopagnosia”. J Neuropsychol 2 (1): 79–97.
 For early work toward this end, see http://www.cc.gatech.edu/~thad/p/journal/augmented-reality-through-wearable-computing.pdf. The overlay of a blinking outline or contour used as an identification cue, incidentally, has long been a staple of science-ﬁctional information displays, showing up in pop culture as far back as the late 1960s. The earliest appearance I can locate is 2001: A Space Odyssey (1968), in which the navigational displays of both the Orion III spaceplane and Discovery itself relied heavily on the trope — this, presumably, because they were produced by the same contractor, IBM. See also Pete Shelley’s music video for “Homosapien” (1981) and the traverse corridors projected through the sky of Blade Runner’s Los Angeles (1982).
 As always, I caution the reader that the specifics of products and services, their availability will certainly change over time. All comments here regarding Nearest Subway pertain to v1.4.
 See discussion of “Superplonk” in [a later section]. http://m.spectrum.ieee.org/podcast/geek-life/profiles/steve-manns-better-version-of-reality
 At the very least, user interface should offer some kind of indication as to the confidence of a proffered identification, and perhaps how that determination was arrived at. See [a later section] on seamfulness.
 Azuma, “Registration Errors in Augmented Reality,” 1997.
 See Governors Highway Safety Association, “Spotlight on Highway Safety: Pedestrian Fatalities by State,” 2010. http://www.ghsa.org/html/publications/pdf/spotlights/spotlight_ped.pdf; similarly, a recent University of Utah study found that the act of immersion in a conversation, rather than any physical aspect of use, is the primary distraction while driving and talking on the phone. That hands-free headset may not keep you out of a crash after all. http://www.informationweek.com/news/showArticle.jhtml?articleID=205207840
 A story on the New York City-based gossip site Gawker expressed this point of view directly, if rather pungently: “If You Wear Google’s New Glasses, You Are An Asshole.” http://gawker.com/5990395/if-you-wear-googles-new-glasses-you-are-an-asshole
 The differentiation involved might be very fine-grained indeed. Users may interact with informational objects that exist only for them and for that single moment.
 The first widespread publicity for Glass coincided with Google’s release of a video on Wednesday, 20th February, 2013; The 5 Point announced its ban on 5th March. The expressed concerns center more on the device’s data-collection capability than anything else: according to owner Dave Meinert, his customers “don’t want to be secretly filmed or videotaped and immediately put on the Internet,” and this is an entirely reasonable expectation, not merely in the liminal space of a dive bar but anywhere in the city. See http://news.cnet.com/8301-1023_3-57573387-93/seattle-dive-bar-becomes-first-to-ban-google-glass/
Consider this a shooting script for one of those concept videos so beloved of the big technology vendors. If you find my reading here tendentious, I can assure you that every element of the scenario I present here has been drawn directly from the website copy or other promotional literature of IBM, Cisco, Siemens, Living PlanIT, Gale International (i.e. Songdo) or Masdar.
Daybreak on a Wednesday in April, sometime in the first third of the twenty-first century. The lights come up slowly in Maria Villanueva’s condo, forty-seven stories up the side of the soaring Phase III development. It’s a few weeks past the first anniversary of Maria’s arrival in Noblessity, and in some ways she’s still getting used to the way she lives in this brand-new city of ten square kilometers, so recently and famously reclaimed from the ocean itself.
Her building, for example: a daringly helical twist of stacked apartment units, devised by a name-brand Danish architectural practice. Back home she could never have afforded to live in anything remotely like this — and that’s if there even were buildings like this at home in the first place, which she doubts. This morning the active shutters, sensing a rare onshore breeze, have deployed microfilaments to trap the moisture in the air, softly hazing them at the edges so they seem to blur into the murky sunlight. Even the soft light that makes it through is too bright for Maria, though, and she clutches vaguely at bedside for her phone so she can launch the app that controls the windowshades.
Maria’s husband Mark left for work hours ago — he’s a lawyer negotiating EMEA rebroadcast rights for an American basketball league, and his teleconferences tend to happen on Los Angeles time. So on this Wednesday morning, she finds she has the apartment to herself. She drags herself from bed, shouts for the kitchen to fix her a latte and heads to the en-suite bathroom.
Headlines stack up on the mirror, and Maria scans them as she blowdries her hair: “Climate talks enter a third fruitless…guest-worker privileges revoked following…Royal scandal erupts as Mail drone captures…” None of this seems like it will immediately bear on her work, and just as quickly as the headlines arrive she dismisses them, with the mere swipe of a fingertip.
The walk-in closet has an app to choose outfits appropriate to the weather, but the weather’s always the same here — punishingly hot and dry outside, and invariably a comfortable 72º everywhere that isn’t. Maria has never once launched the app. She gives herself a last quick once-over in the full-length, pats down a few vagrant strands of hair, and then it’s off to work.
Maria belongs to an elite team of analysts tasked with riding herd on autonomous trading algorithms for a City of London-based financial concern. After a solid six months in which she made a newcomers’s show of diligence, she’d rather gotten used to the luxury of working from home most days of the week, but in the interests of team cohesion senior management has just issued a policy forbidding this. And so once again she finds herself faced with the necessity of a twice-daily commute between the ranked condos of the residential zone and the supertowers of the Central Business District.
This is not, as it happens, a huge imposition. The mobility fee is included in her compensation package, and actually, the drive isn’t so bad; depending on traffic and the precise route chosen by the car, it takes anywhere from ten to fifteen minutes. Maria knows from experience that if she calls the car service as she walks out the front door of her unit, her car will be pulling up under the porte-cochère just as she gets there. And so it is this morning, the elevator, as always, alert to the patterns of movement within the building and therefore empty of anyone else. She momentarily realizes she’s forgotten, again, to shut off the lights in the closet, but it doesn’t matter; but for the low-level autonomic systems, everything in the condo fades to black thirty seconds after the unit detects a lack of human presence.
The briefest blast of desiccating heat, and then she’s safely into the car. Today’s car is a little funky, a little foul — not so much that somebody had actually smoked a cigar in it, but maybe that it had recently been used by somebody who smoked a lot of cigars. And used rather too much cologne. Maria punches the air conditioning to its highest setting and tries to breathe through her mouth.
There’s apparently been a fender-bender on the Grand Axial, and the car is rerouted around it without so much as a peep. And so Maria finds that her way to work this morning takes her via the Coastal Ringway, past the three enormous pipelines that supply Noblessity with fresh water from the mainland. This is provided by the host nation at no expense, for the duration of the developer’s 99-year lease on the land — just one of the many ways the host nation expresses its gratitude for the massive infusion of talent and capital sitting just offshore. Of course it’s been awhile since Maria crossed the causeway; truth be told, she only does so on her way to or from the airport. But she keeps meaning to drag Mark over for a visit, get a taste for how the people here really live, and one of these weekends she’s sure they will.
Just past the ten-story screen that fronts the Museum of Contemporary Art, as the car passes beneath the overway heralding entry into the CBD, the windshield starts to pulse red. The soft bonging of an awareness alert issues from the dashboard, and there is the slightest sideways lurch as the car moves to put some distance between itself and a disturbance rapidly approaching in the curbside lane. On the sidewalk ahead, a man in the yellow coveralls of a guest worker is visibly struggling with two Public Safety men. The windshield overlay has identified him as a PDP, or Potentially Disruptive Person. Ever since the bombings in Rio, of course, everyone’s been a little bit on edge, and feeling the slightest bit guilty that she’d ignored the headline earlier in the morning, Maria taps a finger on the windshield for more information. The public scanners have registered an unidentifiable, roughly weapon-sized object under the man’s clothing; and this, correlated with his location and immigration status, is surely enough to trip the threat-detection algorithm’s probability threshold.
But they’re barely abreast of the disturbance before a Public Safety van has whisked up to the curb, and amid a sudden bloom of khaki PS uniforms the guest worker is hustled in and away. Maria’s car torques up with the silent immediacy of electric drive; with a quick and almost subliminal sigh, she releases the tension she barely knew she was carrying, and the unpleasantness rapidly dwindles in the rearview mirror.
Before long the car glides to a halt in front of the Bourse, and the door pops open to let Maria exit before heading off to its next booking. Maria places great stock in mindfulness, so today as every day she takes a moment to pause for a moment, breathe, and contemplate the massive visualization that pulses across the entire width and breadth of the façade. It’s hard to make out in direct sunlight, but if you shield your eyes and look carefully you can see how the whole surface of the building shimmers with graphics representing real-time trading activity.
At this hour, it’s still last night in Chicago and New York, and half a day yet before the London and Frankfurt exchanges open. So the activity dancing across the façade is all the Nikkei, the Hang Seng and the CSI 300…and the blips of an algorithm she and her colleagues have dubbed Dirty Frank, leaving its bizarre and so-far unfathomed spoor of stochastic trades across the minutes.
The view on Maria’s desk, of course, is more sophisticated by far than the poppy visualization splashed across the façade. Her job is to reverse-engineer algorithms like Dirty Frank, determine the logic driving each one, and help her firm develop tactics to counter them. The few hours of morning work pass quickly, as work always will for someone who is paid well to do what she’s good at, and loves what she is paid to do, and lunchtime rolls around before she knows it.
Everyone knows how awkward it can be to socialize with folks working in different backgrounds, so Maria’s agenda app has booked her for lunch in a restaurant rated highly over the past six weeks by people whose activity on Noblessity’s resident-only social network suggests a high degree of compatibility. But when she gets out onto the Plaza, she finds it unusually, even alarmingly crowded, and asks one of her building’s uniformed concierges if he knows what’s going on.
It seems a private shopper for one of the luxury boutiques on the Skydeck level, deputized to serve one of the members of the boy band that played the Performing Arts Center last night, has uploaded a brief video of her charge shimmying into a tight new pullover — and of course the time- and location-stamped video has gone viral locally. In the fullness of time the shopper will be fired, doubtlessly, but the damage is already done. A lengthening line of cars waits to disgorge passengers at each of the bays around the plaza’s perimeter, and the walks and overways are perceptibly starting to fill with giddy young women.
The mast-mounted cameras high above Bourse Plaza have, of course, identified the potentially troublesome concentration of pedestrians, just as roadbed sensors register the increased traffic load and flag it for immediate attention. It’s just after shift change in Noblessity’s Intelligent Operations Center deep beneath the streets, and the fresh crew is quick to respond to the emergent condition – except for special occasions like the annual Jazz Festival, management likes to keep densities in the CBD low, and the oversight team’s contractual performance incentives depend on keeping the sidewalks at Level of Service C or better.
Ordinarily, of course, this isn’t an issue; between the oppressive heat and the long, triumphal blocks, nobody tends to walk very much or very far in Noblessity. Thanks to the private shopper’s indiscretion, though, today is shaping up to be different. Traffic on the sidewalks has started to thicken, contraflow movement is beginning to be difficult, one or two leading indicators of social distress have started to show up on the Big Board. It’s little more than threshold activity at this point, but if nobody issues a command override, active countermeasures will be deployed…and mindful of those incentives, nobody does. Up go the bollards around the plaza, down go the gates on the overways, and one after another, all of the signals turn green on all of the routes leaving the area.
Maria finds herself rerouted for the second time this day, this time on foot. Her phone runs a few quick calculations against her standing parameters and winds up recommending a trattoria-style Italian place she’s never thought to try before, just the other side of the World Expo Center — happy serendipity. Of everything on the menu, there are only a few options lit up on the tabletop as falling within her current diet guidelines, but the Caesar salad she chooses is delicious. The ten-minute walk back to work mostly takes her through temperature-controlled spaces, while between them the gorgeous, ethnic-inspired patterns of the active brise-soleils have unfolded to shield the walkways from the worst of the noonday sun. Even the more visible crowd-dispersion measures have faded back.
By the time Maria calls it a day, the East Asian markets are long closed, but NASDAQ’s just getting started. With a brief series of taps, she formally passes operational responsibility to her New York-based colleagues, and puts her desk to sleep. Her drive home is daydreamy, if a bit subdued — the billboards along the route all seem to be down, and she watches them drift by in a succession of vivid frames the color of clear sky.
After she’s changed into workout clothes, Maria orders a car to the Recreation Zone. Despite the heat, she loves to run along the manicured paths set between the lakes and fountains, to measure her progress against the countersunk lighting pavers. At the entrance to Oceanside Park, a two-man construction crew with a miniature backhoe is digging up the sensors they emplaced just last year — management has sourced a newer model, cheaper and more capable. True to every word of the promises the headhunter made, Noblessity is continuously in the process of being upgraded.
As Maria huffs around the outer loop, her sunglasses keep a running tally of the calories she’s burning, representing them as a blue line climbing diagonally across her peripheral vision. As the blue of her efforts finally begins to track the green of the optimal curve set by her company’s employee wellness plan, she feels a tight glow of satisfaction well up inside her. A brief flourish of trumpets in her earbuds and an animated burst of fireworks means she’s unlocked a mileage target achievement. This will mean new options at dinner for sure.
The original plan for the evening was to meet Mark for dinner at the new robata grill on the garden level of Entertainment Sector South. But just as she turns into her final lap, Maria’s sunglasses light up with a call. It’s Mark; it turns out that he’s exhausted from what has been a long and arduous day of strategy sessions, and feeling pretty burnt out herself, they decide to meet up at home and order in. She knows from experience that she won’t even need to call for a car — the service’s adaptive load-balancing algorithm knows the fall of darkness will always mean a line of people who need rides home from the park — and the condo is mere minutes away.
Of the many amenities provided by her building, among Maria’s very favorites is the one she now avails herself of: ordered meals, like care packages from home and other deliveries, are deposited in the autolocker, so she doesn’t even need to deal with the delivery boy. Mark orders with a few taps on the kitchen screen, and they catch each other up on their respective days during the twenty or so minutes that go by before the autolocker chimes to announce the arrival of their dinner. They grab a few napkins and their containers of food and settle back on the couch to buy a movie from the wallscreen.
Before it’s even a third over, though, Maria realizes with a start that she’s started to nod off. She plants a kiss on the top of her husband’s head and pads off to bed. Just as she slides between the sheets, the briefest prayer of acknowledgment escapes her lips, a prayer of gratitude for another day of health, profit and productivity, another day in balance, another day in Noblessity.