Augmentology"...is a concise manual of reality for our digital age."

Mark Hancock,_Augmentology: Interfaccia Tra Due Mondi_

[Sponsored by The Ars Virtua Foundation/CADRE Laboratory for New Media]


…(a Tojolabal, two and a half years old, born during the first Intergalactic) is playing with a little car with no wheels or body. In fact, it appears to me that what Pedrito is playing with is a piece of that wood they call “cork”, but he has told me very decisively that it is a little car and that it is going to Margaritas to pick up passengers…The plane makes a pass over Pedrito’s hut, and he raises the stick and waves it furiously at the war plane. The plane then changes its course and leaves in the direction of its base. Pedrito says “There now” and starts playing once more with his piece of cork, pardon, with his little car. The Sea and I look at each other in silence. We slowly move towards the stick which Pedrito left behind, and we pick it up carefully. We analyze it in great detail. “It’s a stick,” I say. “It is,” the Sea says.

- A story from Subcommandante Marcos retold by Ricardo Dominguez

One of my recent attempts at exploring and establishing liberating spaces between realities is a series of performances called technésexual. In technésexual, myself and Elle Mehrmand (my partner/collaborator) perform erotic acts simultaneously in a geophysical space and virtually in Second Life. Using electrocardiogram heart monitor chest straps, Lilypad temperature sensors and Arduino/Freeduinos, we capture heart rate and body temperature data to transmitt to our avatars in Second Life. These transmissions act to bridge the physical space and the virtual environment via the use of audio. This type of linking is often experienced when having a conversation that involves different, yet connected, physical locations. Technésexual provokes questions concerning the representation of sexualities that lie outside restrictive LGBT/homo/hetero categories: such categories are rooted in binary gender assumptions. The mixing of realities in this project are a way of queering new media which parallels our own experiences of mixing genders and sexualities.

Virtual/Synthetic worlds like Second Life facilitate the development of new identities which allow for (as yet) unimagined relations and relationships. Technésexual looks closely at these new relationships and the potential they embody. There is a flipside to the potentialities inherent in the subversive use of Second Life, one that acknowledges that Linden Labs – the creators of Second Life – are attempting to create a walled garden and permanently lock in users. Similarly, the university is beginning to reveal itself as a self-perpetuating obsolescent institution as sites like aaaaarg.org provide instantly searchable digital texts. Any exclusive expertise involved in pinpointing particular topics becomes obsolete when the process is as simple as using a “find” command. If we can begin to understand the university as “managed death[, ] a machine for administering death, for the proliferation of technologies of death”, the need to remove or modify such institutions becomes urgent.

In a recent panel conversation concerning Alex Rivera (the director of Sleep Dealer), Cauleen Smith noted how science fiction is a genre that promotes critique of extant systems of oppression (including class, race and gender).

Mixed and Augmented Reality could likewise be employed subversively to modify Capitalism through the infiltration of entertainment – this would, in turn, present deep critiques of extant systems of power. In Protocol, Alexander Galloway discusses the need for protocological resistance under global Capitalism, where practical implementations are shown in the occupations of universities and virtual worlds. Second Life creates a desire for a free metaverse. Free Software (such as Open Sim) begins to offer a space beyond Second Life and its tightly controlled reality.

Aimee Mullins proposed in a recent article that:

…the generation of children growing up today has a distinct advantage in this realm of identity, thanks to their daily interaction with the internet and video games. It’s commonplace for them to create avatars and parallel representations of themselves, and they see their ability to change, transform, and augment those bodies to best suit their surroundings as beneficial.”

I would, however, suggest caution rather than pure optimism regarding choices available in identity creation: many of these selections can just as easily reinforce forces of social control as offer an alternatives to them. There is no inherent freedom implied in Reality shifting. In her recent book Simulation and its Discontents, Sherry Turkle describes a 13 year old girl who informed her interacting within SimCity taught her that “raising taxes leads to riots”. What lesson did the girl learn – how to be a better ruler or how to take part in a riot? It isn’t clear. What is clear are the reality cracks opening up in front of us every day. As we proceed to navigate (within) these cracks, we must be prepared to imagine, create and bridge these new realities.

“There are many worlds and many realities in our universe. When one reality, or one world-view is superimposed on another, it is inevitable that social, economic and cultural problems arise. Hierarchies of worlds are constructs of a bygone era. Ecologies of worlds should guide us in considering our future… We can begin by designing environments that can respond to physical, environmental, or social needs. Not only the needs of human beings, but also of the organisms and elements with whom we share the Biosphere.” – fo.am

Rezzing occurs in the space in-between worlds. Rezzing happens in the moment we switch from one reality to another: where the structure of synthetic worlds is unveiled. We see these spaces appear gradually – textures, alpha channels and audio appear in layers. Forms start as simple grey patterns that morph and evolve via emergent detail. These patterns resolve as final forms that adhere to in-game physics and flop into “place”.

Rezzing 1

When I begin rezzing – and am between avatars – my body disappears. Then, the simple basic shape beneath is exposed with pitch black skin and bizarre proportions. Finally, my body parts materialise.

I stand naked: staring ahead as my clothes begin to appear, one piece at a time. As the textures of my skin are downloaded, my blurry body is redrawn in photorealistic detail. In Second Life, Linden Labs has added a feature where rezzing avatars are surrounded by a cloud whilst forming. This cloud presumably covers the moments of nakedness while an avatar’s clothes are appearing and bare pixel genitalia are exposed.

There is no geophysical equivalent to the act of rezzing. The closest phenomenon is the act of awakening from – or falling into – dreams. When an object or avatar is rezzed in a synthetic environment, its data representation is downloaded from the database into the local client. On screen, a visual “something” is created from synthetic “nothing” – an ontological novelty out of the pure void. This act reveals a flaw in the materiality and persistence of these worlds or a type of virtual ontology similar to Deleuze’s Spinozan plenty without void.

After encountering the whooshing sound that indicates teleporting, I am dropped into an incomplete world. Often during this phase, my avatar manifests in a falling animation. First, all is sky and water which faithfully glistens with the sun (according to environment settings). Then, distant objects appear. In complex areas this can take minutes as particle scripts initialise and begin to swirl and glow before the details of architecture appear.

555 KUBIK | facade projection |

During the rezzing process, as a user’s body begins to form they step into a swirl of affect. This affect may induce feelings of identification with the avatar or a revulsion from it. This emotional polarisation may produce a sense of pleasure in seeing or a sense of disjunctive discomfort. The activity of the database creates its own unreproducable order dependant on the speed of the bytes transferred. Hair or pants/skirt may take minutes to download, with the avatar blinking into space with a bald head or exposed thong in the meantime. At this juncture, the avatar hover-stands in an unfolding environment and waits for the expected transactions of the “normal” synthetic world to begin.

How do we come to understand the resonances, affects and effects of rezzing into synthetic environments? With augmented reality making headline news, can we think of other ways of entering other realities which are not limited to visual modes? What about pain? Sound? Smell? Can Mixed Reality Performances be used to develop and explore these methods of realityshifting? If we can think of ways of finding spaces between realities, then can we think of the space between realities as similar to the space between genders and sexualities? Could entering a space between realities free us of certain rules, be a strategy of liberation and transformation? Part 2 will explore these questions.

Shok Antwerp Transforms

<cont>

The web was built on openness and designed from the ground up to enable sharing of code – view the source from early web pages for examples. Yet it seems that already Second Life content creators want strict restrictions on copying, even going so far as to support the DMCA. So, while the DMCA is decried in so many cases (such as the RIAA suing elderly women and children who don’t even own computers), Second Life content creators want to call upon it for protection. There are currently multitudes of useful business models built around open source and free sharing. Why do users of Second Life, who have the ability to create a new world and rethink the negatives associated with our geophysical one, want to rely on an obsolete notion of copy restriction? This acts to simulate the production of physically-templated objects instead of assisting in the understanding of new models which are based on (and flourish from) copying, sharing and building commons.

Ultimately, this is my argument: much like the alter-globalization movement wants to create a new world, an “other globalization” not based on corporate profit at the expense of the millions who are exploited, synthetic worlds present us with an opportunity to imagine and craft the kind of worlds in which we want to exist. While many argue that Second Life duplicates the problems of sexism, racism and homophobia that we see in the geophysical world, I would argue that we can’t ignore the way that corporations are shaping our synthetic environs.

Linden Labs are currently the ones responsible for offering new avatars birthed into a synthetic world that is bursting with potentialites. At present, these avatars have the choice of manifesting as Male or Female, City Chic or Clubber. Why aren’t Second Life standard avatars such as these included instead: Steamclock builder, Vampire Neko, Futanari and Transformer? Clearly, Linden Labs choose to please their conservative corporate customers by ensuring sexual standards conform along a traditional axis. If most of Second Life looks like a mall, perhaps that’s because the current system structure is constructed to maintain profitability from every Linden exchange in-world. Another crucial element of interoperability, it would seem, is an open money system. Where are the developers imagining new currency systems who were so active a few years ago? Where are all the offshore havens? It is the responsibility of the creators of, and those passionate about, synthetic worlds to act ethically in the construction of said worlds. Each user is responsible for the emergent system. In light of this, let’s start setting up those realXtend and OpenSim servers, working on the code for interoperable worlds, begin populating them and seeing what new creations and relations arise.
.
Mitch Kapor’s keynote speech presents current users of virtual worlds as marginal people in a “frontier world” that should expect the strong hand of the law to intervene, where the 3D sheriff strides into town on his new mount. Kapor said: “in the earliest wave of pioneers in any new disruptive platform, the marginal and the dispossessed are over represented, not the sole constituents by any means but people who feel they don’t fit, who have nothing left to lose or who were impelled by some kind of dream, who may be outsiders to whatever mainstream they are coming from, all come and arrive early in disproportionate numbers…that sort of arduous frontier conditions really give these environments their charm and their character…that is going to make things challenging for people who feel that as the frontier is being settled and there is less novelty and in some senses less freedom, it is always an uneasy transition for the pioneers.” Kapor goes on to say: “It was the way the west in the U.S. was settled. It is the way Second Life has been settled” and that he endeavours to make virtual worlds operate “in a more decentralized kind of way, one that Thomas Jefferson, if he were around, would be proud of…”. I, for one, want to abandon the whole wild west metaphor in relation to synthetic worlds. I would also hope that the settling of Second Life doesn’t involve the killing of millions of indigenous people and would not make slave owners proud. I prefer instead to think of synthetic worlds as birthed arenas based on the gestation of code. These arenas will then develop through nourishment provided by hardware and user creativity. The kind of decentralization that synthetic environments need to ensure freedom and growth would scare the hell out of Thomas Jefferson.
.

If the example of the web shows us anything, it is that users and developers can ensure some degree of freedom for the next few decades. While net neutrality threatens the future of that openness – as phone companies demand laws that guarantee the prevention of copyrighted films from being downloaded – new technologies like wireless mesh networks offer the possibility for hope. One of the most important and wonderful properties of the net is that problems are identified and routed around. It seems that synthetic worlds are at a point where some routing is necessary.

RealXtend Breakdancing

<cont>

There are components ready to create a decentralized universe of virtual worlds: open source clients (Indra – the official SL client) and open source server software. OpenSim seems to be the current decentralised contender (which offers some SL interoperability) plus others including WoW server software. With the creation of Google’s _Lively_ we’re already seeing a lack of concern with interoperability through name collisions or name theft incidences.

Who stands to benefit from this kind of lack of interoperability? Obviously corporations with the goal of controlling the only available synthetic world would benefit enormously from halting interoperability. Users, then, need to demand interoperability or create systems that operate as such and make those that are not unusable. As users of virtual worlds and synthetic environments, we are responsible for the choices we make about what software we use. Users of Microsoft software are as much responsible for the Microsoft monopoly as is the company itself.

What stands in the way of creating interoperability? One major component of the web’s success is open standards. We need open standards in – and for – synthetic worlds. IBM and Linden Labs are currently working on developing such standards [see: Architecture Working Group].

I don’t think I need to explain how open standards have facilitated the growth and acceptance of the web. Yet, one disturbing element of Second Life that differs from the web is the lack of an underlying value of openness over intellectual property”. Richard Stallman argues that the very term intellectual property is a term that corporations readily co-opt and abuse. No surprise then that Linden Labs, in their official announcement on OpenSim interoperability, state that “intellectual property is the engine that drives Second Life”; not openness, sharing, social engagement, creativity or passion.

Friends of mine who are daily Second Life users describe it as just another social networking site – just another place to chat with their friends, buy a cool outfit and have a nice house too. In this way, one can see that the real value of Second Life is in making synthetic worlds accessible. While the initial openness of the web allowed anyone to write html and make websites, one could argue that it was only with MySpace that a true explosion of web authoring took place. MySpace allowed every kid to suddenly have a web page because of the combination of simplicity (fill out this form, pick your song here, upload your photo here) and social value (express your vanity here, look good to your friends here, show how cool you are here). Second Life does something similar; playing to sociability and degrees of vanity through the use of an easy interface designed primarily for creating and buying 3D objects. Perhaps Google’s Lively will demonstrate whether ease of use and a lack of catering for creativity is the adoption benchmark for the next synthetic world interface.

<tbc>

Second Life/Open Sim

If we think about the synthetic environment of Second Life as a metaphor for the web, where are we at today? In the early days of the web, only universities and advanced scientific laboratories had websites. I remember – as a kid – buying an issue of Scientific American that came with a map of the whole web, all 100 or so websites on a foldout poster. The web then proceeded to become popular with the rollout of Netscape, but really gained mainstream status through the development of _America Online_ (AOL). Now, I’m well aware just how awful America Online is; I’m not sure how many people continue to use it as ISP’s and web hosts began to dramatically multiply and offer alternative services.

I would argue that we are currently at the AOL stage of synthetic world development; beyond the stage of university and military applications but mostly dominated by one or a few corporations (think: AOL or Compuserve as roughly parallel to Linden Labs, Blizzard).

In this metaphor, I’m trying to be clear about distinguishing particular components. At this point, Linden Labs’ main function is serving a synthetic world as the client is open source. Yes, they’re also developing the server software, but the _client_ is open source. This is much like a situation where a single company is acting as the only web server where customers build their websites, just as users of MMO’s build their synthetic homes and characters. Yes, AOL did more than host user’s websites, but for many people their homepages were on AOL’s servers. Similarly, Linden Labs does create some content in-world with most people accessing other’s virtual creations through Second Life.

Given the situation today, one can argue that it is ridiculous to have one or a few companies as exclusive web hosting corporations. Some of these reasons include scalability, freedom of expression and developer freedom. We can also see all of these issues within Second Life, with reports of:

- Multiple avatars in a single sim causing performance problems
- Issues like the recent SL5B celebration rated as PG
- changes to server code breaking existing client additions (as in the University of Michigan’s stereoscopic patches).

If we want to encourage substantial synthetic world growth and continue to use the environments as spaces for creativity and experimentation – not just for corporate profit – then it is critical that we work on open standards and interoperability. Through the employment of software like OpenSim and RealXtend, we can attempt to become independent from the corporate restrictions of Linden Labs.

The recent debate over “prim limits” (ie limiting the number of prims allowed in a sim) reveals the importance of this issue. For Linden Labs, limiting individual user’s processor power is critical to their ability to make a profit and to continue to operate as the primary server of synthetic worlds. While they present themselves as our benevolent benefactors, this position also allows them to ultimately maintain control over what is and is not allowed in this environment. Why is there the strange familial naming of every Linden Labs employee? Is it to give users the feeling that they are part of one big happy family? Or that Linden Labs are our avatar’s loving parents? Would we stand for a world wide web that was hosted by just one corporation?

I propose that we would not seriously invest as much time in web use/web content creation if it was all owned by one corporation which had ultimate say over freedom of expression. What makes the web reliable and open and therefore important is decentralization.

<tbc>