An
essay by Megan Sapnar:
It is hard to deny the tremendous impact the
Web has had on poetry. Not only has it opened
new distribution channels and new possibilities
for collaboration and criticism, but also,
through Web-related audio-visual technologies,
it has encouraged authors to experiment with
the formal elements of poetry — or,
as some critics might put it, what passes
as poetry today. Despite numerous websites
and at least a few institutions devoted to
digital literature — along with plenty
of practitioners — many critics maintain
that digital poetry as an art form has yet
to take shape. What hasn’t really taken
shape, however, may be the framework, the
vocabulary in which digital poetry can be
discussed and appreciated by readers. This
article looks to where audio-visual media
such as video, TV, and film intersect with
poetry on the Web, in order to introduce new
practitioners, readers, and artists who work
in other media to the current debates and
issues that surround the production and reception
of the audio-visual in new media poetry.
The growing popularity of software like
Flash has ushered images, animation, sound,
and kinetic typography into the poem, blurring
the boundaries between film, graphic design,
and computer games. Exploring the Web as
a medium for new forms of artistic expression,
digital artists, designers, programmers,
and poets have collaborated to create some
provocative work that alternately challenges
and ignores the institutional apparatus
for “traditional” or “mainstream”
literature.
With the ability to create
real-time, scalable, interactive, high-frame
rate animation with sound in a file small
enough to be suitable for Web delivery,
Flash has quite literally set the Web in
motion, emerging as an industry standard
development tool used by both professional
designers and amateur Web enthusiasts. While
some poets see Flash as an ideal means for
affordably and easily realizing interactive
multimedia literature, critics suggest that
Flash serves more to dumb-down poetry than
it does to inspire fresh, insightful literary
experiments.
The history of multimedia literature in
the 20th century includes some innovative
work, from using sound and images in Europe
in the 1920s to “poem-painting”
and “film-poem” experiments
in the U.S. and elsewhere during the 1950s,
as well as many other instances of collaborative
and cross-genre work. While there is a growing
body of significant and groundbreaking new
media poetry, there is also a fair share
of work rooted in less ambitious aspirations,
winding up perhaps more Disney than Duchamp.
The latter can certainly be enjoyable and
well-designed; they can be very sophisticated
visually, but they are less ambitious because
they fail to impart on the viewer a larger
sense of the complexities and contradictions
that mark “good” art. Instead
of challenging us, these works speak in
a language we understand and tell us something
that we already know.
We are all familiar, of course, with the
language of motion. We see words and images
move around screens every day, speaking
in the moving language of electronic media:
Visual codes we have learned through television,
advertising, and film — from opening
title and credit sequences to the graphically
rich introductions of nightly news. The
language of motion can speak as loudly as
the language of words, a point of no small
importance to those working with moving
images and kinetic typography. Motion graphic
designer Hillman Curtis explains: “In
motion graphics, the motion can be more
important and have more impact than the
graphical element being moved. The way you
choose to move, or not move, an element
across the screen can enhance the meaning
of that element greatly. If, for example,
I choose to move a text element slowly,
scaling and fading up from black and resolving
center screen, I imbue that text element
with a sense of drama, focus, and perhaps,
stability.”
In graphic design, this is about communicating
a message. In art, this can be used to question
dominant ways of seeing. The text element
that fades up from black and resolves center
screen is also imbued with film language:
Drama, focus, and so on, have been communicated
to the viewer who is familiar with the codes
of motion graphics through other media.
When we see an element fade in or out, we
know what to expect — a point of transition,
a new scene, a dramatic conclusion.
Because new technologies (e.g., Flash)
have made it easier to set text and images
in motion, there is the risk that authors
will incorporate movement into a work purely
for visual excitement, reproducing visual
codes with which we are familiar as a matter
of style: Distressed, dreamlike, nostalgic,
yet lacking critical reflection on the ways
in which the manipulation of text, time,
motion, and space can impact our perceptions,
introduce contradictions, and add multiple
layers of meaning to a work.
Overused clichés are metaphors are
predictable and feel trite. Love is beautiful;
death is sad; life is a journey… Poems
that reiterate such things reaffirm what
we already know. Bringing poetry to visual
media means there will inevitably be new
clichés — tired ways of using
motion, obvious visual metaphors, and interactivity
for its own sake. Some new media poems mask
mediocre writing behind visual effects that
may suggest “high quality production,”
but do little to challenge our accustomed
perceptual habits. As a result, artists
may not want to move elements in a particular
way because certain forms of motion are
over-saturated, signaling “commercialized”
or “produced.”

| “Genius,”
a web-based poem, is written
by Thomas Swiss, designed
by Skye Giordano, and features
music by Randy Schoen. +
View
poem |
|
|
On the other hand, artists
may rely on a viewer’s familiarity
with media codes in order to emphasize their
effects. In “Genius,”
for example, Skye Giordano sets the rhythm
of Thom Swiss reading his poem against the
environment in which the action takes place,
using graphic effects to underscore the
mediated language: “A camera tracks
its flight;” “quick cut back;”
“it was after all their scene.”
As the woman watches the news or skims a
magazine, we too watch through another media
layer, another screen. The poem itself comes
to us like a broadcast; MTV graphics and
special effects editing meets CNN Headline
News.
The steady rhythm of the poem is soothing;
the motion graphics are easy to watch, and
we are almost lulled by the effects until
the jarring conclusion, which sounds a few
loud bangs after the line,
“Tiresome these interruptions.”
The brazen “You don’t have to
be a genius to guess this wreckage will fuck
him up” is
repeated in text before the image is momentarily
frozen, duplicated, and removed, suggesting
a change of channel or a discontinuous signal.
The media is emphasized now in another way:
The distorted image, the buzz of static, and
then finally the color bars — an artificial
signal generated to provide a consistent reference
in post-production — all work to call
attention to the viewer’s own perception
of the relationship between representation
and
the screen.
“Translating” a written poem
from the page to the screen can sometimes
do neither the original piece nor the new
media a favor. New media, after all, doesn’t
make a poem inherently any better or more
appealing, just as film can’t make
a book a better read. Big-screen literary
adaptations which succeed do so not because
they remain faithful to the fidelity of
the original or because the novel as a form
for this narrative was lacking, but rather,
because these films were able to accomplish
something in their own right, and not in
the same way as the novel.
Indeed, in the case of “Genius,”
the new media text offers a different reading
than the words of the poem alone. For one
thing, the text of the poem (read apart
from the images) is primarily about the
woman. She is the one watching television,
reading a magazine, contemplating love handles,
and dealing with the boredom, guilt, and
pain of the daily routine. She is tired
of the outbursts from the television (“Tiresome
these interruptions”) and prays, “Don’t
let it be like that for me.” There
is only one line about her son: “About
an hour ago her son said before napping,
sleeping hurts me I don’t want to
sleep anymore.” She goes on to speculate,
“These days it seems nobody wants
to, just like nobody wants to see their
house blown apart.” But with the images,
the sound and the motion, the impact of
text changes significantly. The son, for
example, has a bigger role. There is the
image of the boy propped on his elbows (in
prime TV-watching position); he is shown
imagining a house being blown apart, and
the viewer is led to believe that, perhaps,
this is why sleeping hurts him.
Likewise, the text’s conclusion (“But
the boy on the screen who screams at the soldiers
is interrupting again”) points back
to one of the boys who had stopped throwing
rocks in the poem’s opening lines. Yet
the accompanying image superimposes the boy
inside the TV screen, making the connection
between
the woman’s son and the boys on CNN
visually apparent, as here “the boy
on the screen” is literally her son.
Is this poem about a boy traumatized by violence
on television, or about a woman’s fragmented
connections between her own pain, and the
pain of others—her son, the soldiers,
the boys who had been throwing rocks, people
with love handles? Genius calls us to investigate
this text a little further, and demonstrates
again that one thing is certain about all
good poetry: It demands a re-reading and still
offers a continually renewed sense of delight,
or uneasiness, or else, simply stays with
us long after the experience has ended.
|