Publikums oplevelser af lydkunst
Nye metoder til undersøgelser af brugeroplevelser på museer
30. oktober 2013
Anders Bonde
Lektor, ph.d., Aalborg Universitet
En undersøgelse af publikums
oplevelser med lydinstallationer ved Zentrum für Kunst und
Medientechnologie (ZKM) i Karlsruhe
Anders Bonde
i samarbejde med Sarai Løkkegaard, Kristina Skovgaard Pedersen, Marianne Lykke og Christian Jantzen
23.-25. november 2012
Zentrum für Kunst und Medientechnologie Karlsruhe
Ramme
Zentrum für Kunst und Medientechnologie
‘Sound Art: Klang als Medium der Kunst’
‘The Unheard Avant-gardes (in
Scandinavia)’
Udstillingens formål
To “rescue the believed-to-be lost archives of
Scandinavien media art and bring them back into current discussion”.
Not just an archive project; also an examination of
“the basic principles and importance of experimental avant-garde ‘media art’.”
An “attempt to re-arrange [the academic ideas about]
the relations between technology, media and art and to formulate a theory of this re-alignment.”
Søndergaard (2012, s. 30)
‘Interaktive’
Lyd aktiveret på foranledning af publikums handlen;
manifesterer sig på forskellig vis afhængig af publikums valg
‘Reaktive’
Lyd aktiveret på foranledning af publikums tilstedeværelse;
manifesterer sig på samme måde hver gang
‘Bruger-uafhængigt design’
En uendelig lydsløjfe; afspilles kontiuerligt uafhængig af publikums tilstedeværelse
Typer af lydinstallationer
Erkki vs. Erkki (2012)
Christian Hvalsøe Leifelt (f. 1970) og Erkki Kurenniemi (f. 1941)
Interaktiv lydinstallation
Hørbar (2007)
Koncept: Mogens Jacobsen og Morten Søndergaard Interaktiv lydinstallation
260 glasflasker, træ, hylder, bord, stole, akrylglas, autolak, RFID-tags og læsere, to arbejdsstationer, to fladskærme, belysning, elektronik, lyddatabase, forstærkere, højttalere, HP-servere, RFID-antenne
Udlånt af Museum of Contemporary Art, Roskilde (DK)
POEX Tape (2012)
Martin Luckmann (f. 1982)
med Mogens Jacobsen og Morten Søndergaard
Interaktiv lydarkiv grænseflade
Infrarød LEDs, Wii controllere, projektorer, database,
Arduino-platform, plexiglas, openFrameworks
Look down! (2012)
Mogens Jacobsen (f. 1952) og Morten Søndergaard (f. 1966)
Interaktiv klanginstallation baseret på en ikke længere eksisterende klanginstallation af Hans Sandmand og Knud Hvidberg (1965)
Dæk, spejle, sensorer, lys,
computere, MP3-afspillere, optaget
stemme
POEX Radar (2012)
Homage to Hans Sandmand & Knud Hvidberg
Koncept: Mogens Jacobsen, Martin Luckmann og Morten Søndergaard
Interaktiv klanginstallation baseret på en ikke længere eksisterende klanginstallation af Hans Sandmand og Knud Hvidberg (1965)
Modificeret radar, motor, sensor, computer, MP3-afspiller, optaget stemme, digitaliserede billeder
I Gevär (2007)
Christian Yde Frostholm (f. 1963)
Animeret lyddigt, efter lyddigt af Åke Hodell (1923–2000)
POEX Chairs - The Debate (2012)
Koncept: Mogens Jacobsen, Martin Luckmann og Morten Søndergaard Interaktive voice-interface
Modificerede stole, sensorer, computere, MP3-afspillere, optaget stemme Mix: Emil Alenius Boserup
Sound Produktion: Emil Alenius AEOEAA
EMS documentation space (2012)
Produceret af Sanne Krogh Groth og Mats Lindström (EMS)
Hansons Head (2012)
An audiovisual remix of Sten Hanson
Hans Sydow (f. 1968) og Christina Ann Sydow (f. 1967)
3 store PVC-bannere, en forstærker, otte højtalere, højtalerkabel, en 8-kanal-afspiller
Hvad ved vi om
publikumoplevelser
på kunstmuseer?
“Laboratory research has [...] indicated that artworks may elicit emotional and physiological responses.”
Tschacher et al (2011)
“Unlike pictures, sound comes in direct contact with the body, creating a sense of presence and proximity and in this way
moving us physically and mentally.”
Lønstrup (2013)
Kropsligt-fysiske oplevelser Mentale oplevelser
Appellerer til fire sanser: syns-, høre-, føle- og lugtesansen.
Forskningsområdets ‘state of art’
Research in the field of aesthetic experience of art, media art and sound art is dominated by a qualitative art-theory discourse, dismissing
laboratory research as insufficient due to the lack of external validity.
However, developments in wireless sensor
technology has facilitated quantitative scientific research methodologies in ecological valid
environments such as an art museum.
Tschacher et al (2011)
Forskningsspørgsmål
I hvilket omfang er det muligt at påvise en sammenhæng mellem brugeres affektive
respons (på baggrund af deres oplevelser af installationerne) og deres retrospektive
vurdering af udvalgte installationer?
Hvilken forskel gør det i den henseende, om
installationerne er udstyret med interaktive
anordninger eller ej.
Målinger via sensorer
Hvorfor?
They “may provide important information on emotion that is complementary, or even contradictory, to that provided by self-report or observation.”
They “can also be regarded as more objective as compared to self- report” (automatic recording vs. “social desirable responding”).
They “may also provide information on emotional responses that, for some reason (e.g., subtle nature of the responses, repression), are not available to [informants’] conscious awareness.”
They “can be performed continously during [...] hearing or viewing, are not dependent on language, do not require memory, and do not interfere with message processing.”
They “also enables the investigation of the phasic shifts in attention and emotion during listening or viewing”.
They “have a level of temporal precision that allows researchers to precisely pinpoint highly emotional [...] content and investigate responses to messages that are not exclusively positive or negative.”
Ravaja (2009, s. 195-196)
Time (GMT-04:00) Time in reference to Greenwich Mean Time Transverse accel - peaks
Forward accel - peaks Longitudinal accel - peaks
Skin temp - average GSR - average
Transverse accel - average Longitudinal accel - average
Near-body temp - average Transverse accel - MAD Longitudinal accel - MAD
Step Counter Number of steps taken in that minute Forward accel - average Average values for sensor.
Forward accel - MAD Mean Absolute Difference or total acceleration
Lying down 0 = negative, 1 = positive
Sleep 0 = negative, 1 = positive
Physical Activity 0 = negative, 1 = positive if they were physically active in that minute
Energy expenditure kcal/min
Sedentary 0 = negative, 1 = positive (Sedentary< 3.0 METS) Moderate 0 = negative, 1 = positive (Moderate 3.1 - 6.0 METS)
Vigorous 0 = negative, 1 = positive (6.1 - 9.0 METS) Very Vigorous 0 = negative, 1 = positive ( > 9.1 METS)
METs Metabolic Equivalent Tasks (1.0 MET ~ rest)
Timestamps 0 = negative, 1 = positive if timestamp was pressed druing that minute
Annotations Any information that was entered into software to annotate length or type of activity
3-axis accelerometer: Transverse, Forward, and Longitudinal. Peaks are the number of turning points
or the amount of jitter in the accelerometer
Average values for sensor.
Mean Absolute Difference or total acceleration
SenseWear Professional - Explanation of Channels in Export
Mini Armband
Time (GMT-04:00) Time in reference to Greenwich Mean Time Transverse accel - peaks
Forward accel - peaks Longitudinal accel - peaks
Skin temp - average GSR - average
Transverse accel - average Longitudinal accel - average
Near-body temp - average Transverse accel - MAD Longitudinal accel - MAD
Step Counter Number of steps taken in that minute Forward accel - average Average values for sensor.
Forward accel - MAD Mean Absolute Difference or total acceleration
Lying down 0 = negative, 1 = positive
Sleep 0 = negative, 1 = positive
Physical Activity 0 = negative, 1 = positive if they were physically active in that minute
Energy expenditure kcal/min
Sedentary 0 = negative, 1 = positive (Sedentary< 3.0 METS) Moderate 0 = negative, 1 = positive (Moderate 3.1 - 6.0 METS)
Vigorous 0 = negative, 1 = positive (6.1 - 9.0 METS) Very Vigorous 0 = negative, 1 = positive ( > 9.1 METS)
METs Metabolic Equivalent Tasks (1.0 MET ~ rest)
Timestamps 0 = negative, 1 = positive if timestamp was pressed druing that minute
Annotations Any information that was entered into software to annotate length or type of activity
3-axis accelerometer: Transverse, Forward, and Longitudinal. Peaks are the number of turning points
or the amount of jitter in the accelerometer
Average values for sensor.
Mean Absolute Difference or total acceleration
SenseWear Professional - Explanation of Channels in Export
Mini Armband
Time (GMT-04:00) Time in reference to Greenwich Mean Time Transverse accel - peaks
Forward accel - peaks Longitudinal accel - peaks
Skin temp - average GSR - average
Transverse accel - average Longitudinal accel - average
Near-body temp - average Transverse accel - MAD Longitudinal accel - MAD
Step Counter Number of steps taken in that minute Forward accel - average Average values for sensor.
Forward accel - MAD Mean Absolute Difference or total acceleration
Lying down 0 = negative, 1 = positive
Sleep 0 = negative, 1 = positive
Physical Activity 0 = negative, 1 = positive if they were physically active in that minute
Energy expenditure kcal/min
Sedentary 0 = negative, 1 = positive (Sedentary< 3.0 METS) Moderate 0 = negative, 1 = positive (Moderate 3.1 - 6.0 METS)
Vigorous 0 = negative, 1 = positive (6.1 - 9.0 METS) Very Vigorous 0 = negative, 1 = positive ( > 9.1 METS)
METs Metabolic Equivalent Tasks (1.0 MET ~ rest)
Timestamps 0 = negative, 1 = positive if timestamp was pressed druing that minute
Annotations Any information that was entered into software to annotate length or type of activity
3-axis accelerometer: Transverse, Forward, and Longitudinal. Peaks are the number of turning points
or the amount of jitter in the accelerometer
Average values for sensor.
Mean Absolute Difference or total acceleration
SenseWear Professional - Explanation of Channels in Export
Mini Armband
En metode til at måle påvirkninger af det sympatiske nervesystem.
Det sympatiske nervesystem system gør det muligt for kroppen at reagere hurtigt og målrettet på fare.
GSR-værdier er udtryk for svedkirtlernes aktivitet, hvilket indikerer graden af psykologisk eller fysiologisk ‘arousal’, dvs. opstemtheds- eller beredskabsniveauet.
GSR-værdier er dermed et mål for intensiteten af en oplevelse.
Men GSR-værdier kan ikke sige noget om oplvelsens kvalitet; ej heller om oplevelsen er positiv eller negativ.
Galvanic Skin Response (GSR)
Psychofysiologiske målemetoder har væsentlige begrænsninger og kan ikke stå alene.
“[T]here is seldom a one-to-one relation, such that a given individual physiological event would be
associated with one and only psychological construct, and vice verca.”
Ravaja (2009, s. 196)
Mixed Method Approach
Metodetriangulering
Affektiv respons
Psykofysiologiske målinger via BodyMedia-sensor (GSR)
Observeret adfærd
Tidsregistrering af informanter mht., hvornår de ankommer til og forlader de enkelte
lydinstallationer
Kognitiv vurdering
Spørgeskemaundersøgelse af informanternes retrospektive bedømmelser af udvalgte
lydinstallationer
Dataindsamling
‘Jagten’ på informanter
Presentation af forskerhold og forskerprojekt
Redegørelse for procedure
Samtykkeerklæring
Plan over deludstillingen
!
!
!
November!2012!
Informed)consent)
Dear!Prospective!Study!Participant, June!2012
We!would!like!to!invite!you!to!participate!in!a!study!of!audiences’!emotional!experiences!with!interactive!
features!of!media!art.!The!study!is!a!part!of!the!research!project!at!Aalborg!University,!Denmark.!Our!goal!is!
to!learn!how!the!possibility!of!interaction!influences!the!emotion,!how!the!interactive!devices!work,!and!if!
the!interaction!makes!a!difference!for!the!experience. You!are!being!asked!to!take!part!because!you!are!a!
visitor!of!The!Unheard!AvantKGardes!(in!Scandinavia),!a!special!section!at!the!Sound!Art!Exhibition,!ZKM!
Zentrum!für!Kunst!und!Medienteknologie!in!Karlsruhe.!!
In!the!study,!we!are!interested!in!how!you!respond!emotionally!to!the!interactive!devices!of!the!special!
section,!and!so!we!use!data!from!sensors. You!will!be!asked!to!wear!an!armband!while!you!watch!or!
interact!with!the!exhibited!objects.!After!that!you!will!be!asked!you!to!fill!out!a!questionnaire!concerning!
your!experience.!The!armband!is!attached!on!the!back!of!your!upper!left!arm!in!contact!with!your!skin!and!
held!securely!in!place!by#a#Velcro#strap.!When!adjusted!to!a!comfortable!fit!you!can!cover!the!sensor!by!
your!clothes!if!you!like!(e.g.!a!shirt,!a!sweater!or!a!jacket).
There!are!no!significant!risks!associated!with!participating!in!this!study.!Analysis!and!post!market!
surveillance!indicate!that!risks!of!using!the!armband!are!extremely!low.!The!most!frequently!reported!
health!risk,!occurring!in!less!than!1%!of!users,!is!a!mild!to!severe!skin!irritation!resulting!from!wearing!the!
armband.!Skin!irritation!may!occur!for!individuals!with!highly!sensitive!skin!or!for!those!with!a!specific!
allergy!to!materials!used!in!the!armband!and/or!strap.!
You!may!not!receive!any!direct!benefit!from!taking!part!in!this!study,!but!the!study!may!help!us!find!ways!
to!make!interactive!devices!of!work!of!art!motivating!and!useful.
We!will!not!collect!(and!thus!will!not!store)!your!name!or!any!other!personally!identifiable!data!as!part!of!
this!study.!Your!answers!to!the!interviewer!will!be!identified!only!by!code,!such!as!participant!number,!sex,!
age!and!nationality.
Participation!is!entirely!voluntary.!Your!decision!to!participate!or!not!will!not!affect!your!relationship!with!
the!researchers,!with!the!ZKM!Zentrum!für!Kunst!und!Medienteknologie,!or!with!Aalborg!University!in!any!
way.!If!you!have!concerns!or!problems!about!your!participation!in!this!study!or!your!rights!as!a!research!
subject,!please!contact:!
If!you!have!questions!about!the!study!itself,!please!contact:!
Anders!Bonde,!Aalborg!University,!Department!of!Communication!and!Psychology,!Teglgårds!plads!1,!DKK 9000!Aalborg,!Denmark,!phone:!+45!9940!9032,!eKmail:!abonde@hum.aau.dk!
Sincerely,!
Anders!Bonde,!Ph.D.,!Associate!Professor!
Department!of!Communication!and!Psychology!
Aalborg!University!
Denmark!
Department of Communication and Psychology
Kroghstræde 3 9220 Aalborg Øst Denmark
Tlf. +45 9940 9940 Fax +45 9815 9434
kommunikation@hum.aau.dk www.kommunikation.aau.dk
!
!
!
November!2012!
Informed)consent)
Dear!Prospective!Study!Participant, June!2012
We!would!like!to!invite!you!to!participate!in!a!study!of!audiences’!emotional!experiences!with!interactive!
features!of!media!art.!The!study!is!a!part!of!the!research!project!at!Aalborg!University,!Denmark.!Our!goal!is!
to!learn!how!the!possibility!of!interaction!influences!the!emotion,!how!the!interactive!devices!work,!and!if!
the!interaction!makes!a!difference!for!the!experience. You!are!being!asked!to!take!part!because!you!are!a!
visitor!of!The!Unheard!AvantKGardes!(in!Scandinavia),!a!special!section!at!the!Sound!Art!Exhibition,!ZKM!
Zentrum!für!Kunst!und!Medienteknologie!in!Karlsruhe.!!
In!the!study,!we!are!interested!in!how!you!respond!emotionally!to!the!interactive!devices!of!the!special!
section,!and!so!we!use!data!from!sensors. You!will!be!asked!to!wear!an!armband!while!you!watch!or!
interact!with!the!exhibited!objects.!After!that!you!will!be!asked!you!to!fill!out!a!questionnaire!concerning!
your!experience.!The!armband!is!attached!on!the!back!of!your!upper!left!arm!in!contact!with!your!skin!and!
held!securely!in!place!by#a#Velcro#strap.!When!adjusted!to!a!comfortable!fit!you!can!cover!the!sensor!by!
your!clothes!if!you!like!(e.g.!a!shirt,!a!sweater!or!a!jacket).
There!are!no!significant!risks!associated!with!participating!in!this!study.!Analysis!and!post!market!
surveillance!indicate!that!risks!of!using!the!armband!are!extremely!low.!The!most!frequently!reported!
health!risk,!occurring!in!less!than!1%!of!users,!is!a!mild!to!severe!skin!irritation!resulting!from!wearing!the!
armband.!Skin!irritation!may!occur!for!individuals!with!highly!sensitive!skin!or!for!those!with!a!specific!
allergy!to!materials!used!in!the!armband!and/or!strap.!
You!may!not!receive!any!direct!benefit!from!taking!part!in!this!study,!but!the!study!may!help!us!find!ways!
to!make!interactive!devices!of!work!of!art!motivating!and!useful.
We!will!not!collect!(and!thus!will!not!store)!your!name!or!any!other!personally!identifiable!data!as!part!of!
this!study.!Your!answers!to!the!interviewer!will!be!identified!only!by!code,!such!as!participant!number,!sex,!
age!and!nationality.
Participation!is!entirely!voluntary.!Your!decision!to!participate!or!not!will!not!affect!your!relationship!with!
the!researchers,!with!the!ZKM!Zentrum!für!Kunst!und!Medienteknologie,!or!with!Aalborg!University!in!any!
way.!If!you!have!concerns!or!problems!about!your!participation!in!this!study!or!your!rights!as!a!research!
subject,!please!contact:!
If!you!have!questions!about!the!study!itself,!please!contact:!
Anders!Bonde,!Aalborg!University,!Department!of!Communication!and!Psychology,!Teglgårds!plads!1,!DKK 9000!Aalborg,!Denmark,!phone:!+45!9940!9032,!eKmail:!abonde@hum.aau.dk!
Sincerely,!
Anders!Bonde,!Ph.D.,!Associate!Professor!
Department!of!Communication!and!Psychology!
Aalborg!University!
Denmark!
Department of Communication and Psychology
Kroghstræde 3 9220 Aalborg Øst Denmark
Tlf. +45 9940 9940 Fax +45 9815 9434
kommunikation@hum.aau.dk www.kommunikation.aau.dk
Procedure
Påføring af sensor Instruktion
Begyndelse af tur
Spørgeskema
Experience)of)media)art)at)ZKM)
Questionnaire++
1. Looking at the pictures of the art installations in this part of the exhibition, are there any of them that you have found particularly interesting, stimulating or provoking?
Yes No
! !
2. If Yes, which number(s)? You may mention one or as many as you like.
________________________________________________________________________________
3. We will ask you to think of one of the installations above and use the following adjective pairs (in German) to rate your emotional state while watching or interacting with it.
Some of the pairs may seem unusual, but you’ll probably feel more one way about the installation than another.
So, for each pair, place a check mark close to the adjective, which you believe describes your reaction better. The more appropriate the adjective seems, the closer you should put your check mark to it.
Unhappy ! ! ! ! ! ! ! ! ! Happy
Annoyed ! ! ! ! ! ! ! ! ! Pleased
Unsatisfied ! ! ! ! ! ! ! ! ! Satisfied
Melancholic ! ! ! ! ! ! ! ! ! Contented
Despairing ! ! ! ! ! ! ! ! ! Hopeful
Bored ! ! ! ! ! ! ! ! ! Relaxed
Relaxed ! ! ! ! ! ! ! ! ! Stimulated
Calm ! ! ! ! ! ! ! ! ! Excited
Sluggish ! ! ! ! ! ! ! ! ! Frenzied
Dull ! ! ! ! ! ! ! ! ! Jittery
Sleepy ! ! ! ! ! ! ! ! ! Wideawake
Unaroused ! ! ! ! ! ! ! ! ! Aroused
Sex ! Male ! Female
Age ________ Nationality _______________________
Have you previously visited this part of the exhibition? ! Yes ! No
Date and time __________________________________ Participant number ____________
Department of Communication and Psychology
Kroghstræde 3 9220 Aalborg Øst Denmark
Tlf. +45 9940 9940 Fax +45 9815 9434
kommunikation@hum.aau.dk www.kommunikation.aau.dk
Spørgeskema
(Både på tysk og på engelsk)
! !
Experience)of)media)art)at)ZKM)
Questionnaire++
1. Looking at the pictures of the art installations in this part of the exhibition, are there any of them that you have found particularly interesting, stimulating or provoking?
Yes No
! !
2. If Yes, which number(s)? You may mention one or as many as you like.
________________________________________________________________________________
3. We will ask you to think of one of the installations above and use the following adjective pairs (in German) to rate your emotional state while watching or interacting with it.
Some of the pairs may seem unusual, but you’ll probably feel more one way about the installation than another.
So, for each pair, place a check mark close to the adjective, which you believe describes your reaction better. The more appropriate the adjective seems, the closer you should put your check mark to it.
Unhappy ! ! ! ! ! ! ! ! ! Happy
Annoyed ! ! ! ! ! ! ! ! ! Pleased
Unsatisfied ! ! ! ! ! ! ! ! ! Satisfied
Melancholic ! ! ! ! ! ! ! ! ! Contented
Despairing ! ! ! ! ! ! ! ! ! Hopeful
Bored ! ! ! ! ! ! ! ! ! Relaxed
Relaxed ! ! ! ! ! ! ! ! ! Stimulated
Calm ! ! ! ! ! ! ! ! ! Excited
Sluggish ! ! ! ! ! ! ! ! ! Frenzied
Dull ! ! ! ! ! ! ! ! ! Jittery
Sleepy ! ! ! ! ! ! ! ! ! Wideawake
Unaroused ! ! ! ! ! ! ! ! ! Aroused
Sex ! Male ! Female
Age ________ Nationality _______________________
Have you previously visited this part of the exhibition? ! Yes ! No
Date and time __________________________________ Participant number ____________
Department of Communication and Psychology
Kroghstræde 3 9220 Aalborg Øst Denmark
Tlf. +45 9940 9940 Fax +45 9815 9434
kommunikation@hum.aau.dk www.kommunikation.aau.dk
