top of page
IMG_0499(1).jpg

Align

Visual-Audio Interaction | Installation | Psychosomatics

The project is a multimedia artwork integrating visuals, audio, and sensor exploring the relationship between cognition and physiology of people with obsessive-compulsive disorder (OCD) or anxiety disorder. Here, the sound represents the cognition, and the visuals represent a balanced self. Adjust the sound to see the visuals being distorted, and manipulate the GSR sensor. which represents the physiological state, to get the visuals integrated again. The whole process simulates a typical dilemma that the patients usually face due to a misalignment of cognition and physiology, and the effort they made to regain the alignment.

IMG_0458(1).jpg
IMG_0477(1).jpg
IMG_0647(1).jpg
IMG_0463(1).jpg
IMG_0468(1).jpg
IMG_0453(1).jpg
IMG_0453(1).jpg
IMG_0666(1).jpg
IMG_0526(1).jpg
IMG_0619(1).jpg
IMG_0479(1).jpg
IMG_0475.JPG
IMG_0653(1).jpg
IMG_0621(1).jpg
IMG_0457(1).jpg
1.png
3.png
IMG_0493(1).jpg
IMG_0495(1).jpg
2.png
IMG_0507(1).jpg
IMG_0672(1).jpg

Motivation

Due to the diagnosis of OCD of a friend, I became gradually knowledgeable    of mental diseases like that. I found that people with OCD or anxiety disorders often experience moments where they feel like they are losing control: they cannot stop thinking or doing something, although they do not want to. Generally, it is believed that a lack or low transmission efficiency of 5-hydroxytryptamine is one of the shared physiological foundations of OCD and many anxiety disorders. Hence, methods such as selective serotonin reuptake inhibitors can significantly relieve anxiety. This phenomenon interests me and makes me think of the pains and misunderstandings by others such misalignment of one’s cognitive intentions and actual physiological situation brings to people with OCD and anxiety disorders. Therefore, I decided to create an artwork which could implicitly inform people of the dilemma the patients face and arouse empathy, understanding, and inclusiveness.

Interviews

I interviewed one person with OCD, one with anxiety disorder, and one who holds both. All of them reported similar feelings of “being not intended to do something while just cannot”. They said that was very conflicting and unsettling, making them live in “an error with clear cognition”, which often exhausted their family members and had them feel guilty.

I collected objects and sound that related to thier lives and diseases. For example, someone said she would think of earphones when talking about her OCD because she was forced to organize her earphone cables meticulously every day.

All objects I collected are:

  • Earphones

  • Chargers

  • Medcines

  • Clothes

  • Wet tissues

  • The Cure for Neurasthenia and Obsessive Thoughts written by Masatake Morita

 

Sound I collected will be described in the “Sound Design” section.

3D Scanning

Models used in the visual part of this project were 3D scanned using Scaniverse and 3D Scanner App and then adjusted in Blender.

Rectangle 98.png
Rectangle 100.png
IMG_0444(1).jpg
微信图片_20260117205507_638_93.jpg
IMG_0426(1).jpg
Rectangle 101.png

Sound Design

The sound was designed from asking the three interviewees sound they mostly concern and was connected in series to mimic a day of a patient with OCD. Most of the sound was recorded by hand.

In orders they are:

 

  • Apple alarm clock playing with Radar

  • Sound of rustling in the quilt

  • Sound of water flow

  • Sound of washing hands

  • Sound of repetitively wiping the body

  • Sound of repetitively placing objects

  • Many people talking in a chaos environment

  • Sound of biting nails

  • Tinnitus sound

  • Sound of train passing by

  • Sound of tearing pills

  • Sound of smoothing the plastic film on the pill

  • Sound of someone spitting

  • Sound of cars’ humming

  • Sound of friction among human bodies

  • Sound of foot kicking the door

  • WeChat call music

  • Sound of friction between garbage bags

  • Sound of throwing garbage bags

  • Sound of an iron spoon hitting an iron bowl

  • Sound of friction between quilts

  • Buzzing sound

Display Design

An establish stand was designed to hold the description board, MIDI, and GSR sensor.

Rectangle 111.png
Group 43.png
IMG_0453(1).jpg

Interaction Process

Sound plays in normal tune with visuals changing with the sound until the audience comes close.

The visuals return to the normal and initial integrated state.

Phase 1.

Phase 2.

Phase 3.

Phase 4.

The audience pushes faders on the MIDI to adjust the sound to whatever tunes they like.

The audience wears the GSR sensor and consciously change the sensor’s reading by regulating the emotion and mental state.

Interaction Logic

Group 43.png

Technology

TouchDesigner Logos - Light.png
ArduinoLogo.png
td图.png
bottom of page