MULTI SENSORY PERFORMANCE & INSTALLATION ~ under development

A human-computer sensory feedback loop.

This video is a compilation of PluginHUMAN’s previous brainwave controlled installations and performances.

the loop places the human body at the centre of a digital experience. This project investigates human-computer integration. We create a feedback loop between people and machines, forming a cycle of information that is shaped by a collusion between active brainwaves and real-time generative music and art. the loop creates a personalised human-computer integrated sensory feedback loop.

the loop features two performers: a live programmer, and a dancer. The dancer’s live brainwave function controls the audio-visuals. Their movement is tracked and their body is projection mapped with imagery generated from their live brainwaves. Their brain function is also visualised and projected onto a large media surface at the rear of the stage. This real-time performance combines brainwave-reactive audio, live movement, computer programming and brainwave-reactive animated visuals.

Our EEG headset reads electrical activity that’s occurring inside the dancer’s brain, and sends this data to our custom designed system. Our system transforms real-time brainwaves into abstract audio-visuals, it also provides aromatic, olfactory and haptic feedback to the dancer. This process is partially automated and partially the result of live programming. the loop’s audio, visuals, aromatic, gustatory and haptic feedback responds and changes in reaction to the dancer’s real-time brain function.

the loop is currently being developed, it features the music of Andrew Ogburn and PluginHUMAN and it is being directed by the internationally renowned theatre maker Dr Kate Hunter. Dr Hunter is a performance expert who specialises in neuroscience, the body and human senses (https://www.katehuntertheatre.com/about/).

the loop places the human body at the centre of a digital experience. the loop’s sensory environment involves sight, sound, smell, taste and touch. The dancer’s brainwaves generate audio visuals, their brainwave function also controls a vibrating vest that they are wearing and effects the release of aromatic and gustatory stimuli. When the dancer hears and sees the audio-visuals, and when they feel, taste and smell the sensory stimuli that is triggered from their brainwaves, this has an effect on their brainwave function and this effect changes the audio, visuals, aromas, gustatory and haptic effects. Therefore, a cyclical feedback loop is created between the human body and a reactive sensory environment.

Betty Sargeant ~ Creative and Technical Director + Artist

Justin Dwyer ~ Creative Technical Director + Artist

Andrew Ogburn + Justin Dwyer ~ Music Composer

Dr Kate Hunter ~ Director

RELATED PROJECTS:

PluginHUMAN DREAM 2.2 - Interactive brainwave art installation. Betty Sargeant and Justin Dwyer.
DREAM 2.2
PluginHUMAN - The Playground, participatory art. Betty Sargeant and Justin Dwyer.
THE PLAYGROUND
PluginHUMAN Brain Art Workshops. Betty Sargeant and Justin Dwyer.
BRAIN ART