VR LULLABY MACHINE
A personalised multi-sensory feedback loop controlled by brainwaves.
Audiences wear EEG and VR headsets – their neural function controls the sights, sounds and aromas in an immersive performance space, their brainwaves also provide haptic (touch) and gustatory (taste) feedback. Inter-Dream places the human body at the centre of a digital experience involving all five senses.
Poor sleep has been acknowledged as an increasingly prevalent global health concern, however, how to design for promoting sleep is relatively underexplored. We propose that neurofeedback technology may potentially facilitate restfulness and sleep onset, and we explore this through the creation and study of Inter-Dream, a novel multi-sensory interactive artistic experience driven by neurofeedback.
This artwork/research project investigates human-computer integration in relation to pre-sleep. We created a feedback loop, forming a cycle of information that is shaped by a collusion between neural function and real-time art. The feedback loop involves sight, sound, touch, smell and taste.
An Inter-Dream participant reclines on an interactive resting platform. They wear EEG and VR headsets. EEG headsets read the electrical activity that occurs in the brain. The participant uses their brain’s function to animate abstract visuals that are projected onto media surfaces at the rear of the space. A version of these projected visuals is also provided in VR so that participants can view the visuals with minimal physical effort. Their neural function also triggers audio loops as well as provides aromatic and gustatory feedback.
When participants hear and see the audio-visuals, and when they feel, taste and smell the sensory stimuli, this has an impact on their neural function. This impact stimulates new brain function and this changes the audio, visuals, aromas, gustatory and haptic effects. Therefore, a cyclical feedback loop is created between the human body and a real-time reactive multi-sensory environment. Our studies show that engaging with this system may assist participants to prepare for sleep.
Betty Sargeant and Justin Dwyer
Andrew Ogburn ~ Music Composer
Research lead ~ Nathan Semertzidis
Thanks to: Florian ‘Floyd’ Mueller and the Exertion Games Lab, Centre for Game Design Research, RMIT University