What does ︎ mean to a bat?
A virtual reality experience of being a bat in Time Square using echolocation.
Category: VR
Made in: 2020 Spring
Tools:
Unity, Cinema4D, Vuforia, Oculus Rift
Advisors:
Marina Zurkow,
Sarah Rothberg
What Does ︎ Mean To A Bat? is a part of an on-going artistic research project A Look At Looking (through not looking), which examines how human’s perceived realities have been mordenized by spectacle through vision-based experience.
Trailer
Abstract
Our living experiences have been reconfigured by ubiquitous digital contents in hypermedia spaces. I wanted to explore what it is like for another being to experience a human-made hypermedia space that is saturated with symbols, signs and spectacles.
Inspired by Thomas Nagel’s essay What is it like to be a bat?, I chose bat as the metaphor. Bat shares a similar cognitive mechanism as human beings but has a very distinctive biological construction and perceptual experience. Bats are mammals, and are assumed to have conscious experience. It is a highly evolved animal who actively uses biological sensors just like human beings. Bats mainly use echolocation to navigate and perceive objects.
Through this experience, I hope to let people experience our human-made world from another being’s perspective, and reflect on how our human experience is just one kind of experiences in nature.
Inspired by Thomas Nagel’s essay What is it like to be a bat?, I chose bat as the metaphor. Bat shares a similar cognitive mechanism as human beings but has a very distinctive biological construction and perceptual experience. Bats are mammals, and are assumed to have conscious experience. It is a highly evolved animal who actively uses biological sensors just like human beings. Bats mainly use echolocation to navigate and perceive objects.
Through this experience, I hope to let people experience our human-made world from another being’s perspective, and reflect on how our human experience is just one kind of experiences in nature.
“Echolocation affords an individual with the unique ability to produce the energy that ‘excites’ the world around them.”
--- Schörnich, Nagy & Wiegrebe, 2012
Storyboard
It is a semi-narrative, semi-interactive experience. User will follow a bat’s voice-over narration through out the experience, and interact with the environment through echolocation.
There are three chapters in this experience:
Chapter I. Born To Be A Bat
It’s a scene where the bat is born --- a cave and a park. Users will feel being a bat in the nature, learn how to echolcate, fly and eat moths
Chapter II. Apple Tree
In this animated scene, the bat will have a conversation with the Universe about its previous life as a human in its dream.
Chapter III. Looking for an Apple
In this scene, users will wonder around Time Square, trying to look for the hint from the Universe about its previous life as a human.
The narration style is inspired by Jim Trainor’s animation The Bats.
There are three chapters in this experience:
Chapter I. Born To Be A Bat
It’s a scene where the bat is born --- a cave and a park. Users will feel being a bat in the nature, learn how to echolcate, fly and eat moths
Chapter II. Apple Tree
In this animated scene, the bat will have a conversation with the Universe about its previous life as a human in its dream.
Chapter III. Looking for an Apple
In this scene, users will wonder around Time Square, trying to look for the hint from the Universe about its previous life as a human.
The narration style is inspired by Jim Trainor’s animation The Bats.
Visual Design
The visual style is based on the research of bat’s perception.
Bats have a cross-modal perception, which means they dynamically switch between the modalities. It uses vision for large objects domain and echolocation for small objects domain.
I intended to represent these two modes of perception using different visual language.
Bats have a cross-modal perception, which means they dynamically switch between the modalities. It uses vision for large objects domain and echolocation for small objects domain.
I intended to represent these two modes of perception using different visual language.
Bat’s Visual Perception
Bat has dichromatic colour vision and UV vision. It can see things especially under dim light environment.
Bat has dichromatic colour vision and UV vision. It can see things especially under dim light environment.
Bat’s Echolocationg Perception
When a bat is echolocating, it construct streams of sound data into real-time acoustic-image motion pictures, which is similar to LIDAR scanning.
When a bat is echolocating, it construct streams of sound data into real-time acoustic-image motion pictures, which is similar to LIDAR scanning.
Artistic Visual Reference for echolocating perception
Visual
Vision Perception
Mono-tone
Sensitive to light
Echolocating Perception
Point cloud as acoustic-image in brain
Players ‘activate’ the point cloud with sound
Sound wave travels
Interaction
In this experience, users will perceive and interact with the environment through echolocating, and move around through flying.
Echolocation simulation
User makes sound to activate the environment. When users make sound, they will hear bat chirping in their headset as their “voice”.
The bat’s sonar beam can be likened to an auditory flashlight. There are two variables controlling the “echolocating” effects:
Echolocation simulation
User makes sound to activate the environment. When users make sound, they will hear bat chirping in their headset as their “voice”.
The bat’s sonar beam can be likened to an auditory flashlight. There are two variables controlling the “echolocating” effects:
- The higher pitch, the narrower “field of view” but the more points be acitvated
- The higher volume, the more points to be activated
Fly simulation
User move hands towards the desired direction to fly.
Installation
While player will perceive through bat’s senses, audience without headsets will see the human-version of the view on the screen.
Player’s View
Audience’s view