Introducing Shark Attack

Shark Attack is an Audio Visualization Program which uses the Leap Motion Sensor, the Java midi library, After Effects animations and PNG sequences. By tracking hand movements and gestures through the Leap, you can control and bend the pitch and volume of the project which has corresponding visual elements. Controling audio and visuals with your hands creates a surreal and soothing experience. Shark Attack was intended to be viewed in a planetarium, but has also been displayed projected on a flat ceiling.

View the Project

The Team

Jackie Valori


Communication Design

Underwater Experience Designer and Expert Sea Creature Animator

Troy Malia


Computer Science

Wekinator Wizard and Shark Choreographer

Josh Peters


Computer Science

Midi Master and Processing Professional

Research

  • Audio Visualization on the Planetarium
  • Use the Leap Motion Sensor for control
  • Use the Wekinator to read Leap output data in Processing
  • Wekinator outputs link to Java Midi Library in Processing for audio
  • Wekinator outputs link to position of graphic elements in Processing
  • Create a visualization that doesn't use a waveform or static shapes
  • Create graphics that can be manipulated in real time using Processing
  1. Planetary Visualizer using planets moving through space is awesome. Having things represented by stars, planets and moons is cool. (http://planetary.bloom.io/)
  2. Oscillate This type of string visual is really cool. Acts almost like the strings of a guitar vibrating with sound. Their movements create dust that lingers. Not sure if this type of visual would be possible with real time manipulation of audio. (https://vimeo.com/65475425)
  3. Shanghai 3D Projection Use of the dome is cool. Simple light streaks that move, change shape, and radiate from the center correspond to the audio. (https://www.youtube.com/watch?v=X6vvbffy-dk)
  4. Bluewater Dome Mapping Dome appears to open up to reveal space. We could have an animation trigger when the Leap detects hands that makes the dome appear to open and reveal the visual. (https://www.youtube.com/watch?v=zJoKm_JXpLw)
  5. Audio Vis in After Effects Ways of creating frequency based audio visualization in after effects. Color and shape can be manipulated. Might be helpful for a background beat, but probably not applicable to real time manipulation. (https://www.youtube.com/watch?v=qc6ugudxLpI)
  6. Space Echo by Cosmic Lab Use of the dome is cool. The way everything travels between the edges and the center. Looks like starts falling down at you from the sun. Immersive expereince is created. (https://www.youtube.com/watch?v=N9U-9IsMF1o)
  7. Magic Music Visuals Allows graphics to move, rotate, and scale according to music beat and midi control in real time. 3D models can be manipulated with real time audio input. (https://magicmusicvisuals.com/)
  8. Relentless: The REV by Robert Hodgin Uses a shape that comes to life corresponding to beat of music. Form opens up, releases light and other elements. Turns and flies through space which is cool. Opening and releasing light is my favorite part. (http://roberthodgin.com/portfolio/work/relentless-the-rev/)
  9. Underwater Light Rays Animation of light rays could shine down from center of dome to create 3D immersive experience. (https://www.youtube.com/watch?v=hivNRADqG0o&t=36s)
  10. O (Omicron) Uses the dome in a cool way. Dome is divided into segments that light up in sequence determined by the beat. (https://vimeo.com/41486619)
  11. Bioluminescent Jellyfish AnimationThe organic way in which the jelly fish float and move could be a good way to represent information similar to a waveform. Luminescence levels could also be an effective visualization. (https://www.youtube.com/watch?v=kLTRxsOYPiw)
  • Riley
  • Riley is an art major at Kutztown. She enjoys visiting art gallaries and museums. Riley enjoys videography and photography as a hobby.
  • Riley enjoys art installations and would be especially interested in an installation that could be interacted with. Being able to interact with and control the installation would be exciting for Riley. Riley would also have fun creating video of and audio/visual working together.
  • Gigi
  • Gigi loves music but is not a musician. She has never worked with a midi before.
  • Manipulating the audio of the installation should be easy and intuitive so that anyone can enjoy participating in the installation without the furstration of not understanding how to use the parts that make it work.
  • Helena
  • Helena is the mother of a college student and a high school student. She is not particularly tech-savvy, but enjoys the things her kids are interested in.
  • Helena would check out the installation because it is something that interests her kids. Because she is not super tech-savvy, the installation would need to be simple and easy to use for it to be enjoyable for Helena.
  • Alex
  • Alex is a musician. He likes mixing music and working with midis. Alex is in a band that sometimes uses a midi for their music and performances.
  • Alex is familiar with working with traditional midis. Being able to work with a midi in a new way, using only hand gestures and movements, would be exciting and intriguing to Alex. This type of midi control could be cool for Alex’s band in their music.
  • Joe
  • Joe loves video games. He likes hands on things that give a fully immersive experience.
  • Joe would enjoy the installation because he would have hands-on control of the environment. The audio/visual synergy would create a compelling, full-immersive experience. The graphic quality of the visuals will be most powerful if the way in which they interact with the audio makes sense to the user.

Development

Interdisciplinary Team Project - Audio Vis from Jackie Valori on Vimeo.