Overview
Starting with the “Fall in Love” music video for Phantogram… Joshua became interested in writing code with audio and Fast Fourier Transform (FFT) to drive animations. Eventually he’d migrate this code into the 3D space using meshes and GLSL shaders to displace/transform 3D objects in real time using processing. In this talk he’ll be showcasing some of the processes behind this work for… Phantogram, Diplo, Squarepusher, Zola Jesus, Pepsi + Pharrell Williams + SuperBowl 50, and more.
Objective
Showcase processes behind creating real-time audio driven 3D animations using meshes and shaders for concert visuals for screen or projection mapping.
Target Audience
Open to anyone interested in real-time audio driven animation techniques.
Five Things Audience Members Will Learn
- WARNING talk contains strobe and flashing lights / will melt brain and eyeballs
- Real-time audio + FFT animation techniques
- Texture mapping meshes
- Using shaders to distort meshes
- Using OSC + touchOSC to map and control animations
