These are examples of songs put through an audio-reactive TouchDesigner project I created.
The shape and color are controlled by the volume and frequency of the audio.
Staying Alive had players dance by pushing their open hands toward the Kinect (away from their body) on the beat of the Bee Gees' song.
The colors of their silhouette would change based on how well they kept with the beat.
This was to get players to move their arms in a "compression" motion at the correct pace used during CPR so it would be easier or automatic if they ever needed to do CPR.
The image is from testing the color scoring system, not actual gameplay.
The intro screen of Wave, a Simon-like game where players have to use proprioception and movement to play.
The player's hand movement is detected by an XBox Kinect.
Here, a player waves and is greeted by the game.
These "noise lines" would be projected onto a wall or dome or used as a loading/inactive screen to calm those around it.
Four examples of working with 3D surface operators or "SOPs" in TouchDesigner.
These were made using modifications of parameters and can be exported into models to be used in other programs such as Unity.
The "party sphere" shape can be controlled by noise or hand movements detected by an XBox Kinect.