This interactive piece is an exploration of the use of gestures to manipulate digital objects, where viewers can control elements of a responsive weather scene with their hands. Each gesture enables a different mode of interaction, and cursor icons that track the viewers’ hands change to reflect the detected gestures. The program is a web app that runs in the browser, powered by p5.js and using Handsfree.js for hand gesture recognition.

Jacobs Institute for Design Innovation
Berkeley, CA