Published On Dec 13, 2018
Semi-Conductor is an experiment that lets you conduct your own orchestra through your browser. You can move your arms to change the tempo, volume, and instrumentation of a piece of music. Check it out here: https://semiconductor.withgoogle.com
It uses PoseNet, a machine learning library that works in the browser using Tensorflow.js, to map out your movements through your webcam. An algorithm plays along to the score as you conduct, using hundreds of tiny audio files from live recorded instruments.
show more