Potion by [drgn]
Live Performance @ Nordlicht 2014 / Bremen, Germany. Scored 3rd place in the "Wild" Competition. Setup : Microsoft Kinect 1 on a NVIDIA Jetson TK1. Software : Moodshades 0.4 Dependencies: LibFreenect, OpenAL, OpenGL, Libusb ---------------------------------------------------------- Youtube Link : https://www.youtube.com/watch?v=fN_zsTROvls ---------------------------------------------------------- Some details : The Kinect delivers depth data @ 30fps, so there is a latency of at least 33ms - 66ms (frameexact interaction is nearly impossible). The Kinect also processes the data in about 100ms. Moodshades uses a stable detection of trigger movements which needs 3 frames (66ms). The overall latency is about 220ms and sometimes varies. This makes it VERY hard to play live along a scripted beat sequence, even if you perfectly trigger the right regions at the right pace. The potion effect is based on a WebGL / Javascript effect from Flexi23, which i ported to OpenGL / C++ for Linux to work on the Jetson Some more details : I arrived at the party with literally nothing done and at least managed to show "something": The first effect part (snow particles, aligning to the contures) worked on the last minute test (thx shd) but refused to run on the presentation. So many ideas (harp play, different drum sets, effect parameter via xyz position of a hand, chiptune emulation, major/minor /septime accord interpolation, multiple shader stage effects, gesture controlled script instead of autoscript) could not be finished, just because of no time. In the end, i am very happy that i left some impression and even won a little trophy =)
[ back to the prod ]