Making our HoloLens robot dance!

As promised, way back when we started this series of posts looking at various Windows Holographic platform capabilities to build an app that displays an animated ABB industrial robot inside HoloLens, here’s the part where we make it dance. 🙂

Dancing robot

During Autodesk Switzerland’s 25th anniversary party in late October, people will be able to give the app a try and hopefully see the robot dancing along to whatever tunes the DJ plays. Let’s talk a bit about how the system works…

Quite early on I decided against doing the additional audio processing directly on the HoloLens device itself. So I wanted to set the HoloLens up as a TCP server that a client could connect to and send messages to whenever it detected a beat.

Let’s take a look at what was needed on the HoloLens for this…

The big challenge here is that Unity’s C# implementation is based on Mono, which doesn’t yet have async/await implemented. And as Universal Windows Apps (UWPs) live in a sandbox, it’s not…

Read more

Leave a Comment