Gesture Control For Your Home
An iOS app that uses CoreML hand gesture recognition to control smart home devices — raise your hand to change the lights.
A showcase of how hand gestures can be used to interact with physical objects in your home. The app uses Apple’s CoreML framework to recognise hand gestures from the camera feed, then sends a command over the network based on the predicted gesture.
A Node-RED application acts as a gateway between the app and the smart light. Because it runs self-hosted on the local network — the same network as the smart light — the response speed is near-instant. The demo illustrates how machine learning at the edge can enable entirely new, touchless ways of interacting with our environments.