You can control a Mac cursor with hand gestures using ClapSnap's Air Mouse: allow camera access, turn Air Mouse on, then point to move, pinch to click or drag, and scroll with three fingers or your pinky. Tracking runs on your Mac with Apple's Vision framework, and even lighting on your hand makes it most accurate.
A webcam and on-device hand tracking can stand in for a mouse. Here is how it works on a Mac and how to get it accurate.
How webcam hand tracking works
The camera sends frames to Apple's Vision framework, which finds the points of your hand: fingertips, knuckles and wrist. Software turns the position of your index finger into a cursor position and specific finger shapes into clicks and scrolls. In ClapSnap's Air Mouse all of this runs on your Mac.
The gestures
| Gesture | Action |
|---|---|
| Point with your index finger | Move the cursor |
| Pinch index finger and thumb | Click; hold to drag |
| Pinch index and ring finger | Right-click |
| Three fingers up | Scroll up |
| Pinky out | Scroll down |
Tips for accurate tracking
- Light your hand evenly. A lamp in front of you beats a bright window behind you.
- Keep your hand in frame at about the distance you sit from the screen.
- Use a plain background if tracking jumps, so your hand stands out.
- Raise smoothing if the cursor shakes, and lower it if it lags.
- Turn off gestures you do not use, such as right-click, to avoid accidental actions.
Built-in alternatives
macOS also has a head pointer and dwell clicking under Accessibility settings, and Voice Control for running the Mac by voice. See the best hands-free tools for Mac for how they compare.
Set up hand-gesture control
- Install ClapSnap. Download ClapSnap and open it from the menu bar.
- Allow the camera. Allow camera access when macOS asks. Frames are analysed on your Mac and never saved.
- Turn on Air Mouse. In ClapSnap Settings, switch Air Mouse on.
- Calibrate. Raise your hand where the camera sees it, point, and adjust sensitivity until a comfortable movement crosses the screen.
Questions
Can a webcam really replace a mouse?
For pointing, clicking, dragging and scrolling, yes. For pixel-precise work like photo retouching, a mouse or tablet is still more precise.
Does it work in the dark?
The camera needs to see your hand, so some light on it is required. A desk lamp is enough.
Try ClapSnap. Double clap or snap to open your whole Mac workspace, and steer the cursor with your hand. Pay what you want, minimum €8, one-time purchase, with a 14-day refund. Get ClapSnap