AndroidMoCap

Facial motion capture on Android, streamed live to Blender, Unity, VBridger, or directly to VTube Studio over the local network. The phone becomes a standalone facial tracker: no third-party app, no cloud service, just the front camera and a blendshape stream sent to the PC.

Born from the observation that there is currently no maintained Android alternative to MeowFace (abandoned, its underlying tracking library having been deprecated): this project aims to fill that gap, with an Android-specific constraint that no app in this space can fully erase -- the lack of a dedicated depth sensor (unlike iPhone/TrueDepth) caps the achievable accuracy, regardless of software quality.

Personal project, developed and maintained by a single person, in active development.

Features Automatic best-pipeline selection based on device capabilities (GPU/CPU, RAM, cores, ARCore support) -- nothing to configure, the app adapts from high-end to entry-level, with automatic GPU → CPU fallback if the GPU delegate fails. 52 ARKit blendshapes via MediaPipe Face Landmarker, plus gaze-direction estimation (not natively provided by MediaPipe, reconstructed from eye blendshapes). Triple network output: VMC/OSC protocol (Blender, Unity), iFacialMocap/UDP protocol (VBridger), and direct VTube Studio integration via its own proprietary Plugin API (VTube Studio doesn't accept VMC/OSC as input). On-demand neutral-pose calibration, with a countdown. Minimal HUD readable regardless of phone orientation, detailed settings (displayed-blendshape selection, low-battery threshold, power-save mode, 478-point tracking-mesh debug overlay). Power-save mode: dims the screen and cuts the camera preview after inactivity without interrupting tracking or sending -- designed for long streaming sessions with the phone sitting away from the user. Semi-automatic update check: compares against the latest GitHub Releases tag and links directly to it -- no silent install, just a heads-up. Per-blendshape weight adjustment: fine-tune individual blendshapes (e.g. an over- or under-reactive one) from Settings > Blendshapes. Requirements Android 11 (API 30) or later. On Android 17 (API 37) or later, the app asks for the local network permission the first time you connect: Android requires it for any traffic on your LAN, and without it no protocol can reach your PC. A physical device with a front camera -- the Android emulator doesn't provide a usable camera feed for tracking. Phone and receiving PC on the same local Wi-Fi network.

License

PolyForm Shield