A3DCamera

This is a camera app for 3D photography hobbyists and experimenters. It runs on the Xreal Beam Pro and captures 3D photos exclusively. It does not replace the native camera app.

The app serves as a starting point for special-purpose experimental 3D camera apps using the Xreal Beam Pro and Leia LumePad 2 cameras. It functions as a software playground for experimentation. See the Experiments section below.

Experiments

1. WiFi Remote Control

The app listens for UDP broadcast messages to control the camera. Only shutter control is implemented so far. This feature enables triggering multiple Beam Pro devices simultaneously. It is functional but currently disabled as a work in progress.

The Android app RemoteCapture sends these broadcast messages.

Any Android device running the MultRemoteCamera app (a modified version of the open-source Open Camera app) can also trigger it. The goal is stereo photography with two phones. A local WiFi network is required.

This setup enables stereo base views or lenticular images with multiple Beam Pro cameras.

2. AI Vision

The code includes support for a local network small multimodal language AI model to generate captions for the last photo taken. This feature is currently disabled.

Tests confirm compatibility with the Google gemma-3-12b-it-Q4_K_M.gguf multimodal model, served on a local Ubuntu Linux computer with an Nvidia 3060 GPU. It uses llama-cpp-server as the LLM server with an OpenAI-compatible API.

3. Beam Pro Remote Control and Viewing Using Scrcpy

The screen mirroring tool Scrcpy (https://github.com/Genymobile/scrcpy) displays the Beam Pro screen on a Windows, Linux, or macOS computer. It also enables control of the Beam Pro using the computer's mouse or keyboard—via USB or wirelessly (initialize with USB first). See the Scrcpy documentation for details.

Developer mode must be enabled on the Beam Pro for full functionality.

Example command for wireless Scrcpy from a Windows computer:

C:UsersandyToolsscrcpy-win64-v3.3.3>scrcpy --tcpip=192.168.1.101:5555 --window-borderless --window-x=0 --window-y=0

scrcpy 3.3.3 <https://github.com/Genymobile/scrcpy> INFO: Connecting to 192.168.1.101:5555... INFO: Connected to 192.168.1.101:5555 C:UsersandyToolsscrcpy-win64-v3.3.3scrcpy-server: 1 file pushed, 0 skipped. 3.1 MB/s (90164 bytes in 0.028s) [server] INFO: Device: [XREAL] XREAL X4000 (Android 14) INFO: Renderer: direct3d INFO: Texture: 2400x1080 [server] WARN: Could not get initial audio timestamp INFO: Texture: 1080x2400 INFO: Texture: 2400x1080

This setup displays the A3DCamera app's stereo SBS (side-by-side parallel) output via Scrcpy.

A Processing.org Java sketch can capture the Scrcpy screenshot, extract the SBS stereo image, and convert it to anaglyph for display. Press the space bar to record the sketch output.

See the sketch code in WindowsStereoScreenCapture.pde, along with screenshots of the output and captured images.

Scrcpy forwards keyboard keys to the A3DCamera app for remote control. Click the Scrcpy window (showing the Beam Pro display) to focus it and direct keys there.

This enables viewing the live camera feed and capturing images from another room using a Bluetooth controller or the computer keyboard over WiFi.

Credits

Thanks to Wilbert Brants for the 3D camera setup and operation code example.