AnyMate Controller

AI agent, ffmpeg, Python, terminal and animation tooling that drives the AnyMate Android studio over MCP

The brain box for the AnyMate animation studio — as an Android app.

An AI director, a Python runtime, a terminal, video encoding and a full animation design system, all on the phone, all talking to AnyMate over MCP.

What it does AI director Chat with any OpenAI-compatible endpoint (OpenAI, OpenRouter, Groq, Ollama, LM Studio…). The model gets every tool below and can see the phone's canvas as it draws. Resilient tool calls Some gateways reject the standard tool-result format with a 404 ("Function … not found for account …"). The controller detects that, flattens the tool turns and retries, then falls back to plain text — a bad gateway costs a retry, not the conversation. Test endpoint in Settings isolates URL / key / model problems. Model auto-fetch Enter the endpoint and API key, press Fetch models. The list comes from GET /models and one tap selects a model. Chat attachments Attach an image, a video (frames are sampled on device) or the live canvas to any message for vision models. Image → art anim_trace_image turns a picture into vector strokes on the phone (Sobel edges → contours → simplified polylines), or places it as a bitmap. detail controls how many lines survive. Video → animation anim_video_to_animation samples a video into frames and rebuilds it on the phone as a bitmap sequence or as traced line art, then anim_edit_animation retimes, reverses, holds, tints, flips or tweens it. Phone tools Draw, animate, layer, play, snapshot, sprite-sheet and export on the AnyMate app — one undo step per batch, live on the artist's canvas. Python A compact Python 3 subset that runs on device: arithmetic, strings and f-strings, lists/dicts/sets, slicing, comprehensions, functions, classes of builtins and the math, random, time and os modules. Terminal ls, cat, cd, mkdir, rm, cp, mv, grep, find, tree, wc, head, tail, du, stat — with pipes (`a Video Animated GIF and H.264 MP4 encoding, plus probing and frame extraction — the ffmpeg-style jobs an animation workflow needs, done on the phone. Animation design Palettes from a base colour, easing curves, timing plans (on-ones/on-twos/on-threes), storyboards, sprite sheets and generated PNGs. Files Browse, read and write the workspace from the app.

License

MIT