SoundVisualizer

Real-Time Audio Visualization & AI Sound Analysis Overlay for Android

SoundVisualizer is an Android application that captures the audio playing on your phone in real time and translates its direction, intensity, and meaning into a graphical overlay and vibration. Going beyond simple waveform rendering, it integrates an AI sound classifier powered by YAMNet and ONNX Runtime to instantly identify the type of sound playing (ambient, speech, danger) and provide adaptive visual and haptic feedback.

✨ Key Features 1. Diverse Spatial and Intensity Visualizer Modes We provide 4 unique rendering modes that intuitively map sound intensity and direction (left and right):

Wave Mode: Renders dynamic audio waves along the screen edges that fluctuate based on intensity. Circle Mode: Swells a ring in the center of the screen toward the side the sound comes from. Pad Mode: Displays glowing pads anchored to 8 spots around the screen edges. Outline Mode: A minimalist variation of Wave mode, showing only the thin borders of the wave to minimize screen occlusion. The graphics float transparently over other apps and let touches pass straight through. Size, opacity, sensitivity, speed, and glow are saved separately for each mode. Simple settings: The Settings tab has a picture-based view. Choose the shape from four cards drawn by the real visualizer, its size in three steps, and for each sound type whether it is shown and how strongly it vibrates. Everything else is under “Detailed”. 2. Control Without Leaving Your Game Change what you see without switching away from the game or video you are watching.

Running notification: Stop the visualizer or switch the visual mode straight from the notification. Quick Settings tile: Turn the visualizer on and off from the notification shade without opening the app. 3. Stereo Direction Detection Compares the left and right channels of the audio playing on the phone to show which side a sound comes from and how loud it is. Phone audio has two channels, so it tells left from right but not front from back. Graphics at the top and bottom of the screen show sound heard equally on both sides and a sense of space. 4. Real-Time AI Sound Classification (ONNX & YAMNet) 3-Class Detection: Analyzes all incoming audio into Ambient, Speech, and Danger categories. Each category triggers independent, customizable UI colors and can be shown or hidden on its own. Warning cues: Sirens, alarms, explosions, fireworks, horns, breaking glass and similar warning sounds count as Danger even when they are only among the model's top five candidates (at 5% or more), so music or game audio can't drown them out. A few cases prone to false alarms, such as when speech is louder, are excluded. Stable colors: Danger appears on the first qualifying result; Speech and Ambient need two in a row, so the color doesn't flicker. The AI pauses while it's quiet and resumes as soon as sound returns. Late danger: Even a short Danger sound that ends before the AI decides is drawn at the size it had. 5. Choose How Each Sound Counts (Sounds Tab) Browse the 521 sounds the AI knows, grouped by similarity, and choose whether each group (or, in advanced mode, each sound) counts as Ambient, Speech, or Danger. Search by name, filter by type or by the sounds you changed, and reset everything in one step. The AI follows your changes immediately. 6. Vibration Alerts Patterns per type: Choose Off, Slow, Medium, Fast, or Continuous and a strength from 10 to 100% for each sound type, so you can tell sounds apart by touch. At first only Danger vibrates, at Medium. Simple settings offer just Off, Weak, and Strong. Follows the sound: It vibrates while that type of sound continues and stops when the sound stops, so you notice sounds even when you are not looking at the screen. Lock screen alerts: When a Danger sound is heard while the phone is locked, an alert appears on the lock screen. 7. External Sound Mode Listens to the sounds around you through the microphone instead of the audio playing on the phone, with the same graphics and vibration, so you can notice fire alarms, sirens, or someone calling you. What it hears is used only to measure loudness and recognize the sound type. The audio itself is never saved to a file or sent anywhere. Microphone sensitivity has 16 steps, and sound picked up while the phone vibrates is handled separately so the phone doesn't mistake its own vibration for sound. 8. Help, Notices, and Tutorial Help tab: Getting started, permissions, visual modes, sound types, FAQ, a report button that opens a prefilled GitHub issue or email, and the open source licenses. Notices: Home and the running notification tell you when no sound is reaching the visualizer, when sound type detection is unavailable, or why the visualizer stopped. Tutorial: The first time you open the app, a short tutorial shows how sound, direction, sound types, and vibration work, using the real renderer and real vibration. You can open it again from the Home tab. Developer mode: Shows what the AI heard (its top five sounds, how sure it was, and how long it took) at the top left of the overlay, and can record every result to a CSV file in the app folder. 9. Comprehensive Localization Supports 18 languages: Korean, English, Japanese, Chinese (Simplified and Traditional), Vietnamese, Thai, Indonesian, Spanish, Portuguese (Brazil), French, Italian, German, Russian, Polish, Turkish, Hindi, and Arabic (right-to-left). By default it follows the phone's language, and you can change it with the globe button on the Home tab.

License

Apache-2.0