Show HN: See Sounds on Your Webcam
summary
SoundMap is a web-based tool designed to visualize and map sound sources using various input methods like webcams and microphones. It allows users to align audio and video feeds to estimate the location of sounds in a 3D space. By supporting multiple localization methods and microphone formats, it provides a flexible environment for spatial audio analysis.
key points
- The tool supports diverse input configurations, including tracked iPhones, stereo microphones, and Ambisonic formats like AmbiX and FuMa. This versatility ensures compatibility with a wide range of hardware setups.
- Users can manually calibrate the system by adjusting microphone spacing, horizontal view angles, and mic rotation relative to the camera. These settings allow for precise alignment between what the camera sees and where the sound is coming from.
- The system employs a motion-based estimation method where users perform actions like clapping or speaking with visible movement. This helps the software synchronize audio triggers with visual cues to determine source localization.
who should read it
Audio engineers, spatial audio researchers, and developers interested in sound localization and 3D audio mapping. It is particularly useful for those needing a quick, browser-based way to calibrate spatial audio hardware.
discussion mixed
consensus
Users are experiencing technical issues where the tool fails to detect speech correctly, instead producing random patterns. This is likely caused by auto-gain control on webcam microphones, which amplifies the noise floor in silent environments. The community suggests testing with a sound clip to verify if the noise is being auto-compensated.
top insight
Auto-gain enabled microphones often crank up sensitivity in silent rooms, transforming the background noise floor into visible patterns. This explains why the tool may seem broken when it is actually just reacting to amplified electronic noise. Understanding this hardware-level behavior helps differentiate between software bugs and microphone settings.
Generated by an LLM from the article and thread. Check the sources before relying on it.