AutoTrack is an advanced Max patch, executing real-time video analysis and concurrently synthesizing correlated, multi-layered soundscapes. It allows users to manipulate these layers during the generation process. This programme fosters a dynamic and customizable audio-visual correlation.
Video analysis encompasses several aspects that are commonly employed in the field. These aspects include color picking and tracking, blob tracking, distance transform calculation, and matrix histogram calculation.
Programming environment is Max/MSP/Jitter, with external packages including cv.jit, XRAY and MIRA.
Download the 'patch' file and double click the 'autoTrack' patch within it.
Work with MIRA: Connect MIRA using tablets(ipad tested).
Federico Foderaro's a series of tutorials that provided guidance on translating shaders from the Shadertoy platform into the Max environment.