VISIBLE TRACK

TAB Foundation / Kunana

Even if they cannot see, blind people can actually ‘watch’ and enjoy various forms of videos like us such as movies and videos on Youtube, as they experience these videos through music, dialogue and sound effects, which in turns help paint the picture in their heads. But there’s one thing that blind people can never experience before : music video, since most music videos are mainly music and visuals that tell a story, so for people who cannot see, watching a music video give them no other enjoyment than listening to the music track. Until now.

VISIBLE-TRACK.com, the first online service that lets blind people ‘see’ millions of music videos that are available online. The service utilises as many as 6 Ais—e.g. scene splitting, scene classification, action classification and object classification—that work together on different tasks to help music videos become visible & universally accessible to everyone. All of which help intelligently add sound effects to each scene automatically to help blind people paint the ‘scene’ in their head. Moreover, the service also uses image-captioning AI and text-to-speech AI to generate audio descriptions to describe what’s going on in the scene.