Apple Music Visualizer

Focus

2019

Team

Solo Project (3 Months)

Recognition

2019 Young Ones ADC, Bronze in Interactive : UX/UI
2019 ADAA by Adobe, Top Talent Award

Focus

UX Design
User Research
Concepting
Prototyping
Motion Graphics

Exploring different ways to enjoy music for the deaf and hard of hearing community.

Apple Music Visualizer is a new feature in Apple Music that translates music into visuals for the deaf and hard of hearing.

Images for this project are coming soon.

Problem

There are 466 million people in the world with disabling hearing loss.

And it’s challenging for them to enjoy and understand songs.

Inspiration

ASL Music Interpretation

I was inspired by Amber Galloway Gallego, an American Sign Language (ASL) interpreter who translates all the elements of a song (lyrics, instruments, beats, and most importantly, the feel) into ASL. Each interpreter translates differently, making the music-listening experience more fun and visceral for the deaf and hard of hearing.

What if

There was a feature in Apple Music that allows one to enjoy music, without having to actually listen?

Case Study

Research

Competitor Analysis

There are tons of music apps out there. But one for the deaf and hard of hearing? Only a few exist. I felt that there's plenty of room for improvement in both design and functionality of these apps.

User Research

Would people agree?

To get a general understanding of the music experience, I conducted a survey, asking people if they think they'll feel more connected to music if they visually saw it. 76% said yes and 16% said maybe.

Research

Interviews

Due to challenge of finding a target audience, I decided to use Instagram to reach out. Using the hashtags #deaf #deafcommunity, I asked questions and found some of the most important insights through this process.

A huge thanks to everyone who kindly answered my questions so thoroughly.

Examples of DM interviews

Christopher, Hard of Hearing

I listen to music every single day. It’s plays a huge role in my life. It’s one of the few things that keeps me in my zone.
The videos do help understand what the music is exactly about than my imagination.
I use to use hearing aids but I got tired of the constant need of replacing them when they get dirty.

Lea, Hearing ASL Music Interpreter

The most important thing is to understand and interpret the context of a song.
I think that everyone has their own way to interpret music.

Raquel, Hard of hearing at birth, currently deaf

If the music isn’t playing on my iPhone, it’s definitely the vibrations.
I just got a new cochlear implant recently where it connects the music I play on my iPhone directly into my cochlear, Bluetooth. I’ve been able to enjoy music now like never before. I appreciate it more because I can hear it directly.
But if there are no lyrics, I love the vibrations of the instruments.

Repetitive Insights I encountered:

Videos with lyrics help build connections.
Being deaf and hard of hearing doesn't mean you know sign language.
Understanding the context of the song is key.
Some people hear only certain pitches.
Everyone interprets songs differently.
Vibrations play a crucial role.

User Flow #1

Enable & Disable in Settings

Apple already has its own system for accessibility. With a simple addition to the hearing section under Accessibility, you can easily enable Apple Music Visualizer.

User Flow #2

Inside Apple Music

Out of the 5 areas inside iPhone’s Apple Music, the hearing ability test will take place in the ‘For You' section for the first time users.
‍
After the user takes the test, the original ‘For You' features will return and users will be able to change the visualizer settings.