img:is([sizes=auto i],[sizes^="auto," i]){contain-intrinsic-size:3000px 1500px} /*# sourceURL=wp-img-auto-sizes-contain-inline-css */

天美影视传媒

Skip to content

Slide to unlock

Today鈥檚 touch-screen world is leaving behind an entire segment of the population: those with motor impairments. iSchool Ph.D. candidate Martez Mott wants to change that.

Scroll Down

We live in a touch-screen world. One where tiny computers full of information live in our pockets. Where boarding passes are printed at touch-screen kiosks and groceries are paid for at touch-screen card readers. A world where extending a finger and making contact with a particular point gets us what we want.

Well, except for the millions of us across the world who experience motor impairments 鈥 the millions of us who are being left behind.

The many
definitions
of 鈥渢ouch鈥

鈥淚鈥檓 pretty sure if you went around and asked, 鈥楬ey, what do you think a touch is?鈥, you might get different answers, but it would probably converge around something that looks like this,鈥 says Martez Mott, raising his pointer finger before tapping it on the table in front of him. 鈥淔or the participants in my studies, that was not the case at all.鈥

Mott is a Ph.D. candidate in the UW鈥檚 and an active member of the philanthropy-funded (Mobile + Accessible Design) Lab and the (Design. Use. Build.) Group, where his research centers on making touch screens accessible for people who live with motor impairments, from cerebral palsy to muscular dystrophy to Parkinson鈥檚 disease.

鈥淭ouch screens were developed for a certain type of use,鈥 says Mott, who received financial support through the 天美影视传媒 Graduate Opportunity Award. It鈥檚 simple: If you want to interact with something on your device, you have to be able to extend a finger and touch it cleanly and accurately. 鈥淭hat鈥檚 it,鈥 he says. 鈥淓verything else is relegated to some other type of functionality 鈥 if you touch your phone with two fingers, it thinks you鈥檙e trying to zoom.鈥

For those who live with cerebral palsy, however, touch might look like patting the screen with the back of the hand, or dragging a palm or a fist. 鈥淲hen that happens, the screen picks up a big blobby area,鈥 says Mott, 鈥渁nd the system has no idea what to do with it.鈥

Yet.

For those who live with cerebral palsy, touch might look like patting the screen with the back of the hand, or dragging a palm or a fist.

How we touch

What happens if you can鈥檛 touch your device with a single finger?

ipad screen showing user touching with finger ipad

When a single finger makes contact with the screen, the device registers the center of that point as the user鈥檚 intended touch point.

ipad screen showing user touching with whole hand ipad

When the back or side of the hand makes multiple points of contact with the screen, the device can鈥檛 register which point is the user鈥檚 intended touch point.

Martez Mott

Say hello to smart
touch

Calibration software for touch-screen accessibility

Imagine a system that adapts to touch 鈥 whatever that might look like. Enter: Smart Touch. The project is a work in progress, constantly being tested and tuned by Mott and a small team of researchers, including his advisor, Associate Professor Jacob Wobbrock.

The objective? To get touch-screen access to a level where anybody can pick up a device and, with a simple calibration procedure, be able to use it right out of the box without needing additional specialized technologies.

Think of it as the counterpart to automated speech recognition, where the device asks you to repeat a few phrases so it can pick up on your unique speech patterns. In Mott鈥檚 model, the device asks you to touch a couple targets 鈥 a balloon or a bull鈥檚-eye, for example 鈥 so it can pick up on your unique touch patterns and adjust how it responds.

And it鈥檚 all guided by Mott鈥檚 participants, who give him real-life, real-time feedback.

Meet Martez Mott

  • Hometown: Detroit
  • Bachelor of Science in Computer Science, Bowling Green State University, 鈥10
  • Master of Science in Computer Science, Bowling Green State University, 鈥12
  • Ph.D. candidate in Information Science, 天美影视传媒
  • 天美影视传媒 Graduate Opportunity Award recipient
  • Post-grad plans: Teaching, preferably at the iSchool. 鈥淚鈥檓 working toward my Ph.D. because I love the research, but I also want to empower others the way my mentors have empowered me.鈥
The device asks you to touch a couple targets 鈥 a balloon or a bull鈥檚-eye, for example 鈥 so it can pick up on your unique touch patterns and adjust how it responds.

You can make inclusive technology possible

Mott is just one of many UW students and researchers working to make digital innovations accessible for everyone. By giving to the iSchool鈥檚 Human Computer Interaction Research Fund, you can fuel life-changing tech solutions for people of all abilities.

Making smart touch a reality

With real-life users

Two years ago, at the start of the project, Mott lugged a huge, table-sized Microsoft Surface into Provail: a local center that helps people with disabilities pursue the lives they want to live. Among the nonprofit鈥檚 many offerings? Computer classes 鈥 and lots of motivated learners willing to participate in his study.

There, Mott worked with eight volunteers to make Smart Touch a reality, beginning by asking them to hit targets on the screen. 鈥淚 had a wide range of participants, so I saw a wide range of strategies used to complete the tasks,鈥 he says. The first person would prop one hand on the tablet for support while dragging the other hand across the screen. The next person would interact with the device in an entirely different way. This, says Mott, is why inclusive innovation 鈥 actually looping the software鈥檚 target population into the design process 鈥 is so important.

鈥淲hen people are motivated to use a technology, they鈥檒l employ a lot of different strategies in order for that to become possible. It was difficult to get an understanding of what 鈥榯ouch鈥 looks like,鈥 he says. 鈥淧eople used the software in ways I couldn鈥檛 have predicted, which resulted in a lot of failure 鈥斅燼nd fixing 鈥 for me.鈥

Martez Mott works on Smart Touch with Provail participant Ken Frye

Martez Mott works on Smart Touch with Provail participant Ken Frye

A DJ with a dream

Ken Frye, a Provail participant in Mott鈥檚 study who has cerebral palsy, has been in the radio industry for over 40 years, with an impressive career that includes gigs at Seattle鈥檚 very own KEXP and Centralia鈥檚 Live 95.1. Today, he hosts his own radio show "Ken鈥檚 Ten," which features music from the 鈥20s to today 鈥渂ecause all music can and should live together鈥 鈥 but that doesn鈥檛 come without its challenges. Watch to learn how Smart Touch could transform the way Frye navigates the world.

Touch screens, everywhere

Failure is part of the learning process, and now 鈥 鈥渁fter a lot of learning,鈥 says Mott, laughing 鈥 he has a system up and running. And as he creates newer versions of Smart Touch over the next few years, retooling algorithms to improve accuracy and creating better designs for performance gains, the iterations will only get better.

鈥淭he hope is that you could buy a device, turn on an accessibility setting, and then go through a calibration procedure for better touch performance so you can use your phone or tablet however you like,鈥 says Mott, who鈥檚 slated to wrap up his dissertation by 2019.

鈥淭his research isn鈥檛 just a theoretical contribution; it鈥檚 a practical one,鈥 he says. 鈥淗earing my participants tell me how important and impactful this work can be in their daily lives is the most rewarding thing. It鈥檚 what drives me.鈥

Ken Frye using a touch device

Ken Frye interacts with a touch-screen device

And as far as rolling it into the market? That鈥檚 a few years away, but Mott has a vision 鈥 starting with buy-in from the tech industry. 鈥淚 would love to see every touch-enabled device 鈥 public or private 鈥 be accessible, with this technology integrated into every operating system, quietly running in the background. I want to see a check-out kiosk at the grocery store embedded with intelligence that can infer people鈥檚 behaviors based on their unique touch,鈥 he says. 鈥淲e can do it. We just haven鈥檛 done it yet.鈥

Ken Frye chats with KEXP DJ Cheryl Waters

Ken Frye chats with KEXP DJ Cheryl Waters

Spotify

Ken Frye鈥檚 10 favorite songs

Listen

(Requires )

My hope for technology is that somebody like me can be clearly understood. Having a device I could use would mean freedom.

Ken Frye

Originally published April 2017

What you care about
can change the world

The 天美影视传媒 is undertaking its most ambitious campaign ever: Be Boundless 鈥 For Washington, For the World. You can be part of Mott鈥檚 project and help iSchool students like him make technology accessible for everyone at the MAD (Mobile + Accessible Design) Lab by making a gift to the Human Computer Interaction Research Fund.