Slide to unlock
Today鈥檚 touch-screen world is leaving behind an entire segment of the population: those with motor impairments. iSchool Ph.D. candidate Martez Mott wants to change that.
img:is([sizes=auto i],[sizes^="auto," i]){contain-intrinsic-size:3000px 1500px} /*# sourceURL=wp-img-auto-sizes-contain-inline-css */
Today鈥檚 touch-screen world is leaving behind an entire segment of the population: those with motor impairments. iSchool Ph.D. candidate Martez Mott wants to change that.
Scroll Down
We live in a touch-screen world. One where tiny computers full of information live in our pockets. Where boarding passes are printed at touch-screen kiosks and groceries are paid for at touch-screen card readers. A world where extending a finger and making contact with a particular point gets us what we want.
Well, except for the millions of us across the world who experience motor impairments 鈥 the millions of us who are being left behind.
鈥淚鈥檓 pretty sure if you went around and asked, 鈥楬ey, what do you think a touch is?鈥, you might get different answers, but it would probably converge around something that looks like this,鈥 says Martez Mott, raising his pointer finger before tapping it on the table in front of him. 鈥淔or the participants in my studies, that was not the case at all.鈥
Mott is a Ph.D. candidate in the UW鈥檚 and an active member of the philanthropy-funded (Mobile + Accessible Design) Lab and the (Design. Use. Build.) Group, where his research centers on making touch screens accessible for people who live with motor impairments, from cerebral palsy to muscular dystrophy to Parkinson鈥檚 disease.
鈥淭ouch screens were developed for a certain type of use,鈥 says Mott, who received financial support through the 天美影视传媒 Graduate Opportunity Award. It鈥檚 simple: If you want to interact with something on your device, you have to be able to extend a finger and touch it cleanly and accurately. 鈥淭hat鈥檚 it,鈥 he says. 鈥淓verything else is relegated to some other type of functionality 鈥 if you touch your phone with two fingers, it thinks you鈥檙e trying to zoom.鈥
For those who live with cerebral palsy, however, touch might look like patting the screen with the back of the hand, or dragging a palm or a fist. 鈥淲hen that happens, the screen picks up a big blobby area,鈥 says Mott, 鈥渁nd the system has no idea what to do with it.鈥
Yet.
For those who live with cerebral palsy, touch might look like patting the screen with the back of the hand, or dragging a palm or a fist.
What happens if you can鈥檛 touch your device with a single finger?
When a single finger makes contact with the screen, the device registers the center of that point as the user鈥檚 intended touch point.
When the back or side of the hand makes multiple points of contact with the screen, the device can鈥檛 register which point is the user鈥檚 intended touch point.
Calibration software for touch-screen accessibility
Imagine a system that adapts to touch 鈥 whatever that might look like. Enter: Smart Touch. The project is a work in progress, constantly being tested and tuned by Mott and a small team of researchers, including his advisor, Associate Professor Jacob Wobbrock.
The objective? To get touch-screen access to a level where anybody can pick up a device and, with a simple calibration procedure, be able to use it right out of the box without needing additional specialized technologies.
Think of it as the counterpart to automated speech recognition, where the device asks you to repeat a few phrases so it can pick up on your unique speech patterns. In Mott鈥檚 model, the device asks you to touch a couple targets 鈥 a balloon or a bull鈥檚-eye, for example 鈥 so it can pick up on your unique touch patterns and adjust how it responds.
And it鈥檚 all guided by Mott鈥檚 participants, who give him real-life, real-time feedback.
Meet Martez Mott
The device asks you to touch a couple targets 鈥 a balloon or a bull鈥檚-eye, for example 鈥 so it can pick up on your unique touch patterns and adjust how it responds.
With real-life users
Two years ago, at the start of the project, Mott lugged a huge, table-sized Microsoft Surface into Provail: a local center that helps people with disabilities pursue the lives they want to live. Among the nonprofit鈥檚 many offerings? Computer classes 鈥 and lots of motivated learners willing to participate in his study.
There, Mott worked with eight volunteers to make Smart Touch a reality, beginning by asking them to hit targets on the screen. 鈥淚 had a wide range of participants, so I saw a wide range of strategies used to complete the tasks,鈥 he says. The first person would prop one hand on the tablet for support while dragging the other hand across the screen. The next person would interact with the device in an entirely different way. This, says Mott, is why inclusive innovation 鈥 actually looping the software鈥檚 target population into the design process 鈥 is so important.
鈥淲hen people are motivated to use a technology, they鈥檒l employ a lot of different strategies in order for that to become possible. It was difficult to get an understanding of what 鈥榯ouch鈥 looks like,鈥 he says. 鈥淧eople used the software in ways I couldn鈥檛 have predicted, which resulted in a lot of failure 鈥斅燼nd fixing 鈥 for me.鈥
Martez Mott works on Smart Touch with Provail participant Ken Frye
Ken Frye, a Provail participant in Mott鈥檚 study who has cerebral palsy, has been in the radio industry for over 40 years, with an impressive career that includes gigs at Seattle鈥檚 very own KEXP and Centralia鈥檚 Live 95.1. Today, he hosts his own radio show "Ken鈥檚 Ten," which features music from the 鈥20s to today 鈥渂ecause all music can and should live together鈥 鈥 but that doesn鈥檛 come without its challenges. Watch to learn how Smart Touch could transform the way Frye navigates the world.
Failure is part of the learning process, and now 鈥 鈥渁fter a lot of learning,鈥 says Mott, laughing 鈥 he has a system up and running. And as he creates newer versions of Smart Touch over the next few years, retooling algorithms to improve accuracy and creating better designs for performance gains, the iterations will only get better.
鈥淭he hope is that you could buy a device, turn on an accessibility setting, and then go through a calibration procedure for better touch performance so you can use your phone or tablet however you like,鈥 says Mott, who鈥檚 slated to wrap up his dissertation by 2019.
鈥淭his research isn鈥檛 just a theoretical contribution; it鈥檚 a practical one,鈥 he says. 鈥淗earing my participants tell me how important and impactful this work can be in their daily lives is the most rewarding thing. It鈥檚 what drives me.鈥
Ken Frye interacts with a touch-screen device
And as far as rolling it into the market? That鈥檚 a few years away, but Mott has a vision 鈥 starting with buy-in from the tech industry. 鈥淚 would love to see every touch-enabled device 鈥 public or private 鈥 be accessible, with this technology integrated into every operating system, quietly running in the background. I want to see a check-out kiosk at the grocery store embedded with intelligence that can infer people鈥檚 behaviors based on their unique touch,鈥 he says. 鈥淲e can do it. We just haven鈥檛 done it yet.鈥
“My hope for technology is that somebody like me can be clearly understood. Having a device I could use would mean freedom.”
Ken Frye
Originally published April 2017
Sign up for our monthly newsletter to discover the latest on new innovations, useful tips and information, and eye-opening stories coming out of the UW community.