Deaf Tech: Travel Through Time from Past to Future | ID24 Recap

Meryl Evans Deaf Tech: Travel Through Time from Past to Future: Inclusive Design 24

Inclusive Design 24 (ID24) is a free 24-hour online event for the global community for sharing knowledge and ideas in inclusive design.

Deaf technology and accessibility tools have come a long way. While automatic captioning is prevalent, there are other products and tools that have turned out to be invaluable to the deaf and hard of hearing.

Pack your bags and hop in the Delorean (DeafLorean — grin) with Equal Entry’s Meryl Evans to travel from the past to the future with stops on the way highlighting technology for the deaf. The final destination will cover recommendations for companies to consider before creating new products.

Here are some highlights from the presentation:

Transcript: Deaf Tech: Travel Through Time from Past to Future / Meryl Evans #id24 2021

Welcome back to Inclusive Design 24, 2021, brought to you with thanks to our platinum sponsors: Fable, Intopia, TPGi ARC, and Adobe, and our gold supporter, TetraLogical. A reminder, you can follow us on Twitter, the account is @id24conf. If you have any questions or comments for our presenters, you can post them on Twitter with the hashtag #id24. Eriol, I will hand it over to you now to present to our next speaker, please.

Up next we have Meryl Evans talking about deaf tech, travel through time, from past to present. Over to you, Meryl. Thank you. And thanks to everyone for joining us. I'm excited to be speaking at #id24 and I hope that you have caught a lot of the sessions with the amazing speakers.

Before we take off, the slides with detail image descriptions are available at Meryl.net/ID24. That's M e r y l. The link to the live transcript for this talk is there too. You'll also find the hashtag and a link to my Twitter ID.

It's @MerylKEvans with a headshot photo like this one of me in a red collared shirt.

Are your bags packed and ready to travel through time? I looked into borrowing Doc Brown's DeLorean and the Doctor's TARDIS. But they were too expensive! So, I found a generic time machine that's a DeafLorean in police box blue.

While the time machine warms up, here's a little background.

Howdy, I'm Meryl. Pronouns she/her. I'm in Plano, Texas, USA right next to Dallas. I'm a member of Generation X with shoulder length curly hair, pale skin, and a dark top.

I was born hearing free aka profoundly deaf. I got my first hearing aid when I was one. It was nothing like the ones you see today. There was no hiding it as the image shows 3 year old me holding a basket of flowers wearing a vintage hearing aid on my chest.

The hearing aid is tucked inside its own case with straps that went over my shoulders and around my waist to hold it in place. Both earpieces have ear molds in the ears. Both sides have a cord that runs from the ear pieces and plug into the box. Four double AA batteries powered it. My dear mother tried.

She really tried. She made hearing aid cases in different colors and designs. There's just no hiding the hearing aid. Poor, Mom. She couldn't make the cords invisible.

Being the typical toddler, I ripped a lot of those cords! By the time I was 9, I leveled up to behind the ear or BTE hearing aids. Finally! I could wear cool t shirts with words and pictures on them.

Then, 18 years ago, I leveled up to a bionic ear, which is lot cooler than saying cochlear implant. Even with the bionic ear, I still need to lipread to listen. A hearing device supersizes lipreading. For example, Mom, mop, bop, pop all look the same on the lips without sound. The most common assumption people make about me is that I know sign language. I don't.

That's neither a good thing or a bad thing. There's no right or wrong. It's just is. Deaf and hard of hearing people are all different. I can only speak from my experience.

When you meet one deaf person, then you've met one deaf person not all of us. In my day job when I'm not an accessibility and caption pusher, I'm a digital marketing handler and accessibility consultant. All right, let's get the show on the road. Hang on to your hats. This generic time machine gets bumpy!

It's 1888. Meet William Hoy, an American professional baseball player who was deaf. Since he couldn't hear the call, he is credited with asking umpires to raise their right arms to indicate a strike. While there's debate about who actually started the hand signals, those signals helped me when I played softball. They also helped a lot of people who aren't deaf like families attending their kids' baseball and softball games.

Since William Hoy and his wife were deaf, they didn't hear the doorbell. He came up with a creative solution by putting a baseball on top of the door next to a mechanism. Their visitors would pull the chain knocking the ball to the floor. When William and Anna felt the vibrations, they knew they had a visitor.

Meanwhile, in the decade prior to this, a new invention was gaining ground that would be challenging for the deaf. And that's the telephone. Almost 500,000 homes in the US had telephones by 1889. Let's jump to 1950.

The pager was patented in 1949 and the first paging service arrived the next year. More than 40 years later, I received a pager in my first job. If somebody needed to reach me, they'd page me with a call back number. Eventually, I graduated to an alphanumeric pager that allowed people to send me messages with text not just phone numbers.

We're in the 1960s when the teletypewriter or TTY came out. You may know it as TDD, which is telecommunications device for the deaf. They weren't originally the same thing, but these terms are interchangeable now. The earlier TTYs were large and bulky. For those not familiar with the TTY, it was like having a keyboard or typewriter with an acoustic coupler.

You'd put the handset into the coupler so the TTY could hear the tones coming in from the other end of the line and translated the tones into text. Later TTYs had a little printer to print the conversation on paper to save the conversations. At the time, communicating through the TTY required people on both ends of the call to have a TTY. Because no one in my life had one, I didn't have a TTY until my first job.

However, I had something else just as good. More on both shortly. Let's set the time machine for the 1970s.

In the late '70s, the modern multi channel cochlear implants came out. There are two parts of a cochlear implant. The external part with the sound processor and microphones that sends signals to the implant on the inside. The internal implant transports the signals to the electrodes in the inner ear.

These signals stimulate the auditory nerve and direct the signals to the brain. The brain converts them into sounds. A hearing aid, on the other hand, simply amplifies sound. Or in my case, booms massive volumes of sound into my ears. It's no wonder why my hearing aids squealed a lot. This is called feedback.

The ear molds had to be made to fit inside the ears just right. It seals the sound to keep it in the ears. But when the molds move or don't fit perfectly, it causes feedback. So, picture a silent room.

And suddenly the hearing aids start screaming and everyone looks at you! Because of that, I had many embarrassing moments. Thanks to the cochlear implant, this doesn't happen anymore. Another great thing about the bionic ear is that I can stream audio from my phone to my head.

Shh … between you and me, this lets me listen to music without anyone knowing. I can also control the volume and programs with my phone. Before this model, I had to use a separate remote control to change the settings.

Many hearing aids today can connect with something people already own: their cell phones. They can change the settings. If they're in a noisy restaurant, they can switch to a different program to reduce the sound around them and the microphone zooms in on the person in front of them. As for the bad things, the cochlear implant in my head contains a magnet.

So, I can't have an MRI. To have an MRI requires getting the implant removed. Fortunately, some of the newer implants don't have this issue. I have a confession to make.

I've put magnets on my head to see if they would stick. And a couple did! Hey, this was a very serious science experiment. Hearing aids and cochlear implants are not cures. As soon as I take mine off, I can't hear anything.Lipreading is still my number one listening tool.

If I close my eyes when you talk to me, I'll know you're talking but not what you're saying. It was no secret that I didn't like summer camp. My parents had to bribe me just so they could go to Hawaii. And I did the exact same thing to my daughter when we went to Hawaii.

Except instead of going to camp, she went to DisneyWorld with her grandparents. Yes, the same ones who bribed me. She got a better deal than I did! Anyway, a big surprise awaited me when I came home from camp. It was a brand new Apple 2 + computer that yelled at me all the time because they had no lower case letters.

That was the start of my lifelong love of computers. Eventually, we added a slow 300 baud modem that let me connect to a bulletin board system or BBS. Think of BBS as the vintage internet in the days before Prodigy and America Online. It had email, it had forums, it had real time chat, and some had games.

The modem made it possible for me to talk to people by myself. I'd email other members or join discussions in the forums. I never missed a word or misunderstood anyone. I used to be embarrassed to tell people this about me. I met my spouse on a BBS.

Now I brag about how I found internet dating before online dating and apps were cool.

My mom said I was her only kid to read before kindergarten. I asked her how that happened. She credited Sesame Street on TV. But this was long before captions came along. Those Muppets don't exactly have lips you can read. Their mouths just go up and down.

What they did have was a lot of onscreen text. People learn to read from watching captions. I probably figured it out between the simple storylines and the text on the screen. The birth of captions came about because of humans having a history of making "improvements" to things that were a setback for the deaf and hard of hearing.

We had the telegraph to send messages, then the telephone replaced it. We had silent movies that everyone could enjoy, then talkies came in 1927. Thanks to talkies, a deaf actor named Emerson Romero lost his job and went back to New York City where he became active in the Deaf community. He bought several films and in 1947, he developed the first captioning for a movie by splicing in dialogue cards much like the silent films did between scenes and rented the captioned films to deaf organizations and churches. To prevent piracy, producers would only sell him bad quality films. Despite this, people like Edmund Boatner, the superintendent of the American School for the Deaf, knew of Romero's work.

Boatner created better methods of captioning and co founded Captioned Films for the Deaf, Inc. Fast forward to the 1970s when the work with decoders began. Viewing captions on TV required a decoder. By 1980, closed captioning started appearing on several TV networks. Three years later, I got my first decoder exactly like this one with useless switches, dials, and buttons.

The only thing you could do was turn it off and on. By 1989, the National Captioning Institute wanted to expand the audience for captioned TV and worked on developing a chip that would put caption decoder technology inside new TVs. That became a reality in 1990 when Congress passed the Television Decoder Circuitry Act. Now every TV and most devices come equipped with captioning capabilities.

Then the Internet came. It didn't take long before videos and sound files to circulate leaving the deaf and hard of hearing behind again like the talkies. It took almost 30 years for captioning tools and services to become widespread. But there are still many things not captioned. Today, there's a new barrier that reminds me of the time when I couldn't find many captioned shows.

It's been hard to find virtual reality apps with captions or subtitles.

Growing up, I had the best alarm. You may have heard of it.It called M O M, which stands for my other mother. Well, I couldn't take Mom to college. So, we found a rectangular block with a cord that you plug into a big digital clock radio.

I'd put the block under the sheets in my bed. When the alarm went off, the block vibrated. However, it wasn't portable for business trips. I found the Shake Awake alarm clock. That's what the picture shows.

I hated that thing because its powerful vibrations had me jumping out of bed. Thankfully, my brain woke me before the alarm did. The last time I traveled for business, I set the alarm on my phone, chose the vibrate mode, and put it in the bed. Once again, just like with captions, technology is built in something we already use. No longer did I need to take an alarm clock on trips and I always knew the TV in my hotel room would have captions.

By the way, remember Emerson Romero? He created a vibrating alarm clock in 1959 as well as an entire product line for the deaf including doorbells, smoke detectors, and baby alarms. I never needed those flashy light devices until I had my first child. My spouse traveled a lot. That meant I would be alone with our child at night. So, we bought a baby notification device to work with the bedroom lamp. The hope was that when she woke up or cried, the lamp would blink and wake me up. That gadget was useless.

It'd go off all … the … time. We promptly got rid of it.

I don't know how we managed, but she has two college degrees, so I think she turned out OK.

Back to my first job. Why did I get that TDD? In 1974, a nonprofit in Connecticut created and managed a telecommunications relay service. In 1987, California became the first state to mandate and establish the telecommunications relay program. Then, thanks to the Americans with Disability Act in 1990, the relay service expanded across the U.S.

Here's how it worked. I'd call the relay operator on my TDD and give them a number to call. The operator called that number and typed everything that person said. I'd read what the operator entered.

Then, I could type or voice my reply. When I voiced my reply, it was called voice carry over or VCO. Before VCO existed, the operator would speak what I typed. Like with all technologies, TDDs got smaller and smaller that I had a portable one for traveling.

After the advent of the internet, you could use your computer to call the relay. Once again, an accessibility feature became available in something we already have and use: a connected computer. I haven't used a TDD in more than 20 years. Today, I have a caption phone and app to make captioned phone calls but they don't work well for me. Using them involves reading the captions, comprehending it, figuring out wrong or missing words plus delayed captions. Cognitive overload makes it hard to fill in the gaps. I found something better.

And we can thank the pandemic for that. First, we need to go to the late 1990s.

Instant messenger was a game changer. It was about the closest thing to texting before it came along. ICQ came out in 1996 and AOL instant messenger also known as AIM followed the next year. Not everyone had text messaging when they got their first cell phones or it cost extra.

So, messenger gave me a way to chat with people until text messaging became more common.

It's not just sound that causes problems for the deaf like me. More and more virtual assistants and voice control apps and devices have come out. Some computers had digital speech recognition technology in the 1990s. Then, Dragon's Naturally Speaking software came out in 1997.

It could recognize and transcribe human speech. I had thumb surgery and couldn't type. So, I tried Dragon Naturally Speaking. The only good thing that came out of the vexing experience was a funny blog post showing the bad transcription of my speech.Look I will up if you would look it up if you would like to check it out.

I'm a native English speaker, but Siri, Alexa, Cortana, Google Assistant, and all the other voice control tools don't like my funky accent. Although I don't say bad words much, the voice assistants frustrate me to the point that they had me saying bad words at them. They'd flatly respond, [flatly] "Sorry, I didn't catch that." These apps don't work well with accents, stuttering, speech differences, and people speaking other languages. And of course, not everyone speaks with their voices. Keep these things in mind when creating products and offer at least two input options.

After all, ebooks didn't replace printed books. Elevators and escalators didn't replace stairs.

Another real game changer came in 2005 when I got my first cell phone with a keyboard, this Sidekick. We got one for my spouse and daughter, so we could text each other. Shortly after, Blackberry came along and cell phones with keyboards were everywhere and texting grew. Many of us use this today except instead of physical keyboards, we have on screen keyboards.

Before the pandemic, none of the video conferencing platforms offered captioning. Then the pandemic changed everything. Google Meet added automatic captions. Then Microsoft Teams.

Initially, Zoom required a paid account to use its captions. No one should pay for accessibility features. Thanks to a petition, Zoom added captions to free accounts. It will be available on all free accounts soon.

Those who need it for accessibility can contact Zoom to get it sooner. Anyway, for me, captioned video calls provide the best experience for live conversations. Have you seen those endearing commercials with deaf customers calling their families for the first time using a cell phone with captions or meeting their grandchild for the first time on a video call with sign language? I've sort of had my own heartwarming moment.

The first photo is with my youngest at Purdue University standing next to the unfinished P statue. He just started college. He's been asking me if I want to do a video call. For him to ask for a captioned video call means a lot to me.

He hasn't sent me any photos of him, so I snuck this one from our call. I know the captions below his face don't make sense. That's because automatic captions don't like my accent and that's why I call them autocraptions. Still, this is a huge game changer.

Despite the challenges of the pandemic, it did a lot of great things for people with disabilities like make captioned video calls widely available, meetings more accessible than in person meetings, and virtual conferences more doable than face to face events.

I came across a wristband made for the deaf. It doesn't have a watch face. What it has a built in microphone, status lights, sensitivity controls, and buzz motors. That's it. It's a sound notification device with different vibration tones or haptics to alert you to specific sounds.

The band vibrates based on the sound it hears. One deaf person said he speaks for all deaf people when he says this won't work because we don't like haptics. But that's not true. Even so, the wristband won't work for different reasons.

First, it's not affordable and it's another device to have with a single purpose. If you already have a watch, you'd be wearing this and the watch. On top of this, deaf people dev people are under or unemployed.

These accessibility products and features target the deaf and hard of hearing. But what about products that were not developed with accessibility in mind, but their curb cut effect ended up creating an accessibility tool? I accidentally discovered one and it's a better way to get alerts. No flashy lamps. No buzzing alarms on steroids.

Little did I know this one thing would be a great accessibility tool that made my life easier. This company never advertised the product as an accessibility tool. This is an example of why it's important to hire people with disabilities. We identify opportunities like this.

If it's quiet, my bionic ear can hear the kitchen timer from my office. But if there's noise or I'm focused on something, I'd totally go deaf to the buzzer and miss it. Thanks to this accessibility tool, I set the timer when I cook something. As soon as it's done, my wrist buzzes. I can't ignore that.

That tool is my Apple Watch. And it works with something I already have, my iPhone. Thanks to the watch, I don't have to carry my phone everywhere in the house. The GPS screen in my car is very out of date.And I can't update it.

And I can't safely look at the phone while driving. A better way is to enter the destination on the phone, then my watch gives me turn by turn directions. It's safer, faster, and easier to see each turn on the watch than on the phone. And what's cool is that the door camera works with the watch. When someone comes to the door, my watch buzzes.

Once I didn't have my bionic ear on. And my watch tells me someone is at the door. It turned out to be my sister! One of my sons forgot to tell me she was coming over.

Typical! This isn't meant to be an ad for the watch. Even if you don't have a watch, all these features also work on the phone. Also, Apple and Android devices have built in sound recognition.

Both listen for sounds like baby noises, appliances, and water running. Like the door camera, sound notifications work with my watch. So far, it's a disaster like that baby lamp. Nonetheless, it's progress and a better option than the wristband with only one purpose.

I'm sure these will get better. No matter how old I get and how many times I've left the water running, I never learn! I just did it again. And sound notifications didn't help. A hearing friend in Japan told me he has the same problem because the shower is so quiet. You can't hear it running.

Sound notifications won't work here either. The Chrome browser has live captions that pop up when there's audio. Google has also added this feature to Pixel phones. Here's a screen shot from a phone call on a Pixel with captions showing. Video calls also allow signers to see each other and sign. There's an app that lets the signer see the person they're calling as well as the sign language interpreter.

I love the haptics on my watch and other deaf people say the same. That's why it's important to talk to multiple people with the same or similar disability. We're all different. What does the future look like? Let's set this time machine to five years in the future and see what's happening. Uh oh.

It looks like the DeafLorean broke. This is what I get for going generic! Let's take a peek into the future with my invisible crystal ball. No doubt, artificial intelligence and automatic speech recognition will continue to mature.

They'll expand to include more languages and hopefully do a better job of those with speech differences and accents like mine. I've seen several voice assistant apps in the works that are for people who speak differently. Research, development, and creating guidelines are underway in virtual reality, augmented reality, and immersive technology. One virtual reality environment has captions for multiple languages in beta. If someone speaks Japanese, I will see a translation of what they said in English captions.

This actually happened and it was amazing! Another VR environment, however, requires paying for captions on a per user basis! Accessibility features should never cost extra. Very few VR apps have captions or subtitles. We have a long way to go.

If you know of a VR title with on screen text for audio, please contact me and let me know about it. I wish the VR app stores would make it easier to find apps with captions, on screen text, and other accessibility features. There are captioned glasses being developed and tested. Maybe the technology will mature and eventually become standard in all glasses.

I bet Live Captions like those on Chrome and Pixel phones will show up in other browsers, operating systems, and devices. In fact, I'm surprised they haven't yet. The future will have more technology incorporating accessibility features. Like captions originally required a decoder, now they're included in TVs and devices. Making phone calls required a TDD.

Now you can use your computer or your phone to do that. No longer do you need a contraption to connect the doorbell to the lamp. Now you can use a door camera that works with your phone and watch.

Many companies with good intentions follow the Functional Solutions model of disability. While they take a real world approach to innovation and finding solutions, they overlook the social and political implications and other issues. You may have heard about sign language gloves. These have been slammed for valid reasons.

The signer wears the gloves and the computer translates them into spoken words. The creators did not consider the cost and that it's awkward for the signer to wear these gloves and carry the computer. A viral video of a wheelchair going up the stairs upset many of us. We saw an expensive and unsafe product. Many folks share article after article of inventions that will supposedly make life better for people with disabilities.

Technology that sounds cool and useful doesn't mean it's a good idea. Often, they're expensive or didn't include people with disabilities in the process. People with disabilities don't want as Liz Jackson says "disability dongles." The best thing businesses can do is talk to the people who would use the technology before designing the product. Better yet, hire people with disabilities.

Dear companies, when you make accessibility part of your business and culture, you'll expand your reach. Promote that you have accessibility features. Don't be shy. This is the time to do it when there's less competition, but that will change soon.

Thanks to the pandemic, more companies are investing in accessibility.

And when you ask for feedback, don't stop with one person. People with the same disability are all different. When I wrote an article about sign language interpreters, I talked to multiple Deaf people who communicate with sign language every day. This quote says it all: "Nothing about us without us."

If you'd like the slides from this presentation along with other resources, they're at Meryl. Net/ID24 and my email is me at Meryl. Net. The email is on that page too. Thank you for your time and I'd like to give a Texas sized thanks and yeehaw to the ID24 team for having me.

And we're ready to take questions.

And here's another picture of me from when I was about two or three, in a vintage dress, gingham with overalls, a big chunky hearing aid on my chest, with a very plain white case.

Hello, sorry about that. Mild technical snafu. There had to be one at some point. Thank you, Meryl, that was a wonderful talk.

I loved hearing about all of that history of technology and and particularly your comment about no matter how many times something happens, like the bath overruns, you don't complain and moan. I get that, I really do. As we say here in the UK, mustn't grumble. I believe we have some questions.

Yeah, we do have some questions. Thank you so much, Meryl. I was giggling a lot at the beginning of your talk, about the magnets especially. So I'm going to go to bed tonight with a big smile on my face.

Our first question is are there underserved sectors of society for deaf folks, are we the privileged few to be in the technology space and have easier access to the benefits of tech improvements for deaf folks? Meryl: Wow. That's a tricky one. We that's a tough one. I'm trying to understand what the question is asking. The funny thing is I just read an article this week that a lot of people with disabilities don't even have access to technology.

So clearly there is a problem. And we and those who don't have access to technology, how are they supposed to let us know? It's kind of a catch 22, isn't it? So it sounds like there may be a need for programs to get technology to people.

It's gotten so cheap, I can't imagine there will be sponsors and government entities who could help get the technology to these people, so that they can be helped, have a bigger role in society.

So the next question is what do you think about tech that makes DeafTEC nothing intentionally visible? As opposed to trying to minimize its appearance? Meryl: I'm assuming that when you talk about deaf technology being visible, I'm assuming maybe you're talking about like a hearing device or a cochlear implant. Some people love it because kids, I've seen all kinds of decorations, colors, on cochlear implants and they are not ashamed of it.

There's no reason to be. They are so proud of it. I kind of envy them because growing up in a time when people always have something on their ear, whether it's Bluetooth or headphones, so it doesn't stick out anymore. I no longer fear the when I wear my [indiscernible] almost all of the time, considering curly hair makes them really hot. Nothing wrong with that.

So visible, not visible, we have control. And it's by choice.

Do we have any more questions? Meryl: Beyond those that you have covered already from history, how the creation of deaf or improvements for tech to be inclusive of deaf folks. Wow. That's on challenging one. A changing one.

Whoever builds the new technology, like right now, I feel like that's happening in virtual reality. But because for apps, all that I find are people asking the same question. Where are the captioned apps? So we have a tendency to create it's not just deaf people. It's people with other disabilities as well.

VR is very virtual. But I'm hearing some exciting research that will make it possible in the dark. So those there's actually a session coming up, so look that up or contact me and I'll tell you about it. So I there's always going to be improvements. Improvements, as I say, that will set us back a little bit but eventually things will come around and find a way to make include us.

Now with the last question, thank you for your excellent thought provoking questions. You had me thinking and I'll probably keep on thinking after this. So thank you. I really appreciate that you attended this.

And gave a little bit of your day. And thank you, Meryl, for your time and effort and a truly excellent talk. Thank you again. For everybody who has tuned in, head over to youtube.com/inclusivedesign24 and please show your appreciation by hitting the like button for Meryl's talk and indeed all of the others that we have shared so far today. While you are there, why not subscribe so you will get notified of future activities. A reminder that Inclusive Design 24 is a respectful community and our code of conduct is available linked from every page of our website.

#id24 2021, is brought to you with thanks from our supporters: Intopia, Fable, TPGi ARC, Adobe, TetraLogical, Intuit, Infoaxia, Centre for Inclusive Design, Web Directions AAA conference, Adrian Roselli LLC, and CANAXESS. Thank you to all of them. And we will be back with you for our penultimate talk in a little under 10 minutes.