LivioTM AI - by Starkey Hearing Technologies | Disrupt SF (Day 1)
3:09AM Sep 6, 2018
You're having fun,
so excited to be here and share a features of amazing new product that we just started shipping in the market. And that's the healing invented. But before I dive into the product, I'd like to start by appreciating the human sensory and perceptual system, our ability to sense the world understand, navigate in the world is quite amazing. The fact that we just see and understand we hear the world our sense of touch, smell and taste, we take it for granted. But our sensory system as amazing as they are, it degrades over time, just looking around. How many of you have eyeglasses? Quite a few? A few. I see a lot of hands. How about hearing loss? How many of us here in the room you think, have some sort of hearing issues? Well, it's not uncommonly as you might think. In fact, according to wall health organization, almost half a billion people in the world have what's considered to be disabling hearing loss. And that number is going to go to 900 million, almost a billion people by 2050. So there's a lot a lot of people that need help with hearing. We don't hear very well, many of us don't recognize that.
And that's where Starkey comes in. You might think, who's talking Have you heard about them? Well, so we are often known for the products we build the hearing aids when are the top five companies a billion dollar company and we also we also known for a work with stir with the world with poor people who cannot afford to buy hearing aids, and we help them through our foundation as well
about 5000 people employed in the company. We're headquartered in Twin Cities, but we do business worldwide in hundred countries. And that's starting you haven't heard about us, we are privately held company. So now we can go and buy stock for Starkey and as a result, not many people are another company.
So hearing aids, I don't know how many of you have hearing aids. But hearing aids, I've gone through a transformation before over the last few decades. They used to be this big, ugly body worn devices. And they have been made into this small tiny devices. Thanks to the miniaturization in microphones, digital signal processing, chips and speakers, Bluetooth radio, etc. They become really tiny devices that can connect with your phones. But in my view, that is only half the path that it could go. In fact, I compared that with the journey that phones went from these big ugly phones on your desk to the mobile phones in your pocket. Did the phone stop there? No, not really. They took one more step phones became multipurpose in 2007 and beyond with the introduction of iPhone and then a whole host of smartphones, phones went from becoming being a single purpose device that you only use to make a phone to a multipurpose device. That is almost everything in your life. The phones, your camera, the phones, your GPS device, the the Fall is your fitness tracker. So phones have gone from single purpose to a multipurpose on other hand, probably the reason many of you are not ever have hearing aids because they have been a single purpose device. Well, that ended last week because we have developed over the last year and started shipping just last week walls. First multipurpose hearing it with embedded sensors and artificial intelligence. It's the same technologies that are changing the world around you making cars drive by themselves, having drones fly around without running into trees, or smart cameras. Recognizing who's at home, we're using the power of AI and sensors that are built into hearing it itself to take a very successful, profitable, useful device for humans and making that into a multifunction device. Let me just walk through what of this multiple functions that this brand new disruptive hearing it does. Number
make no mistake, the primary purpose of the device is still to help people here better. And this device is our best sounding hearing aid best performing getting it were built in technologies like near field magnetic induction for year to year communication between the two devices to enable amazing binary signal processing. And by General noise reduction, we have used machine learning for automatic automatically classifying the environment around you. So if you're having challenging time in a business meeting in a noisy environment, where you having to have a conversation, trying to have a conversation with the person in front of you, this device is going to automatically classify the environment to be speech in noise class. And it's going to set the microphones the two of them in a directional mode. And it's going to preferentially amplify the sound that in front of you and not the rest. I've been using this device for a couple of months. Even though I don't have hearing loss, I don't want to live without them will I have a super human capability in listening to the device. Next,
in terms of streaming phone calls, and music straight into the hearing aids, we have built extremely low power Bluetooth and custom audio streaming protocol by collaborating very closely with Apple such that when I get a phone call, I get phone streamed straight into my hearing it and we get non stop streaming 45 hours of battery life. And with a typical usage closely a week of battery life, not the hours that you're used to in a consumer electronics device. So that's the number one number two. For the first time we have built in groundbreaking body and brain fitness tracker, by fitness tracking your friend, think about devices that track your steps. And of course, you can buy least one devices to do that. But with this hearing it we have embedded sensors and algorithms such that they're locally class, refine your actions. So even if you left your phone at home, or forgot where your watch or your fitness device the device is going to constantly classify will show you a demo of of that. But you've gone one step further. The health is not just about measuring steps and physical activity, but also about measuring quantifying your cognitive fitness. How socially engaged Have you been today, we are able to use machine learning to classify your acoustic environment. So if you sit all day in your room, by yourself, you're going to get a low score, we're able to see how much have you spoken, how much speeches in an environment having socially engaged, have you been, you're quantifying that. And that is our brain fitness score as well, we will show you a demo of that number three
things of science fiction, we're building an incredible language translator right into the hitting it in a foreign country don't speak the language, no worries, because he can speak any one of the 27 languages and choose to translate that to any other 27. And he back the response spoken in the local language back to your language spoken straight into your hearing aid adjusted for your hearing loss, we want to show you a demo of that as well
number for the sun device, which is primarily hitting it is also for the first time capable of automatically detecting if you fell down if you fell down, it will automatically detect it and send a text to your loved ones. And it's a common problem with with society, in fact, a big problem. But before I go into the numbers, I'd like to invite our Chief Innovation Officer Dr. David Ferrie, so you can start setting up to show you this amazing device
they doing and while he's doing that stay with you for just a minute on this fall,
we're not so worried that they're gonna fall down, right? It turns out in the US alone, according to the National Council of aging every 11 seconds and older adult is treated in emergency room for fall every now 19 minutes and older older adults dies from afar relatively injury. In fact, statistics I don't have on the slide. But it's very shocking people that are treated in the emergency room for a fall relative injury, 50% of them die within here. So it's a major problem. In fact, $67.7 billion of projected cost to US economy, it was $50 billion in 2015. And for the first time the hearing, it will be able to detect if you fail and classify the fall. So now I'd like to switch the screen to Dave's phone, which is connected to his fear of Livio a hearing aids and he's going to show you some cool features that I talked about working.
So action said, what I'm showing on the camera right now is the display of the app, which actually is controlling the hearing aids, which I'm wearing on my ears right now, the issue as he mentioned, in terms of the major functionality that we want to demonstrate today, first, the hearing aids can be controlled completely by the app on the phone. So if I want to change the volume up and down as I'm rolling up. And one
thing about the volume because I have not had hearing loss, but I've been using it for two months, the idea that you can raise the volume of the world it's quite amazing like superhuman you are, you know, in a challenging situation, I can raise the volume of my hearing aid or volume of the world. So I can hear conversations going on over there, which a normal healthy person cannot do. Yeah, so this
is our best performing device as option said, that we've ever made. And in addition to being able to control the instrument to amplify sound, raise the volume of the world, I can stream crystal clear audio from phone calls, from Siri from navigation from any app that has audio at all will be streamed discreetly and directly between the smartphone and my devices. So that's the first function. The second thing that he mentioned that we want to illustrate, you'll see what we're calling up here in the middle of the screen. That one 800 is a thrive score. What we talked about with this is really dependent on two functions. First, a physical activity. For those of you who maybe have used an apple watch or other fitness tracker, you'll see that we're recording and reporting steps activity in terms of exercise, and we've set the default at 30 minutes a day and then move just basically to get up and move every hour. Why is this important in the last session, they were talking about diabetes and cardiovascular disease. The issue is, is there strong comorbidity between hearing loss and other health conditions. We know that if you talk to a cardiologist in many cases, they'll tell you that the ear in the aging individual is an overall good barometer of cardiovascular health. We want to get people up and moving with their devices. And this is the first time that this has been directly used with this motion sensor is action indicated directly in the hearing instruments you not dependent on having the phone with you. In order to record your steps. You don't have to suffer from step regret. If you've walked around. This will record your steps throughout the day. And then as soon as your back proximal to the phone, it will log those steps as part of your overall fitness score. For the physical side.
by Charles point out, we have integrated apples health kit and Google fitness decay. So the same locally measured activity will be reported up into your Google Fit or Apple Health apps.
And one thing we wanted to just point out, it's important to gamma phi. This I'm a baby boomer, I'm subject to gamification, I can track my progress over previous days to see that I'm improving my physical activity we believe in sort of here better live better. And the second part of this as I go to the brain side of the score also will vary each day from zero to 100. And now what you see are three scores you score is simply related to the fact that we want people to wear their hearing aids 12 or more hours every day, if they were there hearing aids 12 hours a day, they'll get full credit on that you score, which is 40% of the hundred points. The second part is the engagement score. What we talked about with this is you think of your ears really are like your, your vision, like your smell there a sensor, the hearing really occurs in the brain, but the ears are picking up the sound, what we want people to do is where they're hearing instruments engage in conversation with other people. As often mentioned, the environmental classifier can determine in a physical environment when someone's wearing their hearing aids, whether speeches present,
so whether essentially using artificial intelligence to determine what component of the noise that you're
you're exposed to. It's actually human speech. Exactly. And the more that people engage in conversation with other humans, the bigger their score toward that 40 points will be recorded on a given day. The last element, we don't want people to wear their hearing aids, engage with other people, but stay at home, we want them to go out in social situations, again, because we strongly that hearing loss untreated hearing loss in the aging individual is strongly correlated with social isolation, depression, and even cognitive decline. So the third element of this is we're trying to encourage people to wear their hearing aids, engage in conversation with other people, and engage in active listening in diverse listening environments. We want them to where they're hearing aids everywhere they go, and we want them to go everywhere. So in this case, this score will vary between zero and 100. And you can look at the history the same as we did before. And it will spin up between zero in 200 on any given day,
doing quite well today, I'm doing quite well today. Yeah, I
gotta get my workout in this morning.
This is to show them some science science fiction. Indeed,
indeed. So let's go to that translation. My wife and I were fortunate enough to go to France last week. And I was able to try out my high school French and obviously it didn't take me really far. So the notion of innovation braiding real time translation in this device enabled me to go into an environment and you may have seen other real time translation devices on the market. The difference with our our device is that it will enable me to go into a situation and in this case, I've set it up so that the translated French to English will be broadcast discreetly in audio directly to my ear
Mojo mon ami como tal a vu,
it's just that fast. And it works. As I as you saw the transcription on the screen, it was translated directly to my ear. In audio, I was also able to use it the other way in the sense that if I went French to English, I could use it similar to Rosetta where if I wanted to practice my pronunciation, I could speak in English and hear the translated French and was able to demonstrate my not so good friends from high school. Cool so since
you're not going to fall detection demo by I'm not gonna I'm not gonna fall we should talk about the one more thing where if we have sensors built into the hearing it for the first time and we have AI to classify actions. What else could you do with it?
Well, to simplify human interaction with the device, rather than having to fidget with the buttons or look for the remote control, maybe a modern hearing aids despite this being our best product ever still hearing aid users and people with hearing loss struggle in background noise, we have a remote microphone that will transmit directly and discreetly so that if we were in a restaurant and action was wearing the microphone, it would broadcast wirelessly and directly from the microphone to my ear, like a third year. But many times in aging individuals, they may have neuropathy, they may have arthritis, they may just not want to fumble with the controls on a hearing aid to turn that microphone on or off. So instead, that same motion sensor can be used to engage or disengage simply by double tapping on the ear. It will turn on and off that microphone. Just to
mention the other popular use case of that would be when you're streaming TV signal data to hitting it we do have have a TV accessory that goes with the hearing aid you will be able to double tap to stop start the TV steam as somebody comes into your room and you don't have a conversation so I want to lasting industry the device
so amazingly small, tiny device that I go about all day and no one notices I have one on right. Think about it. I get 45 hours of non stop streaming practically a week and does all of those things. We think we are reinventing a device that was already so useful for a population that cannot live without them. And now the ability to utilize the same platform and bring in new technologies such as new sensors to turn that into a health monitor and utilize artificial intelligence to the give them many more benefits is quite amazing. We're quite excited about that. Helping people get better for sure, but helping people live better and in many more ways. In summary, we've made hearing aids kind of cool, that's for sure. And so thank you. Thank you very much.