Trying to Hear: Constructing Augmented Actuality For Good

Looking to Listen: Building Augmented Reality For Good

With SXSW not going forward as a result of coronavirus, we needed to highlight two groundbreaking tech entrepreneurs who had been hoping to introduce the attendees of the large tech, film, and music competition to an entire new realm of accessibility. At this 12 months’s competition,’s Dr. Yoonchang Han and COO Subin Lee had been set to current a panel on their new Augmented Actuality-based undertaking Trying to Hear, which goals to make small however groundbreaking enhancements within the lives of individuals with listening to impairments.

Within the wake of the competition’s cancellation, we’re sharing this interview that was initially going to run in our SXSW particular version print journal within the hopes of highlighting the work that the pair are doing with their firm and improvements.

Based in Seoul in 2017, has an intriguing mission assertion: “To create a machine listening system that may perceive any sort of sound.” That concept is being put into observe with the Trying to Hear undertaking, which goals to make the most of their expertise to create an app that may supply hearing-impaired individuals a manner of being visually alerted to the sounds that encompass them.

“There are many speech recognition methods on the market,” Dr. Han says. “However the factor is, we imagine that there’s a lot different data contained in different audio, like environmental sounds. Most fashionable AI methods focus an excessive amount of on voice recognition, so we’re making a system that may perceive different kinds of sounds. For instance: canine barking, glass breaking, laughing, or screaming.”’s goal is to create a wearable prototype that can enable individuals who can’t hear to have visible prompts explaining the sounds that the Trying to Hear program hears round them. 

For Han, the journey, from his scholar days at King’s School London finding out music evaluation to founding a machine listening startup, was a logical one. “After doing music evaluation we realized that different sounds could be analyzed in the same manner. Then we have now to consider what utility will probably be most helpful for individuals and, at, our firm slogan is ‘Creating ears for synthetic intelligence.’ So, in fact, essentially the most helpful utility of that will probably be for somebody who can not hear very nicely.” 

In case you’re a gamer, you’ve in all probability utilized Augmented Actuality (AR) when taking part in video games like Pokémon Go, Ingress, or Niantic’s current foray into gaming, Harry Potter: Wizards Unite. The concept of the tech is to construct on the world that we see round us, therefore the time period “augmented,” however, with Trying to Hear, the corporate hopes to take the expertise and apply it to the on a regular basis lives of individuals with listening to impairments. 

The present iteration of this system can decipher 34 separate environmental sounds that vary from human interactions to dwelling home equipment and emergency alerts. That improvement has knowledgeable what the primary iteration of the tech will middle on: primary interpersonal connections and important emergency warnings. “Once we discuss emergency sounds, we’re eager about screaming, sirens, or fireplace and smoke alarms. For human interactions, we’re speaking about noises like finger snapping, whistling, or knocking at a door,” Dr. Han explains. 

Throughout early conversations and consulting periods with individuals with listening to impairments about how the expertise may very well be helpful, one thing shortly grew to become clear: “They didn’t suppose that this was attainable. A lot of the expertise round listening to impairments is extra typical and centered on serving to somebody’s listening skill so what we’re doing as a startup may be very new.” 

In terms of what these individuals need from the potential software, the workforce quickly realized that it’s about creating cheap and simple changes in individuals’s on a regular basis lives that would make an enormous distinction. “If they will ‘hear’ or pay attention to a easy factor like a laundry machine ending its cycle, a canine barking, or a child crying, it may well actually change somebody’s day by day life.” 

In our imaginative and prescient of the longer term, whether or not in video games, movies, or actual life, there’s a massive array of expertise that would doubtlessly have constructive life-altering impacts on the lives of those that stay with disabilities, however typically that facet and the potential of those improvements is ignored. Dr. Han desires to vary that with Trying to Hear by making the most of expertise that already exists and shaping it into one thing new. “Today so many audio system and these platforms are utilizing speech recognition, that’s why there are such a lot of microphones on the market. Once I take into consideration how everybody makes use of good audio system, wears Apple earpods 24/7 and forgets that they’re sporting them, these microphones are actually all over the place. We’ve got the infrastructure prepared for us.”

Although the methods are there, the corporate continues to be engaged on a prototype for the wearable tech which might comprise Trying to Hear and convert the audio evaluation to a visible immediate. Initially starting with the thought of easy textual content visuals, the workforce is now contemplating utilizing pictures and even animation, however the prototype continues to be within the works. 

The tip aim for Dr. Han and is to create one thing that goes far past the straightforward “on and off” capabilities of present voice recognition tech.

“To offer an appropriate personalized expertise for every particular person, that context-aware system is a extremely necessary aim,” he says. “That’s the best use of this audio evaluation expertise.” 

cnx.cmd.push(operate() {
playerId: “106e33c0-3911-473c-b599-b1426db57530”

The put up Trying to Hear: Constructing Augmented Actuality For Good appeared first on Den of Geek.

About the author



Add Comment

Click here to post a comment