Agora Launches Solutions for AI Noise Suppression and 3D Spatial Audio

A smiling woman and three other people using AI noise suppression solutions from Agora for a wide range of use cases.
(Image credit: Agora)

Agora launched its AI Noise Suppression, a new audio solution that removes background noise such as typing, pets, kids, coughing, or room echo from meetings, leaving only the human voice. AI Noise Suppression ensures distraction-free communication, improves the quality of broadcasts and provides a more immersive audio experience.

In recent years, hybrid working has led to employees working from a variety of locations, resulting in the increasingly important need for good acoustical background conditions to support clear, high-quality and effective communications in a remote audio or video setting. Audio experiences such as background noise, echo, and sound reverberation being transmitted into meetings causes disruptions and distractions. As a result, meetings lose productivity and employees can be stressed from not being able to clearly hear what colleagues are saying.

[Step into the Metaverse]

Based on deep-learning models, Agora’s AI Noise Suppression solves these poor audio experiences by recognizing human speech and analyzing the audio feed, filtering out any background noises and enabling a crystal-clear audio output. Features include noise reduction capabilities, echo and reverberation removal, low latency, cross-platform support and global scalability. The technology is easy to integrate and enabling AI Noise Suppression only takes a few lines of code. Agora’s AI Noise Suppression is compatible across commonly used platforms such as Web, Windows, Android, MacOS/iOS, Electron, Flutter React Native and Unity.

"At Agora, we ensure sound quality is a foundational element of our technology, products and services that support communications, whether it be a work video call, virtual education, or playing games with friends," said Patrick Ferriter, vice president of product at Agora. “Audio is at the core of any digital experience and with AI Noise Suppression, customers can easily remove background noise from their applications and create more focused, immersive experiences for their users.”

[Top Integrators 2022: Technology Trends]

AI Noise Suppression can be applied to improve enterprise collaboration, enhancing the clarity of voices in video calls and removing distracting sounds like keyboard noise, office conversations, and outside noise like construction.

A miling man and three other people using AI noise suppression solutions from Agora for a wide range of use cases.

(Image credit: Agora)

For Livecasting and Metaverse interactions, Agora’s solution delivers presence, giving the feeling that everyone is in the same room, and eliminates sounds like feedback and echoes. AI Noise Suppression eliminates common external sounds picked up in game chat rooms, such as game sounds from speakers being picked up by a microphone and feedback from several people speaking at once.

Additionally, Agora announced the launch of Agora 3D Spatial Audio, a solution that allows developers to add immersive, dynamic audio into real-time digital experiences. With a few lines of code, developers can connect to Agora’s 3D Spatial Audio to enable a more natural audio experience that works seamlessly with video, voice, and streaming products, replicating how sounds are heard in the real world and boosting user engagement.

3D Spatial Audio brings theater-like effects to video, voice and streaming products by making it seem as if the sound originates from all around the user. By setting the local and remote user's spatial positions, developers can create an environment that enables users to experience changes in the distance, position, and orientation of other users in real-time. In addition to a more natural listening experience, 3D Spatial Audio is quick and easy for developers to integrate and provides the highest fidelity of 3D audio, supporting 48 kHz full-band sampling. The solution is low latency, low power consumption, and supported across all regularly used platforms such as Web, iOS, Android, Mac, Windows, Unity, Flutter, React Native, and Electron.

[SCN Hybrid World: Workplace Products and Expert Tips]

Agora’s 3D Spatial Audio can be applied to live casting to create a more personal environment, as well as education to enrich the digital learning experience by making it feel as if the teacher is sitting next to the student. Meetings and conference calls are made more effective with 3D Spatial Audio by allowing participants to focus on the main speaker, and music streaming becomes more immersive by allowing listeners to hear more nuances in 3D space.

“Immersive digital experiences, whether for social or work purposes, need to deliver high quality and natural, lifelike three-dimensional audio to users,” said Ferriter. “Agora’s 3D Spatial Audio, gives developers the capabilities to create digital worlds ripe with sounds and auditory details in ways that heighten the opportunities to deliver more vivid and memorable experiences to their user audience.”

The AVNetwork staff are storytellers focused on the professional audiovisual and technology industry. Their mission is to keep readers up-to-date on the latest AV/IT industry and product news, emerging trends, and inspiring installations.