Forum Widgets
Latest Discussions
Speech Recognition for Alphanumeric
Hi, I am using Azure Communication Service with Cognitive Service for handling voice call scenarios (STT and TTS). One of our customer use cases requires alpha-numeric input in a workflow. The Azure Speech recognizer performs well for numbers and other patterns. However, when the user spells out alphabets for alphanumeric values, the recognition success rate is very low. For example, the product ID pattern is like "P-43246". In most cases, "P" is recognized as "D", "B", or "3". I have tested this on both mobile phone networks and VoIP. The success rate is significantly lower on mobile networks. Is there any settings available to improve the recognition success rate? Azure Services used: ACS Phone Number Azure Cognitive Service Event Grid Subscriptions Thanks, Aravind
how to record both video and unmixed audio of a group call
Hi, I need to record a meeting's video as well as unmixed audio stream of the call, but it seems from the documentation, we can only either record a mixed audioVideo format, or an unmixed multi channel audio format, we can not do both at the same time, I tried to start recording on the same serverCallId 2 times with different format mentioned, that did not work, is there any way to achieve what I want?Language Detection ACS Call Automation
Hey there, I am trying to build a multilingual voice bot using ACS and a web service. As users might speak different languages I am looking for a way to either translate the STT or at least detect the spoken language to adjust my backend accordingly. I do know this is possible with the Speech SDK. I am stuck now on how to connect these as I am using the Call Automation Library at the moment. Maybe there is even a better way i did not even think about. Also if someone knows why the Python library seems to be so much slower than the dotnet one when it comes to speech recognition please let me know. Thanks in advance, kugelblytzIgnite 2023: Creating value with intelligent application solutions for B2C communications
Today at Microsoft Ignite we shared that Azure Communication Services will soon release new capabilities for developers to shape the workflows they need to deliver faster, personalized communication experiences to their customers. Read about these releases and let us know if you want to discuss! Ignite 2023: B2C Communications (microsoft.com)Multiple Video/Voice Sessions
Hi Team, I am building a website with React 18 using the sample React projects for the Windows Communication Services components (available on StoryBoard). I would like to have multiple meetings running at the same time, but I don't see how to do that. I would have expected to pass a meetingID or something similar. I am using the useAzureCommunicationCallAdapter hook. Is there an example I can see to create a CallComposite that can "be bound" to a specific meeting URL? Thanks, GrahemVideo Constraints API to Control Call Quality
Azure Communication Services has unveiled a new capability for developers to control video quality during calls. Previously, video quality dynamically changed based on the device or network quality. With the Video Constraints API, developers can set constraints on the video resolution to ensure that a call is optimized for (1) user device and/or (2) network conditions. Examples of constraints include setting the max video resolution. For device optimization, if a user is using an older device with limited processing power for example, developers can set constraints on the video resolution to ensure that the video call runs smoothly on that device. For network optimization, there may be cases where pushing the highest video quality isn't a top priority and developers may want to limit the video bandwidth usage in the application to allow for processing of other capabilities. Learn how to implement call constraints in this documentation: Azure Communication Services Video constraints - An Azure Communication Services concept document | Microsoft LearnSimulcast to improve Call Quality for Group Calling
In group calls with three or more users, Simulcast helps to preserve call quality and bandwidth in situations where one user with poor network conditions acts as the lowest common denominator and degrades the video experience for all users. Simulcast is a technique by which a video feed is encoded with different qualities and sent to a selective forwarding unit (SFU). The SFU decides and sends the video feed with the optimal quality to each user based on the receiving user’s respective network. Lower resolution/bitrate content can be sent to the receiver on poor network and higher resolution/bitrate content can be sent to receivers on good network, thereby minimizing the impact of the lowest common denominator. One common use case that demonstrates the benefits of Simulcast is a receiver on a large screen (e.g. desktop) in a call with another receiver on a small screen (e.g. mobile) will not be affected by the quality of the smaller view. Simulcast will send a higher resolution to the desktop receiver and a smaller resolution to the mobile receiver. Learn more: Azure Communication Services Simulcast - An Azure Communication Services concept document | Microsoft LearnRaw Media Access (Audio and Video) is available in Public Preview
Public preview of audio media access is now complemented by the availability of video media access in public preview. Developers can now access the full raw media stream for incoming and outgoing audio and video media content during a call. The video media access API provides support for developers to get real-time access to video streams to capture, analyze, and process video content during active calls. Developers can access the incoming call video stream directly on the call object and send custom outgoing video stream during the call. This sets the foreground services to support a variety of video and audio manipulation. Outgoing video access can be captured and implemented with screen sharing, background blur, and video filters before being published to the recipient, allowing viewers to build privacy into their calling experience. In more complex scenarios, video access can be fitted with a virtual environment to support augmented reality. Spatial audio can be injected into remote incoming audio to add music to enhance a waiting room lobby. In one example, like a contact center scenario, these streams can be used to run custom AI models for analysis such as your homegrown natural language processing (NLP) for conversation analysis or provide real-time insights and suggestions to boost agent productivity. In virtual appointments, media streams can be used to analyze sentiment when providing virtual care for patients or provide remote assistance during video calls leveraging Mixed Reality capabilities. This also opens a path for developers to leverage newer innovations with endless possibilities to enhance interaction experiences. Learn more in the Raw media access Overview and QuickStart guide.
