We are excited to announce that question answering is now generally available as a feature within Azure Cognitive Service for Language. As part of our AI at Scale initiative across Microsoft, we are making the latest breakthroughs in natural language processing available across our products and within our Azure Services portfolio. Powered by state-of-the-art transformer models and Turing natural language model, we are excited to announce general availability of the question answering feature.
Question answering comprises of two capabilities:
With question answering becoming generally available, we are introducing:
Custom question answering
Customize with language studio: We are introducing a new guided experience to customize question answering with language studio. As shown below, users can customize domain specific knowledge base over their data by clicking on Open custom question answering.
Users can create a custom question answering project which is akin to a knowledge base. Users are guided to add data sources to the knowledge base and then test and deploy the same. We have a distinct Review suggestions section to manage and review Active Learning suggestions generated by the system based on real world user queries. These suggestions help users to optimize the knowledge base
based on real-world feedback.
In the Edit knowledge base section, we have added new editing and testing capabilities to improve the editing experience. We have advanced filters, support for drag-drop of questions and prompts, testing with metadata filters and score thresholds, etc.
Simplify service management: Question answering requires management of only 2 Azure services – Language Service for authoring and computation and Azure Cognitive Search Service for storage and ranking. This simplifies service management compared to QnA Maker that requires users to manage 5 services.
As question answering is now a feature in the Language Service, users can access other NLP features with the same Language Service. This greatly reduces complexity for users who combine multiple NLP features for their use cases. For instances, custom question answering (GA) and custom language understanding (Preview) are now both features in the same Language Service.
Support for 31 regions: Question answering is available across 31 regions supported by the Language Service. Now, the users can control the entire stack – authoring and prediction within the same region.
Support for unstructured content from public URLs: We now support adding both files and URLs with unstructured content to your knowledge bases. We have also added the ability to auto-classify a document/URL as unstructured if applicable.
If the answer to a user query is not addressed by the question answer pairs in the knowledge base, the service searches across the unstructured content (powered by Turing models) and returns the relevant response. Take for instance, a request-response example on adding the following URL on Surface Pen (with unstructured content) : Best in class, Microsoft Classroom Pen 2 empowers every student to achieve more | Microsoft Devices ...
State-of-the-art deep learnt Transformer models: Ranking question and answer pairs is powered by Turing multilingual language model (T-ULRv2), a transformer-based model, which improves the precision of the service for all supported languages. For any user query, the new ranker model understands the semantics of the user query better and gives better aligned results.
Custom question answering supports all the other capabilities that we introduced with QnA Maker managed in preview such as precise/short answer extraction from answer passages, and ability to add knowledge bases in multiple languages to the same service.
Steps to enable custom question answering
Migrate from QnA Maker to custom question answering
Prebuilt question answering
Prebuilt question answering provides users the capability to answer questions over a passage of text without having to create knowledge bases and manage additional storage. Given a user query and a block of text/passage the API will return an answer and precise answer (if available). Prebuilt question answering is available by default with a newly created language resource. Users can test the Prebuilt capability by trying out Answer questions from the Language studio interface. We currently support prebuilt question answering in 87 languages.
Customers will be charged starting 3rd Dec’2021. The pricing details are available on the Language Service’s pricing page. Users will be charged as per usage for question answering APIs. With custom question answering, users will incur the additional cost of Azure Cognitive Search as per the selected tier.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.