Your Video Insights, Promptly Extracted: Azure AI Video Indexer's Preview of Prompt-Ready API
Have you ever watched an online course and wished you could ask questions on the entire course, or have a comprehensive summary of a video? This can all now be achieved with Azure AI Video Indexer and an LLM (Large Language Model) – powering each other. LLMs are powerful language models that can capture the essence of text and allow natural language question-answering and much more. In Azure AI Video Indexer, we understand videos – video content is more than just words, and a single shot can contain a wealth of insights that are critical for its understanding. Coupling these two powerful tools can lead to great results in video understanding, and downstream tasks in natural language. Our new API extracts and processes all the multi-modality insights of a video into prompt-ready format, that can be easily used with LLMs.
Document Redaction and Sanitization with ChatGPT on Azure
Privacy and Security are the topmostpriorities for Consumers and Businesses. Bad actors can steal the information when it is in transit between the systems, when it is being processed or even when archived. Large Language Models have opened doors for more effective ways of sanitizing the documents. In this article I will provide some examples of how to sanitize the documents using ChatGPT on Azure. What is Document Redaction and Sanitization? It is the process of removing or replacing any information that is considered as sensitive, private or confidential. What types of information needs redaction? Following are some sensitive information types that needs redaction: Personally Identifiable and Information (PII): Anything information that helps identify a person called needs to be redacted. Examples include people's names, addresses, social security numbers, drivers license etc. Protected Health Information(PHI) : Health related information such as patient’s medical records, insurance group numbers, benefit information etc. Business Confidential Information: Organizational information such as employee records, biometric records, business related secrets, contractual information, financial documents, judicial records etc. Using ChatGPT on Azure for Redacting and Sanitizing the documents: Example 1: Sanitize the sensitive information from an Invoice The sample invoice I am going to use is in scanned format. As ChatGPT can only take plain text as input currently, we first have to digitalize the invoice. Form Recognizer service is a very effective way of digitizing the scanned documents. Below is a screenshot from Form Recognizer with the Invoice example: After extracting the data from the invoice using Form Recognizer and some cleansing, we will have the plain text something like below: You will find the responses below from ChatGPT for my redaction and sanitizing instructions: Prompt: Show me all the references of PII below: Prompt:redact all references of PII data below: Prompt: Replace all occurrences of Contoso with LinkedIn: Prompt:convert all dates to MON-DD-YYYY format. show me only dates: Example 2: Sanitize information from a Health Insurance Card for PHI data: Similar to the above example, I used the Form Recognizer service to extract the information from a health insurance card. Below are some examples on how to sanitize the PHI information. Prompt:show me all references of PHI: Prompt:redact all references of people names below: You can continue with various redaction and sanitization activities in the document such as replacing text, removing text, translating text, converting currencies etc. All the Best! Note1: The responses may vary depending on the hyperparameters like Temperature, Top Probabilities etc. Note 2: I also encourage you all to try the same prompts ontext-davinci-003 model also.Introducing Native Document Support for PII Detection (Public Preview)
This capability can now identify, categorize, and redact sensitive information (PII - Personally Identifiable Information) in unstructured text directly from complex documents, allowing users to ensure data privacy compliance within a streamlined workflow. It effortlessly detects and safeguards crucial information, adhering to the highest standards of data privacy and security.Building Real-Time, Intelligent AI Copilots with Confluent Cloud, Azure OpenAI & Azure Data Services
Real-time application scenarios such as airline booking systems often provide suboptimal user experiences, with customers having to navigate complex systems and rules to perform simple tasks. In this blog post, we will explain how to build intelligent agents on top of Confluent, Azure data services and Azure Open AI to deliver real-time insights and help customers conduct business transactions.Microsoft Translator Plugin for Azure OpenAI & Tools for PromptFlow
Microsoft Translator Plugin for Azure OpenAI allows users to translate a source text between any of the 125+ languages and dialects supported by Translator service using either general or custom translation models.Translator and Language Detect tools for PromptFlow helps you to get better responses for various prompts submitted to GPT in non-English languages.What’s new Azure AI Language | BUILD 2023
We are announcing more new features and capabilities:General Availability (GA) of document and conversation summarization, and public preview of the following features: interactive custom summarization powered by Z-Code++ and Azure OpenAI Service, custom sentiment analysis, enhanced Text Analytics for health, Named Entity Recognition (NER) and Personal Identifiable Information (PII) Detection, increased language coverage, enhanced integration capability, and expanded container support.
Microsoft Azure Text Translation SDK now in Public Preview
Microsoft announces the public preview of its Azure Text Translation SDK designed to help developers easily add text translation capabilities to their applications. In this post, we'll take a closer look at what the Azure Text Translation SDK is, how it works, and how developers can use it.
