Teach ChatGPT to Answer Questions: Using Azure AI Search & Azure OpenAI (Lang Chain)

AmitNilajkar  Thank you for your question.

In this answer, I'm going to talk about how to keep sensitive data private and how to chat on PDF without saving the PDF to storage.

1. How to keep sensitive data private

Cognitive Search's PII feature allows you to keep sensitive data private.

The following article describes the PII features of Cognitive Search. You may find this article useful.

Personally Identifiable Information (PII) Detection cognitive skill

1. Create a new Cognitive Search Service.

2. select +Import data.

3. Navigate to Add Cognitive Skills 

You can refer to my posts in the Series:1, 5. Add Cognitive Skills.

- Select Extract Key phrases and Extract Personally identifiable information.

 Selecting Extract personally identifiable information allows you to detect sensitive organizational and individual data and make it private.

4.  Change the index settings as shown below.

5. Navigate to the Indexers page and select the indexer you created.

6. In the indexer's JSON, modify the outputFileMappings as shown below.

"outputFieldMappings": [
        {
      "sourceFieldName": "/document/content/pii_entities",
      "targetFieldName": "pii_entities"
    },
    {
      "sourceFieldName": "/document/content/masked_text",
      "targetFieldName": "masked_text"
    },
   {
    "sourceFieldName": "/document/content/pages/*/keyphrases/*",
    "targetFieldName": "keyphrases"
  },
  {
    "sourceFieldName": "/document/content/pages/*",
    "targetFieldName": "pages"
  }
]

The rest of the steps are exactly the same.

Below is an example of a sentence that would appear if sensitive data were private.

"Microsoft employee with ssn *********** is using our awesome API's."

how to chat on PDF without saving the PDF to storage

1. if you are currently using ChatGPT's PLUS Plan
you can attach a PDF directly from ChatGPT's Advanced Data Analysis mode.

2. If not, you can also use private services that people have created.

Is this the answer you were looking for? 

Please leave a comment if you have any questions. Thank you.