NOTE: This is the most updated version of the blog posted in February 2020. This blog is based on the Unified Labeling version of the AIP scanner.
Most modern organizations have terabytes (or petabytes) of unstructured data sitting in their on-premises data repositories and SharePoint libraries. Managing this data, the way you manage other corporate resources, is a daunting but achievable task using tools that you likely already own. In this article, we will walk you through the discovery of sensitive data and show you options to classify and protect that data.
The AIP scanner allows you to scan your on-premises data repositories against the standard Office 365 sensitive information types and custom types you build with keywords or regular expressions. Once the data is discovered, the AIP scanner(s) can aggregate the findings and display them in Analytics reports so you can begin visualizing your data risk and see recommendations for setting up protection rules based on the content.
To configure the AIP unified labeling scanner, there are a few steps you need to follow:
Now, this may seem like a lot of things, but don't worry. We will walk you through the whole process so that it is as painless as possible. This article assumes a standard implementation. Before production deployment we recommend that you read through the official documentation at https://docs.microsoft.com/en-us/azure/information-protection/deploy-aip-scanner to ensure that you will not run into any issues and to help through any custom scenarios.
Installing the AIP scanner binaries is a very straight-forward process as they are included with the AIP unified labeling client. Navigate to https://aka.ms/AIPClient and click the Download button. When presented with the download options, check the box next to AzInfoProtection_ul.exe and click the Next button. The download should start automatically. Once complete, double-click on the file and run through the quick setup on the prepared AIP scanner server. Please be sure to select the most up-to-date GA UL Client.
We must create an Azure AD Application for AIP Authentication to allow the scanner to protect files non-interactively (you only need to run this the first time you are setting up the AIP scanner. You can use the same Set-AIPAuthentication command created at the end to authenticate multiple AIP scanner servers). The official documentation for creating these applications is found at https://docs.microsoft.com/en-us/azure/information-protection/rms-client/client-admin-guide-powershe....
For convenience, we have created a video that will walk you through how to create the AAD Application.
Next we will be obtaining admin consent necessary to run the AIP client unattended. This will be done by obtaining an Azure AD Token.
Navigate to the Azure Portal and proceed to the Azure Active Directory Blade.
In the Azure Active Directory side pane, click App Registrations.
At the top, go ahead and click + New registration.
In the Name section type in AIPScanner.
Leave Supported account types as default.
For the Redirect URI, leave the type as Web but type in http://localhost for the entry portion and click Register.
On the Overview page of this application, note down in your text editor of choice the following IDs: Application (client) ID and Directory (tenant) ID. You will need this later when setting up the Set-AIPAuthentication command.
On the side pane, navigate to Certificates and Secrets
Click on + New client secret
In the dialog box that shows up, enter a description for your secret and set it to Expire In 1 year and then Add the secret.
You should see now under the client secrets section that there is an entry with the Secret Value. Go ahead and copy this value and store it in the file where you saved the Client ID and Tenant ID. This is the only time you will be able to see the secret value, it will not be recoverable if you don't copy it at this time.
On the side pane, navigate to API Permissions
Go ahead and select Add a permission.
When the screen shows, select Azure Rights Management Service. Then select Application Permissions.
Navigate back the API Permissions section and add another permission.
This time, for the Select an API section, click on APIs my organization uses. In the search bar, type in Microsoft Information Protection Sync Service and select it.
Select Application Permissions and then in the Unified Policy drop down, checkmark the permission UnifiedPolicy.Tenant.Read. Then at the bottom of the screen, click Add Permissions.
Back on the API Permissions screen, click Grant Admin Consent and look for the operation being successful (signified by a green checkmark).
Although this step is technically optional, we recommend configuring analytics prior to running your first scan so you can begin to visualize your data risk as shown in the initial image in this article. In the AIP blade of the Azure Portal, you will see Configure analytics (preview) under the Manage section. Click on this and you should see a page like the one below.
If you already have a configured ALA Workspace for this purpose, check the box next to it and press OK. Otherwise, click the + Create new workspace link.
Fill in the items shown in the image below:
Finally, back in the Configure analytics (preview) blade, check the box next to the workspace and click OK.
NOTE: Checking the box next to Enable deeper analytics allows the actual matched content to be stored in the Log Analytics workspace. This could include many types of sensitive information such as PII, Credit Card Numbers, and Banking Information. This option is typically used during testing of automatic conditions and not widely used in production settings due to the sensitive nature of the collected data. If this is used in a production setting, extreme caution should be taken with securing access to this workspace.
Configuration of the AIP scanner is currently done via the Central Management User Interface in the Azure Portal. We will quickly walk through the minimum configuration elements to install a functional scanner in discover mode.
We should now have all prerequisites in place to install the AIP scanner.
If you encounter any errors, please validate that the installer account has the permissions mentioned in the On-Premises Prerequisites and you do not have any firewall issues reaching the SQL server or Azure.
Now that you have the AIP scanner service installed, you can run the Set-AIPAuthentication command to get the non-interactive authentication token as was demonstrated on the video using the following command:
$pscreds = Get-Credential Contoso\AIPScanner Set-AIPAuthentication -AppId "<CLIENTID>" -AppSecret "<SECRET>" -DelegatedUser email@example.com -TenantId "<TENANTID>" -OnBehalfOf $pscreds
For your $pscreds variable make sure to use your AD Domain name followed by the backslash with your local admin that is being used on your AdminPC machine. You will be prompted for the local account password so fill that in and hit enter.
For your -AppID parameter input the Application (Client) ID you saved in a file earlier. Be sure to include the quotation marks.
For your -AppSecret parameter input the Secret Value that you saved in a file earlier. Be sure to include the quotation marks.
For your -DelegatedUser parameter input the AAD synced or cloud-based service account you are using to manage AIP. You do not need quotation marks here.
For your -TenantID parameter input the Directory (Tenant) ID that you saved in a file earlier. Be sure to include the quotation marks.
Make sure to use $pscreds as the parameter for -OnBehalfOf.
Run the command and if successful, you will receive the following message "Acquired application access token on behalf of Contoso\AIPScanner."
You are now ready to run the scanner!
After a few minutes you will begin seeing data start to flow into your Data discovery (Preview) dashboard in the azure portal. Since you are only doing discovery, you will not see any labeled or protected files (unless you have been using AIP before running the scanner), but you will see the identified files and the sensitive data types found in the configured repositories.
There is also a blade under Analytics named Recommendations (Preview) that will be populated by this data. Any sensitive information types discovered that do not have associated automatic classification conditions will display in this blade.
You may then click on the sensitive information type and a fly-out panel will allow you to assign the information type to a classification label. This allows you to quickly map your sensitive information to classification labels.
NOTE: The AIP scanner will only trigger on conditions which are set to Automatic.
Once you have configured these conditions, you can return to the profile in the Azure portal and change the settings to the ones below.
Because we set the schedule to Always, the scanner will begin monitoring the files automatically within 5 minutes. If you want to start the scan yourself, follow the instructions below.
The result will be similar to the image shown below with labeled and protected files and the distribution graph showing in the Data discovery (Preview) dashboard.
Please let us know in the comments if you have any questions on this approach. For more information please be sure to check our team's github at aka.ms/mipfiles. If you are interested in how Microsoft uses the AIP scanner, please see the MSIT showcase at https://aka.ms/ScannerShowcase.
The Information Protection Customer Experience Engineering Team
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.