Forum Widgets
Latest Discussions
Content Search: Stacking Keyword Groups
I am trying to create a Content Search for a data subject request, and I am having a really hard time building out my KQL. The issue is that I need to stack two sets of keyword searches, but the estimated results are wildly high so I feel I must be doing something wrong. In English, the search requirement is (using example keywords): Find all mail or SharePoint content where: Keywords include (Max OR John OR Sally) AND Keywords include (White OR Black OR Red) AND Date between Jun 2024 and Nov 2024 I have tried all different forms of this KQL, but I've essentially come up with this: ((Max John Sally) AND (White Black Red)) AND (Date=2024-06-01..2024-11-04) Does anybody have an idea where I'm going wrong?
Forced to new purview portal nothing works or is too slow
so what we feared has occured; forced to the new portal and nothing works. cannot change roles we have roles as they worked in the old portal but new portal doesn't seem to accept the custom roles. cannot implement content search across SPO anyone else having issues?
Data Quality/Data Profiling Scan issue in Purview
Hi Everyone, Hope you are doing great !! I tried to run Data Quality/Data profiling scan in Purview, Scan got failed with an error "DataQualityInternalError Internal service error occurred. Please retry or contact Microsoft support" Could you please help me how can I resolve it. Want to ensure did I have provided right access to Purview : Currently I am using Purview MSI as an authentication option to integrate (Fabric and Purview) and provided Purview MSI with "Contributor" role access to our required Fabric Workspace. Also I am having "Contributor" role access to the required Workspace. Kindly help me to understand: if we want to run data quality scan on Fabric Workspace, User (Myself) should assign with which level of access Member or Contributor in Fabric To run Data quality/Data profiling scan on Fabric Lakehouse delta tables in Purview , Which authentication should I have use (MSI or Service Principal) Could you please help me to resolve it, It will help us to do Data Quality and Profiling. Thanks in advance. Regards, Banumathi
Exporting Microsoft Purview Data Assets using the REST API
Exporting Data Assets from Microsoft Purview using the REST API in Python enables a streamlined process to retrieve structured metadata and asset information. By leveraging the REST API and Python, users can effortlessly access and export Data Assets, ensuring a programmatic and efficient approach. The powerful combination of the REST API and Python empowers users with flexibility and automation capabilities, facilitating the extraction of Microsoft Purview Data Assets and seamless integration with various data management and analytics workflows. I performed a sample search on the Microsoft Purview governance portal using "*" as the keyword to generate a list of all data assets. The accompanying screenshot from the Purview portal serves as a reference. The generated CSV file shown below is the output obtained from Microsoft Purview using the REST API. Here's a guide on exporting data assets from Microsoft Purview using the REST API in Python. To access Microsoft Purview through the Python SDK, please ensure that you install the following PyPI libraries: pip install azure-identity pip install azure-purview-scanning pip install azure-purview-administration pip install azure-purview-catalog pip install azure-purview-account pip install azure-core pip install pandas Important Your endpoint value will be different depending on which Microsoft Purview portal you are using. Endpoint for theclassic Microsoft Purview governance portal: https://{your_purview_account_name}.purview.azure.com/ Endpoint for the New Microsoft Purview portal: https://api.purview-service.microsoft.com Scan endpoint for theclassic Microsoft Purview governance portal: https://{your_purview_account_name}.scan.purview.azure.com/ Endpoint for the New Microsoft Purview portal: https://api.scan.purview-service.microsoft.com To create a Service Principal and grant Data Reader or Data Curator access to the Service Principal at the Microsoft Purview Collection Level, please refer to the instructions provided [here]. keywords = "*" tenant_id = "<Please update the Microsoft Purview tenant ID here>" client_id = "<Please provide the updated Service Principal client ID that has access to the Microsoft Purview account>" client_secret = "<Please update the Service Principal client secret for the aforementioned client ID>" purview_endpoint = "https://<Please provide the name of the Microsoft Purview account>.purview.azure.com/" purview_scan_endpoint = "https://<Please provide the name of the Microsoft Purview account>.scan.purview.azure.com/" Retrieve the entire notebook file from [GitHub]. from azure.purview.catalog import PurviewCatalogClient from azure.identity import ClientSecretCredential from azure.core.exceptions import HttpResponseError import pandas as pd from pandas.io.json import json_normalize keywords = "*" export_csv_path = "purview_search_export.csv" keywords = "*" tenant_id = "<Please update the Microsoft Purview tenant ID here>" client_id = "<Please provide the updated Service Principal client ID that has access to the Microsoft Purview account>" client_secret = "<Please update the Service Principal client secret for the aforementioned client ID>" purview_endpoint = "https://<Please provide the name of the Microsoft Purview account>.purview.azure.com/" purview_scan_endpoint = "https://<Please provide the name of the Microsoft Purview account>.scan.purview.azure.com/" def get_credentials(): credentials = ClientSecretCredential(client_id=client_id, client_secret=client_secret, tenant_id=tenant_id) return credentials def get_catalog_client(): credentials = get_credentials() client = PurviewCatalogClient(endpoint=purview_endpoint, credential=credentials, logging_enable=True) return client body_input={ "keywords": keywords } try: catalog_client = get_catalog_client() except ValueError as e: print(e) try: response = catalog_client.discovery.query(search_request=body_input) df = pd.DataFrame(response) jdf = pd.json_normalize(df.value) jdf.to_csv(export_csv_path, index=False) except HttpResponseError as e: print(e) The provided Python notebook or script is capable of exporting the following set of columns in the output CSV file. endorsement collectionId updateTime name description displayText label sensitivityLabelId objectType isIndexed assetType @search.score updateBy qualifiedName createBy owner id entityType createTime classification Additional Reference:Exploring Purview’s REST API with Python (microsoft.com)
Do not forward option in Outlook Desktop not removed after change sensitive Label
Hi everyone, Im using Outlook Version 2408 I have a sensitive labelConfidencialset tolet user assign permissions and the optionDo not Forward Enabled If I remove the labelor change it to a lower priority one without encryption. The option Do Not Forward is not automatically removed. I have to remove it manually from the option Encrypt to fix it. With the Outlook new version or Web this is not happening, but some user still use these Outlook Desktop version This will be a problem by the time for users. They might be sending encrypted email messages accidentally or sending encrypted emails withPublicsensitivity label.Is there any way to fix it. Thanks for your help.
Creating content scan jobs in microsoft purview information protection scanner using powershell
Hello Everyone Please let me know what method available to create content scan jobs and add repositories in automated way? Is there any PowerShell method? I do not see commands available to create content scan jobs in Microsoft purview information protection scanner. Thank you in anticipationIs anyone here using Compliance Manager to perform IT audits
Hi, I'm a former CISO now independant consultant and IT auditor , mostly for ISO 27001. I belive Compliance Manager is the future for IT audits but I have not been able to connect to anyone using this module in Purview for IT audits :) Is there anyone able to generate a SOA report ? :)Excluding SharePoint sites from "Never Delete" Policy?
Is there a way to exclude certain SharePoint sites from a Never Delete compliance policy, so that they are allowed to be manually deleted? And if so, how long after I add them to an exclusion list should they become available to be manually deleted?Auto retention label policy does not work in SharePoint Online
I have created an auto retention label policy and ran and tested it in simulation mode two weeks back, but when I run the same policy with the same query in simulation mode, it does not give any matching result; always it comes with 0 matches found. However, when we test the same query in SharePoint Online search, it gives a result. The policy is completing on time; sometimes it takes hours to days to complete, but sometimes it completes on time as expected. What could be the reason? Are you also facing similar issues? Thanks!
