Forum Widgets
Latest Discussions
Data Share. Comparing Azure Data Share with Snowflake Data Share
Hi All, Looking a new implementation and comparing Azure's products along side Snowflake for some key functionality. Has anyone done a similar comparison in the past and is happy to share their learnings. Much appreciated. I'll add back into this discussion with my finding as my investigation progresses.
Extracting tenant settings from Microsoft Fabric using PowerShell and the REST API
Microsoft Fabric is a unified platform that integrates data and services, encompassing data science and data lakes, to enhance your team’s data utilization. Discover how to leverage Fabric’s features like OneLake, Data Factory, Synapse, Data Activator, Power BI, and Microsoft Purview to usher your data into the AI era. To generate a tenant settings report using REST API, you can use the following steps: Obtain an access token from Microsoft Entra (aka Azure Active Directory) by following this guide: https://docs.microsoft.com/azure/active-directory/develop/v2-oauth2-client-creds-grant-flow Use the access token to call the Fabric REST API endpoint for tenant settings: https://learn.microsoft.com/rest/api/fabric/admin/tenants/get-tenant-settings Parse the JSON response and extract the relevant information for your report. Here’s a sample PowerShell script that can produce a report on Microsoft Fabric (including Power BI) tenant settings using the REST API: Download complete code snippet: fabric/admin/tenant_settings.ps1 (github)
azure synapse analytics /Apache spark logging
We are looking to implement logging using log4j in Azure synapse analytics - Spark pool / pyspark could not find any documentation for application level logging in azure synapse analytics. is there any default log library supported in azure synapse analytics ( log4j or any other) We are not able to upload the log4j.properties files into Synapse workspace as the workspace only accepts the .txt files for configuration. We were able to capture the spark logs using below MSFT docs. https://github.com/MicrosoftDocs/azure-docs/blob/master/articles/synapse-analytics/spark/azure-synapse-diagnostic-emitters-azure-storage.md now want to capture only Application logs with some logger library. There are good articles for log4j implementation for Azure Databricks. but we are not able follow same steps as the spark cluster in synapse not allowing to go into ubuntu folder of the cluster. any documentation or samples for synapse analytics will be a great help. Mark Kromer , James Serra - adding you for visibilityAzure Cosmos DB = Erro: The authorization token is not valid at the current time...
Toda vez que tentamos abrir Items, verificar os registros, aparece o alerta de erro abaixo: The authorization token is not valid at the current time. Please create another token and retry (token start time: Wed, 20 Apr 2022 11:50:09 GMT, token expiry time: Wed, 20 Apr 2022 12:05:09 GMT, current server time: Wed, 20 Apr 2022 11:44:19 GMT). ActivityId: xxxxxx, Microsoft.Azure.Documents.Common/2.14.0 Eu abro o Cosmo DB pelo Browser do Meu Computador, Browser "Microsoft Edge". SOLUÇÃO Habilitei os botões abaixo no meu computador para "Definir horário automaticamente" e "Definir fuso horário automaticamente" e tudo voltou a funcionar perfeitamente. FIMMicrosoft Fabric Tenant Settings - Reports
Microsoft Fabric is a unified platform that combines data and services, encompassing data science, data engineering, data lakehouses, data warehouses and visualizations, to enhance your team’s data utilization. Discover how to leverage Fabric’s features like OneLake, Data Factory, Synapse, Data Activator, Power BI, and Microsoft Purview to usher your data into the AI era. Tenant settings provide a detailed level of control over the features accessible to your organization. If you’re worried about sensitive data, some features may not be suitable for your organization, or you may want to limit certain features to specific groups. While tenant settings that govern the availability of features in the Power BI user interface can aid in setting up governance policies, they do not serve as a security measure. For instance, the ‘Export data’ setting does not limit a Power BI user’s permissions on a semantic model. Power BI users with read access to a semantic model have the right to query this model and may be able to save the results without utilizing the ‘Export data’ feature in the Power BI user interface. By extracting and externally visualizing tenant settings in Power BI reports, stakeholders can view, archive, and compare these settings with historical data. This approach negates the need for higher privileges and access to the Microsoft Fabric (previously Power BI) admin portal. Learn more about the tenant settings: About tenant settings - Microsoft Fabric and Tenant settings index - Microsoft Fabric To generate a tenant settings report using REST API, you can use the following steps: Obtain an access token from Microsoft Entra (aka Azure Active Directory) by following this guide: OAuth 2.0 client credentials flow on the Microsoft identity platform Use the access token to call the Fabric REST API endpoint for tenant settings: Tenants - Get Tenant Settings - REST API Parse the JSON response and extract the relevant information for your report. You can obtain the Power BI Template file from this location: Microsoft Fabric Tenant Settings.pbit (github) Enter the Tenant ID, Client ID, and Client Secret associated with the service principal that has the necessary permissions to retrieve the Tenant Settings. Please refer to the following documents to understand how to set up a service principal. Power BI REST APIs and Enable service principal authentication for read-only admin APIs Save the file as PBXI and upload it to the relevant workspace for sharing with stakeholders or co-administrators. Take advantage of the ability to capture snapshots of the settings for audit purposes and historical comparison Set up alerts for any new additions or modifications Set up automatic email exports for record-keeping Here are several methods for retrieving Microsoft Fabric tenant settings via the REST API using M query, Python, and PowerShell. Extracting tenant settings from Microsoft Fabric using PowerShell and the REST API Extracting tenant settings from Microsoft Fabric using Python and the REST APIInventário de Recursos do Azure | Extração de Dados para Analisar Recursos e Custos
Inventário de Recursos do Azure Extração de Dados | Analisar Recursos e Custos Objetivo: Ajudar Administradores de Cloud Azure. https://github.com/leonardorochadf/InventarioRecursosAzure É um script em powershell que possibilita gerar um relatório do Excel de qualquer ambiente do Azure ao qual você tenha acesso de leitura. São exportados dois arquivos: Um Excel contendo o índice de recursos principal no painel mostrando o número correto de recursos e está organizado de acordo com cada um. A arquitetura do Azure será gerada no arquivo XML, que você deverá abrir no https://app.diagrams.net Recursos Extraídos: Centro de Segurança ,Máquina virtual ,Disponibilidade definida ,Conjunto de dimensionamento de máquina virtual ,Disco Gerenciado ,Conta de armazenamento ,Rede Virtual ,Pareamentos de rede virtual ,Gateway de rede virtual ,WAN virtual ,Endereço IP público ,Balanceador de carga ,Gerente de tráfego ,Gateways de aplicativos ,Porta da frente ,Tabelas de rotas ,Zonas DNS públicas ,Zonas DNS privadas ,Anfitriões do Bastião ,Firewall do Azure ,SQL VM ,Servidores SQL ,Banco de dados SQL ,Banco de Dados do Azure para MySQL ,Banco de dados do Azure para Postgre ,Cache do Azure para Redis ,Cosmos DB ,Databricks ,Explorador de dados ,Plano de Serviço de Aplicativo ,Serviços de aplicativos ,Contas de automação e runbooks ,HUB do evento ,ÔNIBUS de serviço ,Espaços de trabalho do Log Analytics ,Serviço de Kubernetes do Azure ,Azure RedHat OpenShift ,Área de trabalho virtual do Azure ,Instâncias de contêiner ,Cofres de Chaves ,Cofre de Serviços de Recuperação ,Hubs IoT ,Gerenciamento de API ,Trabalhos de análise de streaming ,máquinas. Comandos: Install-Module -Name Az -MinimumVersion 4.7.0 -AllowClobber -Scope AllUsers Install-Module ImportExcel Install-Module Az.Accounts Install-Module Az.ResourceGraph Login-AzAccount Chamar o script no PowerShell. Execute "AzureResourceInventory.ps1". No Azure CloudShell você já está autenticado. No PowerShell Desktop, você será redirecionado para a página de entrada do Azure. Se você tiver privilégios em várias subscriptions, poderá especificar o desejado usando o parâmetro "-TenantID" ou o recurso do Azure verificará todas as suas IDs de locatários e solicitará que você escolha um. Exemplo: C:\Users\leonardo.rocha\Documents\GitHub\InventarioRecursosAzure\AzureResourceInventory.ps1 -TenantID xxxxxxxxxxxxxxxxxxxx -IncludeTags -Diagram -SecurityCenter -QuotaUsage O Resultado final estará na pasta C:\InventarioRecursosAzure FIMAzure Data Studio - default dashboard settings for Server and Desktop?
Hello. I am just starting to learning Azure Data Studio. My Server Dashboard and Database Dashboard don't seem to have the same widgets by default as per all of the tutorials. Below are my default settings (which have not changed). Could someone please tell me (or perhaps provide) the default settings I need so that my dashboards display all of the "default" widgets? { "workbench.enablePreviewFeatures": true, "workbench.startupEditor": "welcomePageWithTour", "datasource.connectionGroups": [ { "name": "ROOT", "id": "C777F06B-202E-4480-B475-FA416154D458" } ], "datasource.connections": [ { "options": { "connectionName": "", "server": "localhost\\SQLEXPRESS", "database": "", "authenticationType": "Integrated", "user": "", "password": "", "connectTimeout": "30", "connectRetryCount": "1", "connectRetryInterval": "10", "applicationName": "azdata", "groupId": "C777F06B-202E-4480-B475-FA416154D458", "databaseDisplayName": "" }, "groupId": "C777F06B-202E-4480-B475-FA416154D458", "providerName": "MSSQL", "savePassword": true, "id": "e53c9395-7bd0-4864-b65c-01ad39fbf340" } ], } PS: I couldn't find a specific topic group for "Azure Data Studio". If this is not the correct place, please let me know where best to ask my question. Many thanks MichelleExtracting tenant settings from Microsoft Fabric using Python and the REST API
Microsoft Fabric is a unified platform that integrates data and services, encompassing data science and data lakes, to enhance your team’s data utilization. Discover how to leverage Fabric’s features like OneLake, Data Factory, Synapse, Data Activator, Power BI, and Microsoft Purview to usher your data into the AI era. To generate a tenant settings report using REST API, you can use the following steps: Obtain an access token from Microsoft Entra (aka Azure Active Directory) by following this guide: https://docs.microsoft.com/azure/active-directory/develop/v2-oauth2-client-creds-grant-flow Use the access token to call the Fabric REST API endpoint for tenant settings: https://learn.microsoft.com/rest/api/fabric/admin/tenants/get-tenant-settings Parse the JSON response and extract the relevant information for your report. Here’s a sample Python script that can produce a report on Microsoft Fabric (including Power BI) tenant settings using the REST API: Tenant Settings: Download complete code snippet: fabric/admin/tenant_settings.py (github)Microsoft Fabric Tenant Settings v2 - Current & Snapshot Comparison
Preserve the API responses as JSON files either daily or weekly and use Power BI to analyze these snapshot files. This approach also enables you to subscribe to email notifications or alerts based on certain metrics as needed. Loading JSON Files: To import your local JSON files, select the JSON option in the Get Data menu and utilize the JSON connector in Power Query. This action prompts a local file browser for you to choose your JSON files. Transforming JSON Data: Power Query identifies tables within the JSON data and automatically converts them into a tabular format. You can then employ the editor to further modify the data as required, or simply close and apply. Data Analysis: Once all the JSON files have been imported and transformed into tables, Power BI’s data modeling and visualization tools can be used to analyze the data. You can formulate calculated columns, measures, and visuals to contrast the data across different JSON files. Email Subscriptions: Power BI offers the feature to regularly receive email updates for reports and dashboards. You can adjust the frequency of these emails to be daily, weekly, or triggered by data changes. This functionality allows you to stay informed with the most recent insights without the need to manually check Power BI. Alert Creation: Power BI also provides the capability to set up data-driven alerts, enabling you to receive notifications when your data surpasses predefined limits. Here are several methods for retrieving Microsoft Fabric tenant settings via the REST API Python, PowerShell and Curl. Extracting tenant settings from Microsoft Fabric using PowerShell and the REST API Extracting tenant settings from Microsoft Fabric using Python and the REST API You can obtain the Power BI Template files from this location: v1 Live/Current Tenant Settings: Microsoft Fabric Tenant Settings.pbit (github) v2 Live/Current Tenant Settings + Snapshot Settings: Microsoft Fabric Tenant Settings v2.pbit (github) v3 Snapshot Settings: Microsoft Fabric Tenant Settings v3.pbit (github) Provide the necessary parameters to the template file, save it as a PBIX file, and then publish it to the Power BI service. Provide the Tenant ID, Client ID, and Client Secret for the service principal that can access the Tenant Settings. Also, specify the folder path where the exported snapshot files are stored, so they can be read and compared. Please refer to the following documents to understand how to set up a service principal. Power BI REST APIs and Enable service principal authentication for read-only admin APIs Later, these reports can be shared with others and alerts can be created or subscribed to as required. The below is a version 1 or part 1 article that you can use as a reference. Microsoft Fabric Tenant Settings - Reports - Microsoft Community Hub
