Forum Widgets
Latest Discussions
GitFlow possible with Synapse?
My team has been using synapse for some time across our dev, uat, and production environments. So far, they have not utilized any CD to deploy up environments but instead promote artifacts manually. The reason being is that their UAT environment is rarely ready to go to production. Features often sit in UAT for many months before deployment to production, but are required to be in UAT for testing with the full dataset. This seems to indicate the need for a branching strategy like GitFlow to allow for selective PRs using cherry-picking or git revert to allow for only ready features to production. Has anyone faced this issue or have any tips on how to resolve this challenge. It seems unlike traditional app development; feature flags don't solve the issue as they only really can work inside pipelines. Thanks!
Azure Synapse Issue
Hi, I have a question regarding the backend mechanism of Synapse Spark clusters when running pipelines. I have a notebook that installs packages using !pip since %pip is disabled during pipeline execution. I understand that !pip is a shell command that installs packages at the driver level. I’m wondering if this will impact other pipelines that are running concurrently but do not require the same packages. Thank you for your help.Azure Synapse: What’s Next?
With the recent introduction of Microsoft Fabric, which aims to unify various data and analytics workloads into a single platform, how will this impact the future of Azure Synapse Analytics? Specifically, will Azure Synapse Analytics become obsolete, or will it continue to play a significant role alongside Microsoft Fabric? Additionally, what are the recommended migration paths and considerations for organizations heavily invested in Azure Synapse Analytics?”
Azure Sql Database Linked Service Lookup Activity Error
Started receiving this error when previewing results in both lookup and copy activities that are connected to an Azure SQL Database. My production pipeline (that is triggered) fails on the Azure Database lookup activity. Does anyone hav any insights on what is causing this issue? And/or how to resolve? Thanks!
Error 403 on random occasions
Getting the following error on random occasions since yesterday. It may be related to other issues I am seeing at the same time, such as the Spark pool suddenly not starting up and the splash screen getting stuck with 401 (unauthorized) error. This is not related to our configuration of access. This has been working before. It also works when I try some times, and other times not. It seems completely random. Azure Service Health is just showing green (as always).Synapse Studio stuck on loading the splash screen with '401 unauthorized'
Synapse Studio has been stuck on loading for two days in a row. On a few occasions, I have been able to access Synapse, but most often I am not able to. It's just getting stuck on the splash screen when starting styudio. On yesterday evening, I was able to work as normal, but in the morning the issue was back again. This happens on different instances and resource groups where Synapse is installed. I have tried both Edge and Chrome. Same issue both places We have tried on different accounts where we know we have working access I have checked Azure health status, and Synapse shows up falsely as green. When I look in the console log for my web browser, I see 'Failed to load resource: the server responded with a status of 401 ()'. Meaning there is some kind of authorization issue for URL https://management.azure.com/subscriptions/....?api-version=2025-05-01 (I have deliberately removed the hexadecimal subscription ID).
Nested if statement in the expression builder (dynamic editor)
Hello I am trying to check activity steps failed and if so, get Target (activity) value, something like this below @{ "FailedStepAt": "@{if(not(empty(activity('lkp_tables_list').erro.message)), activity('lkp_tables_list')?.erro.target, if(not(equals(activity('lkp_GetPipelineIDByName').error.message, '')), activity('lkp_GetPipelineIDByName').error.target, if(not(equals(activity('Export_table_to_NTADLS').error.message, '')), activity('Export_table_to_NTADLS').error.target, '')))}", "ErrorMessage": "@{concat(activity('lkp_tables_list')?.error?.message, activity('lkp_GetPipelineIDByName')?.error?.message, activity('Export_table_to_NTADLS')?.error?.message } But it doesn't work . However, to check the target value if activity fails, used set variable to capture the target value but it supports with one condition something like ." "@{if(not(empty(activity('lkp_GetPipelineIDByName').error)), activity('lkp_GetPipelineIDByName').error.target, 'no err') }" I want to achieve using nested if within dynamic edition Or within set variable activity Any help would be appreciatedData Flow textbox size increase
Hi Community, Is there a way to increase the textbox size to Data Flows Select mapping fields (or request a change)? The Destination field (Name As) is way smaller than the source field, and therefore can't see the complete text - there is plenty of space to the right to increase this size...
