Blog Post

Azure Data Factory Blog
3 MIN READ

Integrate Microsoft Fabric with SAP data with USB4SAP [in live and cached mode]

Sunil_Sabat's avatar
Sunil_Sabat
Icon for Microsoft rankMicrosoft
May 29, 2024

Microsoft Fabric integration with SAP using USB4SAP

With USB4SAP, Fabric users can access SAP data. This data can be used to refresh PowerBI semantic models in live and cache mode. USB4SAP provides deep integration into your SAP system (for raw tables data, as well as modeled information like reports, queries, CDS, BW extractors etc), SAP tables data extraction with delta / CDC capabilities (ADF connector) without the need for SLT or Change Pointers activation. 

 

Specifically for integration with customers SAP systems, you can leverage USB4SAP connector for:

 

  • PowerBI live and cached mode
  • Onelake based integration
  • REST based synchronous API integration

It supports no-code, native SAP security based access to the following SAP objects (HANA or non-HANA based):

 

  • Tables (with Change data capture)
  • Views
  • CDS
  • Reports
  • TCodes
  • BW Extractors
  • ABAP queries

Following modes of Change Data Capture are supported:

 

  • Tables & views:
    1. Time-series based [ie, date & time of the record create, update, delete]
    2. Document & item number series based
  • Reports / Queries / TCodes:
    1. Time-series based using variants on selection screen. 

Conceptual architecture

Following are the key components for the conceptual architecture for MS Fabric integration with SAP systems.

  • Customers SAP systems (ERP, S4HANA, BW, CRM, SRM, APO, Solman etc) are organizational systems of record
  • Data transmission is REST over HTTPS (unless specified otherwise, where RFC / OData may also be used)
  • Data & information storage in any cloud (eg, Microsoft Azure) or on-premise repository
  • Information security is using SAS key over HTTPS
  • Synthesis layer is combination of tools like PowerAutomate / Logic Apps etc.
  • PowerBI/ PowerPlatform / MS Excel and other apps are supported using REST / PowerQuery
  • CX-Portal layer [optional] in  MS SharePoint or other customer Portal solutions

Application architecture

 

Following are the application architectures for live  and cache connection from Fabric PowerBI to backend SAP systems. Data Factory templates are also available to accelerate use of Ecoservity's connectors and integration patterns within a pipeline.

 

PowerQuey  Connector Method:

 

  • Fabric live connection to SAP:  Live query to SAP leverages following mechanism
  • PowerQuery module within PowerBI
  • REST API [over HTTPS] connectivity to SAP [based on SICF or Gateway] for Power Platform apps
  • Video guide is available here:  https://youtu.be/vmJVoNSBdpM.

 

 

 

  • Following is the link for Azure marketplace listing for this solution (free trial available):

https://azuremarketplace.microsoft.com/en-us/marketplace/apps/ecoservity.peopleatwork4pbi?tab=Overview

 

Cached Method:

 

Microsoft Fabric cached connection to SAP: Cached query to SAP leverages following:

 

  • PowerQuery module within Fabric PowerBI
  • REST API [over HTTPS] connectivity to SAP [based on SICF or Gateway] , with SAS-key [over HTTPS] based security
  • Onelake data creation with support for CSV, JSON and Parquet
  • Video guide is available here: https://www.youtube.com/playlist?list=PLTum8dvrbVA05nV3hsr8rMPjqGHc2oOAq

     

  • Following is the link for Azure marketplace listing for this solution (free trial available):

https://azuremarketplace.microsoft.com/en-us/marketplace/apps/ecoservity.usb4sap_azure_data_factory?tab=Overview

REST Method:

 

REST API based connection to SAP: Cached query to SAP leverages following:

 

  • PowerQuery module within Fabric PowerBI
  • REST API [over HTTPS] connectivity to SAP [based on SICF or Gateway] , with SAS-key [over HTTPS] based security
  • Onelake data creation with support for CSV and Parquet
 
 

Data Factory Template Method:

 

In collaboration with Microsoft, Ecoservity has developed a set of Data Factory templates that make it faster and easier to integrate SAP into the Fabric ecosystem. These templates use Data Factories REST data source and data sink to read and write data from SAP.

 

 

 

 

The following screenshots show a Data Factory template that copies data from an SAP semantic model via REST.

 

 


Then, the data syncs to Fabric Onelake:

 

 

Conclusion:

 

In this blog, we reviewed alternate methods of using Ecoservity's USB4SAP product in conjunction with Data Factory to load SAP business data for PowerBI reports and data lake. You can adopt live and cache modes.  Templates make it easy for end users to adopt the solution in a pipeline. Ecoservity product is available in Azure Market Place. You can go ahead and try it out as alternative to existing connectors available in data factory.

 

Updated May 31, 2024
Version 3.0
  • anupamj's avatar
    anupamj
    Copper Contributor
    Yes Vitaly these are certified by SAP & Microsoft.
    You will find it on Azure Marketplace:
    3 reasons why customers use it:
    1) >450K semantic models in SAP
    2) >850K SAP tables [with delta capture)
    3) >1.3m live API's, secured with native authorizations
    Hope this is useful, please reach out if there are questions.
     
  • Spidey4u's avatar
    Spidey4u
    Copper Contributor

    Currently, Microsoft Fabric supports a limited set of SAP connectors, and additional connectors may be introduced gradually over time.

     

    In the interim, Azure Data Factory (ADF) provides a broader selection of SAP connectors and integrates seamlessly with Microsoft Fabric. By utilizing these connectors, we can facilitate data integration and invoke ADF copy activities directly from the Fabric environment.

     

    However, ADF offers significant flexibility and a comprehensive range of connectors for SAP data integration with Microsoft Fabric, it also introduces challenges related to complexity, cost management, and maintenance. These factors must be carefully managed to ensure optimal outcomes.

  • Vitaly's avatar
    Vitaly
    Brass Contributor

    anupamjThanks for your response & sorry for missing your comment earlier.

     

    To clarify, by "fully native" I am referring to a 1st party, Microsoft owned and Microsoft operated solution in Fabric. It can be challenging for organizations to onboard a 3rd party module, even if it's certified by Microsoft and/or SAP.

     

    Is such a native SAP capability on the Fabric roadmap?

    • anupamj's avatar
      anupamj
      Copper Contributor

      Thx Vitaly for clarifying. 

      I understand the intent, however in my view this is a classic issue with different ecosystems who have competing & complementary products. 

      In this case, both Microsoft & SAP both provide cloud analytics & visualization solutions.

      So they both provision complementary functionalities readily, but it gets tougher when the solutions are competing. eg, SAP runs on Azure (complementary) but provides Datasphere for analytics (competing).

      Simple market dynamics dictate that none of the 1st parties will be able to provide the comprehensive integration without hurting commercials of their own competing product.

      Hence the reliance on X-platform interconnect providers.

      Very keen to hear others perspectives.

       

    • anupamj's avatar
      anupamj
      Copper Contributor

      Ok Vitaly, now I get the context. 

      To clarify, there was a change by SAP from Feb-2024 [check SAP note 3255746 - Unpermitted usage of ODP Data Replication APIs ] which hampered ADF / Synapse etc ability to get CDC from customer's SAP systems.

      So, this is not Fabric specific (or even Microsoft specific), as SAP has blocked ODP access for all partners.

      SAP's recommendation is to use Datasphere / BTP. 

      Microsoft's recommendation is the article we are on.