Forum Discussion
ETL or Pipeline Tables from One DB to Another
Hello all,
Currently we have a singular Azure SQL database for our company that stores all the information in regards to our platform. We are creating a secondary Azure SQL database that we are planning to use to incorporate elements of our primary database along with information from other systems. We currently have a third party solution that helps us with ETL for our other data sources, but are looking for an effective way to ETL or Pipeline tables from our main Azure database to this new secondary Azure database.
I have an understanding, whether correct or not, that Azure Synapse Analytics offers some tools of this nature, but I wanted to check with the community to see if this was something that could be done and what direction I should maybe pursue before going too deep into an empty rabbit hole.
It would be nice to have a stream of data from our primary to secondary database that updates at the minimum of once a day. We also don't need to bring over all the tables, only a subset of them.
Any advice on this would be greatly appreciated, thanks!