Real-Time Processing with Data Vault 2.0 on Azure
In the last article, we discussed the Data Vault 2.0 architecture with regards to batch processing. However, Data Vault 2.0 is not limited to batch processing: it is possible to load data at any speed, in batches, CDC, near real-time or actual real-time. This article is based on the previous article but extends the architecture with real-time processing. We discussed several options on how real-time data can be ingested and how we, at Scalefree, typically implement a real-time Data Vault 2.0 architecture on the Azure cloud.Azure Stream Analytics: real-time analytics for Big Data, made easy
At the Microsoft Build Conference, we announced several new features extending the capabilities of Azure Stream Analytics, a managed service enabling real-time streaming analytics. With the new innovations announced today, Azure Stream Analytics brought down time-to-insight for Big Data streaming. These new capabilities will be demonstrated during the session “From cloud to the intelligent edge: Drive real-time decisions with Azure Stream Analytics”.Azure Stream Analytics releases slew of improvements at Ignite 2022: Output to Delta Lake and more!
Today we are excited to announce numerous new capabilities that unlock new stream processing patterns that work with your modern lakehouses. We are announcing native support of Delta Lake output, no code editor GA, improved development & troubleshooting experience and much more!Agile Data Vault 2.0 Projects with Azure DevOps
Having discussed the value of Data Vault 2.0 and the associated architectures in the previous articles of this blog series, this article will focus on the organization and successful execution of Data Vault 2.0 projects using Azure DevOps. It will also discuss the differences between standard Scrum, as used in agile software development, and the Data Vault 2.0 methodology, which is based on Scrum but also includes aspects from other methodologies. Other functions of Azure DevOps, for example the deployment of the data analytics platform, will be discussed in subsequent articles of this ongoing blog series.
A Guide to the Developer Journey in Azure Stream Analytics
Are you a developer looking to master Azure Stream Analytics? Our comprehensive guide to the developer journey in Azure Stream Analytics will take you from initial setup to production deployment. Discover the development tools you need to optimize your queries for the best performance.
