Skip to content

Latest commit

 

History

History
52 lines (39 loc) · 5.36 KB

File metadata and controls

52 lines (39 loc) · 5.36 KB

SQL Database Mirroring in Microsoft Fabric

Costa Rica

GitHub brown9804

Last updated: 2025-07-17


Wiki

Mirroring SQL Database in Microsoft Fabric

Mirroring for Azure SQL Database is now available in public preview. This feature allows you to replicate your data residing in Azure SQL databases in near real-time directly into Microsoft Fabric's OneLake. However, it currently does not support Azure SQL Database instances behind a private network. You must update your Azure SQL logical server firewall rules to allow public network access to use this feature.

Alternatives for Near Real-Time Data

If you need near real-time data from SQLDB and your SQL Server is in a private network, consider the following alternatives:

  1. Change Data Capture (CDC) is a feature that captures changes made to data in your SQL Server tables. It records insert, update, and delete activities and makes the change data available for downstream processing.
    • How it works: CDC captures changes from the transaction log and stores them in change tables. These changes can then be processed and replicated to other systems.
    • Use case: Ideal for scenarios where you need to track and replicate changes in near real-time without impacting the performance of your primary database.
  2. Azure Data Factory with Self-hosted Integration Runtime: Allows you to securely connect to your on-premises SQL Server and replicate data to Azure services.
    • How it works: Install the self-hosted integration runtime on a machine within your network. Create pipelines in ADF to copy data from SQL Server to your destination (e.g., Azure Blob Storage, Azure SQL Database).
    • Use case: Suitable for environments where the SQL Server is behind a private network and you need to orchestrate complex data workflows.
  3. Azure Event Hubs: Is a big data streaming platform and event ingestion service capable of receiving and processing millions of events per second.
    • How it works: Use CDC or other mechanisms to capture changes and send them to Event Hubs. From there, you can stream the data to Azure Synapse Analytics or Azure Data Lake Storage for processing.
    • Use case: Best for scenarios requiring high-throughput data ingestion and real-time analytics.
  4. Azure Synapse Analytics: Integrates big data and data warehousing capabilities, allowing you to analyze large volumes of data in near real-time.
    • How it works: Use Synapse pipelines to orchestrate data movement and transformation. Stream data from Event Hubs or other sources into Synapse for real-time processing.
    • Use case: Ideal for complex analytics and reporting on large datasets.

Architecture References

  1. Near Real-Time Lakehouse Data Processing: This architecture uses Azure Event Hubs, Azure Synapse Analytics, and Azure Data Lake Storage to keep lakehouse data in sync in near real-time. It involves capturing changes using Debezium connectors, streaming data to Event Hubs, and processing it in Synapse Analytics.
  2. Mirroring Azure SQL Database in Microsoft Fabric: Mirroring in Microsoft Fabric allows for near real-time replication of Azure SQL Database into Fabric's OneLake. This feature leverages SQL's CDC stack to keep data in sync without complex ETL processes. For more click here.
  3. Azure Well-Architected Framework: This framework provides best practices for designing and operating reliable, secure, efficient, and cost-effective systems in the cloud. It includes guidance on using Active Geo-Replication and Auto Failover Groups for high availability and disaster recovery.
Total views

Refresh Date: 2025-07-18