Skip to content

Commit b0e02e0

Browse files
authored
in progress
1 parent c0c7684 commit b0e02e0

1 file changed

Lines changed: 16 additions & 4 deletions

File tree

0_Azure/WhatsNew/2_FabricConfVegas2025.md

Lines changed: 16 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -88,27 +88,39 @@ Last updated: 2025-04-07
8888
|-----------------------------------|--------------------|----------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
8989
| **Azure SQL Database** | Current Support | On-Premises Data Gateway or VNET Data Gateway for secure and efficient data movement | - **Mirroring Mechanism**: Utilizes SQL’s Change Data Capture (CDC) stack optimized for lake-centric architecture. CDC stores changes locally in the database, while mirroring reads data from the transaction log and publishes it to OneLake.<br>- **Data Format**: Converts data to Parquet format for analytics.<br>- **Features**: Supports DDL (Data Definition Language) operations like Alter/Drop/Rename tables/columns, and Truncate tables while mirroring is active.<br>- **APIs**: Programmatic APIs available for setup and management. |
9090
| **Snowflake** | Current Support | On-Premises Data Gateway or VNET Data Gateway for secure and efficient data movement | - **Mirroring Mechanism**: Similar to Azure SQL Database, leveraging secure gateways for data replication.<br>- **Data Format**: Ensures data is analytics-ready in OneLake. |
91-
| **Azure SQL Managed Instance (MI)**| Coming Soon | Will utilize On-Premises Data Gateway or VNET Data Gateway for secure connectivity | - **Mirroring Mechanism**: Expected to follow the same CDC-based approach as Azure SQL Database.<br>- **Data Format**: Will convert data to Parquet format for seamless integration. |
91+
| **Azure SQL Managed Instance (MI)**| Coming Soon | Will use On-Premises Data Gateway or VNET Data Gateway for secure connectivity | - **Mirroring Mechanism**: Expected to follow the same CDC-based approach as Azure SQL Database.<br>- **Data Format**: Will convert data to Parquet format for seamless integration. |
9292
| **On-Premises SQL Server, Oracle, and Dataverse** | Future Support | Will follow secure connectivity protocols using On-Premises Data Gateway | - **Mirroring Mechanism**: Anticipated to use similar CDC-based replication.<br>- **Data Format**: Data will be converted to Parquet format for analytics. |
9393

9494
> Installation Steps:
9595
<details>
9696
<summary>Azure SQL Database</summary>
9797
9898
1. **Enable System Assigned Managed Identity (SAMI)**:
99-
- In the Azure portal, navigate to your Azure SQL logical server.
99+
- In the [Azure portal](https://portal.azure.com/), navigate to your Azure SQL logical server.
100100
- Enable System Assigned Managed Identity (SAMI) with a single step.
101101

102+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/7a4b8a0e-73eb-442f-9b4f-4e41bec59ce3" />
103+
102104
2. **Configure Mirroring**:
103-
- Go to the Fabric workspace and select the ⚙️.
105+
- Go to the [Fabric workspace](https://app.fabric.microsoft.com) and select the ⚙️.
104106
- Choose `Manage connection and gateways` to configure the connection to your Azure SQL Database.
105107

108+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/c55024b9-1841-4a12-b0c8-81515d925553" />
109+
106110
3. **Set Up Gateway**:
107111
- Deploy either the On-Premises Data Gateway or VNET Data Gateway depending on your network setup.
112+
113+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/51c81b6e-7888-4681-a32d-5008cbc21a22" />
114+
108115
- Configure the gateway to securely connect to your Azure SQL Database.
109116

117+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/3668f188-935c-4287-ac76-8098ea61b3d4" />
118+
110119
4. **Initial Replication**:
111-
- Start the mirroring process. The initial replication time depends on the size of the data being brought in.
120+
- Start the mirroring process. The initial replication time depends on the size of the data being brought in. Click on `New item`, search for `Mirrored`:
121+
122+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/cfc169a7-6caa-4232-ba83-e69e2cf934a4" />
123+
112124
- Data is stored in a landing zone in OneLake, improving performance when converting files into delta verti-parquet.
113125

114126
5. **Monitor Replication**:

0 commit comments

Comments
 (0)