Skip to content

Commit 21c2a8f

Browse files
brown9804brown9804
authored
Merge e183fb9 into 3c834a7 
2 parents 3c834a7 + e183fb9 commit 21c2a8f

2 files changed

Lines changed: 122 additions & 2 deletions

File tree

‎0_Azure/2_AzureAnalytics/0_Fabric/demos/28_MirroringERPperfAnalysis.md‎

Lines changed: 117 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,117 @@
1+
# Mirroring ERP into Fabric: Performance Analysis
2+
3+
Costa Rica
4+
5+
[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
6+
[brown9804](https://github.com/brown9804)
7+
8+
Last updated: 2025-02-28
9+
10+
----------
11+
12+
> Quick technical overview of Mirroring an ERP System Database into Microsoft Fabric
13+
14+
<details>
15+
<summary><b>List of References</b> (Click to expand)</summary>
16+
17+
- [What is Mirroring in Fabric?](https://learn.microsoft.com/en-us/fabric/database/mirrored-database/overview)
18+
- [Mirroring Fabric SQL database in Microsoft Fabric (preview)](https://learn.microsoft.com/en-us/fabric/database/sql/mirroring-overview)
19+
- [Open mirroring in Microsoft Fabric (Preview)](https://learn.microsoft.com/en-us/fabric/database/mirrored-database/open-mirroring)
20+
- [Latency in Activator](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/data-activator/activator-latency)
21+
- [Permission model](https://learn.microsoft.com/en-us/fabric/security/permission-model)
22+
- [Secure data access in Microsoft Fabric](https://learn.microsoft.com/en-us/training/modules/secure-data-access-in-fabric/)
23+
- [Authorization in SQL database in Microsoft Fabric](https://learn.microsoft.com/en-us/fabric/database/sql/authorization)
24+
25+
</details>
26+
27+
28+
<details>
29+
<summary><b>Table of Content</b> (Click to expand)</summary>
30+
31+
32+
</details>
33+
34+
## Overview
35+
36+
| **Purpose and Benefits** | **Description** |
37+
|--------------------------|-----------------|
38+
| **Continuous Replication** | Microsoft Fabric continuously replicates data from your ERP system database into Fabric's OneLake. |
39+
| **Low Latency** | The replication process is designed to be low-latency, ensuring near real-time data availability for analytics. |
40+
| **Read-Only Access** | The mirrored data is stored in a read-only format, protecting the operational ERP database from performance degradation due to analytics queries. |
41+
42+
### Continuous Replication
43+
44+
- **Replication Mechanism:** Microsoft Fabric uses a continuous data replication mechanism to mirror data from your ERP system database into Fabric's OneLake. This process involves capturing changes in the source database and applying them to the mirrored database in near real-time.
45+
- **Change Data Capture (CDC):** The replication process leverages Change Data Capture (CDC) technology to track changes (inserts, updates, deletes) in the source ERP database. These changes are then propagated to the mirrored database in Fabric.
46+
- **Data Consistency:** The replication ensures data consistency between the source ERP database and the mirrored database in Fabric. Any changes made in the source database are reflected in the mirrored database almost immediately.
47+
- **Scalability:** The replication process is designed to handle large volumes of data, making it suitable for enterprise-scale ERP systems.
48+
49+
```mermaid
50+
graph LR
51+
A[ERP System Database] -->|Captures Changes| B[Change Data Capture]
52+
B -->|Propagates Changes| C[Replication Engine]
53+
C -->|Applies Changes| D[Fabric OneLake]
54+
D -->|Stores Data| E[Read-Only Mirrored Data]
55+
56+
subgraph Continuous Replication Process
57+
direction LR
58+
A --> B
59+
B --> C
60+
C --> D
61+
D --> E
62+
end
63+
```
64+
65+
### Low Latency
66+
67+
- **Near Real-Time Replication:** The replication process is optimized for low latency, ensuring that data changes in the source ERP database are mirrored in Fabric's OneLake with minimal delay.
68+
- **Efficient Data Transfer:** The replication engine uses efficient data transfer protocols to minimize latency. This includes batching changes and using optimized network paths to transfer data quickly.
69+
- **Latency Metrics:** Microsoft Fabric provides tools to monitor replication latency, allowing administrators to ensure that the replication process meets the required performance standards.
70+
- **Real-Time Analytics:** The low-latency replication enables real-time analytics on the mirrored data, allowing businesses to make timely decisions based on the most current data.
71+
72+
```mermaid
73+
graph LR
74+
A[ERP System Database] -->|Near Real-Time Replication| B[Fabric OneLake]
75+
B -->|Efficient Data Transfer| C[Replication Engine]
76+
C -->|Monitors Latency| D[Latency Metrics]
77+
D -->|Enables| E[Real-Time Analytics]
78+
79+
subgraph Low Latency in MS Fabric
80+
direction LR
81+
A --> B
82+
B --> C
83+
C --> D
84+
D --> E
85+
end
86+
```
87+
88+
### Read-Only Access
89+
90+
- **Read-Only Format:** The mirrored data in Fabric's OneLake is stored in a read-only format, which means that it cannot be modified directly by users or applications.
91+
- **Protection of Source Database:** By providing read-only access to the mirrored data, the operational ERP database is protected from performance degradation caused by analytics queries.
92+
- **Access Controls:** Microsoft Fabric implements robust access controls to ensure that only authorized users can access the mirrored data. This includes role-based access control (RBAC) and item-level permissions.
93+
- **Data Security:** The read-only nature of the mirrored data also enhances security by preventing accidental or malicious modifications to the data.
94+
95+
```mermaid
96+
graph TD
97+
A[Read-Only Access] --> B[Read-Only Format]
98+
A --> C[Protection of Source DB]
99+
A --> D[Access Controls]
100+
A --> E[Data Security]
101+
102+
B -->|Stored in read-only format| F[Fabric OneLake]
103+
C -->|Prevents perf degradation| G[Operational ERP DB]
104+
D -->|Ensures authorized access| H[Role-Based Access Control ]
105+
D -->|Ensures authorized access| I[Item-Level Permissions]
106+
E -->|Prevents modifications| J[Enhanced Security]
107+
```
108+
109+
110+
111+
112+
<div align="center">
113+
<h3 style="color: #4CAF50;">Total Visitors</h3>
114+
<img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/>
115+
</div>
116+
117+

‎0_Azure/2_AzureAnalytics/0_Fabric/demos/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Costa Rica
55
[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
66
[brown9804](https://github.com/brown9804)
77

8-
Last updated: 2024-08-06
8+
Last updated: 2025-02-28
99

1010
------------------------------------------
1111

@@ -23,4 +23,7 @@ Before you begin, ensure you have met the following requirements:
2323
> Each demo includes detailed instructions on setup and requirements.
2424
2525

26-
26+
<div align="center">
27+
<h3 style="color: #4CAF50;">Total Visitors</h3>
28+
<img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/>
29+
</div>

0 commit comments

Comments
 (0)