Merge pull request #77 from MicrosoftCloudEssentials-LearningHub/bulk-purview

brown9804 · web-flow · commit 2870d4b3c66b · 2025-01-22T15:00:22.000-06:00
Bulk purview classic -&gt; new
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms.md b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms.md
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/README.md b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/README.md
@@ -0,0 +1,152 @@
+# Purview: Bulk Upload of Glossary Terms into new Unified Catalog
+
+Costa Rica
+
+[![GitHub](https://badgen.net/badge/icon/github?icon=github&label)](https://github.com) 
+[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
+[brown9804](https://github.com/brown9804)
+
+Last updated: 2025-01-17
+
+----------
+
+> Bulk upload glossary terms from the classic Purview to the new Unified Catalog
+
+
+## Wiki 
+
+<details>
+<summary><b>Table of Wiki </b> (Click to expand)</summary>
+
+- [Learn about the new Microsoft Purview portal](https://learn.microsoft.com/en-us/purview/purview-portal)
+- [Microsoft Purview setup guides](https://learn.microsoft.com/en-us/purview/purview-fast-track-setup-guides)
+- [Microsoft Purview (formerly Azure Purview) deployment checklist](https://learn.microsoft.com/en-us/purview/legacy/tutorial-azure-purview-checklist)
+- [Import and export glossary terms](https://learn.microsoft.com/en-us/purview/legacy/how-to-import-export-glossary)
+- [Get ready for the next enhancement in Microsoft Purview governance](https://learn.microsoft.com/en-us/purview/new-governance-experience)
+
+</details>
+
+
+## Content 
+
+<details>
+<summary><b>Table of Content </b> (Click to expand)</summary>
+
+- [Wiki](#wiki)
+- [Content](#content)
+- [Prerequisites](#prerequisites)
+- [Create a Microsoft Purview Account](#create-a-microsoft-purview-account)
+- [Uploading Glossary Terms - Classic Purview](#uploading-glossary-terms---classic-purview)
+- [Downloading Glossary Terms - Classic Purview](#downloading-glossary-terms---classic-purview)
+- [How to transition data to - new Microsoft Purview portal](#how-to-transition-data-to---new-microsoft-purview-portal)
+
+</details>
+
+## Prerequisites
+1. **Microsoft Entra Tenant**:
+   - Ensure you have a Microsoft Entra tenant associated with your subscription.
+   - Required roles: Information Protection Administrator, Power BI Administrator (if scanning Power BI tenants).
+2. **Azure Subscription**: You need an active Azure subscription. If you don't have one, create a free subscription.
+3. **Resource Providers**: Register the following resource providers in your Azure subscription:
+     - `Microsoft.Storage`
+     - `Microsoft.EventHub` (optional)
+     - `Microsoft.Purview`
+
+        <img width="550" alt="image" src="https://github.com/user-attachments/assets/89697e6d-464b-4ec9-be5e-7539807cc26b" />
+
+        <img width="550" alt="image" src="https://github.com/user-attachments/assets/7603bd96-6b6a-40b2-9d4f-4fdffba15681" />
+
+## Create a Microsoft Purview Account
+1. **Navigate to Azure Portal**: Go to the Azure portal and search for `Microsoft Purview`.
+
+     <img width="550" alt="image" src="https://github.com/user-attachments/assets/9ebaf4cb-38cb-4285-8786-f286107a983b" />
+
+2. **Create Purview Account**: Click on "Create" and fill in the required details.
+    - Subscription
+    - Resource Group
+    - Purview Account Name
+    - Region
+    
+        <img width="550" alt="image" src="https://github.com/user-attachments/assets/0ab094df-3040-493e-9912-affb635371fe" />
+
+3. **Configure Event Hub (Optional)**: If you plan to use an existing Event Hubs namespace, configure it during account creation.
+
+## Uploading Glossary Terms - (Classic Purview)
+
+1. **Open Microsoft Purview Data Catalog**: If you're using the `classic Microsoft Purview` portal, select `Glossary`.
+
+    <img width="550" alt="image" src="https://github.com/user-attachments/assets/354d43ab-16be-4a02-a230-4a4efccc0dfa" />
+
+2. **Select/Create the Glossary** where you want to import terms.
+
+    <img width="550" alt="image" src="https://github.com/user-attachments/assets/0b013cd2-7785-497a-9f49-20977bcf1a63">
+
+    <img width="550" alt="image" src="https://github.com/user-attachments/assets/cdbd1296-2ab4-4bac-a1f3-029b1080ac56" />
+
+3. Select `Import terms`, and upload your filled CSV file. 
+
+    <img width="550" alt="image" src="https://github.com/user-attachments/assets/df5dbe5b-b3f1-46e4-ac91-381fa39e242f" />
+
+    - You can use `System Default Template` or `Create New Template`:
+
+       | **Feature**                  | **System Default Template**                                      | **Create New Template**                                      |
+       |------------------------------|------------------------------------------------------------------|--------------------------------------------------------------|
+       | **Customization**            | Limited to predefined fields (e.g., Term, Definition)            | Highly customizable; add fields like Synonyms, Categories, etc. |
+       | **Ease of Use**              | Simple and quick to use with basic fields                        | Requires initial setup to define custom fields               |
+       | **Consistency**              | Standardized format with basic fields                           | Ensures consistency with custom fields tailored to your needs |
+       | **Flexibility**              | Less flexible; limited to default fields                        | Highly flexible; adapt to changing requirements              |
+       | **Metadata Inclusion**       | Basic metadata (Term, Definition)                               | Include additional metadata (e.g., Synonyms, Related Terms)  |
+       | **Setup Time**               | Minimal setup time                                              | Requires more time to create and define custom fields        |
+       | **Use Case**                 | Suitable for simple glossaries with basic terms and definitions | Ideal for complex glossaries with detailed information       |
+
+       <img width="550" alt="image" src="https://github.com/user-attachments/assets/79ee1f04-5bff-4680-9b44-0c6c76457cf8">
+
+       <img width="550" alt="image" src="https://github.com/user-attachments/assets/886fec2b-918b-4d52-bfa3-dca5d2442895" />
+
+       <img width="550" alt="image" src="https://github.com/user-attachments/assets/0258f41f-52fc-494b-bd0c-87239a5c41b8" />
+
+## Downloading Glossary Terms - (Classic Purview)
+
+1. **Open Microsoft Purview Data Catalog**: Navigate to the glossary where your terms are stored.
+2. **Select the Terms** you want to export.
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/fd15d234-bb0c-498f-981b-318af80f947b" />
+
+3. **Export Terms**:
+   - Once you've selected the terms, the `Export terms` button will be enabled.
+     
+        <img width="550" alt="image" src="https://github.com/user-attachments/assets/01757369-d79c-4a3d-954d-6eebc91f45b6" />
+
+   - Click on it to download the terms in a CSV file.
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/8d184813-ae63-4ba1-a42e-aa496d6c7f38" />
+
+## How to transition data to - (new Microsoft Purview portal)
+
+> [IMPORTANT]
+> The `data appears to have migrated seamlessly`. Please follow the steps below to `locate the glossary terms you created in the classic Purview portal within this new portal`. 
+
+1. Switch to new portal:
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/4aed6fb8-8db9-45c5-874a-aaf62db5103d" />
+
+2. Go to `Unified Catalog`:
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/a3b8c440-56d8-4369-bddf-817d6b8575ea" />
+
+3. Under `Discovery`, go to `Data assets`. There, you will find your glossary terms.
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/ce5a2a73-1e8f-4ffb-9936-94d41cf4638d" />
+
+4. Search for `glossary`:
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/9f9fc5b2-13af-4531-a421-5f0ae5d16c1d" />
+      
+5. You can click on the terms and perform all related actions with these glossary terms. Therefore, there is no need to migrate them as they are already reflected.
+
+      <img width="550" alt="image" src="https://github.com/user-attachments/assets/1a037ed1-e10a-4f78-97c4-0d55836f1b3e" />
+
+<div align="center">
+  <h3 style="color: #4CAF50;">Total Visitors</h3>
+  <img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/>
+</div>
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Data_Glossary.csv b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Data_Glossary.csv
@@ -0,0 +1,7 @@
+Nick Name,Name,Status,Definition,Acronym,Resources,Related Terms,Synonyms,Stewards,Experts,Parent Term Name,IsDefinitionRichText,Term Template Names
+Data_Analytics_Big_Data,Big Data,Approved,Large volumes of data that can be analyzed for insights.,BD,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Data_Warehousing;Data_Analytics_Data_Mining@otherGlossaryName;,Data_Analytics_Large_Data_Sets;,,,,True,System default
+Data_Analytics_Data_Warehousing,Data Warehousing,Approved,The process of constructing and using a data warehouse.,DW,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Big_Data;Data_Analytics_Data_Mining@otherGlossaryName;,Data_Analytics_Data_Storage;,,,,True,System default
+Data_Analytics_Data_Mining,Data Mining,Approved,The practice of examining large databases in order to generate new information.,DM,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Big_Data;Data_Analytics_Data_Warehousing@otherGlossaryName;,Data_Analytics_Data_Analysis;,,,,True,System default
+Data_Analytics_Data_Visualization,Data Visualization,Approved,The graphical representation of information and data.,DV,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Data_Analysis;Data_Analytics_Data_Presentation@otherGlossaryName;,Data_Analytics_Data_Graphs;,,,,True,System default
+Data_Analytics_Machine_Learning,Machine Learning,Approved,A method of data analysis that automates analytical model building.,ML,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Artificial_Intelligence;Data_Analytics_Deep_Learning@otherGlossaryName;,Data_Analytics_Automated_Learning;,,,,True,System default
+Data_Analytics_Artificial_Intelligence,Artificial Intelligence,Approved,"The simulation of human intelligence processes by machines, especially computer systems.",AI,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Data_Analytics_Machine_Learning;Data_Analytics_Deep_Learning@otherGlossaryName;,Data_Analytics_AI;,,,,True,System default
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Finance_Glossary.csv b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Finance_Glossary.csv
@@ -0,0 +1,6 @@
+Nick Name,Name,Status,Definition,Acronym,Resources,Related Terms,Synonyms,Stewards,Experts,Parent Term Name,IsDefinitionRichText,Term Template Names
+Finance_Annual_Percentage_Rate,APR,Approved,The annual rate charged for borrowing or earned through an investment.,APR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Finance_Interest_Rate;Finance_Loan_Rate@otherGlossaryName;,Finance_Annual_Rate;,,,,True,System default
+Finance_Annual_Percentage_Rate,APR,Approved,The annual rate charged for borrowing or earned through an investment.,APR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Finance_Interest_Rate;Finance_Loan_Rate@otherGlossaryName;,Finance_Annual_Rate;,,,,True,System default
+Finance_Compound_Interest,Compound Interest,Approved,Interest on a loan or deposit calculated based on both the initial principal and the accumulated interest from previous periods.,CI,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,F,Finance_CI;,,,,True,System default
+Finance_Debt_to_Equity_Ratio,Debt to Equity Ratio,Approved,A financial ratio indicating the relative proportion of shareholders' equity and debt used to  a company's assets.,D/E,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Finance_D/E;,,,,True,System default
+Finance_Return_on_Investment,Return on Investment,Approved,A measure used to evaluate the efficiency or profitability of an investment.,ROI,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Finance_ROI;,,,,True,System default
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Healthcare_Glossary.csv b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Healthcare_Glossary.csv
@@ -0,0 +1,6 @@
+Nick Name,Name,Status,Definition,Acronym,Resources,Related Terms,Synonyms,Stewards,Experts,Parent Term Name,IsDefinitionRichText,Term Template Names
+Healthcare_Electronic_Health_Record,EHR,Approved,Digital version of a patient's paper chart.,EHR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Healthcare_Health_Information_System;Healthcare_Patient_Record@otherGlossaryName;,Healthcare_Digital_Health_Record;,,,,True,System default
+Healthcare_Health_Information_System,Health Information System,Approved,A system designed to manage  data.,HIS,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Healthcare_Electronic_Health_Record;Healthcare_Patient_Record@otherGlossaryName;,Healthcare_HIS;,,,,True,System default
+Healthcare_Patient_Record,Patient Record,Approved,A comprehensive record of a patient's medical history and care.,PR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Healthcare_Electronic_Health_Record;Healthcare_Health_Information_System@otherGlossaryName;,Healthcare_PR;,,,,True,System default
+Healthcare_Clinical_Decision_Support,Clinical Decision Support,Approved,A health information technology system that is designed to provide physicians and other health professionals with clinical decision support.,CDS,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Healthcare_Electronic_Health_Record;Healthcare_Health_Information_System@otherGlossaryName;,Healthcare_CDS;,,,,True,System default
+Healthcare_Telemedicine,Telemedicine,Approved,The remote diagnosis and treatment of patients by means of telecommunications technology.,TM,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Healthcare_Telehealth;Healthcare_Remote_Consultation@otherGlossaryName;,Healthcare_TM;,,,,True,System default
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Marketing_Glossary.csv b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Marketing_Glossary.csv
@@ -0,0 +1,5 @@
+Nick Name,Name,Status,Definition,Acronym,Resources,Related Terms,Synonyms,Stewards,Experts,Parent Term Name,IsDefinitionRichText,Term Template Names
+Marketing_Customer_Retention,Customer Retention,Approved,The ability of a company to retain its customers over a period of time.,CR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Marketing_Client_Retention;,,,,True,System default
+Marketing_Brand_Awareness,Brand Awareness,Approved,The extent to which consumers are familiar with the distinctive qualities or image of a particular brand of goods or services.,BA,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Marketing_BA;,,,,True,System default
+Marketing_Customer_Acquisition_Cost,Customer Acquisition Cost,Approved,"The cost associated with convincing a consumer to buy a product/service, including research, , and advertising costs.",CAC,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Marketing_CAC;,,,,True,System default
+Marketing_Conversion_Rate,Conversion Rate,Approved,The percentage of visitors to a website that complete a desired goal (a conversion) out of the total number of visitors.,CR,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,,Marketing_CR;,,,,True,System default
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Project_Glossary.csv b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/Project_Glossary.csv
@@ -0,0 +1,10 @@
+Nick Name,Name,Status,Definition,Acronym,Resources,Related Terms,Synonyms,Stewards,Experts,Parent Term Name,IsDefinitionRichText,Term Template Names
+Project_Management_Scope_Creep,Scope Creep,Draft,Uncontrolled changes or continuous growth in a project's scope.,SC,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Change_Control;Project_Management_Scope_Change@otherGlossaryName;,Project_Management_Scope_Expansion;,,,,True,System default
+Project_Management_Gantt_Chart,Gantt Chart,Approved,A type of bar chart that illustrates a project schedule.,GC,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Timeline;Project_Management_Schedule@otherGlossaryName;,Project_Management_Bar_Chart;,,,,True,System default
+Project_Management_Risk_Assessment,Risk Assessment,Approved,The process of identifying and analyzing potential issues that could negatively impact key business initiatives or projects.,RA,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Risk_Management;Project_Management_Risk_Analysis@otherGlossaryName;,Project_Management_Risk_Evaluation;,,,,True,System default
+Project_Management_Stakeholder_Analysis,Stakeholder Analysis,Approved,The process of assessing a system and potential changes to it as they relate to relevant and interested parties.,SA,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Stakeholder_Management;Project_Management_Stakeholder_Engagement@otherGlossaryName;,Project_Management_Stakeholder_Assessment;,,,,True,System default
+Project_Management_Critical_Path,Critical Path,Approved,The sequence of stages determining the minimum time needed for an operation.,CP,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Project_Schedule;Project_Management_Project_Timeline@otherGlossaryName;,Project_Management_Critical_Sequence;,,,,True,System default
+Project_Management_Milestone,Milestone,Approved,"A significant point or event in a project, program, or portfolio.",MS,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Project_Phase;Project_Management_Project_Event@otherGlossaryName;,Project_Management_Key_Event;,,,,True,System default
+Project_Management_Work_Breakdown_Structure,Work Breakdown Structure,Approved,A hierarchical decomposition of the total scope of work to accomplish the project objectives and create the deliverables.,WBS,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Project_Structure;Project_Management_Project_Decomposition@otherGlossaryName;,Project_Management_Task_Structure;,,,,True,System default
+Project_Management_Project_Charter,Project Charter,Approved,A document that formally authorizes a project or a phase and provides the project manager with the authority to apply organizational resources to project activities.,PC,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Project_Authorization;Project_Management_Project_Documentation@otherGlossaryName;,Project_Management_Project_Approval;,,,,True,System default
+Project_Management_Project_Schedule,Project Schedule,Approved,A timetable that outlines the start and finish dates of project elements.,PS,Microsoft Purview Project:https://web.purview.azure.com;Azure portal:https://portal.azure.com;,Project_Management_Project_Timeline;Project_Management_Project_Plan@otherGlossaryName;,Project_Management_Project_Timetable;,,,,True,System default
diff --git a/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/generate_samples_5_topics_sys_default_template.py b/0_Azure/5_DataProtectionMng/0_Purview/demos/3_Bulk_UploadGlossaryTerms/_samples_glossary_terms/generate_samples_5_topics_sys_default_template.py
