Transitioning to Synapse Link – simplify Dynamics

data integration
Roadmap and next steps

Draft shared with customers under NDA, Ver 0.7, Aug-2023

Agenda 1. What is Synapse Link
2. Dynamics | Dataverse links to Microsoft Fabric
3. Transition from Export to data lake
4. Roadmap and next steps
5. Q&A
1
Synapse Link Unlock Dynamics data for analytics
for Dataverse
 Dataverse is a low code data platform for building Apps
Unified SaaS platform that manages data & logic for
Dynamics 365 and Power platform

Dynamics 365 Power BI Power Apps Power Automate Power Virtual Agents Power Pages
Intelligent Business Apps Business analytics Application development Workflow automation Intelligent virtual agents Webpage development

Business
Jobs Logic Plugins Business Rules Power Fx

Intelligence
Synapse Link + Analytics
Reporting Duplicate Detection Business Q&A Rollups

Integration
Web Hooks Data Events Business Events M365 Loops Dataflows

App
ALM + Data Lifecycle
Dataverse Retention Policies Azure DevOps GitHub

Data Storage
Files & Blobs Relational Semi Structured Logs Search Indexes Connectors

Security + Governance
Authentication Authorization RBAC Auditing Customer Managed Key Private Link
Synapse

Power Apps

Dynamics 365
Sales

Dynamics 365
One-click export of Dataverse Customer
Service
data into Synapse
for analytics Dataverse
Dynamics 365
Continuous replication of Field Service

standard and custom tables to

Azure Synapse Analytics ​
Dynamics 365
Marketing

Includes F&O Data (Public Preview)

8
2
Dynamics 365 and Dataverse
Microsoft Fabric No-copy data integration with Microsoft Fabric
Microsoft Fabric is a unified analytics solution
Unified SaaS-based solution that stores all organizational data
where analytics workloads operate

Data Integration Data Engineering Data Warehouse Data Science Real Time Analytics Business Intelligence

Data Factory Synapse Synapse Synapse Synapse Power BI

Unified data foundation

OneLake

Persistent data governance and security

Purview
Jump in and explore data effortlessly…

Explore Dynamics 365 and PowerApps

1 data in Microsoft Fabric with SQL Spark
or AI generated Copilots

No Data copy, your data never leaves

2 the Dataverse governance boundary
saving money on Data integration

Lake houses, SQL Data warehouse

3 generated behind the scene saving you
days and weeks of work

Build Low code Apps and Business

4
actions with insights from Microsoft
Fabric and drive actions
3
What’s changing
Why transition?
Transition Business benefits
Expected effort
Today: Synapse Link & Export to Data Lake
 Option 1: Synapse Link- Export to your Data Lake (BYOL)

In future we plan to also support using Microsoft Fabric spark compute for delta conversion
15
Option 2: Synapse link -Direct link to Microsoft Fabric

* F&O Tables in Direct link for Fabric are not yet available.

16
Comparison

Criteria Export to data lake Synapse link Export to your Data Direct link to Microsoft
lake (BYOL) Fabric

Security Managed by customer Admin (Keys Managed by Customer – Simplified( Managed by Microsoft
and secret, no firewall support on No key secret management, MSI
storage account) security on the storage)

Management Customer managed PaaS resources Customer managed PaaS resources- Managed by Microsoft
(CDMUtil, Key vault etc., Storage and Simplified (Storage account, Synapse)
Synapse)
End to end data Data staleness – 10-15 min Data staleness – 15- 30 Min Data staleness* < 1 Hour
staleness and Reporting data : Potential read-write Reporting data -Ready for reports Reporting data - Ready for
pipeline contention when read CSV directly, reports
Performance higher data conversion time.
Cost Query cost + Data conversion + Query cost + Data conversion + DV File capacity
Maintenance of the pipeline as PaaS Maintenance of the pipeline as PaaS (entitlement+ add-on)
solutions solutions (Simpler PaaS)

* Data staleness duration(delta conversion) in direct link for Microsoft Fabric is not finalized yet
Why transition from Export to Data lake

1. Data from all Dynamics apps available in a simple experience

2. Configures & connects Synapse and Microsoft Fabric
3. Save as Parquet & delta lake (faster queries, smaller files, no update conflicts)
4. You can setup firewalled storage accounts or use built-in “One Lake”
5. Materialize F&O Entities
6. #Table limitations go away (choose as much data as you like)
7. Available in all regions (including local regions)
8. Support for memo and large string fields
9. Translated F&O Enums

18
What are the risk to transition?
• Synapse link for DV is GA for long time used by thousands of D365
CE + Power platform customers
• F&O Entity and Table support is in public preview – going to GA in
Oct
• With Synapse link – you can still use data lake + synapse that does
not change
• Transitioning Tables from Export to Synapse link F&O table is
minimal
• Only small property change required to export custom tables for
Synapse link
• Follow the established architecture patterns to transition
19
4
Roadmap and Microsoft Product roadmap
timelines Next steps
Microsoft Product Roadmap
Public preview - now
- F&O Entities & Tables in Synapse Link
- Additional features are coming
- Initialization improvements

General availability
- ETA: Oct-2023
- We will enable early Go lives

Invite customers to transition

- Migration handbook
- Invitations sent via LCS (determined based on usage)
- Transition help built into Synapse Link

22
Recommendations- BI and reporting solution
Go-Live immediately
- Continue to use Export to data lake and transition later
- You can transition to Synapse link easily
Go-Live after Nov 2023
- Start with Synapse link and Fabric
- We will support go live on preview
Already Live with export to data lake
- Start POC to Synapse link and transition when ready
Transitioning from BYOD
- Start with Synapse link and Fabric
- Use entities that are supported
- Use tables and create your own entities as view as needed

23
5
Architecture
Common analytics architecture patterns and
patterns and transition strategy from export to data lake to
transition Synapse link and Microsoft Fabric

25
Overview of common analytics architecture patterns

#1 Virtual data warehousing # 2 Lakehouse # 3 Cloud Data warehousing # 4 Integration using TSQL
(Reading data from data lake (Reading and transforming data (Ingesting data from lake to cloud (Incremental ingestion of data to
using TSQL views and SPs) using spark notebooks) MPP data warehouse, transform relational DB (SQL Server) or third
data using TSQL) party DW)

26
#1 Virtual data warehousing: Synapse Link & Export to data lake, with Synapse Serverless

Current
#1 Virtual data warehousing : Synapse Link-Export to your data lake, with Synapse Spark & Serverless
#1 Virtual data warehousing: Synapse Link-Export data to your data lake, with Synapse Spark & Microsoft Fabric
#1 Virtual data warehousing: Synapse Link-Direct link, with Microsoft Fabric
#2 Lakehouse : Synapse Link/Export to Data lake, with Synapse Spark & Serverless

Current
#2 Lakehouse : Synapse Link-Export data to your data lake, with Synapse Spark and Serverless
#2 Lakehouse : Synapse Link-Export data to your data lake, with Synapse Spark & Microsoft Fabric
#2 Lakehouse : Synapse Link, direct link with Microsoft Fabric
#3 Cloud data warehousing: Synapse link/ Export to data lake with Synapse DW
#3 Cloud data warehouse: Synapse Link- Export data to your data lake with Synapse Spark Microsoft Fabric
#3 Cloud data warehouse: Synapse Link, direct link with Microsoft Fabric
#4 Integration using SQL: Synapse Link/Export to Data lake with Azure SQL, On-prem SQL, third-party using Synapse
#4 Integration using SQL: Synapse Link - Export data to your lake with Azure SQL, On-prem SQL, third-party using
Synapse
#4 Integration using SQL: Synapse Link –with Azure SQL, On-prem SQL, third-party using direct link with Fabric
5
Why transition?
Q&A Business benefits
Expected effort
How much does it cost?

How much does it cost?

6
Links to Tech talks
Appendix Product screen shots and details
Documentation
Resources

Documentation

• Synapse Link
• Azure Synapse Link - Power Apps | Microsoft Learn
• Create an Azure Synapse Link for Dataverse with your Azure Synapse Workspace - Power Apps | Microsoft Learn
• Export Microsoft Dataverse data in Delta Lake format - Power Apps | Microsoft Learn
• Choose finance and operations data in Azure Synapse Link for Dataverse - Power Apps | Microsoft Learn
• Microsoft Fabric
• Microsoft Fabric documentation - Microsoft Fabric | Microsoft Learn

Video
Dynamics 365 Bites - Synapse Link for finance and operations apps - Getting started (preview) | August 2023
(2747) Microsoft Fabric: Satya Nadella at Microsoft Build 2023 – YouTube
(2747) Build 2023: Dataverse integration for Microsoft Fabric - YouTube
You can import table selection from Export to Data Lake feature in Finance and Operations. Create a new Synapse Link or choose existing link. Learn more
 Before
Before
myStorage You can import table selection from Export to Data Lake feature in Finance and Operations and use Synapse Link going forward. Click to continue
Dataverse
Anna-created-workspace
3 of 130 selected i

D365 Finance & Operations

0 of 520 selected i
 Before
You can import table selection from Export to Data Lake feature in Finance and Operations and use Synapse Link going forward. Click to continue
myStorage Before
Dataverse
Anna-created-workspace
3 of 130 selected i

D365 Finance & Operations

0 of 520 selected i
 Before
You can import table selection from Export to Data Lake feature in Finance and Operations and use Synapse Link going forward. Click to continue
myStorage Before
Dataverse
Anna-created-workspace
3 of 130 selected i

D365 Finance & Operations

0 of 520 selected i
Q&A

52