Implementing Power BI in the Enterprise
By Greg Low
4.5/5
()
About this ebook
Power BI is an amazing tool. It's so easy to get started with and to develop a proof of concept.
Enterprises want more than that. They need to create analytics using professional techniques.
In this unique book, Dr Greg Low shows you how he has implemented many successful Power BI
Related to Implementing Power BI in the Enterprise
Related ebooks
Practical Business Intelligence Rating: 3 out of 5 stars3/5Learn T-SQL Querying: A guide to developing efficient and elegant T-SQL code Rating: 0 out of 5 stars0 ratingsData Analysis and Business Modeling with Excel 2013 Rating: 1 out of 5 stars1/5Database Management for Business Leaders: Building and Using Data Solutions That Work for You Rating: 0 out of 5 stars0 ratingsDAX Patterns: Second Edition Rating: 5 out of 5 stars5/5Microsoft Power BI A Complete Guide Rating: 0 out of 5 stars0 ratingsPower BI A Complete Guide - 2021 Edition Rating: 0 out of 5 stars0 ratingsFinancial Reporting with Dashboards in Power BI Rating: 0 out of 5 stars0 ratingsSupercharge Power BI: Power BI is Better When You Learn To Write DAX Rating: 5 out of 5 stars5/5Power BI Data Modeling: Build Interactive Visualizations, Learn DAX, Power Query, and Develop BI Models Rating: 0 out of 5 stars0 ratingsPower BI for the Excel Analyst: Your Essential Guide to Power BI Rating: 0 out of 5 stars0 ratingsPower BI Pro Complete Self-Assessment Guide Rating: 0 out of 5 stars0 ratingsTeach Yourself VISUALLY Power BI Rating: 0 out of 5 stars0 ratingsCleaning Excel Data With Power Query Straight to the Point Rating: 5 out of 5 stars5/5Expert Cube Development with SSAS Multidimensional Models Rating: 0 out of 5 stars0 ratingsTabular Modeling with SQL Server 2016 Analysis Services Cookbook Rating: 4 out of 5 stars4/5Supercharge Excel: When you learn to Write DAX for Power Pivot Rating: 0 out of 5 stars0 ratingsM Is for (Data) Monkey: A Guide to the M Language in Excel Power Query Rating: 4 out of 5 stars4/5Microsoft Power BI The Ultimate Step-By-Step Guide Rating: 0 out of 5 stars0 ratingsMicrosoft Power Platform A Deep Dive: Dig into Power Apps, Power Automate, Power BI, and Power Virtual Agents (English Edition) Rating: 0 out of 5 stars0 ratings
Computers For You
Storytelling with Data: Let's Practice! Rating: 4 out of 5 stars4/5Mastering ChatGPT: 21 Prompts Templates for Effortless Writing Rating: 4 out of 5 stars4/5Creating Online Courses with ChatGPT | A Step-by-Step Guide with Prompt Templates Rating: 4 out of 5 stars4/5Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are Rating: 4 out of 5 stars4/5Algorithms to Live By: The Computer Science of Human Decisions Rating: 4 out of 5 stars4/5Elon Musk Rating: 4 out of 5 stars4/5Data Analytics for Beginners: Introduction to Data Analytics Rating: 4 out of 5 stars4/5Get Into UX: A foolproof guide to getting your first user experience job Rating: 4 out of 5 stars4/5Artificial Intelligence: The Complete Beginner’s Guide to the Future of A.I. Rating: 4 out of 5 stars4/5The Innovators: How a Group of Hackers, Geniuses, and Geeks Created the Digital Revolution Rating: 4 out of 5 stars4/5Grokking Algorithms: An illustrated guide for programmers and other curious people Rating: 4 out of 5 stars4/5Good Code, Bad Code: Think like a software engineer Rating: 5 out of 5 stars5/5People Skills for Analytical Thinkers Rating: 5 out of 5 stars5/5The Alignment Problem: How Can Machines Learn Human Values? Rating: 4 out of 5 stars4/5Learn Algorithmic Trading: Build and deploy algorithmic trading systems and strategies using Python and advanced data analysis Rating: 0 out of 5 stars0 ratingsPractical Data Analysis Rating: 4 out of 5 stars4/5The ChatGPT Millionaire Handbook: Make Money Online With the Power of AI Technology Rating: 4 out of 5 stars4/5Master Obsidian Quickly: Boost Your Learning & Productivity with a Free, Modern, Powerful Knowledge Toolkit Rating: 4 out of 5 stars4/5Becoming a Data Head: How to Think, Speak, and Understand Data Science, Statistics, and Machine Learning Rating: 5 out of 5 stars5/5Learning the Chess Openings Rating: 5 out of 5 stars5/5UX/UI Design Playbook Rating: 4 out of 5 stars4/5Blender 3D Basics Beginner's Guide Second Edition Rating: 5 out of 5 stars5/5ChatGPT Rating: 3 out of 5 stars3/5
Reviews for Implementing Power BI in the Enterprise
2 ratings0 reviews
Book preview
Implementing Power BI in the Enterprise - Greg Low
Implementing Power BI®
in the
Enterprise
Dr Greg Low
SQL Down Under Pty Ltd
Implementing Power BI® in the Enterprise
Dr Greg Low
SQL Down Under Pty Ltd
@greglow
https://enterprisepowerbibook.sqldownunder.com
First edition June 2021
Power BI is a registered trademark of Microsoft Corporation
Cover Awesome image by the amazing Pang Yuhao
(c/- Unsplash https://unsplash.com/photos/OPwYu6nhWFc )
This eBook is copyright material and must not be copied, reproduced, transferred, distributed, leased, licensed, or publicly performed or used in any way except as specifically permitted in writing by the publishers, as allowed under the terms and conditions under which it was purchased or provided as strictly permitted by applicable copyright law. Any unauthorized distribution or use of this text may be a direct infringement of the author’s and publisher’s rights and those responsible may be liable in law accordingly.
I have done my best to make this eBook as error free as possible at the time of publication, but I do not promise that it is error free or that anything we describe will work for you or continue to work for you. Every one of these technologies is a moving target. This eBook does not replace professional advice.
Note from the author:
I have worked with data for decades. This eBook is a compilation of the lessons I have learned when implementing Power BI based systems across a variety of organizations.
We intend to keep enhancing and upgrading this book. If you have feedback for it, please send that to [email protected]
About the Author Dr Greg Low
A person smiling for the camera Description automatically generated with low confidenceGreg is one of the better-known database consultants in the world. In addition to deep technical skills, Greg has experience with business and project management and is known for his pragmatic approach to solving issues. His skill levels at dealing with complex situations and his intricate knowledge of the industry have seen him cut through difficult problems.
Microsoft has specifically recognized his capabilities and appointed him to the Regional Director program. They describe it as consisting of 150 of the world's top technology visionaries chosen specifically for their proven cross-platform expertise, community leadership, and commitment to business results
.
Greg leads a boutique data consultancy firm called SQL Down Under. His clients range from large tier-1 organizations to start-ups.
Greg is a long-term Data Platform MVP and considered one of the foremost consultants in the world on Microsoft data-related technologies. He has provided architectural guidance for some of the largest SQL Server implementations in the world and helped them to resolve complex issues. Greg was one of the two people first appointed as SQL Server Masters worldwide. Microsoft use him to train their own staff. He has worked with Power BI since before it was initially released.
A talented trainer and presenter, Greg is known for his ability to explain complex concepts with great clarity to people of all skill levels. He is regularly invited to present at top level tier-1 conferences around the world. Greg's SQL Down Under podcast has a regular audience of over 40,000 listeners.
Outside of work and family, Greg's current main passion is learning Mandarin Chinese, determined to learn to read, write, speak, and understand it clearly.
Graphical user interface, text, application, email Description automatically generatedNeed to learn about data? SQL Down Under offer online on-demand courses that you can take whenever you want. We have many data-related courses.
You can learn with Greg right now!
We are rapidly expanding our list of courses.
Check us out now at https://training.sqldownunder.com
Need assistance with a project? Want help with the architectural design, or with getting a project back on track?
Contact https://sqldownunder.com to see how we can help.
TABLE OF CONTENTS
About the Author Dr Greg Low
Introduction
What this book is and is not about
Useful background knowledge
Structure of the book
Chapter 1: Power BI Cloud Implementation Models
Overview
Cloud-Native Clients
Characteristics
Starting Point
Typical Implementation
Tools Used
Azure SQL Database
Cloud-Friendly Clients
Characteristics
Starting Point
Typical Implementation
Tools Used
Cloud-Conservative Clients
Characteristics
Starting Point
Typical Implementation
Enterprise Gateway
SQL Server Integration Services (SSIS)
Tools Used
Cloud-Unfriendly Clients
Characteristics
Starting Point
Typical Implementation
Tools Used
Chapter 2: Other Tools That I Often Use
Overview
SQL Server Reporting Services
SSRS Tooling
Tabular Editor
Vertipaq Analyzer
DAX Studio
Azure Storage Explorer
Chapter 3: Working with Identity
Overview
Identity Aims
Azure Active Directory
Azure AD Core Directory (AAD)
Hybrid AD
Azure AD Business to Business (AAD B2B)
Azure AD Business to Consumer (AAD B2C)
AAD and Azure Databases
Azure SQL
Azure Analysis Services
Service Principals
Managed Service Identities
Chapter 4: Do you need a Data Warehouse?
Overview
Cleansing Data
Appropriate Naming
Consistency
Schema Design
Data Types
Invalid Data
Missing Data
Unrealistic Data
Rounding Issues
Where to Cleanse Data
Aligning Data from Multiple Systems
Mapping and Reference Tables
Where to Align or Map Data
Data Versioning
Where Should You Version Data?
Maintaining Historical Data
Where to Maintain Historical Data
What I do: Data Warehouse
Cloud-Native and Cloud-Friendly Customers
Cloud-Conservative and Cloud-Unfriendly Customers
Chapter 5: Implementing the DataModel Schema
Overview
Database Schemas
Object Schemas
Schemas for Grouping
Schemas for Security
DataModel Schema in the Data Warehouse Structure
DataModel Schema Design Goals
Design Rules
Table Structures
Appropriate Naming
Data Types
Table Keys and Relationships
Versioning Table Rows
Additional Columns
Missing Rows
Lineage
Table Compression
Row Compression
Page Compression
Columnstore Indexes
Chapter 6: Implementing the Analytics Schema
Overview
Analytics Schema in the Data Warehouse Structure
Analytics Schema Design Goals
Minimizing the Attack Surface
Embedding T-SQL
Outcome of the Analytics Schema
Excluding DataModel Data
Design Rules
Automating View Creation
Installing SDU Tools
Date Tables or Views
Automating Date Table Creation
Local DateTime in Azure SQL Database
Automatic Data Subsetting
What I Want to Achieve
My Workaround
Chapter 7: Using DevOps for Project Management and Deployment
Overview
Project Management and Deployment Goals
Azure DevOps
Project Wiki
Azure Boards
Azure Repos
Azure Pipelines
Infrastructure as Code
Azure Test Plans
Azure Artifacts
Azure Monitor / Azure Log Analytics
GitHub
GitHub vs Azure DevOps
Database Projects
Database Projects in SSDT
Building a Database Project
Change Management Advice
Chapter 8: Staging, Loading and Transforming Data
Overview
Accessing Source Data
What I do: File Processing
What I do: Database Data
Transactional Replication
Transactional Replication Pros and Cons
Common Data Flow
Linked server and custom SQL Server Agent job
Integration Services Package
Availability Group Replica
Creating the Staging Schema
Staging Schema in the Data Warehouse Structure
What I do: Staging Schema
NULL or NOT NULL
Using External Tables to Access Source Data
What I do: Linked Servers
Indexing Staged Tables
Creating the DataLoad Schema
DataLoad Schema in the Data Warehouse Structure
What I do: DataLoad Schema
What I do: Automation Metadata
Loading File Data into Staging Tables
What I do: Logging
Loading Staged Data
Incremental Data Loading
Loading and Transforming the Staged Data
Chapter 9: Implementing ELT and Processing
Overview
ELT Tooling
What I do: On-Premises
What I do: Azure
Azure Data Factory (ADF) Overview
SSIS Packages in ADF
ADF Project Structure
Creating ADF Pipelines
Activities
Pipeline Parameters
Pipeline Variables
Linked Services
Data Sets
Timeouts
Integration Runtimes
Testing Pipelines
ADF Triggers and Scheduling
Schedule Triggers
Tumbling Window Triggers
Storage Event Triggers
Other Triggers
Other Scheduling Methods
ADF Security and Monitoring
Database and Service Connection Security
Monitoring ADF and Creating Alerts
Integration with Source Control
ADF Deployment
Publishing from Code
ADF Data Flows
Chapter 10: Implementing the Tabular Model
Overview
Structure and Tools
What I do: Tabular Data Model
What I do: Power BI
What I do: Tooling
Tabular Projects and Source Control
Analysis Services Project Tooling
Projects and Source Control
Creating Projects and Solutions
Configuring Workspace Databases
Configuring Compatibility Level
Configuring Data Model Properties
Multi-User Development
Initial Loading of Tables
Authentication to Analysis Services
Authentication to Data Sources
Selecting and Transforming the Tables
Initial Commit to Git
Core Aspects of Tabular Models
Relationships
Calculated Tables
Hiding Columns and Tables from Clients
Measures
Summarization for Columns
Correct Level for Computations
Mark as Date Table
Hierarchies
Data Formats
Data Categories
Report Measure Table
Testing and Deployment Options
Testing During Development
Deployment
Chapter 11: Using Advanced Tabular Model Techniques
Overview
Processing Data Models
Database Processing Option – Default
Database Processing Option – Full
Database Processing Option – Clear
Database Processing Option – Recalc
Table Processing Options
Scripting Processing Steps
Scheduling Processing
On-Premises or VM-Based – SQL Server Agent
On-Premises or VM-Based – Integration Services
Azure Data Factory Based Processing
Implementing Row Level Security
Managing Roles
Role Database Permissions
Role Members
Role Table Permissions
Role Row Filters
Dynamic User Security
Testing Roles and Row Filters
Object Level Security
Labeling Sensitive Data
Perspectives
Translations
Scripting Database with TMSL
Partitioning Data
Database Table Partitions
Tabular Data Model Partitions
Table Partition Example
Optimizing Data Model Size
Minimizing Data Model Size
Using DAX Studio and Vertipaq Analyzer
Configuring Encoding Hints
Additional Concepts
Parent-Child Relationships
Many to Many Relationships
Checking for Best Practices
Chapter 12: Connecting Power BI and Creating Reports
Overview
Connecting to the Data Model
Adding Report Measures
Using Composite Data Models
Summary
Glossary
Introduction
A picture containing text, indoor Description automatically generatedWhat this book is and is not about
Thanks for reading this book. To make sure we are on the same page (pun intended), I would like to start by spelling out what this book is and is not about. This book is not an introduction to Power BI. It is also not a book that explains how to create the best visualizations in Power BI. In fact, it does not cover much about building reports.
This book is about putting a framework in place so that you can build great reports using Power BI. It is about all the things that you need to have in place to make it easy to build those great reports, and about doing that in a way that can work in enterprises. Power BI is an amazing tool that is so easy to get started with. But when it comes to making it fit into an enterprise way of thinking, some planning is needed. It is important to understand that Power BI was designed to appeal immediately to power users. It was not targeted at enterprise IT developers.
I see it a bit like I used to see Microsoft Access years ago. In the data community, the use of Access as a database is almost like a running joke as it is not really considered a database. Worse, many companies have challenges with data that has been spread across Access databases all over the organization in an uncontrolled way. I do not see Access that way. I was never a great fan of it, but I know that there are many applications today that would never have existed if the people who started them, were not able to use Access. It was an enabling technology that let ideas get off the ground.
Power BI today has a similar potential issue. It enables so many people to get data and reporting ideas started. For many people, that might also be all that has ever needed. Enterprises, though, can end up viewing this differently. Silos of data with varying quality and management are not going to be popular.
In this book, I will show you how I structure data models, how I stage and process the data, and how I secure it. I will also show you some techniques that I use to automate the process of building the data models.
There is no one right or wrong way to implement Power BI in an enterprise. In this book, I will tell you how I do it, and I have been implementing many successful projects. I cannot also promise you that I will not think differently about aspects of it in the future. I might. All technology changes fast but Power BI changes faster than most. You might disagree with some of my opinions that I provide in the book. That is fine too. Take what you find useful. What I can tell you is this is how I have implemented a lot of projects, and very successfully.
Useful background knowledge
When you are reading this book, it will certainly help if you have some existing background with database