Course Information
Course Name
DP-700T00: Microsoft Fabric Data Engineer
Exam code
DP-700
Duration
4 Days
Certification
Microsoft Certified: Fabric Data Engineer Associate
Overview
This course covers methods and practices to implement data engineering solutions by using Microsoft Fabric. Students will learn how to design and develop effective data loading patterns, data architectures, and orchestration processes. Objectives for this course include ingesting and transforming data and securing, managing, and monitoring data engineering solutions. This course is designed for experienced data professionals skilled at data integration and orchestration, such as those with the DP-203: Azure Data Engineer certification.
Audience Profile
This audience for this course is data professionals with experience in data extraction, transformation, and loading. DP-700 is designed for professionals who need to create and deploy data engineering solutions using Microsoft Fabric for enterprise-scale data analytics. Learners should also have experience at manipulating and transforming data with one of the following programming languages: Structured Query Language (SQL), PySpark, or Kusto Query Language (KQL).
Prerequisities
At Course Completion
Course Outline
Module 1: Ingest Data with Dataflows Gen2 in Microsoft Fabric
Data ingestion is crucial in analytics. Microsoft Fabric’s Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
Introduction
Understand Dataflows Gen2 in Microsoft Fabric
Explore Dataflows Gen2 in Microsoft Fabric
Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
Exercise – Create and use a Dataflow Gen2 in Microsoft Fabric
Module 2: Orchestrate processes and data movement with Microsoft Fabric
Microsoft Fabric includes Data Factory capabilities, including the ability to create pipelines that orchestrate data ingestion and transformation tasks.
Introduction
Understand pipelines
Use the Copy Data activity
Use pipeline templates
Run and monitor pipelines
Exercise – Ingest data with a pipeline
Module 3: Use Apache Spark in Microsoft Fabric
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
Introduction
Prepare to use Apache Spark
Run Spark code
Work with data in a Spark dataframe
Work with data using Spark SQL
Visualize data in a Spark notebook
Exercise – Analyze data with Apache Spark
Module assessment
Module 4: Work with real-time data in a Microsoft Fabric eventhouse
An eventhouse in Microsoft Fabric provides a scalable and flexible store for real-time data.
Introduction
Get started with an eventhouse
Use KQL effectively
Materialized views and stored functions
Exercise – Work with data in a Microsoft Fabric eventhouse
Module 5: Introduction to end-to-end analytics using Microsoft Fabric
Discover how Microsoft Fabric can meet your enterprise’s analytics needs in one platform. Learn about Microsoft Fabric, how it works, and identify how you can use it for your analytics needs.
Introduction
Explore end-to-end analytics with Microsoft Fabric
Data teams and Microsoft Fabric
Enable and use Microsoft Fabric
Module 6: Get started with lakehouses in Microsoft Fabric
Lakehouses merge data lake storage flexibility with data warehouse analytics. Microsoft Fabric offers a lakehouse solution for comprehensive analytics on a single SaaS platform.
Introduction
Explore the Microsoft Fabric lakehouse
Work with Microsoft Fabric lakehouses
Explore and transform data in a lakehouse
Exercise – Create a Microsoft Fabric lakehouse
Module 7: Use Apache Spark in Microsoft Fabric
Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
Introduction
Prepare to use Apache Spark
Run Spark code
Work with data in a Spark dataframe
Work with data using Spark SQL
Visualize data in a Spark notebook
Exercise – Analyze data with Apache Spark
Module 8: Work with Delta Lake tables in Microsoft Fabric
Tables in a Microsoft Fabric lakehouse are based on the Delta Lake storage format commonly used in Apache Spark. By using the enhanced capabilities of delta tables, you can create advanced analytics solutions.
Introduction
Understand Delta Lake
Create delta tables
Optimize delta tables
Work with delta tables in Spark
Use delta tables with streaming data
Exercise – Use delta tables in Apache Spark
Module 9: Ingest Data with Dataflows Gen2 in Microsoft Fabric
Data ingestion is crucial in analytics. Microsoft Fabric’s Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
Introduction
Understand Dataflows Gen2 in Microsoft Fabric
Explore Dataflows Gen2 in Microsoft Fabric
Integrate Dataflows Gen2 and Pipelines in Microsoft Fabric
Exercise – Create and use a Dataflow Gen2 in Microsoft Fabric
Module 10: Orchestrate processes and data movement with Microsoft Fabric
Microsoft Fabric includes Data Factory capabilities, including the ability to create pipelines that orchestrate data ingestion and transformation tasks.
Introduction
Understand pipelines
Use the Copy Data activity
Use pipeline templates
Run and monitor pipelines
Exercise – Ingest data with a pipeline
Module 11: Organize a Fabric lakehouse using medallion architecture design
Explore the potential of the medallion architecture design in Microsoft Fabric. Organize and transform your data across Bronze, Silver, and Gold layers of a lakehouse for optimized analytics.
Introduction
Describe medallion architecture
Implement a medallion architecture in Fabric
Query and report on data in your Fabric lakehouse
Considerations for managing your lakehouse
Exercise – Organize your Fabric lakehouse using a medallion architecture
Module 12: Get started with Real-Time Intelligence in Microsoft Fabric
Implement Real-Time Intelligence with Microsoft Fabric
Real-time intelligence in Microsoft Fabric enables analysis of streaming events in real or near-real time.
Module 12: Get started with Real-Time Intelligence in Microsoft Fabric
Analysis of real-time data streams is a critical capability for any modern data analytics solution. You can use the Real-Time Intelligence capabilities of Microsoft Fabric to ingest, query, and process streams of data.
Introduction
What is real-time data analytics?
Real-Time Intelligence in Microsoft Fabric
Ingest and transform real-time data
Store and query real-time data
Visualize real-time data
Automate actions
Exercise – Explore Real-Time Intelligence in Fabric
Module 13: Use real-time eventstreams in Microsoft Fabric
Microsoft Fabric Eventstreams within Real-Time Intelligence (RTI) enable you to ingest and transform real-time data.
Introduction
Components of eventstreams
Eventstream sources and destinations
Eventstream transformations
Exercise – Ingest real-time data with Eventstream in Microsoft Fabric
Module 14: Work with real-time data in a Microsoft Fabric eventhouse
An eventhouse in Microsoft Fabric provides a scalable and flexible store for real-time data.
Introduction
Get started with an eventhouse
Use KQL effectively
Materialized views and stored functions
Exercise – Work with data in a Microsoft Fabric eventhouse
Module 15: Create Real-Time Dashboards with Microsoft Fabric
Real-time Dashboard is a Real-Time Intelligence capability in Microsoft Fabric that you can use to create real-time data visualizations.
Introduction
Get started with real-time dashboards
Advanced features
Real-Time Dashboard best practices
Exercise – Get started with real-time dashboards
Module 16: Use Activator in Microsoft Fabric
Fabric Activator is an event detection engine that automatically triggers actions when specific patterns or conditions are detected in data sources.
Introduction
Configure Activator for your data
Create rules in Activator
Configure actions in Activator
Exercise – Use Activator in Fabric
Module assessment
Module 17: Introduction to end-to-end analytics using Microsoft Fabric
Implement a data warehouse with Microsoft Fabric
Explore the data warehousing process and learn how to load, monitor, secure, and query a warehouse in Microsoft Fabric.
Module 17: Introduction to end-to-end analytics using Microsoft Fabric
Discover how Microsoft Fabric can meet your enterprise’s analytics needs in one platform. Learn about Microsoft Fabric, how it works, and identify how you can use it for your analytics needs.
Introduction
Explore end-to-end analytics with Microsoft Fabric
Data teams and Microsoft Fabric
Enable and use Microsoft Fabric
Module 18: Get started with data warehouses in Microsoft Fabric
Introduction
Understand data warehouse fundamentals
Understand data warehouses in Fabric
Query and transform data
Prepare data for analysis and reporting
Secure and monitor your data warehouse
Exercise – Analyze data in a data warehouse
Module 19: Load data into a Microsoft Fabric data warehouse
Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.
Introduction
Explore data load strategies
Use data pipelines to load a warehouse
Load data using T-SQL
Load and transform data with Dataflow Gen2
Exercise: Load data into a warehouse in Microsoft Fabric
Module assessment
Module 20: Query a data warehouse in Microsoft Fabric
Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.
Introduction
Query data
Use the SQL query editor
Explore the visual query editor
Use client tools to query a warehouse
Exercise: Query a data warehouse in Microsoft Fabric
Module 21: Monitor a Microsoft Fabric data warehouse
A data warehouse is a vital component of an enterprise analytics solution. It’s important to learn how to monitor a data warehouse so you can better understand the activity that occurs in it.
Introduction
Monitor capacity metrics
Monitor current activity
Monitor queries
Exercise – Monitor a data warehouse in Microsoft Fabric
Module 22: Secure a Microsoft Fabric data warehouse
Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.
Introduction
Explore dynamic data masking
Implement row-level security
Implement column-level security
Configure SQL granular permissions using T-SQL
Exercise: Secure a warehouse in Microsoft Fabric
Module 23: Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric
Manage a Microsoft Fabric environment
Microsoft Fabric is a Software-as-a-Service platform for data analytics. Learn how to manage your environment through Continuous Integration/Continuous Deployment (CI/CD), monitoring, and security.
Module 23: Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric
Microsoft Fabric implements CI/CD using Git integration and deployment pipelines. These tools help you collaborate with your development team and provide you with an efficient process for delivering and updating content.
Introduction
Understand Continuous Integration and Continuous Delivery (CI/CD)
Implement version control and Git integration
Implement deployment pipelines
Automate CI/CD using Fabric APIs
Exercise: Implement deployment pipelines in Microsoft Fabric
Module 24: Monitor activities in Microsoft Fabric
Monitoring helps you gain visibility into the health of your data systems. Monitoring Hub in Microsoft Fabric collects and aggregates data from Fabric activities. Microsoft Fabric Activator helps you take actions when patterns or conditions are detected in streaming data.
Introduction
Understand monitoring
Use Microsoft Fabric Monitor Hub
Take action with Microsoft Fabric Activator
Exercise – Monitor Fabric activity in the Monitor hub
Module 25: Secure data access in Microsoft Fabric
Microsoft Fabric uses a multi-layer security model with access controls at different levels.
Introduction
Understand the Fabric security model
Configure workspace and item permissions
Apply granular permissions
Exercise: Secure data access in Microsoft Fabric
Module 26: Administer a Microsoft Fabric environment
Microsoft Fabric is a SaaS solution for end-to-end data analytics. As an administrator, you can configure features and manage access to suit your organization’s needs.
Introduction
Understand the Fabric Architecture
Understand the Fabric administrator role
Manage Fabric security
Govern data in Fabric
Module 27: Use Activator in Microsoft Fabric
Fabric Activator is an event detection engine that automatically triggers actions when specific patterns or conditions are detected in data sources.
Introduction
Configure Activator for your data
Create rules in Activator
Configure actions in Activator
Exercise – Use Activator in Fabric
Module assessment
All Microsoft certification courses are conducted by certified trainers from Iverson.
Digital Methods acts as the official training partner and assists with program consultation, registration, coordination, scheduling, and administrative arrangements to ensure a seamless and professionally managed training experience.