Databricks Certified Data Engineer Professional (DEP) is Databricks' advanced data engineering certification. While the Associate exam (DEA) asks "do you understand each feature?", DEP asks "can you design, implement, and operate pipelines that meet complex requirements?". All 10 sample questions in the official exam guide are set in real-world situations. You need deep understanding of Delta Lake, Structured Streaming, Unity Catalog, and Lakeflow Jobs, plus production troubleshooting, security design, and CI/CD.
This article systematically covers the specification of the new DEP exam that went live on October 9, 2026, its 9 exam sections, differences from DEA, advanced topics per section, a study roadmap from post-DEA, and strategies for tackling scenario questions.
Here is the DEP exam specification (the new exam live since October 9, 2026, per the official exam guide). Compared with DEA (45 questions, 90 minutes), DEP has 60 questions and a longer 120-minute time limit, which works out to 2 minutes per question. Unscored questions may be included, and the time for them is already part of the 120 minutes. The previous version, available until October 8, 2026, had 59 scored questions and 10 sections.
| Item | Details |
|---|---|
| Number of questions | 60 scored questions (unscored questions may also be included) |
| Time limit | 120 minutes (includes time for any unscored questions) |
| Passing score | Not published (set through statistical analysis, subject to change) |
| Exam fee | $200 (excl. tax) |
| Language | English only (the new exam live since October 9, 2026, per the exam guide) |
| Question format | Multiple choice (all 10 official sample questions start by describing a situation) |
| Code | Mainly Python and SQL |
| Prerequisites | None (DEA cert not required, but the knowledge is) |
| Recommended experience | One year of hands-on experience with the data engineering tasks in the exam outline |
| Validity period | 2 years (to recertify, pass the exam that is live at that time) |
| Delivery format | Online proctored / test center |
DEA and DEP belong to the same "Data Engineer" track, but the required skill level is fundamentally different. DEA is at the "you know what each feature does" level; DEP is at the "you can combine multiple features to make design decisions that satisfy requirements" level.
| Comparison | DEA (Associate) | DEP (Professional) |
|---|---|---|
| Number of questions | 45 questions | 60 questions |
| Time limit | 90 minutes | 120 minutes |
| Passing score | Not published | Not published |
| Exam fee | $200 | $200 |
| Exam languages | English, Japanese, Brazilian Portuguese, Korean | English only |
| Difficulty | Beginner to intermediate | Intermediate to advanced |
| What the exam guide says it assesses | The ability to execute foundational data engineering tasks on Databricks | Advanced skills in building, optimizing, and maintaining production-grade data engineering solutions |
| Expected experience | 6+ months of Databricks usage | 1 year of hands-on experience with the outline's tasks (recommended) |
| Code reading | Read basic PySpark/SQL syntax | Read implementation code (foreachBatch, Lakeflow Pipelines (formerly Delta Live Tables), Jobs API, etc.) and judge correctness |
The new DEP draws from 9 sections. The largest is Developing Code for Data Processing using Python and SQL at 23%, followed by Cost & Performance Optimization (15%) and Data Ingestion & Acquisition and Data Manipulation (12% each). Data Governance and Data Modeling are only 5% each, but that still works out to about 3 of the 60 questions, so you can't afford to skip them.
| Section | Weight | Approx. Questions |
|---|---|---|
| 1. Developing Code for Data Processing using Python and SQL | 23% | ~14 questions |
| 2. Data Ingestion & Acquisition | 12% | ~7 questions |
| 3. Data Manipulation | 12% | ~7 questions |
| 4. Monitoring and Alerting | 10% | ~6 questions |
| 5. Cost & Performance Optimization | 15% | ~9 questions |
| 6. Ensuring Data Security and Compliance | 8% | ~5 questions |
| 7. Data Governance | 5% | ~3 questions |
| 8. Debugging and Deploying | 10% | ~6 questions |
| 9. Data Modeling | 5% | ~3 questions |
The previous version, available until October 8, 2026, had 10 sections (59 scored questions). The official page gave these weights: Developing Code for Data Processing using Python and SQL 22%, Data Ingestion & Acquisition 7%, Data Transformation, Cleansing, and Quality 10%, Data Sharing and Federation 5%, Monitoring and Alerting 10%, Cost & Performance Optimisation 13%, Ensuring Data Security and Compliance 10%, Data Governance 7%, Debugging and Deploying 10%, and Data Modelling 6%. The new exam has no Data Sharing and Federation section; OpenSharing (formerly Delta Sharing), Clean Rooms, and Lakehouse Federation now appear under Data Ingestion & Acquisition. Data Transformation, Cleansing, and Quality became Data Manipulation, which now names the VARIANT type and AI functions such as ai_query.
NicheeLab's DEP question bank has been rebuilt for the new exam guide live since October 9, 2026 (9 sections, 45 objectives), and it includes questions on newly named topics such as Clean Rooms, ai_query, and Metric Views.
The highest-weighted section, with the most objectives (12). It covers streaming pipelines with Lakeflow Pipelines and Auto Loader, Lakeflow Jobs via the UI, API, and CLI, the AUTO CDC APIs, stateful Structured Streaming, UDFs (including Unity Catalog functions), serverless compute configuration, and testing. Choosing between a streaming table and a materialized view is also in scope; in the official sample question, a materialized view is the answer when an aggregate must reflect late-arriving updates to earlier days.
For upserting streaming data into Delta tables, the standard pattern is to use foreachBatch to run MERGE INTO per micro-batch. The exam guide lists stateful processing with watermarks, output modes, foreachBatch, and checkpoints, along with fault-tolerant exactly-once state recovery. Make sure you can explain deduplication using batch IDs, the semantics of the WHEN MATCHED / WHEN NOT MATCHED conditions in MERGE, and how a watermark keeps state from growing without bound when events arrive late.
The AUTO CDC APIs (formerly APPLY CHANGES) in Lakeflow Pipelines build SCD Type 1 and Type 2 tables from a CDC feed; you choose the type with stored_as_scd_type. The AUTO CDC APIs have the same syntax as the APPLY CHANGES APIs, which are still available, but Databricks recommends AUTO CDC. Written by hand with MERGE, SCD Type 2 becomes a two-step process that closes the existing record with a clause such as WHEN MATCHED AND s.value <> t.value THEN UPDATE SET t.end_date = s.effective_date, t.is_current = false and then INSERTs the new one, so be ready to read both styles.
Creating and automating ETL with Lakeflow Jobs (formerly Databricks Workflows) is tested across the UI, API, and CLI. Beyond task dependencies, retry policies (max_retries, retry_on_timeout), and passing values between tasks (dbutils.jobs.taskValues.set() and dbutils.jobs.taskValues.get()), the new exam guide also lists control-flow operators such as If/Else conditions and For Each loops.
On testing, the guide lists unit and integration tests with assertDataFrameEqual, assertSchemaEqual, DataFrame.transform, and testing frameworks. It also covers choosing serverless environments, dependency management, and performance mode, and troubleshooting dependency conflicts and installation failures for libraries from PyPI, local wheels, and source archives.
This section covers ingesting Delta Lake, Parquet, JSON, Iceberg, CSV, and binary data from message buses such as Kafka, Kinesis, and Pub/Sub and from cloud storage. The data sharing and federation objectives, which had their own section in the previous version, are now here too.
Auto Loader has two file-detection modes. Directory Listing lists the cloud storage directory to detect new files, while File Notification receives file-arrival events from the cloud's event services. When detection slows down in a directory with millions of accumulated files, consider switching to File Notification. The current documentation recommends file events (cloudFiles.useManagedFileEvents). With the classic approach (cloudFiles.useNotifications = true), Auto Loader creates notification resources such as AWS SQS queues for you, so it needs the cloud permissions to do so. You can switch between the two modes at any time and keep exactly-once processing.
Configuring CDC ingestion from relational databases such as SQL Server, MySQL, and PostgreSQL with Lakeflow Connect is now named explicitly. In the official sample question, a Lakeflow Connect managed connector is the answer for continuously replicating PostgreSQL inserts, updates, and deletes with minimal custom code. Both Delta and Iceberg are listed as target formats for incremental CDC pipelines in Lakeflow Pipelines.
Expect OpenSharing (formerly Delta Sharing; D2D and Databricks-to-Open) and Clean Rooms for privacy-preserving collaboration, and configuring Lakehouse Federation with Unity Catalog permissions and connection-level credentials.
This section corresponds to Data Transformation, Cleansing, and Quality in the previous version. Besides window functions, joins, and aggregations in Spark SQL and PySpark, it now names semi-structured data and AI functions explicitly.
For JSON with varying shapes, parse it into a VARIANT column with parse_json and extract fields with variant_get or colon-path access. The official sample question uses this as the way to store payloads efficiently and extract fields quickly without declaring a fixed schema. Another objective covers AI functions such as ai_query for running model inference inside pipelines to enrich or classify data.
This objective covers using expectations in Lakeflow Pipelines to quarantine bad records, drop them, or fail the update.
This section covers monitoring with system tables, the REST API, CLI, and SDK, pipeline event logs, Lakehouse alerts, and the Lakeflow Jobs UI and Jobs API.
Databricks system tables such as system.billing.usage, system.access.audit, system.compute.clusters, and the Lakeflow tables (system.lakeflow) are used for cost analysis, auditing, and workload monitoring. In the official sample question, attributing last month's DBU spend to jobs and SQL warehouses is done by joining system.billing.usage with the compute and pricing system tables.
Unity Catalog audit logs are recorded in the system.access.audit table. Be ready to combine the action type (action_name), target resource (request_params), and executing user (user_identity) to query "who accessed which table when". The new exam guide also lists using Databricks Lakehouse alerts to monitor business metrics, data quality and anomaly signals, usage and cost, SQL warehouse and query health, and audit and security events.
This section covers how Unity Catalog managed tables, Predictive Optimization, and Liquid Clustering reduce operational overhead, and how to pick the right optimization for a table's access pattern.
The official documentation describes liquid clustering as a data layout optimization that "replaces table partitioning and ZORDER." The exam guide includes comparing Liquid Clustering with partitioning/ZORDER for a given table size and query pattern, as well as choosing CLUSTER BY AUTO. For a table that receives frequent small MERGE operations that update and delete rows, enabling deletion vectors avoids rewriting whole files on every change (from the official sample question).
Enabling Change Data Feed on a Delta Table lets downstream consumers read the INSERT/UPDATE/DELETE history. You retrieve change data with the table_changes() function or with readStream.option("readChangeFeed", "true") on a Spark DataFrame, then apply it downstream. Memorize precisely that CDF records include _change_type (insert / update_preimage / update_postimage / delete),_commit_version, and _commit_timestamp.
Objectives include using the query profile to find bottlenecks such as data-skipping inefficiencies, join strategies, and shuffles, and understanding how caching (the Delta cache) speeds up repeated reads of the same data.
This section covers least-privilege access control, ABAC, anonymization and pseudonymization, PII detection and masking, and data retention and deletion policies. It is only 8%, but it is an area where misconfiguration is unacceptable in production.
Row filters are applied with ALTER TABLE ... SET ROW FILTER and a function, controlling row visibility based on user attributes. Column masks are applied with ALTER TABLE ... ALTER COLUMN ... SET MASK. The new exam guide adds attribute-based access control (ABAC) policies with governed tags to enforce row filters and column masks at scale. In the official sample question, the way to mask every column tagged 'pii' across hundreds of current and future tables is an ABAC policy, not a per-table SET MASK or dynamic views (views that filter with conditions such as current_user() or is_account_group_member()).
Expect anonymization and pseudonymization methods such as hashing, tokenization, suppression, and generalization; pipelines that detect and mask PII across batch and streaming workloads; and purging data to meet retention and deletion policies such as the GDPR right to erasure, using Delta Lake and Unity Catalog features.
This section covers using Unity Catalog tags and comments to add metadata that makes securable objects easier to discover, and the permission inheritance model across catalogs, schemas, and objects. The official sample question checks that SELECT granted on a catalog also applies to schemas and tables created in it later.
This section covers finding the cause of errors from the Spark UI, cluster logs, system tables, and query profiles, remediating failed job runs with job repairs and parameter overrides, and deployment. DEA also has a CI/CD section (10%), but in DEP the same section also includes error diagnosis and job repairs.
Declarative Automation Bundles let you define jobs, pipelines, notebooks, and configuration in YAML such as databricks.yml and deploy them to a workspace with the databricks bundle deploy command. In the official sample question, deploying the same job and pipeline definitions to dev, staging, and prod with environment-specific settings is done with per-target overrides and databricks bundle deploy -t <target>.
This objective covers Git-based CI/CD with Databricks Git folders (formerly Repos) to deploy notebooks and code. A typical flow with CI/CD tools such as GitHub Actions, Azure DevOps, or GitLab CI is: "PR merge → CI runs unit tests → Declarative Automation Bundles deploys to staging → integration tests → production deploy".
This section covers designing layouts for large Delta/Iceberg tables (partitioning mapped to data grain, clustering aligned to access patterns, and balanced file sizes through compaction) and designing dimensional models for analytical workloads.
In dimensional models such as star schemas, use materialized views for pre-computed aggregations and Unity Catalog metric views for governed, reusable metric definitions. In the official sample question, where each dashboard computes "net revenue" differently and slowly, the answer is to define the metric once in a metric view and read pre-aggregated results from materialized views.
For engineers who already hold DEA and are targeting DEP, we recommend a structured 3-4 month plan. The approach builds on DEA knowledge while layering on the deep implementation knowledge unique to DEP.
DEP's official sample questions are mostly scenario questions that describe a situation and ask which option to choose (9 of the 10 in the exam guide follow this format). You have to extract what is actually being asked and the constraints from the description. The following 4-step approach answers them efficiently.
Read the "Which of the following ..." or "What should the engineer do ..." line at the end of the scenario first. Knowing what's being asked before you read the scenario lets you skip unnecessary information and cuts your reading time.
Keywords in the scenario like "must", "should not", "minimum cost", "without downtime", and "exactly-once" are decisive for choosing the right answer. Check each of these constraints as you read. In many cases, the correct answer and the runner-up are separated by a single point: "does this satisfy the constraint or not?".
Of the 4 options, typically 2 are clearly wrong (non-existent APIs, opposite behavior, etc.). For the remaining 2, judge by matching against the constraints. DEP often comes down to "both would work, but which most efficiently satisfies the requirements?", so train yourself to evaluate along three axes: cost, performance, and operability.
60 questions in 120 minutes means 2 minutes per question. If you've spent 2 and a half minutes and still aren't sure, flag the question and move on. Once you have answered every question, go back to the ones you flagged. Concentrating your remaining time on flagged questions is an effective way to squeeze out every point you can (Databricks does not publish the passing score, so there is no fixed cutoff to aim at).
Data Ingestion & Acquisition
Question 1
A data engineer operates a streaming pipeline that uses Auto Loader to ingest CSV files arriving in cloud storage in real time. The file volume is about 500,000 per day and growing, and recently a multi-minute delay has appeared at Auto Loader startup. The team wants to minimize ingestion delay while preserving the existing checkpoint. Which is the most appropriate action?
Correct answer: A
When file volume is large (500,000/day and growing), Directory Listing mode is slow to enumerate files in storage, causing startup delays. Switching to File Notification mode delivers file-arrival events from the cloud's event services, eliminating the need to list the entire directory and resolving the delay. The current documentation recommends file events (cloudFiles.useManagedFileEvents); the classic approach sets cloudFiles.useNotifications = true. You can switch between the two modes at any time and keep exactly-once processing, so the stream continues on its existing checkpoint. B violates the "real-time ingestion" requirement. C only caps the file processing count and doesn't address the root cause (file-detection latency). D violates the checkpoint-preservation requirement and incurs unnecessary cost and downtime by reprocessing every file.
Can I take DEP (Professional) without first passing DEA (Associate)?
Yes. Databricks does not require Associate certification as a prerequisite for the Professional exam. However, DEP is a higher-level exam that builds on DEA knowledge. Without a solid grasp of Delta Lake, Structured Streaming, and Unity Catalog fundamentals, you'll burn time just parsing the question text. In practice, treat DEA-level knowledge as mandatory.
Are all DEP questions long-scenario format, or are there short knowledge questions too?
Databricks does not publish how question formats are split, including whether short knowledge questions appear. The 10 sample questions in the official exam guide each describe a situation in a few lines and then ask a question, and 9 of them ask which option to choose. What decides pass or fail is reading the requirements and constraints in the scenario (cost, latency, operational effort, and so on) and comparing the options against them.
Do I need a real Databricks environment to study for DEP? Is Free Edition enough?
The official exam guide says the hands-on tasks you generate with its AI Prep Guide are each "small enough to complete in Databricks Free Edition," so Free Edition (the successor to Community Edition, which was retired at the end of 2025) works for hands-on practice. Free Edition is serverless-only, though: you cannot choose your own compute configuration, and Clean Rooms is not supported. It also has limits such as at most 5 concurrent job tasks and one active pipeline per pipeline type. To try features Free Edition does not offer, such as cluster configuration, use your company's workspace or the two-week free trial.
Practice with certification-focused question sets
Try free questionsNicheeLab Editorial Team
NicheeLab editorial team focused on data engineering and cloud certification learning. Content is structured around practical study needs and official exam domains.
Databricks Certifications: All 8 Exams, Difficulty & Study Plan (2026)
Complete guide to all 8 Databricks certifications — Data Eng...
Databricks Exam Difficulty Ranking: 7 Certs Compared (2026)
Seven Databricks certifications ranked by difficulty, with s...
Databricks Study Guide: Fastest Pass Route & Time Estimates (2026)
How to pass Databricks certifications efficiently. Official ...
Databricks Data Engineer Associate: Complete Guide (2026)
Domain-by-domain breakdown of the Databricks Certified Data ...
Databricks Data Engineer Professional: Complete Guide (2026)
Tactics for the Databricks Certified Data Engineer Professio...