Real Interview Questions

Earlier we discussed the silver layer, where we mainly write data cleansing logic using PySpark. I'm curious: would you still use Databricks notebooks and PySpark commands to create the gold layer? Are you familiar with dbt and can you execute dbt using traditional SQL templates?

✅

Silver Layer Gold Layer Pyspark Databricks Dbt Sql

🟡 Medium Conceptual Mid Asked 1× Jul 2026

Do you schedule end‑to‑end flows in Databricks, for example ingesting data through an API, performing cleansing and transformations all the way to the core layer? Are these runs scheduled to execute daily or at specific intervals? If failures occur, how do you receive notifications and troubleshoot the issue?

✅

Databricks Etl Scheduling Job Monitoring Failure Handling Data Pipeline

🟡 Medium Conceptual Mid Asked 1× Jul 2026

Are you familiar with Databricks?

✅

Databricks Data Engineering

🟢 Easy Conceptual Fresher Asked 1× Jul 2026

Say you have ingestion pipelines; what are you primarily using? Are you using Databricks or Snowflake? Was the whole platform considered?

✅

Data Pipelines Databricks Snowflake

🟡 Medium Conceptual Mid Asked 1× Jul 2026

We are talking about a Databricks pipeline. Which pipeline did you develop, and which database did you use?

✅

Databricks Data Pipeline Database

🟡 Medium Conceptual Mid Asked 1× Jul 2026

Shubhi, the question is simple: When a modeler is giving a proposal to someone, should they structure the table and approach with technical rationale? Which platform are you using? In Databricks, if you are giving someone a model that works on finance data and the requirement is to maintain history, from an implementation point of view, what is the underlying architecture of Databricks?

✅

Databricks Data Modeling Data Warehousing History Maintenance

🟡 Medium Conceptual Mid Asked 1× Jul 2026

These are technology stack questions. I'm asking: When storing data, which format do you choose? In Snowflake, you can store data in native Snowflake format or Iceberg. In Databricks, you can store data in Delta Lake or Iceberg. Which format would you pick and why?

✅

Snowflake Databricks Delta Lake Iceberg Data Storage Formats

🟡 Medium Conceptual Junior Asked 1× Jul 2026

Are you comfortable implementing Snowflake and Databricks with a similar model? Why would you need SCD Type 2 when implementing? Both cannot make sense if you’re leveraging either Delta Lake or Iceberg. What is the rationale to use SCD Type 2?

✅

Snowflake Databricks Scd Type 2 Data Warehousing

🟡 Medium Conceptual Mid Asked 1× Jul 2026

Can you explain some use cases you have recently handled in PySpark on Databricks?

✅

Pyspark Databricks Use Cases

🟡 Medium Conceptual Mid Asked 1× Jul 2026

If we want to move dashboards to Tableau, how should we handle transformation logic that currently resides in Remio, and how would we adjust the ingestion pipeline to load data into the raw zone in Databricks?

✅

Databricks Remio Tableau Data Pipeline

🟡 Medium Conceptual Mid Asked 1× Jul 2026

What are the different ways available in PySpark on Databricks to handle large data ingestion scenarios, and is there a particular approach that is recommended?

✅

Pyspark Databricks Data Processing

🟡 Medium Conceptual Junior Asked 1× Jul 2026

What options are available in PySpark on Databricks to handle scenarios involving large datasets and joins?

✅

Pyspark Databricks Data Processing

🟡 Medium Conceptual Junior Asked 1× Jul 2026

Will using a broadcast join resolve the scenario, and can you provide the syntax for it?

✅

Pyspark Databricks Syntax

🟡 Medium Conceptual Junior Asked 1× Jul 2026

Between Python and PySpark on Databricks, which is more professional? If you had to choose a primary skill set, what would you pick?

✅

Python Pyspark Databricks Data Engineering

🟡 Medium Conceptual Mid Asked 1× Jul 2026

Is Azure Data Factory different from Azure Databricks?

✅

Azure Data Factory Azure Databricks Data Integration

🟢 Easy Conceptual Fresher Asked 1× Jul 2026

What is Unity Catalog and why use it?

✅

Unity Catalog Databricks Data Governance

🟢 Easy Conceptual Fresher Asked 1× Jun 2026

What is the difference between a normal ATL pipeline and a DLT pipeline?

✅

Data Engineering Databricks Dlt Etl

🟡 Medium Conceptual Junior Asked 1× Jun 2026

Why use a DLT pipeline?

✅

Dlt Databricks Data Engineering

🟢 Easy Conceptual Fresher Asked 1× Jun 2026

Did you use the auto loader option in Databricks?

✅

Databricks Auto Loader Data Engineering

🟢 Easy Behavioral Junior Asked 1× Jun 2026

We have a Delta table `retail_prod.analytics.sales_silver` that is about 600 GB. It is partitioned by `event_date` (daily) and contains many small files (5–20 MB) with no Z‑Order. Dashboards filter on the last 30 days of `event_date` and `merchant_id`, and the p95 query time is above 12 seconds. We cannot change the upstream schema. How can we bring the p95 query time under 12 seconds for the 30‑day window?

✅

Delta Lake Data Skipping Databricks

🟡 Medium Conceptual Mid Asked 1× May 2026