Have you worked on Databricks as well?

Yes, I have worked extensively on Databricks. In my last role, I used Databricks notebooks to develop Spark jobs that processed log data in real time. I managed clusters using the Databricks UI, configured autoscaling, and set up job triggers for scheduled ETL pipelines. I also leveraged Databricks Delta Lake for reliable storage and used Unity Catalog to enforce access controls on sensitive datasets. Additionally, I integrated Databricks with Azure Data Factory to orchestrate end‑to‑end data workflows, and I monitored job performance using the built‑in Ganglia and Spark UI dashboards.