RO.
Back to training

Data · Course 05 · 80 hours · 8 modules

Trending

Data Engineering with Databricks

Build reliable data pipelines on the lakehouse.

Lakehouse fundamentals on Databricks—Spark, Delta Lake, pipelines, governance, and preparing data for analytics and AI.

DatabricksApache SparkPySparkSpark SQLDelta LakeUnity CatalogMLflowPython
Who it's for
Data engineers, analysts, and developers moving into data platforms
Duration
80 hours
Modules
8 modules, ending in a capstone project
Formats
Corporate training · College & university sessions · Own institute & online courses · Mentoring & internships

Syllabus

What the course covers

01

Lakehouse fundamentals

  • Data lakes versus warehouses
  • Workspaces, clusters, and notebooks
02

Spark essentials

  • DataFrames with PySpark and Spark SQL
  • Transformations and actions
  • Partitioning
03

Delta Lake

  • ACID tables and schema enforcement
  • Time travel
  • Upserts with MERGE
04

Data pipelines

  • Medallion architecture: bronze, silver, and gold
  • Incremental ingestion with Auto Loader
  • Orchestration with Jobs and Workflows
05

Governance with Unity Catalog

  • Access control
  • Data lineage
06

Performance and cost

  • Cluster sizing
  • OPTIMIZE and Z-ordering
  • Caching
07

Data for AI

  • Feature preparation
  • Experiment tracking with MLflow
  • Vector search for retrieval-augmented generation
08

Capstone project

  • Build an end-to-end medallion pipeline from raw data to analytics-ready tables

Interested in this course?

Share your audience, goals, and preferred format, and I'll tailor the structure.

Enquire by emailDiscuss on Contact

Testimonials

Voices from collaboration.

Rudresh was a pleasure to work with at Anchor. Through his involvement in very impactful projects he's showed that he's not only capable of handling complex technical problems, but he's persistent, reliable, and enthusiastic about what he works on. You'll find that the value he brings to a team goes far beyond his expertise, as his altruistic personality and care for others uplifts everyone around him and improves morale. That's a much harder trait to find and is something I'll always appreciate about him.

Rami Chaar

Excellent programmer also good logical and analytical skills

Prashant Kumar

Rudresh is professional, technically proficient, and has a strong problem-solving mindset. His clarity in communication, reliability, and commitment to quality make him a valuable asset to any project. He's dependable, detail-focused, and has a strong grasp of both backend logic and user-centric design.

Neetu Dave

I had the opportunity to work with Rudresh in the same team for more than a year and I highly appreciate his problem solving skills, patience and persistence. His friendly nature makes him easily approachable. I have seen him delaying lunch purely out of curiosity and dedication to resolve a complex issue and not due to any deadlines.

Aatharv Bharve

I've had the opportunity to work closely with Rudresh on multiple projects, and I can confidently say he's not only a highly skilled Full Stack Developer but also a genuinely good and helpful person. His strong technical expertise, problem-solving mindset, and ability to deliver clean, scalable, and efficient code set him apart. Rudresh understands business needs deeply and translates them into impactful technical solutions with ease. Beyond his technical abilities, his collaborative attitude and willingness to support others make him a valuable teammate and a pleasure to work with.

Harshal Jain

I had the pleasure of working with you at Hornblower. Your technical expertise has helped us in resolving high priority issues and also I am happy with your development work which always meet our product requirements.

Beyond your coding skills, you also brings creativity, problem-solving ability, and a genuine collaborative spirit to the team. You always take ownership of your work and always eager to help others overcome technical challenges.

Khushal Gupta

I've had the pleasure of working with Rudresh, and he's one of the most skilled engineers I've met. His expertise SaaS architecture is outstanding.

He is very skilled with modern JavaScript stacks such as React, Next.js, and Node.js, as well as AWS and scalable backend systems. His code is well-organized, clean, and efficient, and it was made to last.

Rudresh is a great teammate and knows how to solve problems. He would be a great addition to any team.

Aman Bhargav

Showing testimonial 1 of 7