Scribd
Upload
4 views8 pages

Data Engineer

The document outlines a structured 10-week training program focused on developing skills in SQL, Python, Spark, Azure Data Factory, and Databricks, along with practical projects and interview preparation. It emphasizes understanding business metrics, critical thinking, and advanced business analysis techniques. The program is divided into three phases: building foundational skills, mastering data engineering core concepts, and preparing for interviews and projects.

Uploaded by

Ganesh chowdary
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
4 views8 pages

Data Engineer

The document outlines a structured 10-week training program focused on developing skills in SQL, Python, Spark, Azure Data Factory, and Databricks, along with practical projects and interview preparation. It emphasizes understanding business metrics, critical thinking, and advanced business analysis techniques. The program is divided into three phases: building foundational skills, mastering data engineering core concepts, and preparing for interviews and projects.

Uploaded by

Ganesh chowdary
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Phase 1: Strong Foundations (Weeks 1–3)

1️⃣ SQL – (Sumit Mittal)

⏳ Daily: 1.5–2 hrs

What to Cover:

 SELECT, WHERE, GROUP BY

 JOINS (very important)

 Subqueries

 Window Functions

 CTEs

 Indexes basics

Practice:

 5 queries daily

 LeetCode / StrataScratch / HackerRank SQL

👉 SQL is your backbone. Don’t skip.

2️⃣ Python – (Manish Tiwari)

⏳ 1 hr daily

Focus on:

 Lists, dictionaries

 Functions

 Pandas

 Data cleaning

 Basic EDA

👉 You don’t need ML now. Focus on data handling.

🟡 Phase 2: Data Engineering Core (Weeks 4–6)

3️⃣ Spark Fundamentals – (Manish Kumar)

⏳ 1.5 hr daily

Focus on:
 What is Spark?

 RDD vs DataFrame

 Transformations vs Actions

 Lazy evaluation

 Spark SQL

4️⃣ Azure Data Factory – (Maheer Basha Shaik)

⏳ 1 hr daily

Learn:

 Pipelines

 Linked services

 Datasets

 Triggers

 Copy activity

 Basic ETL flow

5️⃣ Databricks – (Narender Kumar)

Focus on:

 Delta Lake

 Notebooks

 Cluster basics

 ETL workflows

 Integration with Spark

🔵 Phase 3: Interview + Projects (Weeks 7–10)

6️⃣ Projects – (Ansh Lamba)

You must build at least:

Project 1:

ETL pipeline:
 Load CSV → Clean with Python

 Store in SQL

 Query insights

Project 2:

Mini Data Engineering project:

 Use Spark

 Use Databricks

 Simulate real data pipeline

7️⃣ Interview Preparation

From:

 Manish Tiwari

 Ansh Lamba

 Deepak Goyal sessions

Prepare:

 SQL interview questions

 Spark theory

 ETL scenario questions

 Difference between OLTP & OLAP

 What is Data Warehouse?

 Star vs Snowflake schema

📅 Daily Study Structure (If 4 Hours Daily)

Time Topic

1.5 hr SQL

1 hr Python

1 hr Spark / ADF
Time Topic

30 Interview
min theory

Week 1: Build Business Foundations (Understand Metrics)

Goal:

Understand how businesses actually make money.

📌 Day 1–2: Revenue & Profit Basics

Learn:

 Revenue

 Cost

 Profit

 Gross vs Net Revenue

 Unit Economics

Ask yourself:

 How does Swiggy earn?

 How does Instagram earn?

 How does Amazon earn?

📌 Day 3–4: Core Product Metrics

Learn:

 DAU / MAU

 Retention

 Conversion Rate

 Churn

 AOV (Average Order Value)

 LTV

Then ask:
“If retention drops, what happens to revenue?”
📌 Day 5–6: Funnels

Understand:

User Visit → Sign Up → Add to Cart → Purchase

Ask:

 Where do users drop off?

 Why?

📌 Day 7: Reflection Day

Pick one company (like Swiggy or ShareChat).

Write:

 How they earn

 Their top 5 metrics

 What can go wrong in business

🗓 Week 2: Learn to Think in Questions

Goal:

Train your brain to ask better business questions.

📌 Daily Exercise (Days 8–14)

Take 1 simple SQL question daily like:

 Total revenue last month

 Top 5 customers

 Orders per city

For each question, write:

1. What is the business goal?

2. Who will use this data?

3. What decision can be taken?

4. What follow-up analysis is needed?

This is CRITICAL.
Example:

Revenue decreased 10%.

Ask:

 New users dropped?

 Repeat users dropped?

 Discounts reduced?

 Seasonality?

Now you’re thinking like a product analyst.

🗓 Week 3: Case Study Practice

Goal:

Think like a Product Analyst.

📌 Day 15–17: Growth Case

Question:
“Orders dropped 15%. Why?”

Break into:

 Traffic issue?

 Conversion issue?

 Retention issue?

 Supply issue?

Structure your answer.

📌 Day 18–20: Experiment Thinking

Learn:

 A/B testing basics

 Control vs Test group

 Statistical significance (basic idea)


Ask:
“If we change homepage UI, how do we measure impact?”

📌 Day 21: Mock Interview

Record yourself answering:


“How would you improve revenue of a food delivery app?”

🗓 Week 4: Advanced Business Thinking

Goal:

Move from data reporter → decision driver.

📌 Day 22–24: Deep Dive Metrics

Learn:

 Cohort analysis

 Segmentation

 Customer lifetime value

 CAC vs LTV

Think:
Which customers are most valuable?

📌 Day 25–27: Strategy Thinking

Pick 3 companies:

 ShareChat

 Zomato

 Netflix

For each, answer:

 How do they grow?

 Biggest risk?

 One improvement idea?


📌 Day 28–29: Full Case Simulation

Question:
“ShareChat user engagement dropped 8%.”

Structure like:

1. Define metric

2. Segment users

3. Identify problem

4. Suggest solution

5. Define success metric

📌 Day 30: Final Review

Write 2-page document:

 What is business thinking?

 How metrics connect to revenue?

 How data drives decisions?

If you can explain clearly, you improved.

🏆 Daily Habit (Very Important)

Whenever you see any number:

Don’t say:
“Okay.”

Ask:

 Is this good or bad?

 Compared to what?

 Why?

 What action?

You might also like