Python for Data Management

1
 Contents

About the programme: 3

Programme outcomes: 3
Eligibility criteria: 3
Duration of the programme: 3
Offline training centres: 3
Course Syllabus: 4
Certification Process: 17
Certificate issued by 17

2
Course name: Python for Data Management

About the programme:

The programme covers a wide variety of practical and theoretical concepts, tips and tricks,
and best practices in the industry. It offers skills such as Core Python, SQL Database, Power
BI, REST API, AWS, Apache Spark, Data Science and Machine Learning, which will help
upskill students to become full-stack Python Developers or Data Engineers/ Managers.

Programme outcomes:
● Ability to design, develop, debug and optimise solutions to business problems
● Proficient in handling different data types and structures to design algorithms
● Skills to create intuitive user interfaces for web applications
● Write readable, reusable code for a collaborative programming environment
● Handling Big Data for visualisation and analytics
● Cloud API development, deployment and management
● Managing and securing resources and data-related services over cloud
● Development of Data Science and Machine Learning solutions for B2B and B2C
applications

Eligibility criteria:
● BE/ BTech/ ME/ MTech/BCA/MCA/MSc/BSc (CS/IT/Circuit Branches)

Duration of the programme:

Hours: 400
Months: 4

Offline training centres:

NA

3
Course Syllabus:
Module 1:
The Complete Python Course
Unit 1: Introduction to Python.
Module outcome: Overview of the Course Curriculum; Our Python Coding Environment;
Writing the First Code! Variables and Printing; Numbers in Python; Calculating the
Remainder of a Division; Python Strings; Python String Formatting; Getting a User Input in
Python; Booleans and Comparisons in Python; AND and OR in Python; Lists in Python;
Tuples in Python; Sets in Python; Advanced Set Operations; Python Dictionaries; Length
and Sum; Joining a list.

Unit 2: Python Fundamentals

Module outcome: If Statements in Python; While Loops in Python; For Loops in Python;
Destructuring Syntax; Iterating over Dictionaries; Break and Continue; The Else Keyword
with Loops; Finding Prime Numbers with For Loops; List Slicing in Python; List
Comprehension in Python; Comprehensions with Conditional Statements; Set and Dictionary
Comprehensions; The Zip Function; Functions in Python; Arguments and Parameters;
Functions and Return Values in Python; Default Parameter Values; Lambda Functions in
Python; First Class and Higher Order Functions.

Unit 3: Milestone Project 1

Module outcome: Installing Python on your Computer; Installing PyCharm on your
Computer; Creating the First PyCharm Project; Setting up the PyCharm Font and Display
Settings; Milestone Project Brief; Milestone Project Implementation; Showing the User
Movies; Finding Movies and Retrieving Details.

Unit 4: Object-Oriented Programming with Python.

Module outcome: Intro to Object-Oriented Programming with Python; More about Classes
and Objects; Parameter Naming in Python; Magic Methods in Python; Inheritance in Python;
The @property Decorator; The @classmethod and @staticmethod Decorators in Python;
More @classmethod and @staticmethod Examples.

Unit 5: Errors in Python.

Module outcome: Intro to Errors in Python; Built-in Errors in Python; Raising Errors in
Python; Creating Errors in Python; Dealing with Python Errors ;The On-success Block and
Re-raising Exceptions; Handling User Errors; Debugging with PyCharm.

Unit 6: Files in Python.

Module outcome: Files in Python; Python Exercise: Copying Files; CSV Files with Python;
JSON Files with Python; Using the “with” Syntax in Python; Importing Files; Python Relative
Imports: Children; Python Relative Imports: Parents; Importing Errors and Running as a
Python Script.

Unit 7: Databases in Python and Milestone Project 2.

Module outcome: Intro to Milestone Project 2; Milestone Project with Lists ;Storing Books in
Files ;Using JSON instead of CSV; Intro to Databases in Python; Using SQLite in Python;
Some Database Jargons; Creating Books Table Using Python; Inserting Books Using

4
Python; SELECT Examples; Getting All Books; UPDATE and DELETE Statements; Filtering
using the WHERE Clause ;Finishing the Milestone Project; Ordering and Limiting;
Developing the Context Manager in Python; Errors in Context Managers.

Unit 8: Type Hinting in Python.

Module outcome: Typing in Python; Further Reading.

Unit 9: Advanced Built-in Functions in Python.

Module outcome: Generators in Python; Python Generator Classes and Iterators ;Iterables in
Python; The Filter() Function in Python; The Map() Function in Python; Any() and All()
Functions in Python.

Unit 10: Advanced Python Development,

Module outcome: Mutability in Python; Argument mutability in Python; Default values for
parameters; Mutable default arguments (bad idea); Argument unpacking in Python ;Queues
in Python;Some interesting Python collections;Timezones; Dates and time in Python ;Timing
your code with Python; Regular expressions; Regex examples; Regex in Python
;Introduction to logging in Python; Logging to a File and Other Features; Higher-order
Functions in Python.

Unit 11: Web Scraping with Python,

Module outcome: Markup Languages The Structure of HTML Code ;Understanding HTML
with BeautifulSoup ;More Complex HTML Parsing; Structuring Parsing Program Better;
Splitting HTML Locators out of the Python Class; Understanding HTML with the Browser;
Scraping the First Website with Python; Milestone Project 3: A Quote Scraper Quotes;
Project 2: Structuring a Scraping App in Python; Quotes Project 3: Getting Locators ;Quotes
Project 4: Crafting a Quote Parser; Quotes Project 5: The Quotes Page; Quotes Project 6:
Recap of the Project ;Milestone Project 4: A Book Scraper + Application; Books Project 2:
Recap of HTML Locators ;Books Project 3: Creating Locators in Python ;Books Project 4:
Creating a Page ;Books Project 5: Creating a Book Parser; Books Project 6: Writing an App
File; Books Project 7: Sorting the Books; Books Project 8: Constructing a Menu ;ASIDE: The
Best Way to Write User Menus ;Books Project 9: Getting Multiple Pages; Books Project 10:
Multiple Pages in Python; Books Project 11: Getting the Page Count in Python; Books
Project 12: Adding the Logging Module to a Python Project; A Word on Scraping Pages with
JavaScript.

Unit 12: Browser Automation with Selenium.

Module outcome: Introduction to this Section ;Review of Quotes Scraping Code;
Downloading ChromeDriver ;Using Chrome in Scraping Code ;New Page Locators
;Interacting with Drop-downs; Selecting Tags; Searching for Quotes; Encapsulating Logic
More Simply ;Adding Error Handling ;Implicit and Explicit Waits in Selenium; Adding Waits to
a Program Code.

Unit 13: Asynchronous Python Development.

Module outcome: The Dining Philosophers Problem; Processes and Threads ;The Python
Global Interpreter Lock (GIL) ;Example: Threads in Python; Using Python [Link]
with the ThreadPoolExecutor; Don't Kill Threads; Multiprocessing in Python; Using Python
[Link] and the ProcessPoolExecutor;Dealing with Shared State in Threads;

5
Queuing in Threads with Shared State; Using Python Generators Instead of Threads; First
Single-threaded Task Scheduler in Python ;Yielding from Another Iterator in Python;
Receiving Data Through Yield ;The Async and Await Keywords ;More explanations and
examples ;Asynchronous Scraper; Making the First Async Request in Python; Retrieving
Multiple Pages Efficiently; Using the async_timeout for Security; Turning our Book Scraping
Project async; HTTPS with Python and Mac OS X.

Unit 14: Python on the Console and Managing Project Dependencies.

Module outcome: Running Python in the Console; Running Python ;What is a virtualenv?;
Navigating the Terminal and Using virtualenv ;Using pipenv pipenv and virtualenv.

Unit 15: Web Development with Flask.

Module outcome: Setting up Project with Pipenv; First Flask Endpoint; Returning Information
with Flask and Pythons; Rendering HTML with Flask and Python; Error Pages and Jinja2
Inheritance; Rendering Forms with Flask and Python; Accessing POST Form Data with
Flask ;Adding a Form in a Single Endpoint; Using Jinja2 For Loops to Create a Nice
Homepage; Adding Website Navigation.

Unit 16: Interacting with APIs with Python.

Module outcome: Signing up for Open exchangerates; Getting All Exchange Rates from the
API; Creating a Currency Exchange Library; Caching Functions with Functools; Performing
TTLCache with Cachetools.

Unit 17: Decorators in Python,

Module outcome: A Simple Decorator in Python; Using Syntax; Functools Wraps in Python;
Decorating Functions with Parameters; Decorators with Parameters; Functions that Accept
Multiple Arguments; Using Generic Decorators for any Function.

Unit 18: Advanced Object-Oriented Programming

Module outcome: Introduction to Multiple Inheritance with Python; Introduction to Abstract
Base Classes (ABCs) in Python; The Usefulness of ABCs; The Relationship Between
Abstract Base Classes (ABCs) and Interfaces; The Property Setter in Python.

Unit 19: Graphical User Interface (GUI) Development with Tkinter.

Module outcome: Setting up Tkinter; Hello World in Tkinte;r Labels and Fields; Packing
Components; Using Frames for Different Layouts; Starting the Text Editor Project; Tkinter
Notebooks and Creating Files; Adding a Menu to an Application; Saving Files to a Disk
;Opening Files; Binding Shortcuts in Tkinter; Checking Tabs for Unsaved Changes;
Confirming Exit with Unsaved Changes; Closing Individual Tabs; Adding Another Menu;
Adding a Permanent Scrollbar to the Text Area.

Unit 20: Unit Testing with Python.

Module outcome: Introduction to this Section; Testing Functions; Testing for Errors; Testing
the Multiplication Function; Writing a Printer Class for Testing; Testing Classes; More Printer
Tests; Testing External Libraries; Conclusion of this Section.

Unit 21: Algorithms and Data Structures.

6
Module outcome: Presentation: Queues, Stacks, and Complexity; Presentation: Binary
Search; Presentation: Binary Trees; Presentation: Traversal of Binary Trees; Presentation:
Adding Elements to a Binary Tree; Adding Elements to a Binary Tree in Python; Recursion
and Inorder Traversal in Python; Finding Nodes in a Tree with Python; Deleting Nodes from
a Binary Tree; Deleting Nodes in Code with Python; Deleting Nodes with Two Children in a
Code; Testing a Binary Tree.

Unit 22: Python Libraries

Module outcome: Python Libraries Overview; Using Pylint; Using Yapf; Sending Emails with
smtplib; Sending Emails with Mailgun; Creating a Re-usable Mailgun Library; Sneak Peek:
Integrated Development Environment (IDE) Setup.

Unit 23: Python Reference/ Refresher.

Module outcome: Variables in Python; String Formatting in Python; Getting the User Input;
Lists, Tuples, and Sets; Advanced Set Operations; Booleans in Python; If Statements in
Python; The “in” Keyword; If Statements with the “in” Keyword; Loops in Python; List
Comprehensions; Dictionaries; Destructuring Variables; Functions in Python; Function
Arguments and Parameters; Default Parameter Values; Functions Returning Values;
Lambda Functions in Python; Dictionary Comprehensions; Unpacking Arguments;
Unpacking Keyword Arguments; Object-Oriented Programming in Python; Magic methods:
str and repr ; Class Methods and Static Methods; Class Inheritance; Class
Composition; Type Hinting; Importing Files in Python; Relative Imports in Python; Errors in
Python; Custom Error Classes; First-class Functions; Simple Decorators in Python; The “at”
Syntax for Decorators; Decorating Functions with Parameters; Decorators with Parameters;
Mutability in Python Mutable Default Parameters

Module 2:
SQL Database for Beginners
Unit 1: Rational Databases.
Module outcome: What are Databases?; What's the Role of Databases in Application
Programming?; Tables and Relations; Primary and Foreign Keys and Other Constraints.

Unit 2: SQL Querying

Module outcome: What is Querying?; The ANSI SQL Standard; DML, DDL and More;
Common Query Tools.

Unit 3: Your First Queries

Module outcome: The SELECT Statement; Limiting Output Columns; Formatting and Sorting
Output; Column Aliases.

Unit 4: Filtering Your Results

Module outcome: The WHERE Clause; Creating a Filter Condition; Applying Multiple Filter
Conditions; More Filter Options

Unit 5: Consolidating Your Data

Module outcome: Counting Records; Common Aggregate Functions: SUM, AVG, MIN, MAX;
Do's and Don'ts When Consolidating; Unions and Other Multiset Consolidations

7
Unit 6: Grouping Your Data
Module outcome: The GROUP BY Clause 9; The HAVING Clause; Do's and Don'ts When
consolidating: Unions and other multiset consolidations

Unit 7: Joining Tables

Module outcome: Table Aliases; Inner Joins; Outer Joins; Self Joins; Complex Multi Table
Joins

Unit 8: Subqueries
Module outcome: Filtering Using Subqueries; The EXISTS Clause; Subqueries as
Alternative to Joins; Derived Tables

Unit 10: Manipulating Your Data

Module outcome: The INSERT Statement; The UPDATE Statement; The DELETE
Statement

Unit 10: Transaction Control

Module outcome: What are Transactions?; Initiating a Transaction; The COMMIT and
ROLLBACK Commands

Unit 11: Creating Database Objects and Adding Business Logic

Module outcome: Creating Tables; Creating and Using Views; Developing and Calling
Stored Procedures; Implementing Triggers

Module 3:
Linux & Fundamentals
Unit 1: Getting Started with Linux.
Module outcome: Introduction; Possible Options to Use Linux on macOS and Windows;
Creating a Linux Container Using Docker; What is Shell, Terminal, and Command; Getting
Information about the Linux Computer; How Shell Understands That You Have Entered a
Command?; Getting Help on Commands Using the Man Utility; Command Options;
Command Arguments; Arguments for Options

Unit 2: Processes in Linux

Module outcome: What are Processes?; List Running Processes; Starting Additional
Processes and Killing Processes; Installing the htop Package Using apt-get; Using the htop
Utility; Summary for Processes Monitoring

Unit 3: Data Streams and Piping in Linux

Module outcome: Data Streams of the Process; Redirecting STDOUT and STDERR to the
File; Where do Process Data Streams Send Data by Default?; How to Send Data to STDIN
and Redirect STDOUT and STDERR?; Piping Summary for the Data Streams and Piping

Unit 4: Files and Directories Management in Linux

Module outcome: Introduction to Files and Directories Management; Linux File System
Structure and Navigation; Listing Files and Directories; Exploring Subdirectories of the Root
Directory; Creating and Removing Directories and Files; Creating New Files; Editing Files

8
Using the Vim and Nano Editors; Copying and Moving Files and Directories; Reading Files;
Filtering Text Using the grep Command; Soft versus Hard Links ;Creating Hard and Soft
Links.

Unit 5: Search Operations in Linux

Module outcome: Introduction to the Find Command; Searching Files Using the Find
Command; Some Other Examples of the Find Command; Executing Additional Commands
inside the Find Operation; Xargs Command; Piping Results of the Find Command to the
Other Command Using Xargs

Unit 6: Compressing and Sorting in Linux

Module outcome: Overview of the tar and gzip Utilities; Creating and Extracting Compressed
Archive Using tar and gzip; Sorting Files Using the ls Command; Sorting Contents of Files
Using the Sort Utility

Unit 7: User Management and Permissions in Linux

Module outcome: Introduction to the User Management in Linux; Creating Users Using the
useradd Command; Creating a New User Using the adduser Command; Changing
Ownership of the File; Changing Permissions

Unit 8: Executable Files and Scripting in Linux

Module outcome: Creating Executable Script ;Adding Path to the Scripts into the PATH
Variable; Summary for Users, Permissions, and Scripts

Unit 9: Networking in Linux

Module outcome: Introduction to Linux Networking; Exploring IP Address Settings; Verifying
Connectivity with Remote Servers; Enabling Secure Shell (SSH) on the Linux Server;
Connecting to the Linux Server Remotely Using Secure Shell (SSH); Using the curl and wget
Utilities

Unit 10: Environment Variables in Linux

Module outcome: Environment Variables; Solution – Script with Environment Variables
Access

Unit 11: Summary

Module outcome: Linux Course Summary

Module 4:
Unit 1: Course Overview,
Module outcome: Course Overview

Unit 2: Saturday - Basic Linux Administration,

Module outcome: What is Linux?; What is Virtual Box?; Oracle Virtual Box Installation;
Creating Virtual Machine; Linux Distributions; Linux Installation; Install Putty; Connect Linux
VM through Putty; Changing Password; Introduction to File System and Structure; File
System Navigation Commands; Directory Listing Overview; Creating Files and Directories
;Pipes ( | ); File Permissions; File Ownership; Commands Adding Text to Files; Getting Help

9
(man, whatis, --help)

Unit 3: Sunday - Advance Linux Administration

Module outcome: File Maintenance Commands (cp, rm, mv, mkdir, rmdir); File Display
Commands (cat, less, more, head, tail, vi); Filters / Text Processing Commands (cut, sort,
grep, awk, uniq, wc); Finding System Information (uname, cat /etc/redhat-release, cat
/etc/*rel*, dmid; Linux File Editor (vi); User Account Management (useradd, groupadd,
usermod, userdel, groupdel) ;Switch Users and Sudo Access (su, sudo); System Utility
Commands (date, uptime, hostname, uname, which, cal, bc); Processes and Schedules
(systemctl, ps, top, kill, crontab and at); OS Maintenance Commands (shutdown, reboot,
halt, init); System Monitoring Commands (top, df, dmesg, iostat 1, netstat, free); Shell
Scripting; Basic Shell Scripts; History Command (history); Enabling Internet in Linux VM;
Network Files and Commands (ping, ifconfig, netstat, tcpdump, networking confi; System
Updates and Repositories (rpm and yum)

Module 5:
Unit 1: Developing RESTful APIs with Django
Module outcome: The Course Overview; Designing a RESTful API to Interact with a Simple
SQLite Database; Working with Lightweight Virtual Environments; Setting Up the Virtual
Environment with Django REST Framework; Creating the Models; Managing Serialisation
and Deserialisation

Unit 2: Creating Django views

Module outcome: Defining API Views; Making HTTP Requests to the API; Working with GUI
Tools – Postman and Others

Unit 3: Working with Class-Based Views in Django

Module outcome: Using Model Serialisers to Eliminate Duplicate Code; Working with
Wrappers to define API Views; Using the Default Parsing and Rendering Options; Browsing
the API; Understanding the Tasks Performed by Each HTTP Method

Unit 4: Working with Hyperlinked APIs in Django

Module outcome: Declaring Relationships with the Models; Managing Serialisation and
Deserialisation with Hyperlinks; Creating Class-Based Views and Using Generic Classes;
Working with Endpoints for the API; Creating and Retrieving Related Resources

Unit 5: Improving Authentication to an API with Django

Module outcome: Adding Unique Constraints to the Models; Taking Advantage of
Pagination; Customising Pagination Classes

Unit 6: Adding Authentication to an API with Django

Module outcome: Understanding Authentication, Permission, and Throttling; Adding
Security-Related Data to the Models Creating a Customised Permission Class for Object-
Level Permissions; Configuring Permission Policies; Composing Requests with the
Necessary Authentication; Browsing the API with Authentication Credentials

Unit 7: Additional features of Django and Django REST Framework

10
Module outcome: Configuring Throttling Policies; Testing Throttling Policies; Understanding
Filtering, Searching, and Ordering Classes; Configuring Filtering, Searching, and Ordering
for Views; Testing Filtering, Searching, and Ordering

Unit 8: Defining and Executing Unit Tests

Module outcome: Setting Up Unit Tests; Defining a First Round of Unit Tests; Running Unit
Tests and Checking; Testing Coverage; Improving Testing Coverage

Module 6:
Business Intelligence with Microsoft & Power & BI- with Material
Unit 1: Introduction to Power BI
Module outcome: Introduction Downloading, Installing, and Activating the New Features in
Power BI

Unit 2: Basic Charts in Power BI

Module Outcome: Section Overview; Creating a Column Chart in Power BI; Creating a
Stacked Column Chart in Power BI; Creating a Pie Chart in Power BI; Creating a Donut
Chart in Power BI; Creating a Funnel Chart in Power BI; Creating a Ribbon Chart in Power
BI; Include and Exclude in Power BI; Exporting Data from Visuals

Unit 3: Maps in Power BI

Module outcome: Basic Maps in Power BI; Creating a Filled Map; Creating a Map with a Pie
Chart; Formatting a Map; Changing the Background in a Map; Creating the Map of India in
Power BI; Creating the Map of Australia in Power BI

Unit 4: Tables and Matrix in Power BI

Module outcome: Creating a Table; Formatting a Table; Conditional Formatting in a Table;
Aggregation in a Table; Matrix; Conditional Formatting in a Matrix; Hierarchies in a Matrix;
Sub-Total and Total in a Matrix; Formatting Numbers in a Table

Unit 5: Other Charts in Power BI

Module outcome: Section Introduction; Line Chart in Power BI; Drill Down Line Chart in
Power BI; Area Chart in Power BI; Line Chart versus Column Chart in Power BI; Scatter Plot
in Power BI; Waterfall Chart in Power BI; TreeMap in Power BI; Gauge Chart in Power BI

Unit 6: Cards and Filters in Power BI

Module outcome: Introduction Number Card in Power BI; Text Card in Power BI; Formatting
a Text Card in Power BI; Date Card; Date Card (Relative Filtering); Multi-row Card; Applying
Filters on Visuals; Applying Filters on a Page; Using Filters on All Pages; Drillthrough in
Power BI

Unit 7: Slicers in Power BI

Module outcome: Slicers in Power BI; Text Slicers in Power BI; Formatting a Text Slicer;
Date Slicers in Power BI; Formatting a Date Slicer; Number Slicers in Power BI

Unit 8: Advanced Charts in Power BI

Module outcome: Advanced Charts in Power BI; Creating an Animated Bar Chart Race; Drill
Down Donut Chart; Drill Down Column Chart; Creating a Word Cloud in Power BI; Creating

11
a Sankey Chart in Power BI; Creating an Infographic in Power BI; Creating a Play Axis in
Power BI; Creating a Scroller in Power BI; Creating a Sunburst Chart in Power BI; Creating a
Histogram in Power BI

Unit 9: Power BI Objects, Bookmarks, and Actions

Module outcome: Inserting Images in Power BI; Inserting Text in Power BI; Inserting Shapes
in Power BI; Inserting Buttons in Power BI; Inserting a Web Uniform Resource Locator (URL)
in Power BI; Inserting a Page Navigation Option in Power BI; Inserting a Bookmark Option in
Power BI; Drillthrough Action in Power BI

Unit 10: Power BI Services

Module outcome: Creating a Report in Power BI; Creating an Account in the Power BI
Service; Publishing a Report to the Power BI Service; Exporting a Report to PPT, PDF, and
PBIX; Commenting, Sharing, and Subscribing to Power BI Reports; Creating a Dashboard in
the Power BI Service; Problems in the BI Dashboard and their Solution; Automatically
Refreshing Reports in the Power BI Service

Unit 11: Text Functions in Power Query

Module outcome: Text Functions in Power Query; Merging Columns in Power Query; Split
and Trim Functions; Upper Case, Lower Case and Proper Case; Adding Prefixes and
Suffixes; Left, Right, and Mid Functions in Power Query; Extracting Text with Delimiters

Unit 12: Date Functions

Module outcome: Date Functions; Year, Quarter, and Day Functions; Difference between
Dates; Month and Day Name; Finding Day and Week of the Week/ Month/ Year; Extracting
the Date and Time; Calculating Age Day of Year, Quarter, or Month

Unit 13: Number Functions in Power Query

Module outcome: Number Functions Basic Number Functions Percentage, Percent of, and
Modulo Functions Rounding Off Functions IsEven and IsOdd Functions

Unit 14: Appending Data in Power BI

Module outcome: Appending Data; Appending Multiple Comma Separated Values (CSV)
Files in a Folder; Appending Multiple Excel Sheets and Tables; Appending Excel Sheets or
Tables with Different Columns; Appending Multiple Files from a Folder; Appending Different
Data Sources

Unit 15: Introduction to Merge Queries,

Module outcome: Merge Queries; Merging Sheets or Tables ;Merging Data from Multiple
Excel Files; Merging Data from Different Data Sources; Merging Data Having Multiple
Criteria

Unit 16: Introduction to Conditional Column and Column from Examples

Module outcome: Section Introduction; Column from Examples - Splitting Text; Column from
Examples - Merging Columns; Column from Examples - Date; Column from Examples -
Alphanumeric; Conditional Column - One Column; Conditional Column - Two Columns;
Conditional Column- Comparing Two Columns; Conditional Column - On Dates

12
Unit 17: Important Topics in Power BI
Module outcome: Section Introduction ;Working with the Fill up and Fill Down Options;
Grouping in Power BI; How to Transpose?; How to Unpivot?; What are Data Types?;
Replacing Errors and Values; Keeping and Removing Rows; Adding, Removing, and Going
to Specific Columns

Unit 18: M Language

Module outcome: M Language; Introduction to M Language; ISINDATE Function in M
Language; Adding and Subtracting Dates Using M Functions; Basic Date M Functions; Basic
Text M Functions; Writing a Simple M Code; Tricks to Get Help on More than 900 M
Functions

Module 7:
Getting Started with Informatica
Unit 1: Downloading Informatica Power Center 9.x
Module outcome: The Course Overview ;Downloading the Tool ;Extracting the Tool from Its
.zip File

Unit 2: Installing and Configuring Power Centre

Module outcome: Installing the Server Installing the Client

Unit 3: Getting Familiar with the Admin Console

Module outcome: Configuring Domain and Node; Configuring Repository and Integration
Service

Unit 4: Setting up Security, Permissions, and Client Configuration

Module outcome: Configuring Users and Granting Permissions; Configuring the Repository
Manager

Unit 5: Configuring Users and Granting Permissions

Module outcome: Working with Sources as Files and Databases; Working with Targets as
Files and Databases

Unit 6: Creating Mappings

Module outcome: Creating a New Mapping; Getting Acquainted with the Workflow Manager
Screen

Unit 7: Adding Transformation Using Input and Output Ports

Module outcome: Using the Workflow Manager Interface; Using the Workflow Manager

Unit 8: Setting Up a Path and Connection

Module outcome: Setting the Source And Target Paths; Executing the Workflow

Unit 9: Getting Accustomed to the Workflow Monitor Screen

Module outcome: The Workflow Monitor; The Workflow Log, Session Log, And Run
Properties

Unit 10: Working with the Repository Manager Screen

13
Module outcome: Working with the Repository Manager Screen

Module 8:
Data Science and Machine Learning with Python;- Hands On!
Unit 1: Getting Started
Module outcome: Introduction [Activity]; Getting What You Need [Activity]; Installing
Enthought Canopy; Python Basics – Part 1 [Activity]; Python Basics – Part 2; Running
Python Scripts; Introducing the Pandas Library

Unit 2: Statistics and Probability Refresher, and Python Practise

Module outcome: Types of Data; Mean, Median, and Mode; [Activity] Using Mean, Median,
and Mode in Python; [Activity] Variation and Standard Deviation; Probability Density
Function and Probability Mass Function; Common Data Distributions; [Activity] Percentiles
and Moments; [Activity] A Crash Course in matplotlib; [Activity] Covariance and Correlation;
[Exercise] Conditional Probability; Exercise Solution – Conditional Probability of Purchase by
Age; Bayes' Theorem

Unit 3: Predictive Models

Module outcome: [Activity] Polynomial Regression; [Activity] Multivariate Regression and
Predicting Car Prices; Multi-Level Models

Unit 4: Machine Learning with Python

Module outcome: Supervised versus Unsupervised Learning and Train/Test; [Activity] Using
Train/ Test to Prevent Overfitting of a Polynomial Regression; Bayesian Methods –
Concepts; [Activity] Implementing a Spam Classifier with Naive Bayes K-Means Clustering;
[Activity] Clustering People Based on Income and Age; Measuring Entropy; Decision Trees –
Concepts; [Activity] Decision Trees – Predicting Hiring Decisions; Ensemble Learning;
Support Vector Machines (SVM) Overview; [Activity] Using SVM to Cluster People by using
scikit-learn

Unit 5: Recommender Systems

Module outcome: User-Based Collaborative Filtering; Item-Based Collaborative Filtering;
[Activity] Finding Movie Similarities; [Activity] Improving the Results of Movie Similarities;
[Activity] Making Movie Recommendations to People; [Exercise] Improve the
Recommender's Results

Unit 6: More Data Mining and Machine Learning Techniques

Module outcome: K-Nearest Neighbors – Concepts; [Activity] Using KNN to predict a rating
for a movie; Dimensionality Reduction and Principal Component Analysis; [Activity] A PCA
Example with the Iris Dataset; Data Warehousing Overview – ETL and ELT Reinforcement
Learning

Unit 7: Dealing with Real-World Data

Module outcome: Bias/Variance Trade-off; [Activity] K-Fold Cross-Validation to Avoid
Overfitting; Data Cleaning and Normalisation; [Activity] Cleaning Web Log Data; Normalising
Numerical Data; [Activity] Detecting Outliers

Unit 8: Apache Spark – Machine Learning on Big Data

14
Module outcome: [Activity] Installing Spark – Part 1; [Activity] Installing Spark – Part 2; Spark
Introduction; Spark and the Resilient Distributed Dataset (RDD); Introducing MLLib; [Activity]
Decision Trees in Spark; [Activity] K-Means Clustering in Spark; TF/IDF; [Activity] Searching
Wikipedia with Spark; [Activity] Using the Spark 2.0 DataFrame API for MLLib

Unit 9: Experimental Design

Module outcome: A/B Testing Concepts; T-Tests and P-Values; [Activity] Hands On with T-
Tests; Determining How Long to Run an Experiment; A/B Test Gotchas

Unit 10: Deep Learning and Neural Networks

Module outcome: Deep Learning Prerequisites; The History of Artificial Neural Networks;
[Activity] Deep Learning in the Tensorflow Playground; Deep Learning Details; Introducing
Tensorflow; [Activity] Using Tensorflow, Part 1; [Activity] Using Tensorflow, Part 2;
Activity] Introducing Keras;[Activity] Using Keras to Predict Political
Affiliations; Convolutional Neural Networks (CNN's); [Activity] Using CNN's
for handwriting recognition; Recurrent Neural Networks (RNN's); [Activity]
Using a RNN for sentiment analysis; The Ethics of Deep Learning;
Learning More about Deep Learning.

Unit 11: Final Project

Module 9:
Apache Spark with Python - Big Data with PySpark and Spark
Unit 1: Get Started with Apache Spark
Module outcome:Introduction to Spark; Install Java and Git; Set up Spark; Run our first
Spark job

Unit 2: RDD
Module outcome: RDD Basics, Creating RDDs, Map and Filter transformation; Solutions to
Airport by Latitude problems; FlatMap Transformation; Solution to Sum of Numbers Problem;
Important Aspects about RDD
Summary of RDD Operations

Unit 3: Spark Architecture and Components

Module outcome:Spark Architecture and Components

Unit 4: Pair RDD

Module outcome: Create Pair RDDs; Filter and MapValue Transformations on Pair RDD; Data
Partitioning

Unit 5: Advanced Spark Topics

Module outcome: Accumulators; Solution to StackOverflow Survey Follow-up Problem;
Broadcast Variables

Unit 6: Spark SQL

15
Module outcome: Spark SQL in Action;Spark SQL practice: House Price Problem; Spark SQL
Joins; Dataframe and RDD Conversion; Performance Tuning of Spark SQL

Unit 7 Running Spark in a Cluster

Module outcome:Run Spark Application on Amazon EMR (ElasticMapReduce) cluster

Module 10:
AWS Certified Developer Associate - A Practical Guide
Unit 1: Required Tools
Module outcome: Note on Free Tier; Create Amazon Web Services (AWS) Cloud9

Unit 2: AMAZON WEB SERVICES (AWS) BASICS

Module outcome: About Cloud Computing;Compute and Storage Fundamentals

Unit 3: AMAZON ELASTIC COMPUTER CLOUD (AMAZON EC2)

Module outcome: Basics; Configuration; Storage; Autoscaling Load Balancing; Basics Lab

Unit 4: AMAZON SIMPLE STORAGE SERVICE (AMAZON S3)

Module outcome: Storage classes; Permissions

Unit 5: AMAZON WEB SERVICES (AWS) CLOUDFORMATION

Module outcome: Template cover Mappings; Stacks Stacksets; Parameter Store;WordPress
Demo; LAB

Unit 6: AMAZON DYNAMODB

Module outcome: Basics Cover Concurrency; Local and Global Secondary Indexes; Throughput
and Read Write Operations; Point in Time Recovery

Unit 7: AMAZON VIRTUAL PRIVATE CLOUD (VPC)

Module outcome: Default VPC Walkthrough; VPC Basic lab

Unit 8: AMAZON WEB SERVICES (AWS) IDENTITY AND ACCESS MANAGEMENT (IAM)
Module outcome: Users API Keys; Policies;Roles; Lab

Unit 9: AMAZON WEB SERVICES (AWS) LAMBDA

Module outcome: Functions; Packages; Lab with ec2

Unit 10: AMAZON WEB SERVICES (AWS) DATABASES

Module outcome: Deploying an RDS Instance

Unit 11: AMAZON WEB SERVICES (AWS) KEY MANAGEMENT SERVICE (KMS)
Module outcome: Intro S3 example

Unit 12: AMAZON SIMPLE WORKFLOW (SWF)

Module outcome: Intro AWS Walkthrough

Unit 13: AMAZON SIMPLE QUEUE SERVICE (SQS)

16
 Module outcome: Working With SQS

Unit 14: AMAZON SIMPLE NOTIFICATION SERVICE (SNS)

Module outcome: Working with SNS
Unit 15: API Gateway
Module outcome: Basics

Unit 16: AMAZON WEB SERVICES (AWS) DEPLOYMENT DEVELOPER TOOLS

Module outcome: Code Pipeline Basics; Code Commit; Code Deploy Basics; Code Star Basics;
Blue Green Deployment

Unit 17: AMAZON ELASTIC CONTAINER SERVICE (AMAZON ECS)

Module outcome: Containerised Microservices

Unit 18: AMAZON WEB SERVICES (AWS) ELASTIC BEANSTALK

Module outcome: Basics

Unit 19: AMAZON WEB SERVICES (AWS) WHITEPAPERS

Module outcome: Introduction

Unit 20: AMAZON WEB SERVICES (AWS) WELL-ARCHITECTED FRAMEWORK

Module outcome: AWS framework

Certification Process:
Certification based on final project submitted by candidates and the final assessment

Certificate issued by
L&T Edutech

17