Data Engineering with Python
(by-Sneha mam)
UNIT-I
Introduction, parts of Python Programming Language, Control Flow Statements,
Functions, Strings [Reference 2 - Chapter 1 or Chapter 5]
UNIT-II
Lists, Dictionaries, Tuples and sets, Files,
Regular Expressions
UNIT-III
Introduction to Data Science [ Reference 2-Chapter 12], Data Science: Data
Analysis Sequence, Data Acquisition Pipeline, Report Structure
Files and Working with Text Data: Types of Files, Creating and Reading Text Data,
File Methods to Read and Write Data, Reading and Writing Binary Files, The Pickle
Module, Reading and Writing
CSV Files, Python os and [Link] Modules
Working with Text Data: JSON and XML in Python
Working with Text Data: Processing HTML Files, Processing Texts in
Natural Languages
Regular Expression Operations: Using Special Characters, Regular Expression
Methods, Named Groups in Python Regular Expressions, Regular Expression with
glob Module
UNIT- IV
Working with Databases: Setting Up a MySQL Database, using a MySQL
Database: Command Line, Using a MySQL Database, Taming Document Stores:
MongoDB
Working with Data Series and Frames: Pandas Data Structures, Reshaping Data,
Handling Missing Data, Combining Data, Ordering and Describing Data, Transforming
Data, Taming Pandas File I/O
Plotting: Basic Plotting with PyPlot, Getting to Know Other Plot Types, Mastering
Embellishments, Plotting with Pandas
UNIT-V
Probability and Statistics: Reviewing Probability Distributions, Recollecting Statistical
measures, Doing Stats the Python way.
Machine Learning : Designing a Predictive Experiment, fitting a linear regression,
Grouping Data with K-means Clustering. Surviving in Random Decision Forests.