Data Analysis for
Python
Noelia Franco
Mojix Inc. ©2024 Confidential Information
Agenda Week 1 (Oct 22th - Jun 14th)
Deadline -> Oct 11 Deadline -> Oct 18
Fundamentals Data Processing Data Processing
Time (EST) Week 1 Week 2 Week 3 Week 4
(Kick off and DS Fundamentals) (Python for Data Analysis) (SQL for Data Analysis) (ETL)
Rodo Noe Priscila Renan/VicU
Monday
Tuesday • Kickoff • Python Overview • SQL Overview - Batch ETL
• Data Science Fundamentals • Python Pandas • Data Manipulation with SQL (PySpark-?)
• Data Engineering Fundamentals
Colab Colab Colab
Wednesday
Thursday • Real Applications for Data • Practical Session - Streaming ETL
Products and Business Use Cases • Practical Session (EDA)
(SQL-Streamlit) (Python-Kafka)
Streamlit Colab-Kafka-Python
Friday
Mojix Inc. ©2024 Confidential Information 2
Python Overview
Python Applications
Mojix Inc. ©2024 Confidential Information 3
Python Overview
Mojix Inc. ©2024 Confidential Information 4
Python Overview
Data Life cycle
Mojix Inc. ©2024 Confidential Information 5
Python for Data Analysis
What is Data Analysis?
Mojix Inc. ©2024 Confidential Information 6
Python for Data Analysis
DATA PREPARATION
Mojix Inc. ©2024 Confidential Information 7
Python for Data Analysis
What is pandas?
Pandas is a software library written for the python programming
language for data manipulation and analysis.
Mojix Inc. ©2024 Confidential Information 8
Python for Data Analysis
Types of Data Structures in Pandas
Mojix Inc. ©2024 Confidential Information 9
Python for Data Analysis
Data Frames
Mojix Inc. ©2024 Confidential Information 10
Python for Data Analysis
Data Frames Elements
Mojix Inc. ©2024 Confidential Information 11
Python for Data Analysis
Data Frames Creation
Mojix Inc. ©2024 Confidential Information 12
Python for Data Analysis
Data Frames Creation
Mojix Inc. ©2024 Confidential Information 13
Python for Data Analysis
Reading From and Writing to a File
Mojix Inc. ©2024 Confidential Information 14
Python for Data Analysis
Data Frames Methods
Mojix Inc. ©2024 Confidential Information 15
Python for Data Analysis
Selecting a column in a DataFrame
Mojix Inc. ©2024 Confidential Information 16
Python for Data Analysis
Data Frames Group By Method
Mojix Inc. ©2024 Confidential Information 17
Python for Data Analysis
Filtering
Mojix Inc. ©2024 Confidential Information 18
Python for Data Analysis
Filtering
Mojix Inc. ©2024 Confidential Information 19
Python for Data Analysis
Deleting
Mojix Inc. ©2024 Confidential Information 20
Python for Data Analysis
DataFrames: Slicing
Mojix Inc. ©2024 Confidential Information 21
Python for Data Analysis
DataFrames: Slicing
Mojix Inc. ©2024 Confidential Information 22
Python for Data Analysis
DataFrames: Sorting
Mojix Inc. ©2024 Confidential Information 23
Python for Data Analysis
Exploratory Data Analysis (EDA)
● The analysis of datasets based on various numerical methods and graphical tools.
● Exploring data for patterns, trends, underlying structure, deviations from the trend, anomalies
and strange structures.
● It facilitates discovering unexpected as well as conforming the expected.
Mojix Inc. ©2024 Confidential Information 24
Python for Data Analysis
AIM OF THE EDA
● Maximize insight into a dataset
● Uncover underlying structure
● Extract important variables
● Detect outliers and anomalies
● Test underlying assumptions
● Develop valid models
Mojix Inc. ©2024 Confidential Information 25
Python for Data Analysis
Mojix Inc. ©2024 Confidential Information 26
Python for Data Analysis
Mojix Inc. ©2024 Confidential Information 27
Python for Data Analysis
DataFrames: Missing Values
Mojix Inc. ©2024 Confidential Information 28
Python for Data Analysis
DataFrames: Missing Values
Mojix Inc. ©2024 Confidential Information 29
Python for Data Analysis
DataFrames: Missing Values
Mojix Inc. ©2024 Confidential Information 30
Python for Data Analysis
Aggregation Functions in Pandas
Mojix Inc. ©2024 Confidential Information 31
Python for Data Analysis
Aggregation Functions in Pandas
Mojix Inc. ©2024 Confidential Information 32
Python for Data Analysis
Basic Descriptive Statistics
Mojix Inc. ©2024 Confidential Information 33
Python for Data Analysis
Basic Descriptive Statistics
Mojix Inc. ©2024 Confidential Information 34
Python for Data Analysis
Graphics
Mojix Inc. ©2024 Confidential Information 35
Python for Data Analysis
Mojix Inc. ©2024 Confidential Information 36
Python for Data Analysis
Mojix Inc. ©2024 Confidential Information 37
Python for Data Analysis
Mojix Inc. ©2024 Confidential Information 38