Data Science Tools & Environment Setup
Introduction to Data Science Tools
Why Python for Data Science?
Simple and readable syntax
Large ecosystem of libraries
Strong community support
Widely used in AI, ML, analytics
Python acts as the foundation for data science work.
🔹 What is Data Science?
Data Science is a field that uses:
o Mathematics
o Statistics
o Programming
It helps to extract meaningful insights from data.
🔹 Types of Data
Structured Data → Organized (tables, databases)
Unstructured Data → Raw data (images, videos, text)
🔹 Why Data Science?
Improve decision-making
Predict future trends
Enhance customer experience
Increase business revenue
Tools Used in Data Science
🔹 Programming Languages
Python (most popular)
🔹 Python Libraries
NumPy → Numerical computing
Pandas → Data analysis
Matplotlib / Seaborn → Visualization
Scikit-learn → Machine Learning
🔹 Other Tools
Jupyter Notebook
Google Colab
Excel, Power BI
Pre-Processing in Data Science
🔹 What is Data Preprocessing?
Process of converting raw data into clean and usable form
🔹 Steps in Preprocessing
1. Data Cleaning
o Remove missing values
o Handle duplicates
2. Data Transformation
o Convert data types
o Normalize / scale data
3. Data Reduction
o Remove unnecessary data
4. Data Integration
o Combine data from multiple sources
🔹 Importance
Improves accuracy of analysis
Makes data ready for modeling
2️⃣ NumPy – Numerical Computing
What is NumPy?
A Python library for numerical computing
Works with N-dimensional arrays
Installing NumPy
pip install numpy
or
python -m pip install numpy
For pip : python -m ensurepip –upgrade
Python -m pip --version
Basic Example
import numpy as np
arr = [Link]([1, 2, 3, 4])
print(arr)
Output:
[1 2 3 4]
Array:
An array is like a list but more powerful.
1D Array
a = [Link]([1, 2, 3])
2D Array (like a table)
b = [Link]([[1, 2], [3, 4]])
Basic Operations
arr1 = [Link]([1, 2, 3])
print(arr1 + 2) # [3 4 5]
print(arr1 * 2) # [2 4 6]
Operations happen on every element (very fast!)
Useful Functions
[Link](3) # [0. 0. 0.]
[Link](3) # [1. 1. 1.]
[Link](1, 5) # [1 2 3 4]
[Link](a) # Average
[Link](a) # Sum
Indexing (Accessing Values)
a = [Link]([10, 20, 30])
print(a[0]) # 10
print(a[1]) # 20
Reshaping Arrays
a = [Link]([1, 2, 3, 4])
print([Link](2, 2))
Output:
[[1 2]
[3 4]]
Purpose:
Work with arrays
Perform mathematical operations
Handle large numerical datasets efficiently
🔹 Example:
import numpy as np
arr = [Link]([1, 2, 3, 4])
print([Link]())