Comprehensive Note on Python Modules and Libraries
1. What is a Module and a Library in Python?
- Module: A file containing Python definitions and statements. It can define functions, classes, and variables.
Example: math, random
- Library: A collection of modules. It can include bundled modules or third-party packages for specific domains.
Example: NumPy, Pandas, Scikit-learn
2. Standard Library Modules (Built-in with Python)
Mathematics & Numbers: math, cmath, decimal, fractions, random, statistics
Data Types & Collections: collections, array, enum, dataclasses
File & Directory Access: os, shutil, pathlib, glob
Text Processing: re, string, textwrap, difflib
Date & Time: datetime, time, calendar
Input/Output: io, sys
Internet & Networking: socket, http, urllib, json, xml, html
Operating System Interaction: os, subprocess, platform
Concurrency & Parallelism: threading, multiprocessing, asyncio
Error Handling & Debugging: logging, traceback, warnings, pdb
Testing: unittest, doctest
Data Persistence: pickle, shelve, sqlite3
3. Popular Third-party Libraries (Install via pip)
Data Science: numpy, pandas, matplotlib, seaborn, scipy, statsmodels
Comprehensive Note on Python Modules and Libraries
Machine Learning: scikit-learn, tensorflow, keras, pytorch, xgboost, transformers
Web Development: flask, django, fastapi
GUI Development: tkinter, PyQt, Kivy
Web Scraping: requests, beautifulsoup4, scrapy, selenium
Database: sqlalchemy, pymongo, psycopg2
Game Development: pygame
Image & Audio Processing: Pillow, OpenCV, librosa
Networking & API: httpx, websocket-client, paramiko
Cloud & DevOps: boto3, docker, fabric
Data Serialization: json, yaml, protobuf, msgpack
PDF and Office Files: PyPDF2, pdfplumber, openpyxl, xlrd, xlwt, docx
4. Domain-Specific Libraries
Biomedical: BioPython, SimpleITK, pydicom, nilearn, nibabel
IoT: pySerial, [Link], machine, network
Finance: yfinance, quantlib, ccxt
5. Useful Development Tools
virtualenv, venv, pipenv, poetry
pytest, black, flake8, mypy
Jupyter Notebook
6. Custom Modules