Document 5: Data Science and Big Data
Technologies
1. Introduction
Data science extracts knowledge and insights from structured and unstructured data.
2. Big Data Characteristics
Volume, Velocity, Variety, Veracity, and Value.
3. Data Collection
Sources include sensors, social media, logs, and transactional systems.
4. Data Storage
HDFS, NoSQL databases, and data lakes support big data storage.
5. Data Processing Frameworks
Hadoop and Apache Spark enable large-scale data processing.
6. Data Analytics
Descriptive, predictive, and prescriptive analytics techniques.
7. Visualization
Tools like Tableau and Power BI help interpret data insights.
8. Machine Learning in Data Science
ML models enhance prediction and pattern discovery.
9. Applications
Used in healthcare, finance, e-commerce, and research.
1
10. Future Scope
Real-time analytics and AI-driven decision systems are growing.
Conclusion
Data science and big data are critical for data-driven engineering solutions.