Scribd
Upload
78 views1 page

Big Data Analytics Exam Notes for VTU

The document provides exam-ready notes on Big Data Analytics, covering key concepts such as the characteristics of Big Data, types of data, and various analytics types. It details technologies like Hadoop, MapReduce, MongoDB, Hive, Pig, and Spark, explaining their functions and advantages. Each module outlines essential components and differences between traditional systems and Big Data technologies.

Uploaded by

Rockstar ᴄʀᴇᴀᴛɪᴏɴ's
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
78 views1 page

Big Data Analytics Exam Notes for VTU

The document provides exam-ready notes on Big Data Analytics, covering key concepts such as the characteristics of Big Data, types of data, and various analytics types. It details technologies like Hadoop, MapReduce, MongoDB, Hive, Pig, and Spark, explaining their functions and advantages. Each module outlines essential components and differences between traditional systems and Big Data technologies.

Uploaded by

Rockstar ᴄʀᴇᴀᴛɪᴏɴ's
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

BIG DATA ANALYTICS – EXAM READY NOTES (VTU BCS714D)

MODULE 1: BIG DATA & ANALYTICS Big Data refers to large, complex datasets that cannot be
handled by traditional systems. Characteristics (5Vs): Volume, Velocity, Variety, Veracity, Value.
Types of Data: Structured, Semi-Structured, Unstructured. Traditional BI vs Big Data: BI handles
structured small data; Big Data handles all data types at scale. Big Data Analytics Types:
Descriptive, Diagnostic, Predictive, Prescriptive. Technologies: Hadoop, NoSQL, Spark, Hive, Pig.
MODULE 2: HADOOP & MAPREDUCE Hadoop is an open-source framework for distributed
storage and processing. Components: HDFS, YARN, MapReduce. HDFS stores data in blocks with
replication for fault tolerance. YARN manages cluster resources. MapReduce: Mapper → Shuffle &
Sort → Reducer. Combiner reduces network traffic; Partitioner controls reducer data distribution.
MODULE 3: MONGODB MongoDB is a NoSQL document-oriented database. RDBMS vs
MongoDB: Tables vs Collections, Rows vs Documents. Advantages: Schema-less, scalable, high
performance. Data Types: String, Integer, Boolean, Array, Object. MongoDB Query Language
supports CRUD operations.
MODULE 4: HIVE & PIG Hive is a data warehouse tool on Hadoop using HQL. Hive Architecture:
UI, Driver, Compiler, Metastore, Execution Engine. Hive Data Types: Primitive and Complex. Pig is
a high-level data flow platform. Pig Latin is procedural language. Execution Modes: Local and
MapReduce. Pig vs Hive: Pig is procedural; Hive is declarative.
MODULE 5: SPARK Apache Spark is a fast in-memory data processing engine. Advantages:
Speed, real-time processing, scalability. Components: Spark Core, Spark SQL, Spark Streaming,
MLlib, GraphX. Spark vs Hadoop: In-memory vs disk-based. Spark is widely used for analytics and
machine learning.

You might also like