Click to edit Master title style
Big Data Analytics
Dr. Mukhtaj Khan
[Link]@[Link]
1
Enterprise
Click Technologies
to edit Master and
title style
Big Data Business Intelligence
• Online Transaction process (OLTP)
• Online Analytical Process (OLAP)
• Extract Transform Load (ETL)
• Data Warehouses
• Data Marts
• Traditional BI
• Big Data BI
2
Click
OnlinetoTransaction
edit MasterProcessing
title style (OLTP)
• OLTP is a software system that processes transaction-oriented data.
• The term “online transaction” refers to the completion of an activity in
realtime.
• OLTP systems store operational data that is normalized.
• This data is a common source of structured data and serves as input
to many analytic processes.
• OLTP systems, for example a point of sale system, execute business
processes in support of corporate operations.
• The queries supported by OLTP systems are comprised of simple
insert, delete and update operations with sub-second response times.
Examples include ticket reservation systems, banking and point of
sale systems. 3
Click
OnlinetoAnalytical
edit Master title style(OLAP)
Processing
• Online analytical processing (OLAP) systems are used for processing data analysis
queries.
• OLAPs form an integral part of business intelligence, data mining and machine learning
processes.
• They are relevant to Big Data in that they can serve as both a data source as well as a
data sink that is capable of receiving data.
• They are used in diagnostic, predictive and prescriptive analytics.
• OLAP systems perform long-running, complex queries against a multidimensional
database whose structure is optimized for performing advanced analytics.
• OLAP systems store historical data that is aggregated and denormalized to support fast
reporting capability.
4
Click to Transform
Extract edit Master title(ETL)
Load style
• Extract Transform Load (ETL) is a process of loading data from a source system into a
target system.
• The source system can be a database, a flat file, or an application.
• The target system can be a database or some other storage system.
• ETL represents the main operation through which data warehouses are fed data.
• A Big Data solution encompasses the ETL feature-set for converting data of different
types.
• The required data is first obtained or extracted from the sources, after which the extracts
are modified or transformed by the application of rules.
• Finally, the data is inserted or loaded into the target system.
5
Click
ETL….to edit Master title style
6
Click
Data to edit Master title style
Warehouses
• A data warehouse is a central, enterprise-wide repository consisting of historical and
current data.
• Data warehouses are heavily used by BI to run various analytical queries, and they
usually interface with an OLAP system to support multi-dimensional analytical queries.
• Data pertaining to multiple business entities from different operational systems is
periodically extracted, validated, transformed and consolidated into a single
denormalized database.
• With periodic data imports from across the enterprise, the amount of data contained in a
given data warehouse will continue to increase. Over time this leads to slower query
response times for data analysis tasks.
• To resolve this shortcoming, data warehouses usually contain optimized databases,
called analytical databases, to handle reporting and data analysis tasks. An analytical
database can exist as a separate DBMS, as in the case of an OLAP database. 7
Click
Data to edit Master title style
Warehouses…
8 8
Click
Data to edit Master title style
Marts
• A data mart is a subset of the data stored in a data warehouse that typically belongs to a
department, division, or specific line of business. Data warehouses can have multiple
data marts.
• Enterprise-wide data is collected and business entities are then extracted.
• Domain-specific entities are persisted into the data warehouse via an ETL process.
9
Click
Data to edit Master title style
Marts
10
Click to editBIMaster title style
Traditional
• Traditional BI primarily utilizes descriptive and
diagnostic analytics to provide information on
historical and current events. It is not “intelligent”
because it only provides answers to correctly
formulated questions.
• Correctly formulating questions requires an
understanding of business problems, issues and of
the data itself.
11
Click
Ad-hocto Reports
edit Master title style
• Ad-hoc reporting is a process that involves manually processing data to produce custom
made reports, as shown in Figure.
• The focus of an ad-hoc report is usually on a specific area of the business, such as its
marketing or supply chain management. The generated custom reports are detailed and
often tabular in nature.
12
Click to edit Master title style
Dashboards
• Dashboards provide a holistic view of key business areas. The
information displayed on dashboards is generated at periodic
intervals in realtime.
• The presentation of data on dashboards is graphical in nature, using
bar charts, pie charts and gauges, as shown in Figure
13
Click to edit
Big Data BI Master title style
• Big Data BI builds upon traditional BI by acting on the cleansed,
consolidated enterprisewide data in the data warehouse and combining
it with semi-structured and unstructured data sources.
• It comprises both predictive and prescriptive analytics to facilitate the
development of an enterprise-wide understanding of business
performance.
• While traditional BI analyses generally focus on individual business
processes, Big Data BI analyses focus on multiple business processes
simultaneously. This helps reveal patterns and anomalies across a
broader scope within the enterprise. It also leads to data discovery by
identifying insights and information that may have been previously
absent or unknown.
• This requires a “next-generation” data warehouse that uses new features
and technologies to store cleansed data originating from a variety of 14
sources in a single uniform data format.
Click to edit Master title style
Big Data BI
15
Click to editData
Traditional Master title style
Visualization
• Data visualization is a technique whereby analytical results are
graphically communicated using elements like charts, maps, data
grids, infographics and alerts.
• Graphically representing data can make it easier to understand
reports, view trends and identify patterns.
• Traditional data visualization provides mostly static charts and graphs
in reports and dashboards, whereas contemporary data visualization
tools are interactive and can provide both summarized and detailed
views of data.
• Traditional data visualization tools query data from relational
databases, OLAP systems, data warehouses and spreadsheets to
present both descriptive and diagnostic analytics results.
16
Click
Data to edit Masterfor
Visualization title
Bigstyle
Data
• Advanced data visualization tools for Big Data solutions incorporate
predictive and prescriptive data analytics and data transformation
features.
• The tools also provide the ability to directly connect to structured,
semi-structured and unstructured data sources.
• As part of Big Data solutions, advanced data visualization tools can
join structured and unstructured data that is kept in memory for fast
data access.
• Queries and statistical formulas can then be applied as part of various
data analysis tasks for viewing data in a user-friendly format, such as
on a dashboard.
17
17
Click
Data to edit Masterfor
Visualization title
Bigstyle
Data
• Common features of visualization tools used in Big Data:
• Aggregation – provides a holistic and summarized view of data across
multiple contexts
• Drill-down – enables a detailed view of the data of interest by focusing
in on a data subset from the summarized view
• Filtering – helps focus on a particular set of data by filtering away the
data that is not of immediate interest
• Roll-up – groups data across multiple categories to show subtotals
and totals
• What-if analysis – enables multiple outcomes to be visualized by
enabling related factors to be dynamically changed.
18
18