Unit -1 Introduction to Data Processing and Database

DATA

“DATA is a raw fact; anything can be data”. It is not be meaningful. It is used

analysis and reasoning. It is input processing unit.
Data is basic row material which taken by certain observation, certain
experiment and storing in paper, stored memory, human mind.
Ex:- marks of student ,account information.

INFORMATION

This is a processed form of the data. It is always meaningful. “Meaningful data

is called information”. It is output processing units. Whenever we organize the
data and process is done on it then we get proper Information.

DATA PROCESSING

Data processing is the process of gathering, organizing, and analyzing

collected data for a specific purpose. It is a technique normally performed by a
computer; the process includes retrieving, transforming, or classification of
information.

However, the processing of data largely depends on the following –

The volume of data that need to be processed.

The complexity of data processing operations.
Capacity and inbuilt technology of respective computer system.
Technical skills.
Time constraints.

Stages of data processing:

Collection:
The process begins with the collection of raw data from various sources. The
stage establishes the foundation for subsequent processing, ensuring a
comprehensive pool of data relevant to the intended analysis. It could include
surveys, sensors, databases, or any other means of gathering relevant
information.
Preparation:
Data preparation focuses on organizing, data cleaning, and formatting raw
data. Irrelevant information is filtered out, errors are corrected, and the data is
structured in a way that facilitates efficient analysis during subsequent stages
of processing.
Input:
During the data input stage, the prepared data is entered into a computer
system. This can be achieved through manual entry or automated methods,
depending on the nature of the data and the systems in place.
Data Processing
The core of data processing involves manipulating and analyzing the prepared
data. Operations such as sorting, summarizing, calculating, and aggregating
are performed to extract meaningful insights and patterns.
Data Output
The results of data processing are presented in a comprehensible format
during the data output stage. This could include reports, charts, graphs, or
other visual representations that facilitate understanding and decision-making
based on the analysed data.
Data Storage
The Final stage entails storing the processed data for future reference and
analysis. This is crucial for maintaining a historical record, enabling efficient
retrieval and supporting on-going or future data-related initiatives. Proper data
storage ensures the longevity and accessibility of valuable information.
`
Types of data processing:

Online Data Processing: Online data processing is often confused with real-
time data processing; both receive and process data simultaneously, but with
online processing, the user can extract data anytime, anywhere. The bar code
system is the best example of online processing. When buying a book in a
bookstore, with the bar code scanning, the book’s data is automatically
changed as sold. Another concrete example is access cards.

Batch Data Processing: Batch data processing, process data by providing

actions to multiple data sets through a single command. For example, in
spreadsheets, data entry specialists can enter the formula for a single cell and
apply it for the whole column. This type of data processing accelerates the
processing time and can complete a series of tasks without human
intervention.

Real-time Data Processing: Real-time processing came into existence with

the advent of the internet. By utilizing the internet, this processing method
receives and processes data at the same time. Simply put, it captures data in
real-time and generates quick or automatic reports. Hence this is one of the
fastest data processing methods.

For example, take GPS tracking systems where sensors detect heavy traffic
and give input on a real-time basis. Though the process saves time and
labour, it is expensive and requires heavy maintenance.

INTRODUCTION TO DATABASE AND DATABASE SYSTEM

A database is a collection inter-related data . A database is an organized

collection of relevant data with inherent meaning and built for a certain
purpose. It represents some aspect of the real world.

Database system:
A database system is a set of integrated software components that allow us
to store, retrieve, update, and remove data in a computer system. A database
system is the software that helps you manage and manipulate that data.

The simple example would be your personal detail, this would generally
contain:

First name
Last name
Birthdate
Mobile number
City

Multiple students’ detail kept together in one place, such as an address

book, could be termed as a coherent collection of data.

Thus, the address book is a database and details in the book, is the data
that fills the database.

DATABASE MANAGEMENT SYSTEM (DBMS)

DBMS stands for Database Management System. A database management

system is a collection of interconnected data and a set of programs for
manipulating those data. DBMS is software tool that enables users to create
and maintain a database. DBMS is a system that allows inserting, updating,
deleting and processing of data. Thus, DBMS is an organized, collection of
data.

The system catalog, also known as the data dictionary, is a feature of the
database management system (DBMS) that contains a collection of all the
information it possesses, including names, structures, and locations. DBMS
programs that are widely used include MySQL, ORACLE, FoxPro, and MS
SQL Server.

Purpose of Database Systems

The purpose of database systems is to make databases more user-friendly

and to perform simple tasks. Users may input, update, and delete data with
ease. Actually, the primary goal is to have greater control over the data.

Data redundancy and inconsistency:

If there are multiple copies of the same data, it just avoids it. It just maintains
data in a single repository. Also, the purpose of database systems is to make
the database consistent.

Difficulty in accessing data:

A database system can easily manage to access data. Through different
queries, it can access data from the database.

Data isolation:
Because data are scattered in various files, and files may be in different
formats, writing new application programs to retrieve the appropriate data is
difficult.

Atomicity of updates:
In case of power failure, the database might lose data. So, this feature will
automatically prevent data loss.
Concurrent access:
Users can have multiple access to the database at the same time.

Integrity problems:
The data values stored in the database must satisfy certain types of
consistency constraints.

Security problems:
Database systems will make the restricted access. So, the data will not be
vulnerable.

Supports multiple views of data:

It can support multiple views of data to give the required view as their needs.
Only database admins can have a complete view of the database. We cannot
allow the end-users to have a view of developers.

Advantages of DBMS (Database Management System):

There are several advantages to using a DBMS to handle data.

Controls database redundancy

DBMS prevents duplicate data by keeping everything in one place. No
wastage or confusion. Simple and organized.

Data sharing
A database management system (DBMS) allows authorized users to distribute
database contents to multiple users.

Easy to maintain:
Data management is made easier by the database's centralization.

Reduce time
The time required for creation and maintenance is reduced.

Backup
To preserve data integrity in the event of a failure, it automatically creates
backups.

Various user interfaces

It provides numerous users with a variety of user interfaces.
Disadvantages of DBMS (Database Management System):

Cost of software and hardware

Running a database management system (DBMS) requires a lot of powerful
CPUs and plenty of RAM.

Size
A large quantity of storage capacity is needed for DBMS operation to be
effective.

Complexity
A DBMS increases the data's complexity by another level.

Higher impact of failure

DBMSs are more vulnerable to data loss since all of their data is kept in one
place and can be completely erased by a catastrophic failure.

Types of a DBMS

According to data models, there are the following DBMS types:

Relation Database
A system where data is arranged using rows and columns in two-dimensional
tables is called a relational database management system (RDBMS). One of
the most often utilized data models in industries is this one. It is based on
SQL.

Object Oriented Database

It is a system used in object-oriented programming where data or information
is represented as objects. It is a combination of relational database concepts
and object-oriented principles. Concepts from relational databases include
transactions and concurrency management. Three fundamental concepts of
OOPs are polymorphism, inheritance, and data encapsulation. It requires less
code and is easy to maintain. For example − Object DB software.

Hierarchical Database
It is a system where the data elements have a one to many relationship (1: N).
Here data is organized like a tree which is similar to a folder structure in your
computer system. All of the child nodes are connected to the parent node by
the hierarchy, which begins at the root node. It is used in industry on
mainframe platforms. For example− IMS (IBM), Windows registry (Microsoft).

Network database
A network database management system is one in which the data elements
maintain relationships of many to many (N: N) or one to one (1: 1). Its
structure is hierarchical as well, but the data is arranged in a graph-like
manner, it is allowed to have more than one parent for one child record.
Example: Teachers can teach in multiple departments.

DATBASE ADMINISTRATOR (DBA):

The person or team in charge of establishing DBMS in an organization is

known as a database administrator (DBA).

Roles and Responsibilities of DBA:

The following is the main responsibility of a database administrator:

Database design
The task of creating a database that meets user needs falls to the
database administrator. Therefore, database design knowledge is
crucial for an administrator.
Performance issues

Database backup
It is the duty of a database administrator to regularly backup all of the
data in the database. This is necessary in order to resume operations
during disasters or downtime.

Database availability
A database administrator has the responsibility of ensuring database
accessibility to users from time to time.

Database restore
When necessary, a database administrator is in charge of recovering a
 file from a backup state.

Data move
A database administrator has the responsibility of moving a database
set, say from a physical base to a cloud base, or from an existing
application to a new application.

Database upgrade
A database administrator has the responsibility of upgrading database
software files when there is a new update for them, as this protects
software from security breaches.

Database security
Datasets are assets, and one major responsibility of database
administrators is to protect the data and ensure adequate security in an
organization’s database.

Database monitoring
A database administrator has the responsibility of monitoring the
database and the movement of data in the database. Administrators
provide access for users who require access to the database.

Error log review

A database administrator has the responsibility of interpreting the error
messages sent by a database when there is a fault or bridge.

Responsibilities of DBA
Makes the decision concerning the content of the database.
Plans the storage structure and access strategy.
Provides the support to the users.
Defines the security and integrity checks.
Interpreter backup and recovery strategies.
Monitoring the performance and responding to the changes in the requirement