Selected Topics in Computer Science
Selected Topics in Computer Science
Table of Contents
Chapter 1: Natural Language Processing (NLP)........................................................................................... 1
1.1 Definition of NLP ............................................................................................................................... 1
1.2 Natural Language Processing.............................................................................................................. 1
1.3 Importance of NLP ............................................................................................................................. 2
1.4 Difficulty of NLP ................................................................................................................................ 3
1.5 Levels of Linguistic Analysis ............................................................................................................. 3
1.5.1 Morphology.................................................................................................................................. 3
1.5.2 Roots, Affixes versus Combining Forms ..................................................................................... 5
1.5.3 Syntactic Analysis- analyzes:..................................................................................................... 7
1.5.3 Parsing.......................................................................................................................................... 8
1.5.4 Semantic Analysis ...................................................................................................................... 11
1.5.5 Discourse.................................................................................................................................... 12
1.5.6 Disambiguation .......................................................................................................................... 14
1.6 Approaches to NLP ........................................................................................................................... 14
1.7 Application of NLP ........................................................................................................................... 16
Chapter 2: Data Mining .............................................................................................................................. 18
2.1 What is Data Mining? ....................................................................................................................... 19
2.2 Statistics vs. Data Mining ................................................................................................................. 23
2.3 Goal of Data Mining ......................................................................................................................... 23
2.4 Application of Data Mining .............................................................................................................. 25
2.6 Data source for DM applications ...................................................................................................... 27
2.7 Data Mining Functionalities.............................................................................................................. 28
2.8 A Multi-Dimensional View of Data Mining Classification ........................................................ 31
Chapter 3: Data Warehouse ........................................................................................................................ 32
3.1 What is Data Warehouse? ................................................................................................................. 33
3.2 Data Warehouse vs. Operational DBMS .......................................................................................... 34
3.3 OLTP (On-Line Transaction Processing) vs OLAP (On-Line Analytical processing).................... 34
3.4 Design of a Data Warehouse:............................................................................................................ 35
Natural language: refers to human languages (Amharic, Afaan Oromo, Tigrigna, English,
Arabic, Chinese, etc.), as opposed to artificial/programming languages such as C++,Java, Pascal,
etc.
NLP is the computerized approach to analyzing text that is based on both a set of
theories and a set of technologies.
An interdisciplinary field of study dealing with computational techniques for analyzing and
representing naturally occurring texts at one or more levels of linguistic analysis for the purpose
of achieving human-like language processing for a range of tasks or applications.
…...interdisciplinary field...
.....computational techniques...
Multiple models, methods and algorithms are employed to accomplish a particular type of
language analysis.
Texts can be in spoken or written forms representing natural languages used by humans to
communicate to one another.
Multiple types of language processing are known to be at work when humans produce or
comprehend language.
NLP strives for human-like performance, and thus considered as a discipline with in
Artificial Intelligence.
...tasks or applications...
The goal of NLP is to accomplish human-like language processing for various tasks and
applications such as machine translation, information retrieval, question-answering, etc.
Closely related (and overlapping) fields are Natural Language Understanding and Computational
Linguistics.
The field of NLP was originally referred to as Natural Language Understanding (NLU) in the
early days of Artificial Intelligence. A full NLU system would be able to:
An alternative view on NLP is that it is a computer system which uses natural language as input
and/or output. In this view, NLP is considered to have two distinct focuses-Natural Language
Understanding and Natural Language Generation.
The task of Natural Language Understanding is equivalent to the role of reader/listener, whereas
the task of Natural Language Generation is that of the writer/speaker.
People generally don’t appreciate how intelligent they are as natural language processors.
For them natural language processing is deceptively simple because no conscious effort is
required.
Since computers are orders of magnitude faster, many find it hard to believe that
computers are not good at processing natural languages.
1.5.1 Morphology
At morphological level, the smallest parts of words that carry meanings, affixes are
analyzed.
Morphology is important in NLP because language is productive: in any given text we will
encounter words and word forms that we haven’t seen before and that are not in our precompiled
dictionary.
Stem: part of the word that never changes even when morphologically inflected.
For example, walk is the stem for the words walk, walks, walking, and walked.
Root/Lemma is citation form of a set of words, e.g. break is the root form for the words break,
breaks, breaking, broke, and broken.
is a linguistic category of words that explains how the word is used in a sentence.
Although different languages may have different classification schemes, English and
Amharic words are usually classified into eight lexical categories: noun, pronoun,
adjective, verb, adverb, preposition, conjunction and interjection.
Morphological Analysis –
Morphological Generation:
Large in enlarge
help in helpfulness
perform in performance
Roots - morphemes (within a non-compound word) that makes the most precise and
concrete contribution to the word’s meaning, and is either the sole morpheme or else the
only one that is not an affix.
e.g. break in breaks
help in unhelpfulness
Affixes - bound morphemes that either precede, follow or are inserted inside the root or
stem.
e.g. Prefix: en- in enlarge is an affix that precedes the root large
Suffix: -ly in largely is an affix that follows the root large
Infix: is an affix that is inserted inside the root.
Combining Forms - morphemes that are formed from two bound or free-like roots.
1. Inflections are the systematic modifications of a root form by means of prefixes and
suffixes to indicate grammatical distinctions like singular and plural.
Inflection does not change word class or meaning significantly, but varies features such
as tense, number, and plurality.
All the inflectional forms of a word are often grouped as manifestations of a single
lexeme.
An example is the derivation of the adverb widely from the adjective wide.
3. Compounding refers to the merging of two or more words into a new word.
English has many noun-noun compounds, nouns that are carbonations of two other
nouns.
2. Syntax- refers to the way words are related to each other in a sentence.
Grammar Checking
Question Answering
Information Extraction
Machine Translation
Student, the student, that student, two students, many students, Clever student, A
student of computer science
1.5.3 Parsing
is a derivation process which identifies the structure of sentences using a given grammar.
Considered as a special case of a search problem.
• top-down strategy
• bottom-up strategy
• chunking
Top-down parsing starts with the symbol S and then searches through different ways to
rewrite the symbols until the input sentence is generated.
Bottom-up parsing starts with words in a sentence and uses production rules backward
to reduce the sequence of symbols until it consists solely of S.
Chunking: also called partial parsing, is a technique which attempts to model human
parsing by breaking the text up into small pieces, each parsed separately.
A semantic role: is the underlying relationship that a participant has with the main verb
in a [Link] roles are identified from the grammatical relations
1.5.5 Discourse
Deals with the properties of the text as a whole that convey meaning by making connections
between component sentences.
Discourse imposes meaning and structure on individual sentences (or utterances) that go
well beyond the compositional meaning of sentences in isolation.
The most common methods applied for discourse processing are discourse
segmentation and reference resolution.
The task of reference resolution is to determine which noun phrases refer to each real
world entity mentioned in the text.
Anaphora:
Reference:
• The expressions can be in the same text or different texts, in the same
language or different language.
Example: A bus had to divert to the local hospital when one of the
passengers had a heart attack. It go to the hospital in time and the man’s life was saved.
Anaphoric: {it}
Pragmatics:
is the study of how linguistic properties and contextual factors interact in the interpretation of
utterances, enabling hearers to bridge the gap between sentence meaning and speaker’s
meaning.
1.5.6 Disambiguation
1. Rule-based Approach
The inference engine repeatedly selects a rule whose condition is satisfied and
executes the rule.
Rule-based approaches have been used tasks such as information extraction, text
categorization, ambiguity resolution, and so on.
2. Statistical Approach
Statistical approaches employ various mathematical techniques and often use large text
corpora to develop approximate generalized models of linguistic phenomena based on
actual examples of these phenomena provided by the text corpora without adding
significant linguistic or world knowledge.
The primary source of evidence in statistical systems comes from observable data (e.g.
Large text corpora).
Statistical approaches have typically been used in tasks such as speech recognition,
parsing, part-of-speech tagging, statistical machine translation, statistical grammar
learning, and so on.
3. Connectionist Approach
What separates connectionism from other statistical methods is that connectionist models
combine statistical learning with various theories of representation.
Connectionist approaches have been used in tasks such as word-sense disambiguation, language
generation, syntactic parsing, limited domain translation tasks, and so on.
2. Information retrieval
3. Information Extraction
focuses on the recognition, tagging, and extraction of certain key elements of information
(e.g. persons, companies, locations, organizations, etc.) from large collections of text into
a structured representation. It has the following subtasks:
5. Question-Answering provides the user with either just the text of the answer
itself or answer-providing passages.
6. Dialogue Systems are agents that converse with human beings in a coherent
structure using several modes of communication such as text, speech, gesture, etc.
9. Speech Synthesis, also known as Text-to-Speech system, performs the reverse process, i.e.
artificially produces human speech from a given text.
Note that: query processing systems, Expert statistical data analysis or Information
retrieval systems are not data mining tasks.
The result of mining may be to discover the following type of new information:
Association rules:
for example, whenever a customer buys video equipment, he or she also buys another electronic
device.
Sequential patterns:
for example, suppose a customer buys a camera, and within three months he or she buys
photographic supplies, then within six months he is likely to buy an accessory item. This defines
a sequential pattern of transactions. A customer who buys more than twice in lean periods may
be likely to buy at least once during the Christmas period.
Classification trees:
for example, customers may be classified by frequency of visits, types of financing used, amount
of purchase, or affinity for types of items; some revealing statistics may be generated for such
classes.
The results of data mining may be reported in a variety of formats, such as listings, graphic
Typically encompasses more than data mining. The knowledge discovery process comprises six
phases: data selection, data cleansing, enrichment, data transformation or encoding, data mining,
and the reporting and display of the discovered information.
Data Mining
Pattern Evaluation
Task-relevant Data
Data Warehouse
Data Cleaning
Data Integration
Databases
Data mining is typically carried out with some end goals or applications. Broadly speaking, these
goals fall into the following classes: prediction, identification, classification, and
optimization.
1 Prediction.
Data mining can show how certain attributes within the data will behave in the future.
Examples of predictive data mining include the analysis of buying transactions to predict
what consumers will buy under certain discounts, how much sales volume a store will
generate in a given period, and whether deleting a product line will yield more profits.
In such applications, business logic is used coupled with data mining
2. Identification.
Data patterns can be used to identify the existence of an item,
an event, or an activity.
For example, intruders trying to break a system may be identified by the programs
executed, files accessed, and CPU time per session.
In biological applications, existence of a gene may be identified by certain
sequences of nucleotide symbols in the DNA sequence.
The area known as authentication is a form of identification.
It ascertains whether a user is indeed a specific user or one from an authorized class,
and involves a comparison of parameters or images or signals against a database.
3. Classification. Data mining can partition the data so that different classes or categories
can be identified based on combinations of parameters.
For example, customers in a supermarket can be categorized into discount seeking
shoppers, shoppers in a rush, loyal regular shoppers, shoppers attached to name brands,
and infrequent shoppers.
This classification may be used in different analyses of customer buying transactions as a
post mining activity. Sometimes classification based on common domain knowledge is used
as an input to decompose the mining problem and make it simpler.
For instance, health foods, party foods, or school lunch foods are distinct categories in the
supermarket business.
It makes sense to analyze relationships within and across categories as separate problems.
Such categorization may be used to encode the data appropriately before subjecting it to
further data mining.
4. Optimization.
One eventual goal of data mining may be to optimize the use of limited resources such
as time, space, money, or materials and to maximize output variables such as sales or
profits under a given set of constraints. As such, this goal of data mining resembles the
objective function used in operations research problems that deals with optimization
under constraints. The term data mining is popularly used in a very broad sense.
In some situations, it includes statistical analysis and constrained optimization as well
as machine learning. There is no sharp line separating data mining from these
disciplines.
Currently, commercial data mining tools use several common techniques to extract
knowledge. These include association rules, clustering, neural networks, sequencing, and
statistical analysis.
The best-known tool for data mining applications is Weka
Data mining functionalities are used to specify the kind of patterns to be found in data mining
task. Data mining task can be broadly classified into two as:
Descriptive
Predictive
1. Descriptive data mining
task characterize the general properties of the data in a database. For example, one can say:
Ethiopia’s weather is selected to leave in for many birds
The past 10 years rainfall of Ethiopia is appropriate for the agriculturalist in southern
Shewa
All mobile callers make few calls to wired lines than mobile recipients
2. Predictive data mining
task perform interpretation on the current data in order to make prediction to the future
reference. For example, one can say
A person loves to leave in Ethiopia if he/she was in ASIA for the last two years
It will rain in Ambo within two days if there is a wind from Mediterranean see in
west - east direction and average current temperature at Ambo is bellow 20oc
The kind of pattern to be mined form a given data is not known for the user (hence it is
hypothesis generation not hypothesis proving). Techniques should be implemented to extract
various pattern from the available data so that user can choose what they need to use.
There are different kinds of data mining functionalities that can be used to extract various types
of pattern from data. This are:
2. Association Analysis
Association analysis is the discovery of association rules showing attribute-value conditions that
occur frequently together in a given set of data.
Association rules are of the form XY [Support = s%, confidence = c%] where X is
conjunctions of attributes and Y is conjunctions of values and interpreted as if X then it is likely
to happen Y with support s% and confidence c%.
For example
age(X, “20..29”) ^ income(X, “20..29K”) buys(X, “PC”) [support = 2%,
confidence = 60%]
Interpreted as anyone whose age ranges from 20 to 29 and income range is from
20 to 29K likely buy PC with support 2% and confidence of 60%
Support shows the probability that all the predicates in X and Y fulfill together. i.e. P(X
U Y)
Confidence shows if predicates in X fulfilled then the predicate in Y is also fulfilled with
the stated percentage. i.e. P(Y | X).
3. Classification and Prediction
Classification
is the process of finding a set of models (or functions) that describe and distinguish data classes
or concepts for the purpose of being able to use the model to predict the class of an object whose
class is unknown.
The derived class is based on training data set and can be represented in various forms
such as classification IF—THEN rule, decision tree, mathematical formulae or neural
networks.
Prediction is the process of predicting some missing or unavailable data values rather than class
labels.
Finding models (functions) that describe and distinguish classes or concepts for future
prediction
4. Cluster analysis
In cluster Analysis, class labels are unknown and a group of data is given to be classified. Cluster
analysis group data to form new classes, e.g., cluster houses to find distribution patterns.
Clustering based on the principle:
maximizing the intra-class similarity and minimizing the inter-class similarity
5. Outlier analysis
Database may contain data object that do not comply with the general behavior or model of the
data. These data objects are outliers. Usually outlier data items are considered as noise or
exception in many data mining applications
However, in some application such as fraud detection, the rare events can be more
interesting than the more regularly occurring ones.
The analysis of outlier data is referred to as outlier mining
The time horizon for the data warehouse is significantly longer than that of
operational systems.
Operational database: current value data.
Data warehouse data: provide information from a historical perspective (e.g.,
past 5-10 years)
Every key structure in the data warehouse
Contains an element of time, explicitly or implicitly
But the key operational data may or may not contain “time element”.
Data Warehouse: Non-Volatile
A data warehouse is based on a multidimensional data model which views data in the form of a
data cube. A data cube allows data to be modeled and viewed in multiple dimensions. A data
cube is modeled around a central team like sales which is maintained by a table called fact table.
Dimensions are the perspective of entities with respect to which an organization wants to keep
records.
For example:
Records of store sales can be maintained with respect to the dimension time(day,
week, month, quarter, year), item(item_name, brand, type), branch, and location
Fact table contains measures (such as dollars_sold, unit sold, amount_budgeted)
and keys to each of the related dimension tables where
Dollar sold refers to the amount of money sold
Unit sold refers to the number of items sold
Amount budgeted refers to the amount of money planned
Consider the amount of money collected in Birr at Bontu Supermarket at different
branches
Branch: Ambo
Time
Mon Tue Wed Thu Fri Sat Sun
Chocolate 20 19 21 34 30 35 28
Alcoholic Drink 80 74 45 87 90 99 91
Item
canned foods 67 68 63 55 64 52 55
Soft drink 44 60 63 54 64 45 54
Baby diaper 45 54 55 65 65 54 67
Branch = Guder
Time
Mon Tue Wed Thu Fri Sat Sun
Chocolate 43 45 34 78 54 34 19
Alcoholic Drink 45 43 26 33 54 71 31
canned foods 22 76 34 34 91 42 21
Soft drink 41 53 94 54 29 61 42
Item
Baby diaper 76 34 89 67 18 27 53
Branch= Ginchi
Time
Mon Tue Wed Thu Fri Sat Sun
Chocolate 34 54 43 87 45 43 91
Alcoholic Drink 54 34 62 33 45 27 13
Item
canned foods 22 67 43 43 19 24 12
Soft drink 14 35 49 45 92 16 24
Baby diper 67 43 98 76 81 72 35
• This data can be seen at various granularity such as amount of money per day, per week, for
coca cola, sprite, biscuits, etc.
• The above three tables can be seen as sub-cuboids of the cube shown below.
34 54 43 87 45 43 91
Item
43 45 34 54 34 19
20 19 21 34 30 35 28
20 19 21 34 30 35 28
checholet 80 74 45 87 90 99 91
Alcoholic drink 67 68 63 55 64 52 55
44 60 63 54 64 45 54
Canned food
45 54 55 65 65 54 67
Time
Bay Dipper
As data warehouse can be seen from various views. In data warehousing literature, an n
dimensional (n-D) cube is called a base cuboid. Base cuboid shows some information
about every attribute at most refined granularity. The top most 0-D cuboid, which holds the
highest-level of summarization, is called the apex cuboid. This shows the most
summarized information which is free from any attribute. Lattice is formed by
systematically arranging the possible cuboid and their relationship. The lattice of cuboids
forms a data cube.
Example of a lattice with four dimensions (time, item, location, supplier). The fact and
dimension table model will be discussed soon.
Concept Hierarchy
Dimensions are organized into concept hierarchies. A concept hierarchy defines a sequence of
mappings from a set of low-level concepts to higher-level and more general concepts. As shown
in the concept hierarchy, each level refers to values of some type. The type of hierarchy define
ordering which can be partial ordering or total ordering.
Location dimension can be seen as a total ordering
continent country Region Zone city kifle ketema kebele
Time dimension shows partial ordering
second minute hour day {monthquarter, week}year
More ordering
Many concept hierarchies are implicit within the database schema as location and time are
described by the fields shown above.
define dimension time as (time_key, day, day_of_week, month, quarter, year)
These are called schema hierarchy. The concept hierarchy for location is schema hierarchy
whereas for annual income concept hierarchy may be set as grouping hierarchy. Concept
hierarchies may also be defined by discretizing or grouping values for a given dimension or
attribute resulting in a set-grouping hierarchy
In multidimensional model, data are organized into multiple dimensions, and each dimension
contains multiple level of abstraction defined by concept hierarchies. This organization provides
users with flexibility to view data from different perspectives. Different OLAP data cube
operations exist to materialize these views:
Roll up (drill-up)
Drill down (roll down)
Slice and dice
Pivot (rotate)
Roll up (drill-up): Data is summarized with increasing generalization (for example, weekly to
quarterly to annually). For example: from cities to countries, form second to minute.
Drill down (roll down): reverse of roll-up: from higher level summary to lower level summary
or detailed data, or introducing new dimensions. For example: from region to town, from year to
month.
Slice: performs selection on one dimension of a given cube resulting in a sub-cube (say time =
Q1 from different dimensions like time, location and item).
Dice: performs defines a sub cube by performing a selection on two or more dimension.
Dice for(location=”Ambo” or “ Wolliso” and Time =”Q1” or “Q2”, Item=”Mobile”, or
“Compuer”)
From (location (Ambo, Wolliso, Ginch, Guder, Bako),
Time=(quarters(Q1,Q2,Q3,Q4)),Item(mobile, computer, stabilizer, divider, cable)).
Pivot (rotate): reorient the cube, visualization, 3D to series of 2D planes.
From the architecture point of view, there are three data warehouse models described as
Enterprise warehouse, Data Mart, or Virtual warehouse
1. Enterprise warehouse: collects all information about subjects that span the entire
organization (customers, products, sales, assets, personnel). Requires extensive business
modeling (may take years to design and build).
2. Data Mart: a subset of corporate-wide data that is of value to a specific group of users. Its
scope is confined to specific, selected groups. For example, a marketing data mart my
confine its subject to customer, product and sales. Data marts depending on the data source
can be dependent or independent. Dependent data marts are sourced directly from the
enterprise data warehouse. Independent data marts source can be from some operational
data sources, external information providers, from data generated locally within a particular
department or geographic area.
3. Virtual warehouse: a set of views over operational databases. Only some of the possible
summary views may be materialized. Easy to build but requires excess capacity on
operational database servers.
4.1 Introduction
Geographical Information system (GIS) is computer based system that enables users to collect,
store, process and analyses and present spatial data.
It provides an electronic representation of information called spatial data, about the earth’s
natural and man-made features
A GIS references these real world spatial data elements to a coordinate system these features can
be separated in to different layers
A GIS system stores each category of information in a separate layer for ease of maintenance,
visualization and analysis
For example, layers can represent terrain characteristics, census data, demographics information,
environmental and ecological data,roads,land users, rivers drainage and flood paints, and rare
wildlife habitats. Different applications creates and use different layers.
A GIS can also store attribute data, which is descriptive information of the map features.
A GIS is a computer-based system that provides the following four sets of capabilities to handle
georeferenced data:
4. Data representation
The following GIS types are not necessarily manually exclusive and a GIS application can be
always classified under more than one type.
while patio-temporal geo representation can handle two dimensions space and one of time, four-
dimensional GIS are designed for three dimensions of space and one of time
Widespread access to the internet, the ubiquity of browsers and the explosion of commodified
geographic information has made it possible to develop new forms of multimedia geo-
representation on the web.
Virtual Reality GIS has been developed to allow the creation, manipulation and exploration of
geo-referenced virtual environments ,[Link] VRML modeling (Virtual Reality Modeling
Language).
Virtual Reality GIS can be also web-based. Application includes 3D simulation for planning (to
experiment with different scenarios).
4.4.1Multimedia
Multimedia is a technology that encompasses various types of data and present them in an
integrated form. There are several types of data that are used by the technology. Including text,
graphics, hyperlinks, images sound digital and analogue video and animation. Although many
GIS have been successfully implemented. It has become quite clear that two-dimensional maps
cannot precisely present multidimensional and dynamic spatial data. It seems that merging GIS
and multimedia is a way growing towards accessing spatial data. It seems that GIS merging and
multimedia is a way to with these issues. The latest advances in computer industry especially
in hardware have led to the development of the multimedia and geographical information
system(GIS) technology
Multimedia provides communication using texts, graphics, animation and video. Multimedia GIS
systems is a way to overcome the limitations displayed by the technologies when they are used
separately.
Multimedia can extend GIS capabilities of presenting geographic and other information.
The combination of several media often results in a powerful and richer presentation of
information and ideas to stimulate interest and enhance information retention. They can also
make GIS friendlier and easier to use.
A data input subsystem allows the user to capture, collect and transform spatial and thematic data
in to digital form. The data inputs are usually derived from a combination of hardcopy maps,
aerial photographs, remotely sensed images, reports, survey documents, etc.
These data will contains maps of different details levels(maps of the country, its main cities,
and villages, maps of the archaeological and historical sites etc.) photos of places and moments,
video images, text(in many language),music and sound.
For more complex applications, multimedia data can be remotely sensed imagery scanned maps,
digitized video clips,DTMs, one or more dimensional measurements, simulations model output
and other. Most of them are complicated objects which have large data volumes, intensive
processing requirements and rich semantic. The basic data types in a GIS reflect traditional data
found on a map .Accordingly, GIS technology utilizes two basic types of data. These datas are:
Spatial data
Attribute data
Source of data
A wide variety of data sources exist for both spatial and attribute data.
The most common digital data sources for spatial data are:
Hard copy map
Aerial photo graphs
Remotely sensed imagery
Point data samples from surveys
Existing data files
Data editing and verification is in response to the errors that arise during the encoding of spatial
and non-spatial data.
The second necessary component for a GIS is data storage and retrieval subsystem
the data storage and retrieval subsystem organize the data, spatial and attribute ,in a form
,which permits it to be quickly retrieved by the user for analysis and permits rapid and
accurate update to made to the database.
4.6.1 Education
Education is a field where integration of multimedia and GIS can bring enormous benefits.
In addition, it will possible to individualize learning and tune it to particular preference of each
student.
In this model, a teacher becomes a guide rather than repository of [Link] is a computer that takes
on a role of “an infinitely patient teacher”.
4.6.2 Mapmaking
GIS can use and combine all layers that are available for an area, in order to produce an overlay
that can be analyzed by using the same GIS.
GIS has aided management of land information by enabling easy creation and maintenance of
data for land records, land planning and land use.
GIS technologies are also widely applied to the planning and management of public utilities.
Typical uses include management of the following services.
Electric gas, water roads, telecommunication, storm sewers, TV/FM transmitting facilities,
hazard analysis and dispatch and emergency services.
4.7.1 Environmental
The Environmental field has long used GIS for a variety of applications that range from simple
inventory and query, to map analysis and overlay, to complex spatial decision making systems.
Examples includes: Forest modeling, air /water quality modeling and monitoring,
environmentally sensitive zone mapping analysis of interaction between Economic,
meteorological and hydrological and Ecological change. Typical data input in to an
environmental GIS include: elevation. Forest cover, and soil quality and hydrogeology coverage.
4.7.2 Archaeology
Archaeology, as a spatial discipline ,has used GIS in a variety of ways. At the simplest level,
GIS has found applications as database management for archaeological records, with the added
benefits of being able to create instant maps.
4.7.4 Forestry
GIS has been emerging as a strong tool for many areas for forestry, from harvesting schedules to
urban forestry.
GIS offers a virtually unique ability to aggregate, automate, integrate and analyze geographical
data, which further enhance the intelligence base for defense operations.
As discussed above many disciplines can benefit from GIS [Link] active GIS market has
resulted in lower cost and continual improvements in the hardware and software of the
components of GIS. These developments will, in turn, result in a much wider application of the
technology throughout government, business and industry.
It is quite likely that the future GIS system of the future will include the additional dimension of
time, giving researchers the ability to examine the variation in earth processes over days, months
and years. The advances in computer hardware ,software and remote sensing technology will
lead to more band more GIS adopting multimedia to represent data,. These GIS systems coupled
with with the multimedia technologies will result in a power full and richer presentation of
information and ideas to stimulate interest and enhance information retention. The GIS of the
future will also be more user friendly and accessible to the common man.
It is quite likely that the future GIS system of the future will include the additional dimension of
time, giving researchers the ability to examine the variations in earth processes over days,
months and years. The advances in computer hardware, software and remote sensing technology
will lead to more and more GIS adopting multimedia to represent data .
these GIS systems coupled with the multimedia technologies will result in a powerful and
richer presentation of information and ideas to stimulate interest and enhance information
retention. The GIS of future will also be more user friendly and accessible to the common man
A cloud computing is a computing paradigm where a large pool of systems are connected in
private or public networks, to provide dynamically scalable infrastructure for application, data
and file storage. With the advent of this technology, the cost of computation, application hosting,
content storage and delivery is reduced significantly.
Cloud computing is a practical approach to experience direct cost benefits and it has a potential
to transform a data center from a capital-intensive set up to a variable priced environment.
Public cloud
Public clouds are, owned and operated by third parties they deliver superior economies of
scale to customers, as the infrastructure cost are spread among a mix of users, giving each
individual client an attractive low cost ,’pay as you go’ model. All customer share the same
infrastructure pool with limited configuration, security protections, and availability variance.
These are managed and supported by the cloud providers. One of the advantage of a public
cloud is that they may be larger than an enterprises cloud ,thus providing the ability to scale
seamless ,on demand.
Private cloud
Private clouds are built exclusively for single enterprise. They aim to address concerns on data
security and offer greater control, which is typically lacking in a public cloud,
It also known as Internal clouds are hosted within one’s own data center. This model provides a
more standardized process and protection,but is limited in aspect of size and scalability.
This type of private cloud is hosted externally with a cloud provider,where the provider facilitate
an exclusive cloud environment with full guarantee of privacy.
Hybrid cloud
Hybrid cloud combines both public and private cloud models. With a hybrid model, service
providers can utilize 3rd party cloud providers in a full or partial manner thus increasing the
flexibility of computing .the hybrid cloud environment is capable of providing on-demand,
externally provisioned scale. The ability to augment a private cloud with the resources of a
public cloud due to sharing of physical resources
1. Reduced cost
There are a number of reasons to attribute cloud technology with lower cost the billing
model is pay as per usage. The Infrastructure is not purchased thus lowering
maintenance. Initial expense and recurring expenses are much lower than traditional
computing.
2. Increased Storage
With the massive Infrastructure that is offered by cloud providers today, storage and
maintenance of large volume of data is a reality.
3. Flexibility
Despite its growing influence, concerns regarding cloud computing still remain. In our opinion,
the benefits outweigh the drawback and the model is worth exploring. Some common challenges
are:
1. Data protection
Data security is a crucial element that warrents scrutiny. Enterprises are reluctant to to buy an
assurance of business data security from vendors. They fear losing data to competition and the
data confidentiality of [Link] many instances, the actual storage location is not
disclosed,adding onto the security concerns of [Link] the existing model, firewalls across
data centers (owned by enterprise ) protect this sensitive information. In the cloud model service
providers are responsible for maintaining data security and enterprises would have to rely on
them
All business applications have service level agreements that are stringently followed.
Operational teams play a key role in management of service level agreement and runtime
governance of application. In production environments,operational teams support
In production environment ,operational teams support.
If, any of the above mentioned services is under-served by a cloud provider, the damage and
impact could be severe
3. Management capabilities
Despite there being multiple cloud providers, the management of platform and infrastructure is
still in Infancy, Features like ‘Auto scaling’ are crucial requirements for many enterprises. There
is huge potential to improve on the scalability and load balancing features provided today.
With cloud computing, the action moves to the interface that is so, the interface between service
suppliers and multiple groups of service consumers. Cloud services will demand expertise in
distributed services ,procurement, risk assessment and service negotiation areas that many
enterprises are only modestly equipped to handle
Statistical analysis is primarily confirmative, dealing with small, clean datasets to test pre-defined hypotheses, often using a deductive approach . In contrast, data mining is exploratory and inductive, focusing on discovering unknown patterns in large, sometimes unclean datasets that include numeric and non-numeric data . While statistical analysis is used for specific variable testing, data mining aims to extract non-trivial and potentially useful information from extensive data collections .
Data mining improves business intelligence and decision-making by uncovering hidden patterns and correlations in large datasets, which can inform strategic decisions. This process helps businesses predict consumer behavior, optimize marketing strategies, and enhance customer segmentation . By providing a deeper understanding of data, data mining allows businesses to make data-driven decisions, predict future trends, and align their operations with market demands , thus increasing competitive advantage.
GIS core capabilities in managing georeferenced data include data capture and preparation, data management for storage and maintenance, data manipulation and analysis, and data representation . These capabilities allow users to organize spatial and non-spatial data for comprehensive analysis, enabling the integration of diverse data types into coherent maps and facilitating visualization of complex spatial relationships .
GIS technologies support environmental management and planning through various applications such as mapping environmentally sensitive zones, analyzing interactions between ecological, economic, and meteorological changes, and monitoring air and water quality . These systems facilitate complex spatial decision-making processes by integrating and analyzing diverse datasets like forest cover and soil quality, helping to predict and mitigate the impact of natural hazards .
Cloud computing transforms traditional IT infrastructure by enabling the use of shared, scalable resources over the internet, reducing the need for physical data centers . It shifts capital expenditure on infrastructure to operational costs based on consumption, offering significant cost benefits. This model allows organizations to pay only for the resources they use, facilitating cost-effective scalability and reducing the expenses associated with maintaining idle infrastructure .
Multimedia capabilities are incorporated into GIS by integrating various data types such as text, images, videos, and sound, enhancing data representation and user interaction . This multimedia integration can lead to the creation of hypermaps and virtual environments that improve the visualization of complex data, making it more engaging for users. These features also facilitate more intuitive interpretations of spatial data, aiding in educational and presentation contexts .
Challenges in data mining include handling high-dimensionality, noise, and incomplete data, as well as the efficiency and scalability of mining algorithms . Such challenges can affect the effectiveness of data analysis by complicating data processing and increasing computational costs, which may lead to incomplete or inaccurate pattern recognition . Incorporating expert knowledge and maintaining data privacy further complicate data mining processes, requiring robust methodologies to overcome these hurdles .
Future GIS developments incorporating temporal dimensions will significantly impact the study of geographical phenomena by enabling researchers to analyze changes over time with greater precision . This functionality would facilitate the understanding of dynamic processes such as climate change, urban development, and deforestation, allowing for more accurate predictions and strategy formulations in managing resources and planning sustainable developments .
Data mining facilitates the creation and use of data warehouses by necessitating the aggregation and summarization of data, which are essential for mining operations . Efficient data mining requires a well-structured data warehouse to effectively analyze large datasets and discover meaningful patterns. Hence, during the design phase of data warehouses, data mining considerations are crucial, ensuring that the data structures support extensive data exploration and pattern recognition tasks .
Data cleaning and transformation are critical in the knowledge discovery process as they ensure data integrity and consistency, which are essential for accurate analysis and pattern recognition . Cleaning removes noise and corrects inaccuracies, while transformation converts raw data into a suitable format for mining. These steps are foundational in creating a reliable dataset that can provide meaningful insights and accurate discoveries, directly impacting the quality of the knowledge extracted from databases .