DISTRIBUTED COMPUTING
INTRODUCTION TO DISTRIBUTED SYSTEMS
Learning Objectives
After studying this unit, students will be able to:
1. Define distributed computing and distributed systems.
2. Explain the characteristics of distributed systems.
3. Understand the goals and objectives of distributed computing.
4. Describe various types of distributed systems.
5. Explain distributed system architectures.
6. Analyze advantages and challenges of distributed systems.
7. Identify real-world applications of distributed computing.
1. Introduction to Distributed Computing
Modern computing applications require enormous computational resources, large-scale data processing, and
global accessibility. Traditional centralized computer systems often struggle to meet these requirements.
Distributed Computing addresses these challenges by connecting multiple computers through a network and
allowing them to work together as a single system.
Definition
A Distributed System is a collection of independent computers that appears to its users as a single coherent
system.
According to Andrew S. Tanenbaum:
"A distributed system is a collection of independent computers that appears to its users as a single coherent
system."
2. What is a Distributed System?
A distributed system consists of multiple computers (nodes) connected through a communication network.
Each computer:
Has its own processor.
Has its own memory.
Operates independently.
Cooperates with other computers to perform tasks.
Basic Architecture
User
|
----------------
| |
Client 1 Client 2
| |
----------------
|
Network
|
------------------
| | |
Server1 Server2 Server3
The user interacts with the system as if it were a single computer.
3. Characteristics of Distributed Systems
3.1 Resource Sharing
Resources can be shared among multiple users.
Examples:
Printers
Files
Databases
Applications
Example
A printer connected to one server can be accessed by all computers in an organization.
3.2 Openness
Distributed systems use standard protocols and interfaces.
Benefits:
Interoperability
Flexibility
Vendor independence
3.3 Transparency
The system hides its distributed nature from users.
Users should not know:
Where data is stored.
Which server processes requests.
How communication occurs.
3.4 Scalability
The system can grow without significant performance degradation.
Types:
1. Size Scalability
2. Geographical Scalability
3. Administrative Scalability
3.5 Concurrency
Many users can access resources simultaneously.
Example:
Multiple students accessing an online examination portal.
3.6 Fault Tolerance
The system continues to function even when some components fail.
Example:
If one server fails, another server takes over.
4. Goals of Distributed Systems
4.1 Resource Sharing
Enable users to access resources regardless of location.
Example
Cloud storage services.
4.2 Improve Performance
Tasks are divided among multiple machines.
Benefits:
Faster execution
Better throughput
4.3 Reliability
System remains operational despite failures.
Example
Banking systems maintain backup servers.
4.4 Communication
Facilitates collaboration among users.
Examples:
Email systems
Video conferencing
Online collaboration tools
5. Advantages of Distributed Systems
5.1 Improved Performance
Multiple machines process tasks simultaneously.
5.2 Reliability
Failure of one node does not stop the entire system.
5.3 Scalability
Easy to add new computers.
5.4 Resource Sharing
Shared access to expensive resources.
5.5 Geographic Distribution
Users can access services globally.
6. Challenges in Distributed Systems
6.1 Network Failure
Communication depends on network availability.
6.2 Security Issues
Challenges include:
Unauthorized access
Data breaches
Malware attacks
6.3 Synchronization
Maintaining consistency among distributed nodes.
6.4 Complexity
Designing distributed applications is difficult.
6.5 Data Consistency
Multiple copies of data must remain synchronized.
7. Types of Distributed Systems
7.1 Distributed Computing Systems
Multiple computers cooperate to solve computational problems.
Examples:
Scientific simulations
Weather forecasting
7.2 Distributed Information Systems
Support information sharing among users.
Examples:
Banking systems
Enterprise Resource Planning (ERP)
7.3 Distributed Pervasive Systems
Embedded devices communicate and cooperate.
Examples:
Smart homes
IoT networks
8. Distributed System Architectures
8.1 Client-Server Architecture
A client requests services from a server.
Client ----> Server
Examples:
Web applications
Email services
Advantages:
Centralized management
Easy maintenance
Disadvantages:
Single point of failure
8.2 Peer-to-Peer Architecture
All nodes act as both client and server.
Peer A <----> Peer B
^ |
| v
Peer D <----> Peer C
Examples:
File sharing systems
Blockchain networks
Advantages:
No central server
Highly scalable
Disadvantages:
Difficult management
8.3 Multi-Tier Architecture
Presentation Layer
|
Business Logic Layer
|
Database Layer
Widely used in enterprise applications.
9. Transparency in Distributed Systems
Transparency hides the complexity of distributed operations.
Types of Transparency
Access Transparency
Users access resources uniformly.
Location Transparency
Users need not know resource locations.
Migration Transparency
Resources can move without affecting users.
Replication Transparency
Multiple copies appear as a single resource.
Concurrency Transparency
Multiple users can access resources simultaneously.
Failure Transparency
Failures are hidden from users whenever possible.
10. Real-World Applications
Banking Systems
ATM networks and online banking.
Cloud Computing
Examples include services from Amazon Web Services, Microsoft Azure, and Google Cloud.
E-Commerce
Online shopping platforms.
Social Networks
Distributed data storage and processing.
Online Education
Learning management systems and virtual classrooms.
Solved Example
Problem
A distributed system contains 5 servers. If one server fails and the remaining servers continue processing
requests, what characteristic of distributed systems is demonstrated?
Solution
The system continues functioning despite a server failure.
Answer: Fault Tolerance.
Key Terms
Distributed System
Node
Resource Sharing
Scalability
Transparency
Fault Tolerance
Client-Server
Peer-to-Peer
Concurrency