Choosing computers for an organization
Thara Angskun (angskun@[Link])
Data Center / Server Room
“A place/room used to store, power
and operate computer servers and
their components.
22
Server Room Components
Hardware Cabling System Cabling System
Server / Storage / Rack Raised Floor Ceiling Racks
3
Server Room Components
Power Generator Operations
Redundant Power Source Uninterruptible Swapping devices
power supply
4
Server Room Components
Infrastructure Physical Security Fire Protection
Networking Access control Escape paths
5
Server Room Components
Environment Environment Backup
Temperature: AIR Temperature: Water DR: Disaster Recovery
6
Why should own a server room
Accessibility. Latency.
Availability. Security
Bespoke
(customizability). Visibility.
7
Server Rack
“a structure that is designed
specifically to house technical
equipment including routers, switches,
hubs, and of course, servers.
88
Server Rack
Network Cabinets
Server Cabinets
Wall Mount Cabinets
Under Desk Cabinets
Desk Top Cabinets
Open Close
9
Server Rack
Wide: 19 inches (482.6 mm), 23 inches.
Height: Rack Unit (RU or U).
1U = 1 3/4 inches (44.45 mm)
Full size = 42U
10
Connectivity to Rack Server
Core Switch Zone Switch Patch Panel
Based on bandwidth
11
How to Design a Server Room
Determine room size.
Setup rack
Make space for cable
Develop security protocol.
Monitoring (e.g., IOT
notification).
12
How to Design a Server Room
Keep the room cool (18 - 22 C)
InRack / InRow Cooling Raised Floor
13
How to Design a Server Room
InRack / InRow Cooling
14
How to Design a Server Room
Raised Floor
15
Common server room
Location
• Safe from fire, flood, explosions, hazards
• Noise will not disturb office, classroom etc.
Room Structure.
• Safe from fire, flood, explosions, hazards
• Wear the weight of all system, No exterior windows
• Large doors (at least 42 inches wide, 9 feet tall)
• Adequate clearance (4 feet) around computing racks
• Anti-static floor surface, raised floor (clearance >= 24 inches)
16
Common server room
Perimeter Security.
• Electronic Locks, CCTV, Entry log, Visitor procedures
Alarm System
• Fire, Water, Power Outage, High Temperature, …
Equipment.
• Seismic Bracing, Proper Grounding
• Power density < 300 W/Sq Ft.
• More power density = more heat
17
Common server room
Power
• Sufficient dedicated circuit
• Critical System connect to UPS
• UPS / Generator must be tested
• Emergency light
18
Common server room
Fire / Flood
• Fire Detection and Suppression
• Class C Clean Agent Fire Extinguishers (e.g., CO2)
• maintained and routinely tested.
• Free of fire hazard (e.g., boxes, papers)
• Moisture sensors
19
Server Room Maintenance
“keeping the server room hardware
equipment, building facility, and
hosted equipment functional and
operational
2020
Server Room Maintenance
Condition-based / Predictive maintenance
• based on current status / prediction
Corrective maintenance
• identify, isolate, and rectify fault
Total Productive maintenance
• improve performance
Planned / Preventive maintenance
• based on stat (e.g., MTBF)
21
Server Buying Guide: Form Factor
Tower Rack Blade
SME’s server room data center/server room modular design fits in a rack
22
Server Buying Guide: CPU
CISC RISC VLIW
X86 (Intel, AMD) IBM, Oracle (SUN) IA-64 (Itanium)
23
Example: DIGITECH Render Farm
CLUSTER NODE CPU
RACK Fujitsu 2550M4 Intel Xeon Silver 4116
24
Server Buying Guide: Memory
Handle 0x002B, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0029
Error Information Handle: Not Provided
RAM Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
• GB/Cores Form Factor: DIMM
Set: None
Locator: CPU1_DIMM_A1
Bank Locator: NODE 1
HDD / SSD Type: DDR4
Type Detail: Synchronous
Speed: 2666 MHz
Manufacturer: Samsung
• Fibre channel : 400 MB/s Serial Number: 40DAC24D
Asset Tag: CPU1_DIMM_A1_AssetTag
• Serially Attached SCSI (SAS) : 300 MB/s Part Number: M393A2K40BB2-CTD
Rank: 1
Configured Clock Speed: 2400 MHz
• Ultra320 SCSI : 320 MB/s Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
• Serial ATA (SATA) : 300 MB/s Configured Voltage: 1.2 V
25
RAID: Redundant Array of
Inexpensive Disks
“data storage virtualization
technology that combines multiple
physical disk drive components into
one or more logical units for the
purposes of data redundancy,
performance improvement, or both
”
2626
RAID: Redundant Array of Inexpensive Disks
RAID 0
• Block stripe (increase read performance)
RAID 1
• Mirroring (increase fault-tolerance)
RAID 2
• Bit stripe + Hamming drive
27
RAID: Redundant Array of Inexpensive Disks
RAID 3
• Byte stripe + Parity drive
RAID 4
• Block stripe + Parity drive
RAID 5
• Block stripe + Distributed parity
28
RAID: Redundant Array of Inexpensive Disks
RAID 6
• Block stripe + 2 x Distributed parity
Hybrid
• e.g., Raid 0+1, 1+0(10), 5+0(50), 5+3(53)
29
Choosing the right server for the right job
Private Cloud (Network Attached Storage)
• multiple hot-swappable drive bays
• configurable hardware/software RAID
• a low-power CPU should suffice
Authentication for a domain (e.g., radius server)
• A virtualization-capable server
• Any 64-bit CPU, 4 GB+ RAM)
30
Choosing the right server for the right job
Web Servers
• hardware redundancy
• RAM capacity benefits performance
Database Servers
• Hard drives
• rated for fast writes
31
Choosing the right server for the right job
32
Choosing the right server for the right job
Mail / File Servers
• Dedicated hardware is recommend
Shared Equipments (e.g., printer servers)
• Low-power specs will suffice
Application Server (e.g., shared software)
• Enterprise-grade storage bays (SAS hard drives)
33
FUGAKU: The fastest computer in the world
Location: RIKEN (Kobe, Japan)
Speed: 442 Petaflop/s
CPU: 7,630,848 cores
RAM: 5,087,232 GB
34
Case Study: Render Farm TOR
Case Study: Render Farm TOR
Case Study: Render Farm TOR