Database Services

Foreword
⚫ After learning basic compute, storage, and networking services on Huawei
Cloud, let's move on to database services.

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 2

 Objectives
⚫ After completing this lesson, you will be able to understand:
 Basic database concepts
 Characteristics of Huawei Cloud relational and non-relational database
services
 Differences between relational and non-relational databases
 How to use database services to set up a service architecture
 How to use Data Admin Service (DAS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 3

 Contents
1. Introduction to Database Services

2. Relational Database Services

3. Non-Relational Database Services

4. Data Admin Service (DAS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 4

Besides OBS, EVS, and SFS, are there any other services
that can be used to store data?

Object Storage Service Elastic Volume Service Scalable File Service

OBS EVS SFS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 5

Different Data Types
Unstructured data Structured data

Book Name Published Year Author

The Great Gatsby 1925 F. Scott Fitzgerald

Lord of the Rings 1968 J. R. R. Tolkien

Documents Compressed Audio and
packages video files Fully structured Semi-structured
{
Year: 2018,
Author: {
Byliner: J. R. R. Tolkien,
Drafter: Internet pal}
}

RDS DDS
EVS OBS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 6

Relational Database vs Non-Relational Database
Relational Database Non-Relational Database

Traditional applications require databases that New Internet applications require databases
Application model can process transactions, complex queries, and that can store massive data and handle a large
joint queries, and maintain data integrity. number of concurrent requests.

10 ms-level
ms-level
Access performance Depending on query complexity and the
Irrelevant to the amount of stored data
amount of stored data
Semi-structured (key-value pairs and
Data types Fully structured
documents)
Vertical scaling
Vertical scaling
Scalability Horizontal scaling: primary instance + read
Horizontal scaling: cluster + read replicas
replicas

Depending on database configurations

Data consistency Strong consistency
Strong consistency or eventual consistency

Depending on the upper limit of DB nodes in

Storage space limit Depending on the DB engine
Copyright © Huawei Technologies Co., Ltd. All rights reserved. different
Page 7 scaling modes
Diversified Huawei Cloud Databases
Relational Non-Relational
For traditional database workloads For fast-growing workloads

RDS GaussDB GeminiDB DDS

RDS for MySQL GaussDB(for MySQL) GeminiDB Mongo API

GeminiDB Cassandra API

GeminiDB Influx API
RDS for PostgreSQL GaussDB
GeminiDB Redis API

Database ecosystem
Building complete database solutions

DRS DAS DBSS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 8

Advantages of Cloud Native
Database optimization Database optimization Database optimization
Database development Database development Database development
Backup and restoration Backup and restoration Backup and restoration
High availability High availability High availability

Database engine management Database engine management Database engine management

Patch and configuration Patch and configuration Patch and configuration

management management management
Software system Software system Software system
OS OS OS
Physical device maintenance Physical device maintenance Physical device maintenance
Power supply, cooling, and Power supply, cooling, and Power supply, cooling, and
cabinets cabinets cabinets
Buildings, locations Buildings, locations Buildings, locations

Traditional DC deployment Deployed on cloud

Cloud native
servers
Green: Huawei Cloud's
Legend: Blue: Customer's responsibilities
responsibilities
Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 9
 Contents
1. Introduction to Database Services

2. Relational Database Services

3. Non-Relational Database Services

4. Data Admin Service (DAS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 10

Relational Database Service (RDS)
⚫ A service that manages database engines and
resources
⚫ Compatible with mainstream relational database
engines

MySQL, PostgreSQL, SQL Server

⚫ A cloud-native service that is easy to maintain
RDS ⚫ Built-in automated backup and patching
⚫ HA configuration and automatic switchover/failover
within seconds
⚫ Multiple read replicas supported

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 11

Building a Simplified Architecture

⚫ A database service, for example, RDS

App Server functions as a database resource manager.

⚫ Applications access the database using IP
ELB RDS addresses, the same way as before.
Primary
App Server ⚫ DB engines and versions are selected while
you are creating databases.
⚫ However, this architecture has service
availability issues.
Backups in OBS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 12

High Availability of RDS

AZ AZ1 AZ2

App App 1 App 2

Failover Failover

Primary Standby Primary Standby

Primary/standby deployment within an AZ Primary/standby deployment across AZs

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 13

Building an HA Architecture
⚫ Databases are deployed in different AZs to
App Server
RDS ensure high availability.
Standby
⚫ DB engines ensure failover within seconds.

ELB ⚫ Using primary/standby deployment can avoid

App Server service interruptions during maintenance.

RDS
Primary ⚫ If the primary instance fails, workloads can be

smoothly switched over to the standby instance.

Backups in OBS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 14

Backup Characteristics of RDS

Full data backup + Binlog backup

Current time
Automated Automated Automated Automated
backup backup backup backup
Binlog
(every 5 minutes)
Binlog Binlog Binlog
Backups are
02
1 2 3 4 stored in OBS Automated
and can be Binlog backups
OBS binlog backup
restored to the can be restored
and manual
customer's on- to a specific
backup are
PITR premises data point in time.
supported.
Latest restorable time center.

Latest automated
backup
Latest Binlog 01 03
1 2 3 Log backups

OBS

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 15

RDS Read/Write Splitting
Application

Write Read
Basic functions
request request
Read/write splitting address ⚫ A unified read/write splitting address is provided,
(proxy)
transparent to applications.
⚫ Read weights are configurable for each node.
Write ⚫ If a health check detects that a read replica fails or
request
Read Read Read
request request request the I/O latency of a read replica goes beyond your
HA
preset threshold, read requests are no longer
distributed to the read replica.

Primary Standby Replica 1 Replica 2 Replica 3

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 16

Scaling Out Using Read Replicas
⚫ Read replicas can be added or

deleted as needed.
RDS
Standby ⚫ The number of read replicas
App Server
Read replica supported per DB instance varies

ELB by DB engine type. A DB instance

supports up to 10 read replicas.

App Server
Read replica
⚫ Data can be replicated across AZs

within a given region.

RDS
Primary

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 17

RDS for MySQL Architecture
Developers End users

Application

RDS console
DBAs Read-only
Read/write
Instance management
Instance access Backups
Backup and restoration
Instance monitoring Monitor Primary Failover Standby Read replicas
Scaling instance instance
Log management
Replication
Parameter
configuration
Delivery and O&M
personnel
Storage Storage Storage

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 18

Other Huawei Database Services

⚫ Huawei DB engine
⚫ Compatible with MySQL clients
⚫ Decoupled storage and compute
⚫ Cross-AZ HA
GaussDB(for MySQL)
⚫ Three copies stored to ensure reliability
⚫ Scale-out and scale-up

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 19

Decoupled Storage and Compute

Read replica Primary node Read replica ⚫ Compute and storage are decoupled,
Compute improving performance to several times that
layer
of open-source MySQL.

⚫ RDMA is used for database transmission,

RDMA
eliminating I/O performance bottlenecks.

⚫ With DFV distributed storage, GaussDB(for

Storage
layer MySQL) supports up to 128 TB of storage.

Shared distributed DFV storage

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 20

High Reliability: Zero Data Loss and Fast Fault Recovery
⚫ Cross-AZ deployment and cross-region backup, improving instance DR capabilities
 Compute layer: When the primary node is faulty, a read replica is automatically promoted to primary, achieving a
zero RPO.
 Storage layer: Three data copies are stored for fault tolerance. Services will remain uninterrupted even if one
copy becomes inaccessible. Read-only Read/Write Read-only

Read replica Primary node Read replica

DBMS (read/write)
(read-only) (read-only)

Shared disk pool

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 21

Multi-Dimensional Scaling and Mass Storage
⚫ Bidirectional scaling of compute nodes
 As the nodes are virtual resources, their
Read/Write Read-only
specifications can be changed.
 There can be one primary node and up to 15 read x 15
replicas for a DB instance. DBMS
Primary node Read replica Compute node
(read/write) (read-only) scale-out
⚫ Storage pooling
 Up to 128 TB of storage is supported per instance.
 Adding compute nodes does not increase storage
Shared disk pool
costs.
Three copies of a shared disk pool can support 15
 Storage is billed on a pay-per-use basis and can be
nodes at the upper layer.
easily scaled up with no downtime.

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 22

A More Powerful Huawei Database Service

⚫ Independent innovation from Huawei

⚫ A distributed relational database
⚫ Primary/Standby instances supported

GaussDB ⚫ Intra-city cross-AZ deployment

⚫ Up to 1,000+ nodes
⚫ Petabytes of storage

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 23

GaussDB Uses a Shared-Nothing (Sharding) Architecture

Shared-Everything Shared-Disk Shared-Nothing

CPUs, memory, disks are Only disks are shared. CPUs and memory CPUs, memory, and disks are not shared.
shared. are not shared. Typical example: Hadoop
Typical example: SQL Server Typical example: Oracle RAC

DB DB

DB DB DB DB
DB DB DB

Disk Disk Disk Disk

Disk

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 24

What will happen if there is a lot
of concurrent data?
 Contents
1. Introduction to Database Services

2. Relational Database Services

3. Non-Relational Database Services

4. Data Admin Service (DAS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 26

GeminiDB Features
⚫ Huawei-developed DB engine
⚫ Distributed multi-model NoSQL database service
⚫ Compatible with mainstream NoSQL APIs of Cassandra,
DynamoDB, MongoDB, InfluxDB, Redis, and HBase
⚫ Decoupled storage and compute
⚫ Compute resources scaled within minutes and storage
within seconds

GeminiDB

If needed, you can select DDS

Document Database
instances that use the MongoDB
Service engine.
(DDS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 27

GeminiDB Architecture

⚫ High availability
Application Application Application Application Application
 If a compute node fails, workloads can
be switched over within seconds.
 Three copies of data are stored, so the
Cassandra API Mongo API Influx API Redis API HBase API system can run fine if a storage node
fails.
⚫ Unlimited scalability
 Compute nodes are stateless and can be
Node 1 Node 2 Node 3 Node 4 . . . Node 5 quickly scaled out.
 Shared storage means you can add
nodes in a click or two and without
interrupting services.

Distributed storage pool

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 28

Features of Non-Relational Databases

01 03
There are no
logical
Users can locate
Each data relationships
data using key
record is a between the
values rather than
structured data records in a
through complex
document. collection.
queries.

02

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 29

Precautions for Using Non-Relational Databases
⚫ Define data keys and indexes so there is no need to scan entire collections, and data
can be located faster.
 Do not use hot keys.
 Keep records simple.
 Data can be located in milliseconds no matter how much data there is.
⚫ If necessary, use optimistic locks for transactions at the application layer.
⚫ If there is a lot of traffic, use clusters.
 Select an appropriate sharding algorithm to locate data.
 Distribute data access across all cluster nodes and avoid hot partitions.

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 30

 Contents
1. Introduction to Database Services

2. Relational Database Services

3. Non-Relational Database Services

4. Data Admin Service (DAS)

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 31

Data Admin Service (DAS)
⚫ Data Admin Service (DAS) is a one-stop database management platform that allows you to manage Huawei Cloud
databases on a web console. DAS offers database development, O&M, and intelligent diagnosis, making it easier to
use and maintain databases on the cloud.

⚫ O&M functions
⚫ No client required Developers DBAs ⚫ Host and instance performance
⚫ Visual operations data analysis
⚫ Online access ⚫ Slow and full SQL statement
analysis
⚫ Databases and table
creation, SQL statement ⚫ Real-time database performance
execution. diagnosis and analysis
⚫ Historical data analysis

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 32

 Summary
⚫ Have a good command of basic concepts of databases.
⚫ Have understood the characteristics of Huawei Cloud relational and non-
relational database services.
⚫ Have understood the differences between relational and non-relational
databases.
⚫ Have understood how to use databases to set up a service architecture.
⚫ Have learned how to use DAS to manage your databases.

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 33

 Quiz
Which of the following are the advantages of Relational Database Service
(RDS) over on-premises databases?
A. High availability
B. Elastic scaling and fast upgrade
C. Easy O&M
D. Low initial investment

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 34

 Acronyms and Abbreviations
⚫ AZ: availability zone
⚫ DAS: Data Admin Service
⚫ DRS: Data Replication Service
⚫ ECS: Elastic Cloud Server
⚫ EVS: Elastic Volume Service
⚫ OBS: Object Storage Service
⚫ SFS: Scalable File Service
⚫ EIP: Elastic IP
⚫ VPC: Virtual Private Cloud
⚫ RDS: Relational Database Service

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 35

 Recommendations
⚫ Huawei Cloud websites
 Huawei Cloud: [Link]
 Huawei Cloud Developer Institute: [Link]

Huawei Cloud
Developer Institute

Copyright © Huawei Technologies Co., Ltd. All rights reserved. Page 36

 Thank You.
Copyright © 2024 Huawei Technologies Co., Ltd. All Rights Reserved.
The information in this document may contain predictive statements including, without
limitation, statements regarding the future financial and operating results, future product
portfolio, new technology, etc. There are a number of factors that could cause actual results
and developments to differ materially from those expressed or implied in the predictive
statements. Therefore, such information is provided for reference purpose only and
constitutes neither an offer nor an acceptance. Huawei may change the information at any
time without notice.