EXADATA基础知识培训

…
提纲
• Exadata架构设计原理 • Exadata硬件体系架构 • Exadata软件体系技术 • 新一代数据库云平台特点和案例
Exadata 硬件架构
• 高性能, 低成本, 冗余, 线性扩展 • 超级性能 &开箱即用
数据库网格 • 8台数据库服务器(X2-2)
96 CPU cores (12Core per server,2x Six-Core Intel X5675 Processors (3.06 GHz) 768 GB memory (可扩展至1152GB)
Data Intensive Processing
Sun Oracle Database Server
Compute Intensive Processing
Sun Oracle Exadata Storage Server
Data Intensive Processing
Sun Oracle Database Server
- 连接网线、电源线、加电即可用 - 无需更改现有应用程序，you are Exadata certified
数月到数天
• 即可获得极限性能
Sun Oracle Database Machine: System Architecture
Sun Oracle Exadata Storage Server
Database Machine X2-2 Full Rack
14 Exadata Storage Servers (all high performance or all high capacity)
8 Intel-based 2 CPU Sun Fire database servers Keyboard, Video, Mouse (KVM) hardware 2 Power Distribution Units (PDUs) at rear
SunFire Compute Intensive Processing
Sun Oracle Exadata Storage Server
Data Intensive Processing
Clustered Database Servers
High Bandwidth Interconnect
Massively Parallel Storage
Exadata低功耗
Maximum Power usage of a Full Rack Database Machine is 14KW, typical is 9.8 KW. A single high end SMP platform without storage or switches can consume well over 20 KW.
controller All 8 disk arrays can sustain 8 * 200MB/s = 1600 MB/s
Disk Array 1
Disk Array 2
Disk Array 3
Disk Array 4
Disk Array 5
Disk Array 6
Disk Array 7
Disk Array 8
的数据分布不均匀，存在IO热点
•网络层：传输带宽不足，无法快速传输大量数据到服务器
•服务器层：接收过多数据进行处理，内存优势无法发挥
解决思路：减轻负载、加宽通道、提高并行
传统数据库架构解决思路：
1. 加宽通道、增加通道数量
2.
3.
减少需要传送到服务器处理的数据量提高系统扩展能力
增加系统并行处理
• Each building block is a
FC-Switch1
FC-Switch2
• CPU: Quantity and speed Each switch(Host Bus Adapter): • HBA needs to support 800MB/s to guarantee a total system throughput Quantity and speed of 1600 MB/s • Switch speed • Controller: Quantity and speed Each disk array has one 2Gbit • Disk: Quantity and speed
Database Servers
Storage Arrays
wk.baidu.com
Exadata设计原则：资源共享和资源控制
Oracle Database Servers
Smart storage operations
I/O Resource Management High performance storage network
端到端优化
•
将IT 智慧转化成业务需求
- 而不要设计，调优，维护，硬件配置
问题4：系统的维护和扩容过程复杂
均衡化配置方法论 分区和HA规划
网络互联配置规划
数据库存储规划
Exadata设计原则：简化部署 • 消除了数据库系统部署的复杂性 - 数月的配置、排错、调优
• 当天即可完成部署
- 预置的、经过测试的、可稳定运行的标准配置
1 Cisco Ethernet switch (48-port)
3 Sun Datacenter InfiniBand Switch 36 (36-port managed QDR switch - 40Gb/s)
Start Small and Grow
X2-2 Quarter Rack
X2-2 Half Rack
•
• • • •
Add more racks for additional scalability
Exadata X2-2 Half Rack
• 4 Dual-procesor Database Servers (Sun Fire X4170 M2) - 48 cores (12 per server) - 384 GB memory (96GB per server) - 10 GigE connectivity to Data Center - 8 x 10GbE ports (2 per server) 7 Exadata Storage Servers X2-2 - All with High Performance 600GB SAS disks OR - All with High Capacity 2 TB SAS disks 3 Sun Datacenter InfiniBand Switch 36 - 36-port Managed QDR (40Gb/s) switch 1 “Admin” Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware 2 Redundant Power Distributions Units (PDUs)
Exadata设计原则：存储层智能化、数据预处理能力
Oracle Database Servers
Exadata Cell
Exadata software
Exadata Cell
Exadata software
Disk
…
Disk
…
问题2：多系统资源互相独立，无法共享
有些资源过度，有些资源不足，由于生产环境动态变化，无法动态满足
Storage consolidation
(Transparent to databases)
Data compression
问题3：复杂的数据库系统均衡化配置
Each machine has 2 CPUs All four servers drive about 2 * 200MB/s * 4 = 1600 MB/s
X2-2 Full Rack
Exadata X2-2 Full Rack
• 8 Dual-procesor Database Servers (Sun Fire X4170 M2) - 96 cores (12 per server) - 768 GB memory (96GB per server) - 10 GigE connectivity to Data Center - 16 x 10GbE ports (2 per server) 14 Exadata Storage Servers X2-2 - All with High Performance 600GB SAS disks OR - All with High Capacity 2 TB SAS disks 3 Sun Datacenter InfiniBand Switch 36 - 36-port Managed QDR (40Gb/s) switch 1 “Admin” Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware 2 Redundant Power Distributions Units (PDUs)
•“The weakest link” defines the throughput
HBA1 HBA1 HBA2 HBA1 HBA2 HBA1 HBA2 HBA2
Each machine has 2 Gb HBAs balanced unit All 8 HBAs can sustain •Components to 8 * 200MB/s = 1600 MB/s consider:
ORACLE数据库云服务器 技术揭密
单明祺 Galvin.Shan@Oracle.com
提纲
• Exadata架构设计原理 • Exadata硬件体系架构 • Exadata软件体系技术 • 新一代数据库云平台特点和案例
问题1：随着系统规模增加，传统数据库架构瓶颈凸显
• 存储层：1）数据量不断增加，带来的IO瓶颈；2）随着数据长时间运行带来
SunFire SunFire Sun Oracle Exadata Storage Server
Data Intensive Processing
Sun Oracle Database Server
Compute Intensive Processing
Sun Oracle Exadata Storage Server
• 112 Intel cores in storage
• 5.3 TB PCI 闪存 • 跨存储服务器的数据镜像保护Data mirrored across storage servers
InfiniBand Network • Redundant 40Gb/s switches • Unified server & storage network
Compute Intensive Processing
Sun Oracle Exadata Storage Server
Data Intensive Processing
…
Sun Oracle Database Server
Compute Intensive Processing
Sun Oracle Exadata Storage Server
Data Intensive Processing
Clustered Database Servers
High Bandwidth Interconnect
Massively Parallel Storage
…
Sun Oracle Database Machine: 5.3 TB SunFire Flash Cache
Data Intensive Processing
Sun Oracle Database Server
Compute Intensive Processing
SunFire
Sun Oracle Exadata Storage Server
Data Intensive Processing
…
Sun Oracle Database Server
Exadata 智能存储网格 • 14 x 高性能低成本存储服务器(2U)
• 或2台数据库服务器(X2-8)
128 CPU cores (64Core per server) 2 TB (1 TB per server)
• 100 TB High Speed disk, 或 336 TB High Capacity disk
Exadata设计原则：平衡且优化配置
• 客户化系统无法达到最佳性能
- 组件不平衡, 错误配置，瓶颈
•
Exadata 端到端优化
- 从磁盘到数据库传输是两倍的GB/sec - 磁盘，闪存，控制器，总线，HBA, 网络，CPU等
- 数据库从固件，驱动，操作系统，网络的优化
- 多年的调优经验 - 没有瓶颈