Gibbs Exadata
Gibbs Exadata
Gibbs Exadata
Who Am I?
[email protected]
Makers of Ignite8 Response Time Analysis Tools
IgniteVM for Oracle/SQL/Sybase/DB2 on Vmware
Alarm VM for VM Admins
Agenda
What is Exadata
How Exadata Solves Performance Problems
How is Performance Tuning different on an
Exadata Machine
How Exadata Can Create Performance
Problems
Questions
Database Appliance
This is just a preconfigured 11gr2 database on OEL Fully Redundant Integrated
Database Appliance in a single box
RAC and RAC One Licensing is included in the price.
What is Exadata?
History of Exadata
What is Exadata V2
8 Compute Servers
8 x 2 sockets x 4 cores = 64
cores
576 GB DRAM
14 Storage Servers
- 14x12=168 Disks
- 100T SAS or
- 336T SATA
InfiniBand Network
40 Gb/sec each direction
Fault Tolerant
14 Storage Servers
- 14x12=168 Disks
- 100T SAS or
- 336T SATA
InfiniBand Network
40 Gb/sec each direction
Fault Tolerant
2 Compute Servers
8 x 2 sockets x 8 cores =
128cores
2 TB DRAM
InfiniBand Network
40 Gb/sec each direction
Fault Tolerant
14 Storage Servers
- 14x12=168 Disks
- 100T SAS or
- 336T SATA
8 x DL360 G5
Database CPUs
16
Database cores
Database Threads
Database RAM
Storage Server
64
64
128
576GB
14 x SunFire X4275
64
128
576GB
14 x SunFire X4270
28 x Quad-Core
Intel Xeon E5540
2.53GHz
112
224
112GB
5.3TB
4 x 1GbE x 8 servers
= 32 x 1GbE
112
224
336GB
5.3TB
4 x 1GbE x 8 servers
= 32 x 1GbE
112
224
336GB
5.3TB
4 x 1GbE x 8 servers
= 32 x 1GbE
112
168
224
336
336GB
5.3TB
8 x 1GbE x 2 servers
+ 8 x 10GbE x 2 servers
= 16 x 1GbE + 16 x 10GbE
InfiniBand Switches
3 x 36 port QDR 40Gbit/s switches 3 x 36 port QDR 40Gbit/s switches (Total ports
(Total ports 108)
108)
Ethernet Switch
Database Servers OS
Multiple Rack Capability (with
requiring additional switches)
PDU
V1
576GB
14 x DL180 G5
2 x 16port Switch
Oracle Linux 5 Update 3
8
V2
8 x Sun Fire x4170 1U
96
192
768GB
14 x SunFire X4270 M2
168
336
4 x 1GbE x 8 servers
+ 2 x 10GbE x 8 servers
= 32 x 1GbE + 16 x
10GbE
X2-8
2 x Sun Fire x4800 5U
128
256
2TB
14 x SunFire X4270 14 x SunFire X4270
M2
28 x Six-Core Intel
Xeon E5640
2.26GHz
2 redundant 15 kVA PDUs (single 2 redundant 15 kVA PDUs (single phase or three 2 redundant 24 kVA PDUs (three phase,
phase or three phase, high
phase, high voltage or low voltage)
high voltage or low voltage)
voltage or low voltage)
X2-2
8 x Sun Fire X4170 M2
1U
High Performance
SAS Disks
High Performance
SAS Disks
High Capacity
SAS Disk
21 GB/sec
14 GB/sec
25 GB/sec
14 GB/sec
25 GB/sec
14 GB/sec
50 GB/sec
50 GB/sec
50 GB/sec
50 GB/sec
50 GB/sec
50 GB/sec
Disk IOPS
50,000 IOPS
25,000 IOPS
50,000 IOPS
25,000 IOPS
50,000 IOPS
25,000 IOPS
Flash IOPS
1,000,000 IOPS
1,000,000 IOPS
1,000,000 IOPS
1,000,000 IOPS
100 TB
336 TB
100 TB
336 TB
100 TB
336 TB
28 TB
100 TB
28 TB
100 TB
28 TB
100 TB
5.3TB
5.3TB
5 TB/hour
High Capacity
SAS Disk
5.3TB
5 TB/hour
5 TB/hour
5 TB/hour
8 x DL360 G5
CPU
Memory
32 GB
72 GB
72 GB
1 TB
Disk Controller
96 GB
Local Disks
4 x 146 GB 10K RPM 4 x 300 GB 10K RPM SAS 8 x 300GB 10K RPM SAS Disks
SAS
Local Storage
292GB (RAID1)
292GB (RAID1)
292GB (RAID1)
Infiniband Ports
Ethernet Ports
4x1Gb
Power Supplies
2 x Redundant Hot-Swappable
2 x Redundant Hot-Swappable
4 x Redundant Hot-Swappable
600GB (RAID1)
1.2 TB (RAID1)
14 x DL180 G5
14 x SunFire X4275 2U
14 x SunFire X4275
2U
CPU
Memory
8GB
24 GB
24 GB
24 GB
Flash Card
4 x 96 GB Sun Flash Accelerator F20 PCIe Cards 4 x 96 GB Sun Flash Accelerator F20 PCIe
Cards
384 GB
384 GB
384 GB
12
12
Disk Controller
Infiniband Ports
Ethernet Ports
Power Supplies
2 x Redundant Hot-Swappable
2 x Redundant Hot-Swappable
2 x Redundant Hot-Swappable
OEL 5.5
OEL 5.5
OS
12
14 x SunFire X4270 M2
2U
What is Exadata
Environmental Specifications
Exadata Model Comparison - Full Rack
Environmental Specifications
Height
Width
23.62 (600mm)
23.62 600 mm
23.62 600 mm
Depth
47.24 1200 mm
47.24 1200 mm
47.24 1200 mm
Weight
44,800 BTU/hr
32,800 BTU/hr
1680 CFM
2,200 CFM
2,200 CFM
950 CFM
1,560 CFM
1,560 CFM
Operating temperature
5 C to 32 C (41 F to 89.6 F)
Operating humidity
Exadata Performance
Cell Offloading
Smart Scan
Storage indexes
Hybrid Columnar Compression
DBRM/IORM
Smart flash cache
Additional Views
15
10 TB of user data
Requires 10 TB of IO
20 GB
with Storage Indexes
17
1 TB
with compression
5 GB
with Smart Scans
100 GB
with partition pruning
Sub second
On Database
Machine
18
Exadata Performance
Storage Index
Storage Index
19
20
Exadata Performance
Hybrid Columnar Compression
21
Exadata Performance
Hybrid Columnar Compression
Types
Query Low
Query High
Archive Low
22
Exadata Performance
DBRM/IORM
23
Exadata Performance
DBRM/IORM
DBRM
CPU Quantum wait event. Resmgr: cpu quantum.
Is the unit of CPU time that the DBRM uses for
allocating CPU to consumer groups. Occurs when
DBRM is actively throttling Cpu Consumpton.
Check DBRM Metrics V$RSRC_Consumer_group.
Also v_$RSRCMGRMETRIC and
V_$RSRCMGRMETRIC_HISTORY for monitoring
effect of DBRM resource allocations have on
sessions
Instance Caging Provisions CPU at db instance
level.
24
Exadata Performance
DBRM/IORM
IORM
Interdatabase IORM Manages priority among
multiple dbs by db name
IORM Categories This is a new attribute. Still by
dbname. Ex oltp_category batch_category
Intradatabase IORM On exadata when a DBRM
plan is activated the db transmits a desc of this
plan to all cells in the storage grid. So in a way this
is a bit of the default
25
Exadata Performance
DBRM/IORM
IORM
IORM manages at the storage cell
IORM distinguishes between small and large io
request (<128k in size or > 128K)
For each cell disk cellsrv maintains an IORM queue
for each consumer group and each backgrou
pprocess. For each db accessing the cell.
Cellcli> alter iormplan objective = low_latency
Cellcli> list iormplan attributes object
low_latency
26
Exadata Performance
DBRM/IORM
Or SQLPlus
27
28
CELL_FLASH_CACHE=KEEP
None, default, keep
Alter table oltp.busy_table (cell_flash_cache=keep);
Cellcli CELL_FLASH_CACHE=KEEP
29
30
Exadata Performance
What to look for when tuning
31
Exadata Performance
32
33
Exadata Performance
34
35
Conclusion
36
Confio Software