Exadata X10M Hardware Overview

Download as pdf or txt
Download as pdf or txt
You are on page 1of 56

Oracle Exadata Database Machine

Exadata X10M Hardware Overview

Exadata Product Management


March 2023
Safe harbor statement

The following is intended to outline our general product direction. It is intended for information
purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any
material, code, or functionality, and should not be relied upon in making purchasing decisions. The
development, release, timing, and pricing of any features or functionality described for Oracle’s
products may change and remains at the sole discretion of Oracle Corporation.

2 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Hardware Overview Updates to the Following Content

• Exadata X10M 1/8 rack will be available at a later date


• ExaCC X10M base system will be available at a later date
• ExaCC X10M Control Plane Server (CPS) could be an X9M

3 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata Vision
Extreme Performance and Availability, Lowest Cost, Available Everywhere

Ideal Database Hardware


Scale-out, database optimized compute,
networking, and storage Available

Database Aware System Software On Premises


Unique algorithms vastly improve OLTP,
Analytics, and Consolidation Cloud@Customer

Automated Management Oracle Cloud


Fully automated and optimized end-to-end

4 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M New Hardware Highlights

Consolidate database servers and storage servers into a common 2U chassis


• Database servers move from 1U to 2U
Build RDMA cache using DRAM memory on storage servers
• Intel Optane persistent memory has been discontinued
• Exadata RDMA Memory (XRMEM) Cache achieves the same low latency, high throughput
OLTP I/O performance as prior-generation Optane
Reimagine Extreme Flash storage servers leveraging both capacity-optimized and performance-
optimized flash
• Capacity-optimized flash boosts storage capacity from 51.2TB  122.8TB (2.4x growth)
• Performance-optimized flash delivers superior I/O performance as a cache fronting the
capacity-optimized flash

5 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Server Hardware Changes

Step up from 1U  2U chassis on DB servers


Adopt the latest AMD Genoa chips on DB servers
• 2-socket On-Premises & Cloud@Customer DB server cores increase from 32  96 cores
• 2-socket Public Cloud DB server cores increase from 64  96 cores
• 2-socket X10M DB server cores match X9M generation 8-socket DB server cores, allowing us to
consolidate on a sole 2-socket DB server config for the X10M generation
Deliver faster memory performance and larger DRAM capacity on DB servers
• Memory throughput approaches 1TB/sec on a single DB server  2.5x faster memory
- DRAM upgrades from DDR4 to DDR5 for higher density and bandwidth
- Genoa chips enable more DDR5 memory channels at a higher speed
• Memory capacity increase from 2TB to 3TB on a single DB server  1.5x more memory

Enable more client network connectivity by increasing from 3  5 NICs per DB server

6 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Storage Server Hardware Changes

Adopt the latest AMD Genoa chips on Storage Servers


• Storage server cores increase from 32  64 cores
Build Exadata RDMA Memory (XRMEM) Cache using DRAM on Storage Servers for the same
low latency, high throughput OLTP I/O performance as prior-generation Optane PMEM
• 1.25TB of XRMEM Cache per Storage Server
Hard drive capacity increases from 18TB  22TB
Faster flash performance and larger capacity
• Next Generation Aura-10 (internal code name)
• Flash capacity grows from 6.4 TB  6.8 TB

7 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Extreme Flash Storage Server Hardware Changes

Capacity-optimized flash drastically boosts flash capacity at a lower cost with reduced I/O
capability
Performance-optimized flash achieves 3.7x higher throughput and ~20% lower latency than
capacity-optimized flash, albeit at a higher cost
X10M Extreme Flash Storage Server combines the best of both worlds –
• Capacity-optimized flash expands an Extreme Flash Storage Server capacity from 51.2TB 
122.8TB (2.4x growth)
• Performance-optimized flash guarantees superior I/O performance as a cache fronting the capacity-
optimized flash

8 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M
Hardware Configuration

9 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Hardware Change Overview

Database Server (2-Socket)


• New AMD EPYC™ CPU – 96-core up to 3.7 GHz (up from 32-core 2.4 GHz)
• New and Increased Memory Capacity – 512 GB, 1.5 TB, and 3 TB-DDR5-4800MT/s (up from DDR4-3200
MT/s) factory options – with more memory channels
Network
• 100Gb/s RoCE Network Cards; New PCIe Gen5
Storage Server
• New AMD EPYC™ CPU – 32-core up to 2.7 GHz
• New Exadata RDMA Memory Accelerator (XRMEM) – 1.25 TB DDR5 4800 MT/s
• Faster memory – 256 GB DDR5 4800 MT/s (up from DDR4-3200 MT/s)
• New performance-optimized F680 6.8 TB NVMe PCIe Gen4 flash
• New capacity-optimized D5-P5316 30.72 TB NVMe PCIe Gen4 SSD
- 122.8 TB per EF Storage Server, up from 51 TB (previously using F640v3 flash cards)
• New and increased storage capacity – 22 TB Hard Drives (up from 18 TB)
- 264 TB per HC/XT Storage Server, up from 216 TB

10 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Hardware Change Overview

Database Server (2-Socket)


• New AMD EPYC™ CPU – 96-core up to 3.7 GHz (up from 32-core 2.4 GHz)
• New and Increased Memory Capacity – 1.5 TB, and 3 TB-DDR5-4800MT/s (up from DDR4-3200 MT/s) factory
options – with more memory channels

Network
• 100Gb/s RoCE Network Cards; New PCIe Gen5

Storage Server
• New AMD EPYC™ CPU – 32-core up to 2.7 GHz
• New Exadata RDMA Memory Accelerator (XRMEM) – 1.25 TB DDR5 4800 MT/s
• Faster memory – 256 GB DDR5 4800 MT/s (up from DDR4-3200 MT/s)
• New performance-optimized F680 6.8 TB NVMe PCIe Gen4 flash
• New and increased storage capacity – 22 TB Hard Drives (up from 18 TB)
- 264 TB per Storage Server, up from 216 TB

11 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M: Unparalleled Performance Scale-out Database Platform

• Scale-Out 2 Socket Database Servers


• Latest 96-core AMD EPYC™ CPUs
• Up to 3 TB Memory Database Server

• Ultra-fast 100Gb/s RDMA over Converged Ethernet (RoCE)


Internal Fabric
High Capacity (HC) Storage Server

• Scale-Out intelligent 2-Socket Storage Servers


• Latest 32-core AMD EPYC™ CPUs
• 1.25 TB XRMEM per storage server
• Three tiers of storage: XRMEM, NVMe Flash, HDD Extreme Flash (EF) Storage Server

Compute Capacity Storage Capacity


Each rack 2,880 DB Cores 1088 Storage Cores
has up to... 33 TB Memory 21.25 TB XRMEM
462.4 TB NVMe Flash
2.1 PB Raw Flash Capacity Extended (XT) Storage Server
4.2 PB Raw Disk Capacity

12 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M: Unparalleled Performance Scale-out Database Platform

• Scale-Out 2 Socket Database Servers


• Latest 96-core AMD EPYC™ CPUs
• Up to 3 TB Memory

Database Server
• Ultra-fast 100Gb/s RDMA over Converged Ethernet (RoCE)
Internal Fabric

• Scale-Out intelligent 2-Socket Storage Servers


• Latest 32-core AMD EPYC™ CPUs High Capacity (HC) Storage Server

• 1.25 TB XRMEM per storage server


• Three tiers of storage: XRMEM, NVMe Flash, HDD

Compute Capacity Storage Capacity


Each rack Extended (XT) Storage Server
2,496 DB Cores 896 Storage Cores
has up to... 36 TB Memory 17.5 TB XRMEM
380.8 TB NVMe Flash
3.69 PB Raw Disk Capacity

13 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Machine (changes from X9M-2 in red)

• Scale-Out 2-Socket Database Servers


Database Server
• 3x more cores – 96-core AMD EPYC™ CPUs
• Memory options – 512 GB / 1536 GB / 3072 GB
• Additional client network flexibility 192 cores per server
• 2RU Servers 512GB – 3TB DRAM
High-Capacity (HC) Storage

• 100Gb RDMA over Converged Ethernet (RoCE) Internal fabric


• PCIe5.0, active-active, 2x 100 Gb RoCE network interface 264 TB disk capacity
ports in Database and Storage Servers 27.2 TB PCIe NVMe Flash
1.25 TB Exadata RDMA Memory
64 cores for SQL offload
• Scale-Out Intelligent 2-Socket Storage Servers Extreme Flash (EF) Storage
• Latest 32-core AMD EPYC™ CPUs
• 1.5 TB DDR5 DRAM
122.88 TB flash storage capacity
• 1.25 TB Exadata RDMA Memory 27.2 TB PCIe NVMe Flash
• 256GB – for Exadata System Software 1.25 TB Exadata RDMA Memory
64 cores for SQL offload
• 22% higher capacity – 22 TB Disk Drives (HC/XT) Extended (XT) Storage
• 2.4x higher capacity – 30.72 TB NVMe Flash Drives (EF)
• 27.8 TB Flash Cache (HC & EF)
264 TB disk capacity

14 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Database Machine (changes from X9M-2 in red)

• Scale-Out 2-Socket Database Servers


Database Server
• 3x more cores – 96-core AMD EPYC™ CPUs
• Memory options –1536 GB / 3072 GB
• Additional client network flexibility 192 cores per server
1.5TB / 3TB DRAM
• 2RU Servers
High-Capacity (HC) Storage
• 100Gb RDMA over Converged Ethernet (RoCE) Internal fabric
• PCIe5.0, active-active, 2x 100 Gb RoCE network interface
ports in Database and Storage Servers 264 TB raw disk capacity
27.2 TB PCIe NVMe Flash
1.25 TB Exadata RDMA Memory
64 cores for SQL offload
• Scale-Out Intelligent 2-Socket Storage Servers
• Latest 32-core AMD EPYC™ CPUs
Base System Storage Server
• 1.5 TB DDR5 DRAM
• 1.25 TB Exadata RDMA Memory
• 256GB – for Exadata System Software
132 TB raw disk capacity
• 22% higher capacity – 22 TB Disk Drives
• 27.8 TB Flash Cache

15 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Elastic Scaling from Eighth-Rack to Multi-Rack

Eighth Quarter Elastic Multi


Rack Rack Rack Rack
• Start with 2 Database Servers and 3 Storage Servers
• Add Database and/or Storage Servers as needed - scale out up to 14 racks
• Use Oracle Exadata Configuration Assistant (OECA) to model desired configuration
16 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Servers

• Exadata X10M Database Machines uses x86 2-socket Database Servers, available in two
configurations
• Database Server
• Both CPU sockets populated with 96 cores
• Well suited for all workloads - OLTP, Analytics, Consolidation, Memory Intensive, horizontally and vertically
scalable database workloads and all multi-rack data workloads
• Database Server Eighth Rack
• A single CPU socket populated with 32 cores
• Perfect for small workloads which do not require scalability or maximum performance

17 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Server
96-core 4th Generation AMD EPYC™ CPUs with up to 3 TB of Memory

Processor • 2x 96-core AMD EPYC™ 9J14 Processors

DDR5 Memory • 512 GB (16x 32 GB) / 1.5 TB (24x 64 GB) / 3 TB (24x 128 GB) 4800MT/s DDR5 DIMMs
(factory options, field upgradeable)
Local Disk • 2x 3.84 TB NVMe PCIe4.0 Drives – expandable to 4x 3.84 TB (hot swappable)

Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active
• Two dual-port SFP28 10/25G ethernet NIC
Network (optional, Up to 3 of the following (any combination):
field install) • Dual port QSFP28 100G ethernet NIC (field install)
• Dual-port SFP28 10/25G ethernet NIC (field install)
• Quad-port RJ45 10G ethernet NIC (field install)
Remote Management • 1x ethernet port (ILOM)
• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

18 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Server Eighth Rack Configuration
32-core 4th Generation AMD EPYC™ CPUs with up to 1.5 TB of Memory

Processor • 1x 32-core AMD EPYC™ 9334 Processors

DDR5 Memory • 384 GB (12x 32 GB) / 768 GB (12x 64 GB) / 1.5 TB (12x 128 GB) 4800MT/s DDR5 DIMMs
(factory options, field upgradeable)
Local Disk • 2x 3.84 TB NVMe PCIe4.0 Drives – expandable to 4x 3.84 TB (hot swappable)

Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active
• Two dual-port SFP28 10/25G ethernet NIC
Network (optional, One of the following:
field install) • Dual port QSFP28 100G ethernet NIC (field install)
• Dual-port SFP28 10/25G ethernet NIC (field install)
• Quad-port RJ45 10G ethernet NIC (field install)
Remote Management • 1x ethernet port (ILOM)
• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

19 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Database Server
96-core 4th Generation AMD EPYC™ CPUs with up to 3 TB of Memory

Processor • 2x 96-core AMD EPYC™ 9J14 Processors

DDR5 Memory • 1.5 TB (24x 64 GB) / 3 TB (24x 128 GB) 4800MT/s DDR5 DIMMs
(factory options, field upgradeable)
Local Disk • 4x 3.84 TB NVMe PCIe4.0 Drives

Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active
• Two dual-port SFP28 10/25G ethernet NIC
Network (optional, Up to indicated quantity of each of the following (or any combination):
field install) • Up to 1 of Dual-port SFP28 10/25G ethernet NIC (field install)
• Up to 2 of Quad-port RJ45 10G ethernet NIC (field install)

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

20 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Database Server Base System Configuration
32-core 4th Generation AMD EPYC™ CPUs with 768 GB of Memory

Processor • 1x 32-core AMD EPYC™ 9334 Processors

DDR5 Memory • 768 GB (12x 64 GB) 4800MT/s DDR5 DIMMs

Local Disk • 2x 3.84 TB NVMe PCIe4.0 Drives

Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active
• Two dual-port SFP28 10/25G ethernet NIC
Network (optional, • One Quad-port RJ45 10G ethernet NIC (field install)
field install)

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

21 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Machine – Storage Server Options

Eighth Rack High


Capacity (HC) Extreme Flash(EF) Extended(XT)
Capacity (HC)
• 2x 32-core AMD EPYC™ Genoa • 2x 32-core AMD EPYC™ Genoa • 1x 32-core AMD EPYC™ Genoa • 1x 32-core AMD EPYC™ Genoa
processors processors processors processors
• 256 GB DDR5 Memory • 256 GB DDR5 Memory • 128 GB DDR5 Memory • 256 GB DDR5 Memory
• 1.25 TB Exadata RDMA • 1.25 TB Exadata RDMA • 512 GB TB Exadata RDMA
• none
Memory Memory Memory

• 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe

• 12x 22 TB 7200rpm hard disk • 4x 30.72 TB capacity- • 12x 22 TB 7200rpm hard disk • 6x 22 TB 7200rpm hard disk
drives optimized NVMe Flash Cards drives drives
• 4x 6.8 TB F680 NVMe PCIe4.0 • 4x 6.8 TB F680 NVMe PCIe4.0 • 2x 6.8 TB F680 NVMe PCIe4.0
• none
Flash Cards Flash Cards Flash Cards

• 1x dual-port QSFP28 100Gb/s • 1x dual-port QSFP28 100Gb/s • 1x dual-port QSFP28 100Gb/s • 1x dual-port QSFP28 100Gb/s
RDMA Network Fabric Adapter RDMA Network Fabric Adapter RDMA Network Fabric Adapter RDMA Network Fabric Adapter

22 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Database Machine – Storage Server Options

Base System
Capacity (HC)
High Capacity (HC)
• 2x 32-core AMD EPYC™ Genoa • 1x 32-core AMD EPYC™ Genoa
processors processors
• 256 GB DDR5 Memory • 256 GB DDR5 Memory

• 1.25 TB Exadata RDMA Memory • none

• 2x 480 GB M.2 SSD NMVe • 2x 480 GB M.2 SSD NMVe

• 12x 22 TB 7200rpm hard disk • 6x 22 TB 7200rpm hard disk


drives drives
• 4x 6.8 TB F680 NVMe PCIe4.0 • 2x 6.8 TB F680 NVMe PCIe4.0
Flash Cards Flash Cards

• 1x dual-port QSFP28 100Gb/s • 1x dual-port QSFP28 100Gb/s


RDMA Network Fabric Adapter RDMA Network Fabric Adapter

23 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M High Capacity (HC) Storage Server
32-core 4th Generation AMD EPYC™ CPUs, XRMEM, NVMe Flash Cards

Processor • 2x 32-core AMD EPYC™ 9334 Processors

Total DDR5 Memory • 1.5 TB (24x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 1.25 TB
Drives • 4x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 12x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Disk Controller • Disk Controller HBA

Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

24 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Extreme Flash (EF) Storage Server
32-core 4th Generation AMD EPYC™ CPUs, XRMEM, NVMe Flash Cards, No Spinning Drives

Processor • 2x 32-core AMD EPYC™ 9334 Processors

Total DDR5 Memory • 1.5 TB (24x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 1.25 TB
Drives • 4x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 4x 30.72 TB capacity-optimized 2.5-inch NVMe PCIe Gen4 SSD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

25 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Extended (XT) Storage Server
32-core 4th Generation AMD EPYC™ CPU

Processor • 1x 32-core AMD EPYC™ 9334 Processor

DDR5 Memory • 128 GB (4x 32 GB) 4800 MT/s DDR5 DIMMs

Drives • 12x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)


• 2x 480 GB NVMe M.2 (hot-pluggable)

Disk Controller • Disk Controller HBA

Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

26 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Eighth Rack High Capacity (HC) Storage Server
32-core 4th Generation AMD EPYC™ CPU, XRMEM, NVMe Flash Cards

Processor • 1x 32-core AMD EPYC™ 9334 Processors

Total DDR5 Memory • 768 GB (12x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 512 GB
Drives • 2x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 6x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Disk Controller • Disk Controller HBA

Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

27 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Eighth Rack Extreme Flash (EF) Storage Server

• Exadata X10M Eighth Rack Extreme Flash (EF) Storage Server is not available

28 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Storage Server
32-core 4th Generation AMD EPYC™ CPUs, XRMEM, NVMe Flash Cards

Processor • 2x 32-core AMD EPYC™ 9334 Processors

Total DDR5 Memory • 1.5 TB (24x 64 GB) 4800 MT/s DDR5 DIMMs
System Memory • 256 GB
Memory Acceleration • 1.25 TB
Drives • 4x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 12x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Disk Controller • Disk Controller HBA

Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

29 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Base System Storage Server*
32-core 4th Generation AMD EPYC™ CPU, XRMEM, NVMe Flash Cards

Processor • 1x 32-core AMD EPYC™ 9334 Processors

Total DDR5 Memory • 256 GB (8x 32 GB) 4800 MT/s DDR5 DIMMs

Drives • 2x 6.8 TB performance-optimized Flash Accelerator F680 PCIe Gen4 NVMe (hot pluggable)
• 6x 22 TB 3.5-inch 7200rpm SAS3 HDD (hot swappable)
• 2x 480 GB NVMe M.2 (hot-pluggable)
Disk Controller • Disk Controller HBA

Network • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active

Remote Management • 1x ethernet port (ILOM)


• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

*Available for Base System ExaC@C Machines only

30 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
ExaC@C X10M Control Plane Server
32-core 4th Generation AMD EPYC™ CPUs with 128 GB of Memory

Processor • 1x 32-core AMD EPYC™ 9334 Processors

DDR5 Memory • 128 GB (4x 32 GB) 4800MT/s DDR5 DIMMs

Local Disk • 2x 3.84 TB NVMe PCIe4.0 Drives

Network (installed) • One dual-port QSFP28 100G RDMA Ethernet NIC (PCIe5.0) – both ports active
• One dual-port SFP28 10/25G NIC
• One Quad-port RJ45 10G ethernet NIC
Network (optional, No expansion options
field install)
Remote Management • 1x ethernet port (ILOM)
• 1x ethernet port (eth0)
Power Supply Redundant hot swappable power supplies and fans

31 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M – In-Factory Configurations

• Database Server Client Connectivity


• All database servers ship with two dual-port 25GBE Network Cards

• Database Server Memory Capacity


• Choose from 512GB, 1.5 TB or 3 TB per database server (Quarter Rack)
• Choose from 384GB, 768 GB or 1.5 TB per database server (Eighth Rack)

• Visible in configurator
• Choose Base/Quarter Rack
• Choose configuration of initial servers
• Choose additional servers
• Example later in presentation

32 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Server Memory Configuration
Factory Installed Choice of Memory Capacity

• Choose from three memory capacities on Exadata X10M Database Servers:


• 3 TB (24x 128 GB DDR5 DIMMs)
• 1.5 TB (24x 64 GB DDR5 DIMMs)
• 512 GB (16x 32 GB DDR5 DIMMs)

• Choose from three memory capacities on Exadata X10M Eighth Rack Database Servers:
• 1.5 TB (12x 128 GB DDR5 DIMMs)
• 768 GB (12x 64 GB DDR5 DIMMs)
• 384 GB (12x 32 GB DDR5 DIMMs)

33 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Server Memory Upgrades (Field Upgrade)

Exadata X10M Memory Expansion Kit


- Marketing Part Number: 7605989 - Exadata X10M XRMEM Memory Expansion Kit - Twenty four 64 GB DIMMs
- Marketing Part Number: 7605030 - Exadata X10M Memory Expansion Kit - Twenty four 128 GB DDR5 DIMMs

• Expands memory configuration of the X10M Database Server


- From 512 GB to 1.5 TB using 64 GB DIMMs (1x kit) – replace existing
- From 512 GB or 1.5 TB to 3 TB using 128 GB DIMMs (1x kit) – replace existing
• Expands memory configuration of the X10M Eighth Rack Database Server
- From 384 GB to 768 GB per Database Server using 64 GB DIMMs (1x kit for two servers) – replace existing
- From 384 GB or 768 GB to 1.5 TB per Database Server using 128 GB DIMMs (1x kit for two servers) – replace existing

• Notes
- No option to expand memory on Exadata X10M Storage Servers
- Previous generation memory not compatible with X10M (and vice versa)

34 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Network Expansion Options
Network Expansion – Field Upgrade

• Exadata X10M Database Servers come with Dual 25G Dual 25G

• 2x Dual 25G Network Adapters

• Up to 3x additional slots available for networking, choose from


• Dual 100G Network Card (QSFP28), or Dual 100G / Dual 25G / Quad 10G

• Dual 25G Network Card (SFP28), or


• Quad 10G Network Card (RJ45), or
• Combination of above

Dual 25G Dual 25G

Field Upgrade Slot

36 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Network Port Mapping

Eth1-4 Eth5-8 Eth9-12 Eth13-16 Eth21-24 Eth29-32 Eth33-36

ROT Not Used


Dual 25G Dual 25G

4 1
3
2
2
1

Quad-port NIC Dual-port NICs


(Bottom to Top) (Top to bottom)

38 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Database Machine Elevation Change
42
41

• Database Server changes from 1RU (& 5RU) to 2RU 40


39
38

• Eighth Rack continues with 2x Database + 3x Storage Servers 37


36
35

• Quarter Rack continues with 2x Database + 3x Storage Servers 34


33
32

• Elastic Rack (total number of servers varies depending on power requirements) 31


30

• Minimum 2x Database Servers and 3x Storage Servers 29


28
27
• Maximum 15x Database Servers (512GB or 1.5TB Memory) 26
25

• Maximum 11x Database Servers (3TB Memory) 24


23


22
Maximum 16x HC Storage Servers and 17x EF Storage Servers 21
20

• Storage Expansion Rack up to a total of 19x servers 19


18
17
• Minimum 4x HC or EF Storage Servers per rack 16
15

• Up to 14 additional HC Storage Servers 14


13

• Up to 15 additional EF Storage Servers


12
11
10
• Up to 15 additional XT Storage Servers 09
08
07
06
05
Use OECA (Oracle Exadata Configuration Assistant) to create your desired Exadata configuration. Maximum configurations will vary 04
depending on server memory capacity, power requirements, PDU capacity, etc. OECA will ensure that your configurations are valid. 03
02
https://www.oracle.com/database/technologies/oeca-download.html 01

39 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata Database Machine X10M Exadata 10M Elastic Examples
Elastic Configuration
• Start with a Quarter Rack
• 2x Exadata X10M Database Servers
• 3x Exadata X10M High Capacity (HC) or 3x Extreme Flash (EF) Storage Servers
• Add more Exadata X10M Database Servers (2RU each in size) :
• Up 13x Database Servers with 512GB or 1.5TB Memory
• Up 9x Database Servers with 3TB Memory
• Add more Exadata X10M Storage Servers (2RU each in size):
• Up to 13x HC Storage Servers
• Up to 14x EF Storage Servers
• Up to 14x XT Storage Servers
• Can mix Extreme Flash, High Capacity, and Extended Storage Servers in the
same rack
• Minimums for redundancy apply (2x NR, 3x HR)
• Embedded Hardware
• 2x Cisco Nexus 9336C-FX Switch (leaf)
36-port Managed QSFP28 (100GbE) switch
• 1x Cisco 9348 Switch (management)
• Redundant Power Distribution Units
• Optional Hardware
• 1x Cisco Nexus 9336C-FX2 Switch (spine)
12x Database Servers + 6x Database Servers +
5x HC Storage Servers 12x HC Storage Servers
Use OECA available to model performance and environmental metrics

40 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata Database Machine X10M Exadata 10M
Storage Expansion Configuration Storage Expansion Rack Examples

• Start with a Quarter Rack


• 4x Exadata X10M High Capacity (HC) Storage Servers, or
• 4x Exadata X10M Extreme Flash (EF) Storage Servers
• Add more Exadata X10M Storage Servers (2RU each in size):
• Up to 14x HC Storage Servers
• Up to 15x EF Storage Servers
• Up to 15x XT Storage Servers
• Can mix Extreme Flash, High Capacity, and Extended Storage
Servers in the same rack
• Minimums for redundancy apply (2x NR, 3x HR)
• Embedded Hardware
• 2x Cisco Nexus 9336C-FX Switch (leaf)
36-port Managed QSFP28 (100GbE) switch
• 1x Cisco 9348 Switch (management)
• Redundant Power Distribution Units
• Optional Hardware
• 1x Cisco Nexus 9336C-FX2 Switch (spine)

Use OECA available to model performance and environmental metrics

42 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M
Environmental Information

43 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata Database Machine Component Environmental Specifications

44 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata Database Machine Environmental Specifications

45 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Rack Power Considerations

• Exadata X10M database server with 3TB memory has higher power
requirements and requires different cabling arrangement in the rack
• In OECA, under “Rack Generation”, there are two options:
- “X10M”: rack cabling is optimized for 512GB and 1.5TB configurations
- “X10M (3TB DB)”: rack cabling is optimized for 3TB configurations
• In OECA, under “Database Server Generation”, there are two options:
- “Exadata X10M DB”: database server with 512GB or 1.5TB memory
- “Exadata X10M DB (3TB)”: database server with 3TB memory
• Recommendation when using OECA:
- If you need database servers with 3TB memory, select the “X10M (3TB DB)” under Rack
Generation, then select “Exadata X10M DB (3TB)” for your server
- If you need database servers with 512GB or 1.5TB memory, select the “X10M” under
Rack Generation, then select “Exadata X10M DB” for your server
- Refer to FAQ in next slide for other scenarios

• How does the CPQ/Configurator handle this?


- It is handled in the background, automatically; there is no option for rack type
- The Exadata system will ship with the proper rack cabling for the selected database server

46 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
CPQ/Configurator Base System and DB Server Screenshots

47 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Rack Power Considerations - FAQ

Q: Why should I use OECA to model my Exadata configuration? Q: How about CPQ/Configurator? What are the rules around this?
- In addition to facilitating the scoping and analyzing of elastic - It determines the type of rack depending on the database server you select.
configurations, OECA also validates your Exadata configuration on power There is no option to select the rack type.
requirements, PDU size, weight distribution, etc. - If you select a Quarter Rack with 512GB or 1.5TB database servers and add
any 3TB server, it will error out indicating to select a Quarter Rack with a 3TB
Q: Should I model the Exadata configuration I want to purchase in database server instead.
OECA? - If you select a Quarter Rack with 3TB database servers, then you are allowed
- Yes, you must. It will provide you with detailed information on weight, to add 512GB or 1.5TB database servers. It is recommended to use database
usable capacity, PDU size to order, power and cooling requirements, etc. servers with the same memory size.
With this information, the quoting and booking in CPQ/Configurator will go
smoothly. Q: Can I mix 3TB memory database servers with 512GB or 1.5TB
memory servers?
Q: Why are there two rack options in OECA for Exadata X10M? Prior
- Yes, it is possible. Months or years after the Exadata purchase, customer
generations only had one rack option. requirements may change, and some servers need to be upgraded to 3TB
- To accommodate the database server with 3TB of memory. This server has memory. Use OECA to model your desired configuration and ensure that it is
higher power requirements than the 512GB and 1.5TB memory options, OK with your current rack.
and it needs a different power cabling configuration in the rack.
- Note that CPQ/Configurator allows ordering a quarter rack with 3TB
Q: Why does OECA allow adding a 3TB database server to the database servers and mixing lower memory configuration database servers.
“X10M” Rack when it should force it to use the “X10M (3TB DB)”
Q: Are the X10M PDU Cabling Tables the same as Exadata X9M-2?
rack? - No, the X10M PDU tables are updated to reflect the greater power demands
- This option should only be used after the purchase of the Exadata system. of the X10M storage servers
If you purchased a 512GB or 1.5TB, but later you have a need to increase
the memory capacity of some of these servers, you can use OECA to model
your desired configuration to ensure that the changes are OK with your
current rack.

48 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Onsite Re-Racking

• Use Oracle Exadata Configuration Assistant (OECA) to determine if current configuration is approved
for re-rack
• Additional re-rack service fee in addition to standard HW installation and SW configuration fees
• Re-racking performed at customer location by Oracle HW service engineers prior to standard install
• Information in OECA re-rack presentation available at database.us.oracle.com

49 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M Data Center Deployment

• Use Oracle Exadata Configuration Assistant (OECA) to determine configuration power, weight and cooling requirements
• Each data center has a unique environment, therefore a universal optimal deployment is not possible
• All cooling options that do not change or interfere with the rack internals, while providing adequate cold air inflow and head
exhaust to satisfy the Exadata rack requirements are allowed
• Examples include perforated tiles, cold/hot aisle containment, active/passive chimney, close coupled cooling, etc
• Inadequate cold air flow could result in higher air inlet temperatures in the servers due to exhaust air recirculation, which
could lead to failure of components

Rack Front Rack Rear


Cold Air Inlet Hot Air Outlet

50 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Exadata X10M RoCE Internal Fabric

51 Copyright © 2023, Oracle and/or its affiliates | Confidential: Highly Restricted [Date]
Exadata Uses RDMA for Extreme Performance

• RDMA is an integral part of the Exadata high-performance architecture enabling


• High throughput and low-CPU usage for large data transfers
• Exadata RDMA Memory Data Accelerator enables orders of magnitude lower latency
• Unique Direct-to-Wire Protocol to deliver 3x faster inter-node OLTP cluster messaging
• Unique RDMA protocol to coordinate transactions between nodes

• Exadata RoCE provides RDMA speed and reliability on Ethernet fabric


• 100Gb/s active-active bandwidth with X10M and PCIe5
• Zero packet loss messaging
• Prioritization of critical database messages
• Latest KVM-based virtualization
• Secure Isolation of Storage Traffic

52 Copyright © 2023, Oracle and/or its affiliates | Confidential: Highly Restricted [Date]
Exadata X10M RDMA Network Fabric

• Cisco Nexus 9336C-FX2 QSFP28 (100GbE) Ethernet Switches


• Delivers a network infrastructure using Ethernet as the unified fabric that
facilitates deployment, maintenance and upgrades
• Administers reliable Ethernet workloads that do not tolerate loss

• 2x Leaf switches standard per rack for redundant connectivity of servers within
the rack

• 1x Spine switch per rack required if Exadata rack will be connected via RoCE to
other racks
• Added at the factory when chosen during the ordering process
• Added in the field when chosen after the initial ordering process

53 Copyright © 2023, Oracle and/or its affiliates | Confidential: Highly Restricted [Date]
Exadata X10M-2 RDMA Network Fabric Multi-rack

• Single RDMA Network Fabric Network across all connected racks

• Connect up to 14 Racks with no external switches


• Every leaf uplinked to every spine switch
• Leaf switches do not connect to other leaf switches; likewise, spine switches do not connect with other spine
switches
• Exadata Database and Storage Server cabling unchanged
• Inter-rack cabling performed at installation time

• Database Machine racks do not include the third spine switch by default
• Need to install spine switch (Expansion Switch Kit) when inter-connecting multiple racks

• Need to configure inter-rack cables with appropriate lengths


• Copper or Optical depending on distance

• Refer to the Database Machine Owner’s Guide for exact port mappings

54 Copyright © 2023, Oracle and/or its affiliates | Confidential: Highly Restricted [Date]
Exadata X10M Interoperability
Client and Backup Network Details

55 Copyright © 2023, Oracle and/or its affiliates | Confidential: Highly Restricted [Date]
Exadata Database Machine

• The ultimate platform for all database workloads


• OLTP, Warehousing, Database as a Service
• Most advanced hardware
• Fully scale-out servers and intelligent storage with
unified RDMA Network Fabric connectivity and PCI
flash with Memory Acceleration
• Most advanced software
• Database optimized compute, storage, and
networking algorithms dramatically improve
performance and cost
• Standardized, optimized, hardened end-to-end

57 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Thank you
Text
Text

58 Copyright © 2023, Oracle and/or its affiliates | Confidential: For Internal and Authorized OPN Partners Use Only
Our mission is to help people see
data in new ways, discover insights,
unlock endless possibilities.

You might also like