Oracle Exalogic Elastic Cloud - Network Diagram for Exalogic Machine

To Next Page

To Previous Page

• Additional networks (optional): Each Sun Network QDR InfiniBand Gateway

Switch has eight 10 Gb Ethernet ports. The number of ports used in Exalogic

deployment depends on your specific bandwidth requirements (how many 10 Gb

ports can be shared per compute node) and on your specific LAN/VLAN

connection requirements. A group of 16 compute nodes connects 2 Sun Network

QDR InfiniBand Gateway Switches in an active-passive bond. Each compute node

is connected to two separate Sun Network QDR InfiniBand Gateway Switches for

HA.

Note that each compute node requires a bond for each external network (physical

network or VLAN).

Figure 6-1 shows the network diagram for the Exalogic machine with Oracle Linux

operating system.

Figure 6-1 Network Diagram for Exalogic Machine

Overview of Network Requirements

6-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Main Page

Default Chapter3
- Table of Contents3
- Preface17
1 Learn about the Exalogic Machine21
- About Oracle Exalogic21
  - Features of Exalogic21
- Hardware Components of Exalogic22
- Exalogic Machine Rack Layout23
- Operational Procedures for Exalogic Machines24
2 Site Requirements27
- Environmental Requirements27
- Space Requirements27
- Flooring Requirements29
- Electrical Power Requirements29
- Temperature and Humidity Requirements32
- Temperature, Humidity, and Altitude Requirements32
- Ventilation and Cooling Requirements33
- Typical Data Center Configuration for Perforated Floor Tiles34
3 Install Planning and Procedure35
- Installation Overview35
- Prepare to Install an Exalogic Machine36
- Power on the System the First Time46
- Connect a Laptop to the Exalogic Machine52
- What Next54
4 Default IP Addresses and Ports55
- Exalogic Machine Full Rack55
- Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack55
- Exalogic Machine Half Rack58
- Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack58
- Exalogic Machine Quarter Rack60
- Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack61
- Exalogic Machine Eighth Rack63
- Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack64
- Default Port Assignments66
- Default Ports67
5 Add the Exalogic Machine to Your Network71
- Default State of the Exalogic Machine Network Configuration71
- Verify the Factory Configuration71
- Prerequisites for Connecting Exalogic Machine to External Ethernet Network75
- Initial Network Configuration of Exalogic Machine75
  - Configuring the Cisco Ethernet Switch75
6 Understand Network Requirements and Configuration83
- Overview of Network Requirements83
- Available Network Components and Interfaces on the Compute Nodes and Storage Appliance83
- Network Diagram for Exalogic Machine86
- Naming Conventions87
- Important Notes for Oracle Solaris Users87
- Network Connection and IP Address Requirements87
- Default Infiniband Bonded IP Addresses92
- Introduction to Oracle Exalogic Network Configuration92
- Prepare to Reconfigure the Networking of Exalogic Machine98
- Subnet Manager Requirements for Connecting Exalogic to Exadata98
- Network Configuration Worksheets98
7 Set up ILOM on the Compute Nodes103
- ILOM Overview103
  - ILOM Interfaces104
- Important Notes before You Begin104
- Management Network Diagram for Exalogic Machine104
- ILOM IP Addresses for Exalogic Machine Components105
- Connect to ILOM Via the Network105
- Connect to ILOM Via a Serial Connection107
  - Connect to the ILOM of a Compute Node107
  - Connect to the ILOM of a Sun Network QDR Infiniband Gateway Switch108
- Reconfigure the Network Access108
- What Next111
8 Configure the Storage Appliance113
- Prerequisites113
- Getting Started113
- Storage Appliance Overview115
  - Introduction to Projects115
  - Introduction to Shares115
- Configuration Overview115
- Create Custom Projects127
- Project Settings127
- Create Custom Shares129
- Create Filesystem130
- File System Access Types and Permissions130
- Case Sensitivity Values131
- Use the Phone Home Service to Manage the Storage Appliance132
  - Normalization Settings132
  - Register Your Storage Appliance133
9 Configure NFS Version 4 on Exalogic135
- Overview135
- Verify the NIS Setting on Exalogic136
- Configure the Storage Appliance136
- Configure an Exalogic Linux Compute Node to Use Nfsv4138
- NIS Service138
- Create Nfsv4 Mount Points on Oracle Linux140
10 Configure Ethernet over Infiniband141
- Introduction to Virtual Nics (Vnics)141
  - VNIC Resource Limit141
- Set up Ethernet over Infiniband (Eoib) on Oracle Linux142
- Set up Ethernet over Infiniband (Eoib) on Oracle Solaris147
  - Set up Ethernet over Infiniband on Oracle Solaris 11.1147
  - Set up Ethernet over Infiniband on Oracle Solaris 11.2147
11 Set up Virtual Lans157
- Introduction to VLAN157
- Example Scenario157
- Tag the Ethernet Connectors with a VLAN Identifier158
- Oracle Linux: Creating Vnics and Associating Them with Vlans159
- Oracle Solaris: Creating Vnics and Associating Them with Vlans160
12 Use the Infiniband Gateway Switches163
- Using Sun Network QDR Infiniband Gateway Switches163
- What Next170
13 Manage the Infiniband Network Using Subnet Manager171
- Understand Administrative Commands171
  - Hardware Command Overview171
  - Infiniband Command Overview171
- Manage Infiniband Network Using Subnet Manager172
- Work with the Default Rack-Level Infiniband Partition175
  - Partition in Exalogic Machine176
  - Verify the Default Partition176
14 Use the Sun Datacenter Infiniband Switch 36 in Multirack Configurations177
- Physical Specifications177
- Sun Datacenter Infiniband Switch 36 Specifications177
- Access the CLI of a Sun Datacenter Infiniband Switch 36178
- Verify the Switch Status178
- Start the Subnet Manager in Multirack Configuration Scenarios180
- Check Link Status181
- Verify the Infiniband Fabric in a Multirack Configuration181
- Monitor the Spine Switch Using Web Interface184
- What Next184
15 Monitor and Control the Infiniband Fabric185
- Monitor the Infiniband Fabric185
- Control the Infiniband Fabric195
- For more Information198
16 Use Infiniband Partitions in Exalogic Physical Environments199
- Overview of Partitioning199
- Understand Partition Keys200
  - Guidelines for Managing Pkey Allocation in a Hybrid Rack200
- Before You Begin201
- Move from a Default Partition to a Custom Partition203
- Create an Ipoib Partition and Adding Ports204
- Delete a Partition207
- Create a Partition for Eoib and Associating the Pkey with a VNIC and VLAN207
- Perform the Post-Configuration Steps213
- Important Notes for Combined Exalogic-Exadata Fabric Users213
- Partitioning Limitations214
17 Monitoring the Exalogic Machine Using Oracle Enterprise Manager Ops Center215
- Overview216
- Key Features216
- Prerequisites217
- Accessing Oracle Enterprise Manager Ops Center Documentation217
- Launching Oracle Enterprise Manager Ops Center217
- Understanding the Workflow218
- Oracle Enterprise Manager Home Page218
- Management of Exalogic Machine Hardware Using Oracle Enterprise Manager Ops Center219
- Managing Users and Roles220
- Discovering and Managing Exalogic Machine Hardware220
- Custom Asset Discovery Screen221
- Grouping Exalogic Machine Hardware Assets223
  - Prerequisites223
  - Creating the Exalogic Top-Level Group223
  - Configure Group224
  - Creating a Sub-Group for Exalogic Compute Nodes225
  - Group Summary Screen225
  - Creating a Sub-Group for the Storage Appliance226
  - Configure Sub-Group for Compute Nodes226
  - Configure Sub-Group for Storage Appliance227
  - Creating a Sub-Group for Infiniband Switches228
  - Adding Assets to a Group229
  - Configure Sub-Group for Infiniband Switches229
- Viewing Exalogic Compute Nodes230
- Exalogic Group View231
- Compute Node Hardware Information232
- Viewing Infiniband Switches233
- Launching Service Processor Console233
- Switch View234
- Switch Hardware Information235
- Viewing the Storage Appliance236
- Storage Appliance View236
- Storage Appliance Hardware View237
- Viewing the Infiniband Fabric and Its Nodes238
- Viewing Shares Configured on the Storage Appliance238
- Fabric View239
- Viewing a Switch in the Fabric240
- Switch Port Monitoring241
- About Problem Management242
- Viewing the Storage Appliance in the Fabric242
- Using Monitoring Profiles and Rules243
  - Creating a Monitoring Profile243
  - Adding a Monitoring Rule from the Asset View244
- Using Reports in Oracle Enterprise Manager Ops Center245
- Using Oracle Services in Oracle Enterprise Manager Ops Center246
  - Prerequisites for Using Oracle Services in Oracle Enterprise Manager Ops Center246
  - Viewing Service Requests247
  - Filing a Service Request249
18 Install the ASR Software251
- About Oracle Auto Service Request (ASR)251
- Recommended Configuration252
- Before You Begin252
- Prerequisites for Installing ASR Manager252
- Install ASR Manager on a Standalone System252
- Register the ASR Manager254
- Activate ILOM for Exalogic Compute Nodes254
- Activate the Storage Appliance254
- Phone Home Tab on the List of Services255
- Approve and Verify ASR Activation for Exalogic Machine Assets256
A Configure the Exalogic Machine Using ECU259
- Overview259
- Important Notes before You Use the ECU259
- Configuration Tasks260
B Site Checklists261
- System Components Checklist261
- Data Center Room Checklist262
- Data Center Environment Checklist263
- Access Route Checklist263
- Facility Power Checklist265
- Power Checklist266
- Safety Checklist266
- Logistics Checklist267
- Network Specification Checklist268
- Reracking Checklists270
  - Rack Recycling272
C Cabling Diagrams273
- Exalogic Eighth Rack273
- Exalogic Quarter Rack274
- Exalogic Eighth Rack Network Connectivity274
- Exalogic Half Rack275
- Exalogic Quarter Rack Network Connectivity275
- Exalogic Half Rack Network Connectivity275
- Exalogic Full Rack276
- Exalogic Full Rack Network Connectivity276
- Rack-Level Frus for Exalogic X4-2277
500 D Replacement Units278
- Rack-Level Replacement Parts for el X5-2278
- Rack-Level Replacement Parts for el X4-2278
- D.1 Rack-Level Frus for Exalogic X5-2278
- Rack-Level Frus for Exalogic X2-2 and X3-2279
- Rack-Level Replacement Parts for el X2-2 and X3-2279
- Parts for ZS3-ES Storage Appliance for Exalogic X5-2280
- Replacement Parts for Oracle ZS3-ES Appliance280
- Parts for ZS3-ES Storage Appliance for Exalogic X4-2281
- Parts for Sun ZFS Storage 7320 Appliance282
- Replacement Parts for Sun ZFS Storage 7320 Appliance282
- Parts for Oracle Server X5-2 Compute Nodes283
- Replacement Parts for Oracle Server X5-2 Compute Nodes283
- Parts for Sun Server X4-2 Compute Nodes284
- Replacement Parts for Sun Server X4-2 Compute Nodes284
- Parts for Sun Server X3-2 Compute Nodes285
- Replacement Parts for Sun Server X3-2 Compute Nodes285
- Parts for X4170 M2 Compute Nodes286
- Replacement Parts for X4170 M2 Compute Nodes286
- Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X5-2287
- Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X4-2288
- Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X2-2 and X3-2288
- Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X5-2 Machines288
- Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X4-2 Machines288
- Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X2-2 and X3-2 Machines289
- Replacement Parts for the Cisco Catalyst 4948E-F-S Switch290
- D.16 Parts for Sun Datacenter Infiniband Switch 36 for Exalogic X2-2 and X3-2290
- Parts for the Cisco Catalyst 4948E-F-S Switch291
- Parts for the Cisco Catalyst 4948 Switch291
- Parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2291
- Parts for the Gari DE2-24C Disk Enclosure291
- Replacement Parts for Cisco Catalyst 4948 Switch291
- Replacement Parts for Gari DE2-24C Disk Enclosure291
E Cabling Tables293
- Administrative Gigabit Ethernet Network-Cabling Tables293
- E.2 Infiniband Network Cabling Tables299
- Power Distribution Unit Cabling Tables314
F Manage Solaris Zones on Exalogic325
- Requirements325
- Terminology325
- Create a Solaris Zone326
  - Prerequisites326
  - Set up a Solaris Zone332
- Migrate a Zone to a New Host336
G Customize Linux on the Compute Nodes339
- Rpms that Must Not be Modified or Removed339
- Prepare the Compute Nodes for Yum Updates340
- Install, Update, and Remove Rpms Using Yum340

Oracle Exalogic Elastic Cloud - Network Diagram for Exalogic Machine

Table of Contents

Related product manuals