Home
Oracle
Server
Exalogic Elastic Cloud
Oracle Exalogic Elastic Cloud User Manual
5
of 1
of 1 rating
342 pages
Give review
Manual
Specs
To Next Page
To Next Page
To Previous Page
To Previous Page
Loading...
Table E-21 (Cont.) Three Phase PDU Power Cabling for Exalogic Machine Eighth
Rack
From Rack
Unit
Type of Equipment
PDU-A
PDU-B
Jumper Length
U05
Compute node
G0-4
G3-2
2M
U04
Compute node
G0-3
G3-3
2M
U03
Compute node
G0-2
G3-4
2M
U02
Compute node
G0-1
G3-5
2M
Power Distribution Unit Cabling Tables
Cabling Tables
E-31
322
324
Table of Contents
Default Chapter
3
Table of Contents
3
Preface
17
Audience
17
Revision History
17
Documentation Accessibility
20
Related Documents
20
Conventions
20
1 Learn about the Exalogic Machine
21
About Oracle Exalogic
21
Features of Exalogic
21
Hardware Components of Exalogic
22
Pdus in Exalogic
23
Spares Kit for Exalogic
23
Pre-Cabling for Exalogic X4-2 and Newer Machines
23
Exalogic Machine Rack Layout
23
Operational Procedures for Exalogic Machines
24
Hardware Components of Exalogic
24
Layout for All Exalogic Machine Configurations
24
Non-Emergency Power Procedure
25
Cautions and Warnings
26
Emergency Power-Off Considerations
26
2 Site Requirements
27
Environmental Requirements
27
Space Requirements
27
Receiving and Unpacking Requirements
28
Maintenance Access Requirements
28
Access Route Requirements
28
Flooring Requirements
29
Electrical Power Requirements
29
Floor Load Requirements for Exalogic Machine
29
Maintenance Access Requirements for Exalogic Machine
29
PDU Requirements for High Voltage
30
PDU Requirements for Low Voltage
30
Circuit Breaker Requirements
31
Facility Power Requirements
31
Grounding Guidelines
31
Temperature and Humidity Requirements
32
Temperature, Humidity, and Altitude Requirements
32
Ventilation and Cooling Requirements
33
Typical Data Center Configuration for Perforated Floor Tiles
34
3 Install Planning and Procedure
35
Installation Overview
35
Prepare to Install an Exalogic Machine
36
Before You Begin
36
Exalogic Installation Safety Guidelines
36
Unpack the Exalogic Machine Rack
37
Tools for Installation
38
Unpacking Exalogic Machine Rack
38
Prepare the Installation Site
39
Place the Exalogic Machine in Its Allocated Space
39
Location of Leveling Feet on Exalogic Machine
41
Securing Exalogic Machine Using the Leveling Feet
42
Location of Mounting Brackets on Rack
43
Bottom View of Exalogic Machine Showing Mounting Hole and Floor Cutout Dimensions
43
Base Position to Measure
44
Securing Exalogic Machine Using Mounting Brackets
45
Power on the System the First Time
46
Inspect the Machine after It Is in Place
46
Earth Ground Attachment Bolt Location
46
Connect the Power Cords
47
Power on the Exalogic Machine
48
Power Cord Routing from the Bottom of the Rack
48
Power Cord Routing Example from the Top of the Rack
48
PDU Switch Locations
49
Exalogic Compute Node LED Lights
50
Soft Switches on the Server Heads in the Sun ZFS Storage 7320 Appliance
50
Soft Switch and LED Lights on Server Heads
51
Connect a Laptop to the Exalogic Machine
52
What Next
54
4 Default IP Addresses and Ports
55
Exalogic Machine Full Rack
55
Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack
55
Exalogic Machine Half Rack
58
Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack
58
Exalogic Machine Quarter Rack
60
Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack
61
Exalogic Machine Eighth Rack
63
Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack
64
Default Port Assignments
66
Default Ports
67
5 Add the Exalogic Machine to Your Network
71
Default State of the Exalogic Machine Network Configuration
71
Verify the Factory Configuration
71
Prerequisites for Connecting Exalogic Machine to External Ethernet Network
75
Initial Network Configuration of Exalogic Machine
75
Configuring the Cisco Ethernet Switch
75
6 Understand Network Requirements and Configuration
83
Overview of Network Requirements
83
Available Network Components and Interfaces on the Compute Nodes and Storage Appliance
83
Network Diagram for Exalogic Machine
86
Naming Conventions
87
Important Notes for Oracle Solaris Users
87
Network Connection and IP Address Requirements
87
Network Connection Requirements
88
IP Address Requirements
89
IP Address Requirements for Exalogic Machine
90
Default Infiniband Bonded IP Addresses
92
Introduction to Oracle Exalogic Network Configuration
92
Infiniband Fabric
93
Infiniband Switches
93
Default Bonded Interfaces
93
IPMP Overview for Oracle Solaris Users
94
Connectivity between Exalogic Compute Nodes
95
Connectivity between Exalogic Machine and External LAN through Sun Network QDR Infiniband Gateway Switch
95
Connectivity between NM2-GW and External 10 GB Ethernet Switch
96
Additional Infiniband Network Requirements and Specifications
97
Transceivers and Cables
97
HCA, Port Specifications and Cable Requirements
97
Prepare to Reconfigure the Networking of Exalogic Machine
98
Subnet Manager Requirements for Connecting Exalogic to Exadata
98
Network Configuration Worksheets
98
General Network Configuration Worksheet
98
Management Network Configuration Worksheet
98
Client Access Network Configuration Worksheet
99
General Network Configuration Worksheet (Required)
99
Management Network Configuration Worksheet (Required)
99
Private Infiniband Network Configuration Worksheet
99
Client Access Network Configuration Worksheet (Required)
100
Private Infiniband Network Configuration Worksheet (Required)
101
7 Set up ILOM on the Compute Nodes
103
ILOM Overview
103
ILOM Interfaces
104
Important Notes before You Begin
104
Management Network Diagram for Exalogic Machine
104
ILOM IP Addresses for Exalogic Machine Components
105
Connect to ILOM Via the Network
105
Management Network in Exalogic Machine
105
Connect to the CLI
106
Connect to the Web GUI
106
Launch a Remote KVM Session
106
Connect to ILOM Via a Serial Connection
107
Connect to the ILOM of a Compute Node
107
Connect to the ILOM of a Sun Network QDR Infiniband Gateway Switch
108
Reconfigure the Network Access
108
Reconfigure the Network Access Using a Serial Connection
109
Reconfigure the Network Access Using the Ethernet Connection
109
Use the Ipmitool Commands When SP Network Information Is Lost
109
Configure ILOM IP Addresses Manually
110
Configuring ILOM IP Using Serial Port Connection
110
What Next
111
8 Configure the Storage Appliance
113
Prerequisites
113
Getting Started
113
Storage Appliance Overview
115
Introduction to Projects
115
Introduction to Shares
115
Configuration Overview
115
Initial Configuration
115
Connect Storage Heads to the Management Network and Accessing the Web Interface
116
Network Ports on the Storage Appliance
116
Network Configuration Screen
117
Cluster Network Configuration
118
Network Interface Settings
118
Network Configuration Options
119
Igb2 and Igb3 in an IPMP Group
121
Creating a New IPMP Group Interface
122
IPMP Network Interface Settings
124
Default Storage Configuration
125
Custom Configuration
126
Default Configuration of the Storage Appliance
126
Create Custom Projects
127
Project Settings
127
Create Custom Shares
129
Create Filesystem
130
File System Access Types and Permissions
130
Case Sensitivity Values
131
Use the Phone Home Service to Manage the Storage Appliance
132
Normalization Settings
132
Register Your Storage Appliance
133
9 Configure NFS Version 4 on Exalogic
135
Overview
135
Nfsv3
135
Nfsv4
135
Naming Service
135
Verify the NIS Setting on Exalogic
136
Configure the Storage Appliance
136
Configure the NFS Service
137
NFS Service
137
Configure the NIS Service
138
Configure an Exalogic Linux Compute Node to Use Nfsv4
138
NIS Service
138
Create Nfsv4 Mount Points on Oracle Linux
140
10 Configure Ethernet over Infiniband
141
Introduction to Virtual Nics (Vnics)
141
VNIC Resource Limit
141
Set up Ethernet over Infiniband (Eoib) on Oracle Linux
142
Set up Ethernet over Infiniband (Eoib) on Oracle Solaris
147
Set up Ethernet over Infiniband on Oracle Solaris 11.1
147
Set up Ethernet over Infiniband on Oracle Solaris 11.2
147
11 Set up Virtual Lans
157
Introduction to VLAN
157
Example Scenario
157
Tag the Ethernet Connectors with a VLAN Identifier
158
Oracle Linux: Creating Vnics and Associating Them with Vlans
159
Oracle Solaris: Creating Vnics and Associating Them with Vlans
160
12 Use the Infiniband Gateway Switches
163
Using Sun Network QDR Infiniband Gateway Switches
163
Physical Specifications
163
NM2-GW Specifications
163
Access the Command-Line Interface (CLI) of a Gateway Switch
164
Verify the Status of a Gateway Switch
164
Start the Subnet Manager Manually
166
Check Link Status
166
Verify the Infiniband Fabric
167
Monitor a Gateway Switch Using Web Interface
169
What Next
170
13 Manage the Infiniband Network Using Subnet Manager
171
Understand Administrative Commands
171
Hardware Command Overview
171
Infiniband Command Overview
171
Manage Infiniband Network Using Subnet Manager
172
Overview of Subnet Manager
172
Subnet Manager Operation in Different Rack Configurations
172
Running the Subnet Manager in Different Rack Configurations
172
Monitor the Subnet Manager
174
Control the Subnet Manager
174
Work with the Default Rack-Level Infiniband Partition
175
Partition in Exalogic Machine
176
Verify the Default Partition
176
14 Use the Sun Datacenter Infiniband Switch 36 in Multirack Configurations
177
Physical Specifications
177
Sun Datacenter Infiniband Switch 36 Specifications
177
Access the CLI of a Sun Datacenter Infiniband Switch 36
178
Verify the Switch Status
178
Start the Subnet Manager in Multirack Configuration Scenarios
180
Check Link Status
181
Verify the Infiniband Fabric in a Multirack Configuration
181
Discover the Infiniband Network Topology in a Multirack Configuration
182
Perform Diagnostics on the Infiniband Fabric in a Multirack Configuration
182
Check for Errors in the Infiniband Fabric in a Multirack Configuration
183
Monitor the Spine Switch Using Web Interface
184
What Next
184
15 Monitor and Control the Infiniband Fabric
185
Monitor the Infiniband Fabric
185
Identify All Switches in the Fabric
185
Identify All Hcas in the Fabric
185
Display the Infiniband Fabric Topology
186
Display a Route through the Fabric
187
Display the Link Status of a Node
188
Display Counters for a Node
188
Display Data Counters for a Node
189
Display Low-Level Detailed Information for a Node
189
Display Low-Level Detailed Information for a Port
190
Map Lids to Guids
191
Perform Comprehensive Diagnostics for the Entire Fabric
192
Perform Comprehensive Diagnostics for a Route
192
Determine Changes to the Infiniband Topology
192
Determine Which Links Are Experiencing Significant Errors
194
Check All Ports
194
Control the Infiniband Fabric
195
Clear Error Counters
195
Clear Data Counters
195
Reset a Port
195
Set Port Speed
196
Disable a Port
197
Enable a Port
198
For more Information
198
16 Use Infiniband Partitions in Exalogic Physical Environments
199
Overview of Partitioning
199
Understand Partition Keys
200
Guidelines for Managing Pkey Allocation in a Hybrid Rack
200
Before You Begin
201
Verify the Firmware of Infiniband Switch
201
Gather Port Guids of Compute Nodes and Bridgex Ports of Gateway Switches
201
Identify All Infiniband Switches in the Fabric
203
Determine the SM Priority on an Infiniband Switch
203
Move from a Default Partition to a Custom Partition
203
Create an Ipoib Partition and Adding Ports
204
Delete a Partition
207
Create a Partition for Eoib and Associating the Pkey with a VNIC and VLAN
207
Perform the Post-Configuration Steps
213
Important Notes for Combined Exalogic-Exadata Fabric Users
213
Partitioning Limitations
214
17 Monitoring the Exalogic Machine Using Oracle Enterprise Manager Ops Center
215
Overview
216
Key Features
216
Prerequisites
217
Accessing Oracle Enterprise Manager Ops Center Documentation
217
Launching Oracle Enterprise Manager Ops Center
217
Understanding the Workflow
218
Oracle Enterprise Manager Home Page
218
Management of Exalogic Machine Hardware Using Oracle Enterprise Manager Ops Center
219
Managing Users and Roles
220
Discovering and Managing Exalogic Machine Hardware
220
Custom Asset Discovery Screen
221
Grouping Exalogic Machine Hardware Assets
223
Prerequisites
223
Creating the Exalogic Top-Level Group
223
Configure Group
224
Creating a Sub-Group for Exalogic Compute Nodes
225
Group Summary Screen
225
Creating a Sub-Group for the Storage Appliance
226
Configure Sub-Group for Compute Nodes
226
Configure Sub-Group for Storage Appliance
227
Creating a Sub-Group for Infiniband Switches
228
Adding Assets to a Group
229
Configure Sub-Group for Infiniband Switches
229
Viewing Exalogic Compute Nodes
230
Exalogic Group View
231
Compute Node Hardware Information
232
Viewing Infiniband Switches
233
Launching Service Processor Console
233
Switch View
234
Switch Hardware Information
235
Viewing the Storage Appliance
236
Storage Appliance View
236
Storage Appliance Hardware View
237
Viewing the Infiniband Fabric and Its Nodes
238
Viewing Shares Configured on the Storage Appliance
238
Fabric View
239
Viewing a Switch in the Fabric
240
Switch Port Monitoring
241
About Problem Management
242
Viewing the Storage Appliance in the Fabric
242
Using Monitoring Profiles and Rules
243
Creating a Monitoring Profile
243
Adding a Monitoring Rule from the Asset View
244
Using Reports in Oracle Enterprise Manager Ops Center
245
Using Oracle Services in Oracle Enterprise Manager Ops Center
246
Prerequisites for Using Oracle Services in Oracle Enterprise Manager Ops Center
246
Viewing Service Requests
247
Filing a Service Request
249
18 Install the ASR Software
251
About Oracle Auto Service Request (ASR)
251
Recommended Configuration
252
Before You Begin
252
Prerequisites for Installing ASR Manager
252
Install ASR Manager on a Standalone System
252
Install Service Tags for Oracle Linux
252
Install SASM Package
253
Install ASR Package
253
Register the ASR Manager
254
Activate ILOM for Exalogic Compute Nodes
254
Activate the Storage Appliance
254
Phone Home Tab on the List of Services
255
Approve and Verify ASR Activation for Exalogic Machine Assets
256
Phone Home Settings Page
256
Approve Exalogic Machine Assets in My Oracle Support
257
ASR Activation - Asset Screen in My Oracle Support
257
View and Verify ASR Assets
257
A Configure the Exalogic Machine Using ECU
259
Overview
259
Important Notes before You Use the ECU
259
Configuration Tasks
260
B Site Checklists
261
System Components Checklist
261
Data Center Room Checklist
262
Data Center Environment Checklist
263
Access Route Checklist
263
Facility Power Checklist
265
Power Checklist
266
Safety Checklist
266
Logistics Checklist
267
Network Specification Checklist
268
Reracking Checklists
270
Rack Recycling
272
C Cabling Diagrams
273
Exalogic Eighth Rack
273
Exalogic Quarter Rack
274
Exalogic Eighth Rack Network Connectivity
274
Exalogic Half Rack
275
Exalogic Quarter Rack Network Connectivity
275
Exalogic Half Rack Network Connectivity
275
Exalogic Full Rack
276
Exalogic Full Rack Network Connectivity
276
Rack-Level Frus for Exalogic X4-2
277
500 D Replacement Units
278
Rack-Level Replacement Parts for el X5-2
278
Rack-Level Replacement Parts for el X4-2
278
D.1 Rack-Level Frus for Exalogic X5-2
278
Rack-Level Frus for Exalogic X2-2 and X3-2
279
Rack-Level Replacement Parts for el X2-2 and X3-2
279
Parts for ZS3-ES Storage Appliance for Exalogic X5-2
280
Replacement Parts for Oracle ZS3-ES Appliance
280
Parts for ZS3-ES Storage Appliance for Exalogic X4-2
281
Parts for Sun ZFS Storage 7320 Appliance
282
Replacement Parts for Sun ZFS Storage 7320 Appliance
282
Parts for Oracle Server X5-2 Compute Nodes
283
Replacement Parts for Oracle Server X5-2 Compute Nodes
283
Parts for Sun Server X4-2 Compute Nodes
284
Replacement Parts for Sun Server X4-2 Compute Nodes
284
Parts for Sun Server X3-2 Compute Nodes
285
Replacement Parts for Sun Server X3-2 Compute Nodes
285
Parts for X4170 M2 Compute Nodes
286
Replacement Parts for X4170 M2 Compute Nodes
286
Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X5-2
287
Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X4-2
288
Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X2-2 and X3-2
288
Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X5-2 Machines
288
Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X4-2 Machines
288
Replacement Parts for Sun Network QDR Infiniband Gateway Switch for Exalogic X2-2 and X3-2 Machines
289
Replacement Parts for the Cisco Catalyst 4948E-F-S Switch
290
D.16 Parts for Sun Datacenter Infiniband Switch 36 for Exalogic X2-2 and X3-2
290
Parts for the Cisco Catalyst 4948E-F-S Switch
291
Parts for the Cisco Catalyst 4948 Switch
291
Parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2
291
Parts for the Gari DE2-24C Disk Enclosure
291
Replacement Parts for Cisco Catalyst 4948 Switch
291
Replacement Parts for Gari DE2-24C Disk Enclosure
291
E Cabling Tables
293
Administrative Gigabit Ethernet Network-Cabling Tables
293
Gigabit Ethernet Cabling for Exalogic Machine Full Rack
294
Gigabit Ethernet Cabling for Exalogic Machine Half Rack
296
Gigabit Ethernet Cabling for Exalogic Machine Quarter Rack
297
Gigabit Ethernet Cabling for Exalogic Machine Eighth Rack
298
Exalogic Machine Full Rack
299
Infiniband Network Cabling for Exalogic Machine Full Rack
299
E.2 Infiniband Network Cabling Tables
299
Infiniband Gateway Switch Cross-Connections for Exalogic Machine Full Rack
305
Exalogic Machine Half Rack
306
Infiniband Network Cabling for Exalogic Machine Half Rack
306
Infiniband Gateway Switch Inter-Connections for Exalogic Machine Half Rack
309
Exalogic Machine Quarter Rack
310
Infiniband Network Cabling for Exalogic Machine Quarter Rack
310
Exalogic Machine Eighth Rack
312
Infiniband Network Cabling for Exalogic Machine Eighth Rack
313
Power Distribution Unit Cabling Tables
314
Single Phase PDU Power Cabling Full Rack
315
Single Phase PDU Power Cabling for Exalogic Machine Full Rack
315
Single Phase PDU Power Cabling Half Rack
316
Single Phase PDU Power Cabling Quarter Rack
317
Single Phase PDU Power Cabling for Exalogic Machine Half Rack
317
Single Phase PDU Power Cabling Eighth Rack
318
Single Phase PDU Power Cabling for Exalogic Machine Quarter Rack
318
Single Phase PDU Power Cabling for Exalogic Machine Eighth Rack
318
Three Phase PDU Power Cabling Full Rack
319
Three Phase PDU Power Cabling for Exalogic Machine Full Rack
319
Three Phase PDU Power Cabling Half Rack
320
Three Phase PDU Power Cabling Quarter Rack
321
Three Phase PDU Power Cabling for Exalogic Machine Half Rack
321
Three Phase PDU Power Cabling Eighth Rack
322
Three Phase PDU Power Cabling for Exalogic Machine Quarter Rack
322
Three Phase PDU Power Cabling for Exalogic Machine Eighth Rack
322
F Manage Solaris Zones on Exalogic
325
Requirements
325
Terminology
325
Create a Solaris Zone
326
Prerequisites
326
Set up a Solaris Zone
332
Migrate a Zone to a New Host
336
G Customize Linux on the Compute Nodes
339
Rpms that Must Not be Modified or Removed
339
Prepare the Compute Nodes for Yum Updates
340
Install, Update, and Remove Rpms Using Yum
340
5
Based on 1 rating
Ask a question
Give review
Questions and Answers:
Need help?
Do you have a question about the Oracle Exalogic Elastic Cloud and is the answer not in the manual?
Ask a question
Oracle Exalogic Elastic Cloud Specifications
General
Brand
Oracle
Model
Exalogic Elastic Cloud
Category
Server
Language
English
Related product manuals
Oracle Exadata X10M
276 pages
Oracle VM
112 pages
Oracle X5-2
180 pages
Oracle X7-2
312 pages
Oracle SPARC
108 pages
Oracle X6-2-HA
473 pages
Oracle SPARC M8
330 pages
Oracle X6 series
126 pages
Oracle X4 series
240 pages
Oracle Sun Fire X4800
92 pages
Oracle SPARC T8 Series
12 pages
Oracle Sun Fire X2270 M2
100 pages
To Next PageTo Next PageTo Previous PageTo Previous Page
Loading...
Need help?
General
