EasyManua.ls Logo

Oracle Exalogic Elastic Cloud User Manual

Default Icon
342 pages
To Next Page IconTo Next Page
To Next Page IconTo Next Page
To Previous Page IconTo Previous Page
To Previous Page IconTo Previous Page
Page #309 background image
Table E-8 (Cont.) InfiniBand Network Cabling for Exalogic Machine Half Rack
From
Rack Unit
(Sun
Network
QDR
InfiniBand
Gateway
Switch)
Port To Rack
Unit
Type of
Equipment
Port Description
U16 14A U5 Compute node PCIe 2, P1 3 meter QDR
InfiniBand cable
U16 14B U4 Compute node PCIe 2, P1 3 meter QDR
InfiniBand cable
U16 15A U3 Compute node PCIe 2, P1 3 meter QDR
InfiniBand cable
U16 15B U2 Compute node PCIe 2, P1 3 meter QDR
InfiniBand cable
Table E-9 lists the InfiniBand gateway switch inter-connections for an Exalogic
machine half rack.
Table E-9 InfiniBand Gateway Switch Inter-Connections for Exalogic Machine Half
Rack
From
Rack Unit
(Sun
Network
QDR
InfiniBand
Gateway
Switch)
Port To Rack
Unit
Type of
Equipment
Port Description
U16 4A U23 Sun Network
QDR InfiniBand
Gateway Switch
4A 2 meter QDR
InfiniBand cable
U16 4B U23 Sun Network
QDR InfiniBand
Gateway Switch
4B 2 meter QDR
InfiniBand cable
U16 5A U23 Sun Network
QDR InfiniBand
Gateway Switch
5A 2 meter QDR
InfiniBand cable
U16 5B U23 Sun Network
QDR InfiniBand
Gateway Switch
5B 2 meter QDR
InfiniBand cable
U16 6A U23 Sun Network
QDR InfiniBand
Gateway Switch
6A 2 meter QDR
InfiniBand cable
InfiniBand Network Cabling Tables
Cabling Tables E-17

Table of Contents

Question and Answer IconNeed help?

Do you have a question about the Oracle Exalogic Elastic Cloud and is the answer not in the manual?

Oracle Exalogic Elastic Cloud Specifications

General IconGeneral
BrandOracle
ModelExalogic Elastic Cloud
CategoryServer
LanguageEnglish

Summary

Learn About the Exalogic Machine

About Oracle Exalogic

Overview of Oracle Exalogic as an integrated hardware and software platform for various workloads.

Hardware Components of Exalogic

Details on compute nodes, storage appliance, and networking components in an Exalogic machine.

Exalogic Machine Rack Layout

Describes the physical arrangement of components within the Exalogic machine rack.

Operational Procedures for Exalogic Machines

Explains procedures for powering on/off Exalogic machines and handling emergencies.

Site Requirements

Environmental Requirements

Specifies the environmental conditions necessary for Exalogic machine operation and installation.

Space Requirements

Outlines the physical dimensions and clearance needed for Exalogic machine installation.

Flooring Requirements

Details requirements for raised flooring, floor load, and electrical access considerations.

Electrical Power Requirements

Covers voltage, current, PDU requirements, and circuit breaker specifications for Exalogic.

Temperature and Humidity Requirements

Specifies optimal and acceptable ranges for temperature and humidity for reliable operation.

Ventilation and Cooling Requirements

Details airflow requirements, clearances, and floor tile configurations for proper cooling.

Install Planning and Procedure

Installation Overview

Provides a step-by-step overview of the Exalogic machine installation process.

Prepare to Install an Exalogic Machine

Covers prerequisites, safety guidelines, unpacking, and tools needed for installation.

Power on the System the First Time

Step-by-step guide for initial system power-up and verification of component status.

Connect a Laptop to the Exalogic Machine

Instructions for connecting a laptop for initial configuration and management tasks.

What Next?

Guidance on proceeding after initial power-on and configuration steps.

Default IP Addresses and Ports

Exalogic Machine Full Rack

Lists default ILOM, NET0, and InfiniBand IP addresses for a full rack configuration.

Exalogic Machine Half Rack

Lists default ILOM, NET0, and InfiniBand IP addresses for a half rack configuration.

Exalogic Machine Quarter Rack

Lists default ILOM, NET0, and InfiniBand IP addresses for a quarter rack configuration.

Exalogic Machine Eighth Rack

Lists default ILOM, NET0, and InfiniBand IP addresses for an eighth rack configuration.

Default Port Assignments

Details default network ports used for SSH, HTTP, SNMP, IPMI, and ILOM remote console.

Add the Exalogic Machine to Your Network

Default State of the Exalogic Machine Network Configuration

Describes the factory default network topology and interfaces for Exalogic.

Verify the Factory Configuration

Instructions on how to verify the default network configuration using a specific file.

Prerequisites for Connecting Exalogic Machine to External Ethernet Network

Lists requirements for connecting Exalogic to the existing Ethernet network infrastructure.

Initial Network Configuration of Exalogic Machine

Details the steps for configuring the Cisco Ethernet switch and other network components.

Understand Network Requirements and Configuration

Overview of Network Requirements

Describes network components, interfaces, and the purpose of Exalogic networks.

Naming Conventions

Explains how host names for network interfaces are generated for Exalogic systems.

Important Notes for Oracle Solaris Users

Highlights key terms and technologies relevant to Oracle Solaris users in Exalogic.

Network Connection and IP Address Requirements

Details network cable requirements and IP addressing schemes for Exalogic.

Default InfiniBand Bonded IP Addresses

Information on default InfiniBand bonded IP addresses and how to reconfigure them.

Introduction to Oracle Exalogic Network Configuration

Introduces key network concepts like InfiniBand fabric, switches, and bonded interfaces.

Set Up ILOM on the Compute Nodes

ILOM Overview

Introduces Oracle Integrated Lights Out Manager (ILOM) and its capabilities for managing Exalogic components.

Important Notes Before You Begin

Essential considerations before starting ILOM setup, including IP address requirements.

Management Network Diagram for Exalogic Machine

Visual representation of the management network and ILOM connectivity within Exalogic.

ILOM IP Addresses for Exalogic Machine Components

Details how ILOM IP addresses are assigned and can be reconfigured.

Connect to ILOM via the Network

Instructions for accessing ILOM using network interfaces (CLI, Web GUI, KVM).

Connect to ILOM via a Serial Connection

Procedures for accessing ILOM via a serial connection when network access is problematic.

Reconfigure the Network Access

Steps to reconfigure network access for ILOM via serial or Ethernet connections.

What Next?

Guidance on post-ILOM configuration steps, including storage appliance setup.

Configure the Storage Appliance

Prerequisites

Lists the necessary conditions and information required before configuring the storage appliance.

Getting Started

Initial steps to access and begin configuring the storage appliance via Ethernet.

Storage Appliance Overview

Explains the concepts of projects and shares used for organizing storage on the appliance.

Configuration Overview

Outlines the stages involved in configuring the storage appliance for deployment.

Create Custom Projects

Step-by-step guide to creating custom projects for managing shares and resources.

Create Custom Shares

Instructions for creating custom shares (file systems and LUNs) for compute nodes.

Use the Phone Home Service to Manage the Storage Appliance

Describes how to use the Phone Home service for fault reporting and system configuration.

Configure NFS Version 4 on Exalogic

Overview

Introduces NFSv4 and its advantages over NFSv3 for file locking and multihomed systems.

Verify the NIS Setting on Exalogic

Steps to verify the Network Information Service (NIS) configuration on the storage appliance.

Configure the Storage Appliance

Details how to configure NFS and NIS services on the storage appliance for NFSv4.

Configure an Exalogic Linux Compute Node to Use NFSv4

Instructions for configuring Exalogic Linux compute nodes to utilize NFSv4.

Create NFSv4 Mount Points on Oracle Linux

Steps to create NFSv4 mount points on Oracle Linux compute nodes.

Configure Ethernet Over InfiniBand

Introduction to Virtual NICs (VNICs)

Explains Virtual NICs (VNICs) and their mapping to Exalogic network interfaces.

Set Up Ethernet Over InfiniBand (EoIB) on Oracle Linux

Comprehensive guide to setting up Ethernet over InfiniBand on Exalogic compute nodes using Oracle Linux.

Set Up Ethernet Over InfiniBand (EoIB) on Oracle Solaris

Instructions for setting up Ethernet over InfiniBand on Exalogic compute nodes running Oracle Solaris.

Set Up Virtual LANs

Introduction to VLAN

Explains Virtual LANs (VLANs) and their benefits for network segmentation and traffic management.

Example Scenario

Illustrates the use of VLANs for combining and isolating environments within Exalogic.

Tag the Ethernet Connectors With a VLAN Identifier

Describes how to assign VLAN identifiers to Ethernet connectors on gateway switches.

Oracle Linux: Creating VNICs and Associating Them with VLANs

Steps for creating VNICs and associating them with VLANs on Exalogic compute nodes using Oracle Linux.

Oracle Solaris: Creating VNICs and Associating Them with VLANs

Procedures for creating VNICs and associating them with VLANs on Exalogic compute nodes using Oracle Solaris.

Use the InfiniBand Gateway Switches

Using Sun Network QDR InfiniBand Gateway Switches

Covers physical specifications, CLI access, status verification, and link status checks for gateway switches.

What Next?

Guidance on optional tasks such as creating VLANs and VNICs using InfiniBand gateway switches.

Manage the InfiniBand Network Using Subnet Manager

Understand Administrative Commands

Provides an overview of administrative tasks and command sets for managing gateway switches.

Manage InfiniBand Network Using Subnet Manager

Details the role of the Subnet Manager and its operation in different rack configurations.

Work with the Default Rack-Level InfiniBand Partition

Explains how to manage partitions within the Exalogic machine's InfiniBand fabric.

Use the Sun Datacenter InfiniBand Switch 36 in Multirack Configurations

Physical Specifications

Lists the physical dimensions and weight of the Sun Datacenter InfiniBand Switch 36.

Access the CLI of a Sun Datacenter InfiniBand Switch 36

Instructions for accessing the command-line interface of the spine switch.

Verify the Switch Status

Procedures to check the operational status of the switch, including voltage and temperature.

Start the Subnet Manager in Multirack Configuration Scenarios

Steps to manually start and activate the Subnet Manager on the spine switch.

Check Link Status

Instructions to verify link status LEDs and troubleshoot cable connections.

Verify the InfiniBand Fabric in a Multirack Configuration

Commands to verify the operational status of the InfiniBand fabric in multirack setups.

Monitor the Spine Switch Using Web Interface

Steps to access the web interface for monitoring the spine switch and fabric.

What Next?

Guidance on proceeding after setting up the Sun Datacenter InfiniBand Switch 36.

Monitor and Control the InfiniBand Fabric

Monitor the InfiniBand Fabric

Covers identifying switches, HCAs, fabric topology, routes, and link status.

Control the InfiniBand Fabric

Procedures for clearing counters, resetting ports, and managing port speed and status.

For More Information

Provides a URL for additional documentation on InfiniBand gateway switches.

Use InfiniBand Partitions in Exalogic Physical Environments

Overview of Partitioning

Explains InfiniBand partitions for network isolation and security on Exalogic.

Understand Partition Keys

Details the concept of partition keys (pkey) and their assignment and membership types.

Before You Begin

Lists prerequisites for creating unique InfiniBand partitions.

Move from a Default Partition to a Custom Partition

Guides on transitioning from default partitions to custom configurations for compute nodes.

Create an IPoIB Partition and Adding Ports

Step-by-step instructions for creating a non-default IPoIB partition with specific pkey values.

Delete a Partition

Procedure for deleting a non-default InfiniBand partition.

Create a Partition for EoIB and Associating the pkey with a VNIC and VLAN

Steps to create an EoIB partition and associate it with a VNIC and VLAN on the edge network.

Perform the Post-Configuration Steps

Steps to create child interfaces and configure networks for IPoIB partitions on compute nodes.

Important Notes for Combined Exalogic-Exadata Fabric Users

Crucial notes for scenarios involving Exalogic connected to Exadata on the same InfiniBand fabric.

Partitioning Limitations

Discusses limitations related to partition configuration, such as pkey assignment and number of partitions.

Monitoring the Exalogic Machine Using Oracle Enterprise Manager Ops Center

Overview

Introduces Oracle Enterprise Manager Ops Center for monitoring Exalogic machine components.

Key Features

Highlights key features of Ops Center for managing Exalogic hardware lifecycle and network views.

Prerequisites

Lists requirements for using Oracle Enterprise Manager Ops Center, including installation and network setup.

Accessing Oracle Enterprise Manager Ops Center Documentation

Provides the URL to access official documentation for Oracle Enterprise Manager Ops Center.

Launching Oracle Enterprise Manager Ops Center

Steps to launch and log in to the Oracle Enterprise Manager Ops Center interface.

Understanding the Workflow

Illustrates the workflow for managing Exalogic hardware components using Ops Center.

Managing Users and Roles

Instructions for managing user accounts and roles within Oracle Enterprise Manager Ops Center.

Discovering and Managing Exalogic Machine Hardware

Steps to discover and manage Exalogic hardware assets through custom criteria.

Grouping Exalogic Machine Hardware Assets

Guide on organizing managed assets into groups and sub-groups based on physical hierarchy.

Viewing Exalogic Compute Nodes

Procedures to view detailed hardware information about Exalogic compute nodes.

Viewing InfiniBand Switches

Steps to view detailed hardware and port information for InfiniBand switches.

Viewing the Storage Appliance

Instructions to view storage appliance details, including hardware and configured shares.

Viewing the InfiniBand Fabric and Its Nodes

How to view the InfiniBand fabric topology, nodes, and detailed information within Ops Center.

About Problem Management

Explains the components and process of problem management within Ops Center.

Using Monitoring Profiles and Rules

Details on creating monitoring profiles and rules to detect and alert on component attributes.

Using Reports in Oracle Enterprise Manager Ops Center

Information on generating various reports for asset lifecycle insights, compliance, and system info.

Using Oracle Services in Oracle Enterprise Manager Ops Center

How to use Oracle Services for viewing warranty, service requests, and filing new tickets.

Install the ASR Software

About Oracle Auto Service Request (ASR)

Overview of Auto Service Request (ASR) as a feature for automated hardware fault reporting.

Recommended Configuration

Recommended setup for installing the ASR Manager outside of Exalogic for telemetry reception.

Before You Begin

Lists essential conditions and prerequisites before starting ASR installation.

Prerequisites for Installing ASR Manager

Outlines system requirements like OS, Java version, and root access for ASR Manager installation.

Install ASR Manager on a Standalone System

Step-by-step guide for installing ASR Manager on a separate system.

Register the ASR Manager

Instructions for registering the ASR Manager with Oracle Support services.

Activate ILOM for Exalogic Compute Nodes

Steps to activate ILOM for Exalogic compute nodes for ASR functionality.

Activate the Storage Appliance

Procedure to activate the storage appliance for Phone Home and ASR services.

Approve and Verify ASR Activation for Exalogic Machine Assets

Steps to approve and verify ASR activation status in My Oracle Support.

Configure the Exalogic Machine Using ECU

Overview

Provides an overview of the Exalogic Configuration Utility (ECU) for initial machine setup.

Important Notes Before You use the ECU

Key points to consider before using the ECU for Exalogic configuration.

Configuration Tasks

Recommends performing configuration tasks with trained Oracle personnel or accredited partners.

Site Checklists

System Components Checklist

Checklist to ensure all system component considerations are addressed for Exalogic installation.

Data Center Room Checklist

Checklist to ensure data center room requirements, like space and layout, are met.

Data Center Environment Checklist

Checklist for verifying data center environmental factors like temperature and airflow.

Access Route Checklist

Checklist to ensure access routes are clear and meet transportation requirements for equipment.

Facility Power Checklist

Checklist to confirm facility power requirements, voltage, and outlet availability are met.

Power Checklist

Checklist for verifying power sources, UPS capacity, and frequency specifications.

Safety Checklist

Checklist to ensure safety requirements, including emergency power shut-off, are met.

Logistics Checklist

Checklist to ensure proper handling of delivery, unpacking, and staging of equipment.

Network Specification Checklist

Checklist to ensure network specification requirements, including IP addresses and cabling, are met.

Reracking Checklists

Checklist for considerations and requirements related to reracking Exalogic machines.

Cabling Diagrams

Exalogic Eighth Rack

Illustrates the cabling for a single Exalogic eighth rack configuration.

Exalogic Quarter Rack

Shows the cabling for a single Exalogic quarter rack configuration.

Exalogic Half Rack

Depicts the cabling for a single Exalogic half rack configuration.

Exalogic Full Rack

Illustrates the cabling for a single Exalogic full rack configuration.

Replacement Units

Rack-Level FRUs for Exalogic X5-2

Lists field-replaceable units (FRUs) for Exalogic X5-2 machines.

Rack-Level FRUs for Exalogic X4-2

Lists field-replaceable units (FRUs) for Exalogic X4-2 machines.

Rack-Level FRUs for Exalogic X2-2 and X3-2

Lists field-replaceable units (FRUs) for Exalogic X2-2 and X3-2 machines.

Parts for ZS3-ES Storage Appliance for Exalogic X5-2

Lists replaceable parts for the ZS3-ES storage appliance in Exalogic X5-2.

Parts for ZS3-ES Storage Appliance for Exalogic X4-2

Lists replaceable parts for the ZS3-ES storage appliance in Exalogic X4-2.

Parts for Sun ZFS Storage 7320 Appliance

Lists replaceable parts for the Sun ZFS Storage 7320 appliance in Exalogic.

Parts for Oracle Server X5-2 Compute Nodes

Lists replaceable parts for Oracle Server X5-2 compute nodes in Exalogic.

Parts for Sun Server X4-2 Compute Nodes

Lists replaceable parts for Sun Server X4-2 compute nodes in Exalogic.

Parts for Sun Server X3-2 Compute Nodes

Lists replaceable parts for Sun Server X3-2 compute nodes in Exalogic.

Parts for X4170 M2 Compute Nodes

Lists replaceable parts for X4170 M2 compute nodes in Exalogic.

Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X5-2

Lists replaceable parts for Sun Network QDR InfiniBand Gateway Switches in Exalogic X5-2.

Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X4-2

Lists replaceable parts for Sun Network QDR InfiniBand Gateway Switches in Exalogic X4-2.

Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X2-2 and X3-2

Lists replaceable parts for Sun Network QDR InfiniBand Gateway Switches in Exalogic X2-2 and X3-2.

Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X5-2

Lists replaceable parts for Sun Datacenter InfiniBand Switch 36 in Exalogic X5-2.

Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X4-2

Lists replaceable parts for Sun Datacenter InfiniBand Switch 36 in Exalogic X4-2.

Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X2-2 and X3-2

Lists replaceable parts for Sun Datacenter InfiniBand Switch 36 in Exalogic X2-2 and X3-2.

Parts for the Cisco Catalyst 4948E-F-S Switch

Lists replacement parts for the Cisco Catalyst 4948E-F-S switch.

Parts for the Cisco Catalyst 4948 Switch

Lists replacement parts for the Cisco Catalyst 4948 switch.

Parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2

Lists replacement parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2.

Parts for the Gari DE2-24C Disk Enclosure

Lists replacement parts for the Gari DE2-24C Disk Enclosure.

Cabling Tables

Administrative Gigabit Ethernet Network-Cabling Tables

Provides tables detailing Gigabit Ethernet cable connections for Exalogic machine configurations.

InfiniBand Network Cabling Tables

Presents tables detailing InfiniBand cable connections for Exalogic machine configurations.

Power Distribution Unit Cabling Tables

Contains tables detailing power cabling connections for Exalogic machine configurations.

Manage Solaris Zones on Exalogic

Requirements

Lists the requirements for creating Solaris zones on an Exalogic machine.

Terminology

Defines key terms used in managing Solaris zones, such as Logical Unit and Initiator.

Create a Solaris Zone

Step-by-step instructions for creating a Solaris zone, including iSCSI setup and LUN formatting.

Migrate a Zone to a New Host

Procedure for migrating a Solaris zone from one physical host to another.

Customize Linux on the Compute Nodes

RPMs That Must Not Be Modified or Removed

Lists the essential RPM packages that should not be modified or deleted outside of updates.

Prepare the Compute Nodes for Yum Updates

Steps to set up a local yum repository and configure compute nodes as yum clients.

Install, Update, and Remove RPMs Using Yum

Instructions on using yum to install, update, or remove RPM packages on compute nodes.

Related product manuals