AMD LE-363 User's Guia do Utilizador

XgOSUser’s GuidePart No.: E53170-02September 2014

x XgOS User’s Guide • September 201410GE and 10-Port GE VLAN Examples 126Example 1: Port Access Mode, VLAN-Unaware Host 127Example 2: Port Trunk Mode,

74 XgOS User’s Guide • September 2014▼ Configure a Default GatewayThe following figure shows the topology of a default gateway.Take the following step

Chapter 5 Server Profiles and Gateways 75Note – The gateway’s IP address must be on the same subnet as the vNIC’s address.5. Associate the default-gat

76 XgOS User’s Guide • September 2014This example changes the DNS to 2.2.2.2. After the change is made, the default-gateway profile must be reassociat

77CHAPTER6Virtual Network Interface Cards(vNICs)The Oracle virtual Network Interface Card (vNIC) virtualizes NIC connectivity. AvNIC is a virtual NIC

78 XgOS User’s Guide • September 2014Basic vNIC ConfigurationA vNIC involves the following bringup procedure: Adding a server profile Creating a nam

Chapter 6 Virtual Network Interface Cards (vNICs) 79Note – The Oracle Fabric Interconnect automatically assigns MAC addresses tovNICs from a pool of i

80 XgOS User’s Guide • September 2014vNIC Counters and StatisticsThere are several ways to gather vNIC counters and statistics.On the host server:On t

Chapter 6 Virtual Network Interface Cards (vNICs) 81High Availability vNIC PairsHigh availability (HA) vNIC pairs can be configured for a single Oracl

82 XgOS User’s Guide • September 20142. Bind the vNIC to a physical Ethernet card.3. Select the slot/port that you want to link to the vNIC (in this e

Chapter 6 Virtual Network Interface Cards (vNICs) 83Note – Do not select the same slot/port that was assigned to the primary vNIC.This command set cre

Contents xiExample: remove-prescan 150▼ Detect LUN Changes rescan 150Set FC Card Attributes 151Syntax 151Parameters 152Example: Display FC Cards 152Ex

84 XgOS User’s Guide • September 2014c. Bind the vNIC to a physical Ethernet card.d. Select the slot/port that you want to link to the vNIC (in this e

Chapter 6 Virtual Network Interface Cards (vNICs) 85f. Configure the vNIC as the primary vNIC of the HA pair.g. Select “-primary”, then press Enter.Th

86 XgOS User’s Guide • September 2014b. Bind the second vNIC to a physical Ethernet card on the second chassis.c. Select the slot/port that you want t

Chapter 6 Virtual Network Interface Cards (vNICs) 873. Configure the second vNIC as the secondary vNIC of the high-availability pair.Select “-secondar

88 XgOS User’s Guide • September 20144. Insert the primary vNIC’s MAC address.a. Select “-mac”.b. Type ‘<space>’, enter the MAC address retrieve

Chapter 6 Virtual Network Interface Cards (vNICs) 89When 1/1 goes down, traffic fails over to path 2/1. When 1/1 comes back online, thevNIC reverts ba

90 XgOS User’s Guide • September 2014Admin State ControlUse set vnic up|down to control the administrative state of a configured vNIC.SyntaxParameter

Chapter 6 Virtual Network Interface Cards (vNICs) 91Gigabit Ethernet Card StateUse the show ethernet-card command to display information about the Gig

92 XgOS User’s Guide • September 2014Example: Show Ethernet Card UtilizationIn the following example, the show ethernet-card utilization command isiss

Chapter 6 Virtual Network Interface Cards (vNICs) 93Example: Show an Ethernet PortIn the following example, the show ethernet-port command is issued a

xii XgOS User’s Guide • September 2014vHBA Statistics 167Fibre Channel Monitoring 168Syntax 168Example 168LUN Masking 169Syntax 171Parameter Descripti

94 XgOS User’s Guide • September 2014Example: Watch an Ethernet PortIn the following example, the watch command is issued against Ethernet port 1 onth

Chapter 6 Virtual Network Interface Cards (vNICs) 95Parameter Description▼ Set the MTU1. Select the I/O port and set the new MTU value:2. Confirm the

96 XgOS User’s Guide • September 2014vNIC MirroringThe Oracle Fabric Interconnect supports vNIC Mirroring, which is a feature thatenables duplicating

Chapter 6 Virtual Network Interface Cards (vNICs) 97traffic flow on “vn1.pubstest” is copied and sent to output vNIC “vn6.pubstest”,which is connected

98 XgOS User’s Guide • September 2014Mirroring to PortWhen you mirror to an output port, the traffic is copied to another physical port thatis on the

Chapter 6 Virtual Network Interface Cards (vNICs) 99 When mirroring to a port connected to a network switch, you should use theoptional -mirror-mac=&

100 XgOS User’s Guide • September 2014Note – For the 10GE I/O module, use the <mac address> option because themodule has only one port.▼ Configu

Chapter 6 Virtual Network Interface Cards (vNICs) 1013. Display detailed vNIC information to verify that the mirror was created. Lookfor the mirror fi

102 XgOS User’s Guide • September 20141. Set the input vNIC to mirror to an output vNIC:2. Set the direction of traffic that will be mirrored:3. Displ

Chapter 6 Virtual Network Interface Cards (vNICs) 103▼ Configure Mirror for All vNICsTo mirror all vNICs on a specific port, use the set ethernet-port

Contents xiiiBandwidth 192Burst Size 192Network QoS Services 193QoS Operations Overview 193QoS Feature Matrix 195QoS Default Sets 195Syntax 197Example

104 XgOS User’s Guide • September 20144. If you need to undo the mirror-all-vNICs option, you use the -mirror-all-vnics qualifier and specify none (or

Chapter 6 Virtual Network Interface Cards (vNICs) 105If the mirror field is empty, the vNIC is not configured as a mirror. For example:oper-ipaddr

106 XgOS User’s Guide • September 2014If the mirror field displays the output port or vNIC but also shows (none), thevNIC is currently disabled.Contro

Chapter 6 Virtual Network Interface Cards (vNICs) 107A common use case for delayed leaves is an ESX environment where a single vNICmay be acting as th

108 XgOS User’s Guide • September 2014Setting Allowed VLANs Per vNICWith the Allowed VLANs feature, you can specify a list of VLANs that are allowedto

Chapter 6 Virtual Network Interface Cards (vNICs) 109Parameter Description▼ Set VLANs on a vNICEach vNIC comes with the default VLAN range (1-4095) al

110 XgOS User’s Guide • September 20142. Remove the existing VLAN configuration (if any) from the vNIC. For example:3. Add the specific range of allow

Chapter 6 Virtual Network Interface Cards (vNICs) 111TCP Segmentation OffloadVirtual NICs support TSO, which allows large chunks of TCP data coming fr

112 XgOS User’s Guide • September 2014not support TSO. If you have any question about the ability of a Gigabit Ethernetcard to support TSO, issue the

Chapter 6 Virtual Network Interface Cards (vNICs) 113enabled for TSO to function. Because TSO is configured at vNIC creation time, youcannot disable t

xiv XgOS User’s Guide • September 201412. Access Control Lists 213Setting Actions 214Syntax 214Parameter Description 215Example 216Setting Conditions

114 XgOS User’s Guide • September 20144. Check the flags field for ct where:t indicates that TSO is configured on the vNIC.c indicates that checksummi

Chapter 6 Virtual Network Interface Cards (vNICs) 115SyntaxParameter DescriptionThe Receive Batching feature takes the following options:▼ Configure R

116 XgOS User’s Guide • September 20143. Check the detailed vNIC configuration to verify that Receive Batching isconfigured.For example:4. Check the f

117CHAPTER7Virtual LANs (VLANs)A Virtual LAN (VLAN) is a private, independent, logical network that is createdwithin a physical network. A VLAN behave

118 XgOS User’s Guide • September 2014In this example, only the default VLAN (VLAN 1) is present. As a result, no isolationexists, and all hosts (s1,

Chapter 7 Virtual LANs (VLANs) 119These properties collectively define rules by which the Oracle Fabric Interconnectoperates and handles VLAN tagged a

120 XgOS User’s Guide • September 2014PropertiesVLANs are configured through various VLAN properties on Ethernet ports andvNICs.Ethernet PortThe port

Chapter 7 Virtual LANs (VLANs) 121AccessThis property specifies the default VLAN domain with which the port is associated.The default access VLAN is 1

122 XgOS User’s Guide • September 2014 When tag-native=true, in the egress path, VLAN ID of the newly inserted tagon an untagged frame equals the acc

Chapter 7 Virtual LANs (VLANs) 123You can set the vNIC mode for the VLAN at vNIC creation time, by using the addvnic command as shown:The -mode option

Contents xvParameter Description 229LAG Configuration Options 230Example LAG Configuration for Peer Device 231Configuring a Static LAG 232▼ Configure

124 XgOS User’s Guide • September 2014 chassis managedHost-Managed VLAN ConfigurationWith this method, the user only adds a vNIC to the server on the

Chapter 7 Virtual LANs (VLANs) 125All chassis-managed VLANs are flagged as static in the type column of the showvlans command.The output of the show v

126 XgOS User’s Guide • September 2014Before adding a VLAN, you will find it helpful to:1. Determine if vNIC tags must be preserved between the Oracle

Chapter 7 Virtual LANs (VLANs) 127 “Example 3: Port Trunk Mode, VLAN-Unaware Host” on page 129 “Example 4: Port Trunk Mode, VLAN-Unaware Host and HA

128 XgOS User’s Guide • September 20142. Add vNICs to the hosts:3. On the hosts, configure the IP addresses.Example 2: Port Trunk Mode, VLAN-Aware Hos

Chapter 7 Virtual LANs (VLANs) 1291. Configure the Ethernet port mode:2. Add vNICs to the hosts:3. On the hosts, configure the VLAN interfaces and ass

130 XgOS User’s Guide • September 20141. Configure the Ethernet port mode:2. Add vNICs to the hosts:3. On the hosts, configure IP address information.

Chapter 7 Virtual LANs (VLANs) 131In this example, s1 and s2 are not VLAN-aware. The Oracle Fabric Interconnect isresponsible for inserting and removi

132 XgOS User’s Guide • September 2014

133CHAPTER8Virtual Host Bus Adapters (vHBAs)The Oracle virtual Host Bus Adapter (vHBA) virtualizes HBA connectivity. Itappears to the OS as a physical

xvi XgOS User’s Guide • September 2014Using the Internal IMS 250User Roles 250▼ Create a User Account 251How Access is Controlled By User Roles 252▼ G

134 XgOS User’s Guide • September 2014vHBA TopologyThe following figure displays a typical vHBA topology.An IB connection exists between the Oracle Fa

Chapter 8 Virtual Host Bus Adapters (vHBAs) 135N_Port ID Virtualization (NPIV) enables multiple fibre channel initiators (WWNs) tolog in and occupy a

136 XgOS User’s Guide • September 2014 (4 vHBAs) * (4 targets) * (2 LUNs) = 32, which complies with the rule of 256 totalLUNs per host. This example

Chapter 8 Virtual Host Bus Adapters (vHBAs) 137Optional Modifiers▼ Configure a Basic vHBATake the following steps to enable a minimum vHBA configurati

138 XgOS User’s Guide • September 20142. Find an FC card (sanFc2Port4GbLrCard) on which you can terminate a vHBA:3. Find an FC slot/port to which you

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1396. Repeat the steps again.Note – vHBAs must be distinct when created on distinct chassis. For example,

140 XgOS User’s Guide • September 2014vHBA AttributesAdditional options are available for a vHBA through the set vhba command.These options allow for

Chapter 8 Virtual Host Bus Adapters (vHBAs) 141vHBA StateYou can control vHBA state by using the set vhba command to set the vHBA toeither up down, or

142 XgOS User’s Guide • September 2014When you bring a vHBA online (up) it will attempt to discover all the attachedtargets that are available to it.

Chapter 8 Virtual Host Bus Adapters (vHBAs) 143Parameter DescriptionNote – The persistent binding can only apply to the target’s level but not to theL

Contents xviiExample: Changing a RADIUS User’s Privileges 267Example: Set IMS to a RADIUS Server 268Example: Display all RADIUS Server Configurations

144 XgOS User’s Guide • September 2014Take the following steps to configure a persistent map (binding) for an undeployedvHBA.1. Add a named SAN map an

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1455. Bind the named server profile to a physical connection:6. Bind the vHBA to a physical slot/port:At t

146 XgOS User’s Guide • September 2014Example: Configure Persistent Mapping WhileCreating a vHBAThe persistent binding can be assigned while creating

Chapter 8 Virtual Host Bus Adapters (vHBAs) 147The Oracle Fabric Interconnect relies on fibre channel’s Registered State ChangeNotification (RSCN) to

148 XgOS User’s Guide • September 2014▼ Enable prescanTo enable prescan for an unbound vHBA:1. Create an unbound server profile, where the state is “u

Chapter 8 Virtual Host Bus Adapters (vHBAs) 149▼ Bind After prescanThe ideal scenario is to bind the prescan-discovery results to a host server. XgOSs

150 XgOS User’s Guide • September 20145. If you are satisfied with the results, bind the server-profile:From now on, this vHBA has become a normal vHB

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1514. Configure this vHBA to rediscover (rescan state) the available LUNinformation.If there are any LUN c

152 XgOS User’s Guide • September 2014ParametersExample: Display FC CardsDisplay the properties of all Fibre Channel cards.Example: Display FC Card Ut

Chapter 8 Virtual Host Bus Adapters (vHBAs) 153Watch FC Card UtilizationWith the watch fc-card command, you can run a command that continuouslyupdates

xviii XgOS User’s Guide • September 2014Listing Virtual Interfaces 287Virtual Interface Status 288Traffic Counters 288Input and Output Traffic Counter

154 XgOS User’s Guide • September 2014The most commonly used fibre-channel controls are rate, topology (topo), frame-size, and execution-throttle. How

Chapter 8 Virtual Host Bus Adapters (vHBAs) 155Parameter Description-descr=<text> Applies a text description to the FC port.Quotes are required

156 XgOS User’s Guide • September 2014Example: Set the Link Down Time-OutNote that modified settings do not become effective until you reset the I/O c

Chapter 8 Virtual Host Bus Adapters (vHBAs) 157▼ Configure a Port for Direct-Attached StorageThe Oracle Fabric Interconnect supports direct-attached s

158 XgOS User’s Guide • September 2014Removing vHBAsTo support the graceful deletion of vHBAs, you must follow the documentedprocedures. Failure to do

Chapter 8 Virtual Host Bus Adapters (vHBAs) 159Environments Where Special Procedure is RequiredIf the vHBA is in any of the following environments, us

160 XgOS User’s Guide • September 2014SyntaxRemove vHBAs Connected to VMware VirtualMachinesOVN supports VMware ESX, which is documented in the follow

Chapter 8 Virtual Host Bus Adapters (vHBAs) 161Note – Changing the storage configuration when using VMware might require arescan to discover those cha

162 XgOS User’s Guide • September 2014Note – Changing the storage configuration when using VMware might require arescan to discover those changes and

Chapter 8 Virtual Host Bus Adapters (vHBAs) 16310. Log in to the I/O Director.For example, from a secure command prompt, enter the following:where <

Contents xixSyntax 307Example: Display vNIC Status 307Tracing End-to-End IB Path Continuity 308▼ Determine the IB Path Continuity 30917. System Manage

164 XgOS User’s Guide • September 2014Note – Rebooting the server will cause service interruptions for any runningapplications, so this procedure is r

Chapter 8 Virtual Host Bus Adapters (vHBAs) 165To gracefully delete a vHBA connected to a Linux host server in a multipathenvironment, follow this pro

166 XgOS User’s Guide • September 2014manually rescan without having to unload vHBA drivers from the host server, thenreload them. This procedure is u

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1678. On the host server, start the PowerPath service, by issuing either of thefollowing commands: /etc/i

168 XgOS User’s Guide • September 2014You can also display vHBA statistics for multiple vHBAs through the use of the<wildcard> option (for examp

Chapter 8 Virtual Host Bus Adapters (vHBAs) 169LUN MaskingLogical Unit Number (LUN) masking is an authorization feature that makes LUNsavailable to so

170 XgOS User’s Guide • September 2014In this figure, the Oracle Fabric Interconnect controls which LUNs can be seen by thevHBAs. To accomplish this,

Chapter 8 Virtual Host Bus Adapters (vHBAs) 171SyntaxBy default LUN masking is not applied to a vHBA. All LUNs are visible by default.Parameter Descri

172 XgOS User’s Guide • September 2014▼ Set a LUN Mask1. Create a LUN Mask named “oracle-mask” with target WWPN“20:70:00:C0:FF:0A:81:30” and LUN ID “1

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1736. Display the LUNs that vHBA “oracle-vhba1” is allowed to see:However, before the rescan, the change w

PleaseRecycleCopyright © 2013, 2014 Oracle and/or its affiliates. All rights reserved.This software and related documentation are provided under a lice

xx XgOS User’s Guide • September 2014▼ Disable or Enable Root Login Over SSH 324Display Login Information 324Syntax 325Example 325Setting System Passw

174 XgOS User’s Guide • September 2014Optional LUN Masking: No Report LUNInterceptionWhen a host (Linux or Windows) issues a SCSI report LUNs, the cha

Chapter 8 Virtual Host Bus Adapters (vHBAs) 175SyntaxExampleTo determine if LUN masking is enabled for a vHBA, see the “l” value under“flags”. This fi

176 XgOS User’s Guide • September 2014▼ Change Port Topology from Fabric to LoopXgOS supports changing a SAN topology or migrating from one topology t

Chapter 8 Virtual Host Bus Adapters (vHBAs) 1772. Delete all the vHBAs terminated on the port for which you will change the porttopology.For example:3

178 XgOS User’s Guide • September 2014

179CHAPTER9VMware ESX ServersThis chapter describes configuring virtual I/O for VMware ESX in the followingsections: “Introducing Virtual I/O for VMw

180 XgOS User’s Guide • September 2014install the host drivers to see 32 vNICs not added or attached to anything. Theseare placeholders for when the i

Chapter 9 VMware ESX Servers 181SyntaxCreate a server profile:then add a vNIC or vHBA with a local-id value:A local-id maps a vNIC into 32 predefined

182 XgOS User’s Guide • September 2014ESX ConfigurationThe ESX server in the following figure has four virtual machines (Service Console,bob, fred, jo

Chapter 9 VMware ESX Servers 1831. Install the InfiniBand RPM on the ESX server:Linux ships with its own IB drivers, but the ESX server does not. This

Contents xxiResetting the HCA 341Displaying All Option ROM Images on the Oracle Fabric Interconnect 342Displaying All Firmware Images on the Oracle Fa

184 XgOS User’s Guide • September 2014Oracle created a Fabric Manager VMware Extension that operates with VMwareVirtualCenter. The extension runs the

Chapter 9 VMware ESX Servers 1856. If the Virtual I/O tab is not displayed, click Plug-ins on the toolbar to verify thestate of the Oracle Fabric Mana

186 XgOS User’s Guide • September 2014If the Oracle Fabric Manager has not been integrated into Virtual InfrastructureClient, no Fabric Manager plug-i

Chapter 9 VMware ESX Servers 187▼ Monitor vNICs1. From the Oracle Fabric Interconnect, monitor the health of the vNICs:All configuration can be done v

188 XgOS User’s Guide • September 2014CaveatsThe following sections cover specific issues of which you must be aware whenconfiguring virtual I/O resou

Chapter 9 VMware ESX Servers 189Automatic Rescans in ESXIn ESX, discovery of new vHBA devices and changes to the FC fabric often require arescan. Resc

190 XgOS User’s Guide • September 2014Also, note that using the command line tool esxcfg-rescan <vmhba> does notpropagate information to the VI/

191CHAPTER10Network QoS for vNICsOracle’s network Quality of Service (QoS) provides administrators the ability to treatpackets differently, based on t

192 XgOS User’s Guide • September 2014Note – The SAN QoS feature set uses vHBAs (not vNICs) and is different fromnetwork QoS. See “SAN QoS for vHBAs”

Chapter 10 Network QoS for vNICs 193CBS and PBS values can also be automatically calculated to linear values based onthe CIR and PIR values that you s

xxii XgOS User’s Guide • September 2014SRC RPM File 359Basic rpmbuild Example 359The SPEC File 360Environment Variables 362Build Option 1: Stock Kerne

194 XgOS User’s Guide • September 2014Each vNIC has eight traffic queues. Network traffic can enter on any of the queues,but the QoS Profiles are appl

Chapter 10 Network QoS for vNICs 195QoS Feature MatrixThe following table describes the network QoS features supported Oracle FabricInterconnect’s Gig

196 XgOS User’s Guide • September 2014Note – If you have multiple 10 GE or 10-Port GE cards and want to deploy the sameQoS policy to all the cards irr

Chapter 10 Network QoS for vNICs 197SyntaxA profile itself has no direction (ingress or egress). You must explicitly apply twoprofiles (one for each d

198 XgOS User’s Guide • September 20141. Create a custom QoS set.2. Specify a profile within the set. Repeat this step as needed to define all profile

Chapter 10 Network QoS for vNICs 199Automatic CalculationAutomatic calculation ensures that the optimal linear-function settings areconfigured. XgOS s

200 XgOS User’s Guide • September 2014In this example, Server1 attaches to an Oracle Fabric Interconnect over a vNIC. TheOracle Fabric Interconnect is

Chapter 10 Network QoS for vNICs 2014. On the same vNIC, enable policing in the egress direction (server to network):A profile itself has no direction

202 XgOS User’s Guide • September 2014ACLs With QoS and Application QoSACL rule configurations can be used with QoS. Specify an action for each matche

Chapter 10 Network QoS for vNICs 203Example: ACL-Based Policer for 10GbE I/O CardsAn ACL-based policer sets up an ACL that matches a particular flow,

Contents xxiiiUpgrading Windows Host Servers 381▼ Upgrading Windows Host Servers 381▼ Upgrading Windows HCA Firmware and Option ROM 382Xsigo Dependenc

204 XgOS User’s Guide • September 20143. Create an ACL and assign it a name:No auto commits exist for ACLs. You must issue commit (see Step 5) after t

Chapter 10 Network QoS for vNICs 205Disabling QoS on a vNICXgOS allows you to disable QoS for either ingress or egress traffic on a per vNICbasis. You

206 XgOS User’s Guide • September 2014By using this example, the default Policer is disabled, but remains bound to thevNIC. QoS is disabled for ingres

Chapter 10 Network QoS for vNICs 207See the ACL mark option in “Setting Actions” on page 214.Note – 802.1p and IP Precedence mapping is supported, but

208 XgOS User’s Guide • September 2014AF12 001100 1AF11 001010 1DF (Other) 000000 0DSCP Name Value (Binary) Queue Number

209CHAPTER11SAN QoS for vHBAsOracle’s vHBAs support QoS where the bandwidth is rate limited with shaping (notdropped). There are no queues or policers

210 XgOS User’s Guide • September 2014 Using ACLs with SAN QoS Automatic calculation on SAN QoS for CBS and PBS Ingress vs egress direction control

Chapter 11 SAN QoS for vHBAs 211▼ Create vHBA With ShapingTake the following steps to create a SAN QoS shaping policy and apply it to a vHBA:1. Create

212 XgOS User’s Guide • September 2014

213CHAPTER12Access Control ListsAccess control lists (ACLs) classify packets. The classification result can be appliedto quality-of-service applicatio

xxiv XgOS User’s Guide • September 2014

214 XgOS User’s Guide • September 2014Setting ActionsYou specify an action to be taken whenever a packet matches the specified condition.For each acti

Chapter 12 Access Control Lists 215Parameter DescriptionParameter Descriptionrule <num> The ID number for this rule.-rank=<number> A speci

216 XgOS User’s Guide • September 2014ExampleSetting ConditionsAn ACL condition is a match-test rule to perform on a packet. A condition definesrules

Chapter 12 Access Control Lists 217OperatorsOperators match strings following a specific pattern. Use an operator in thefollowing table to define how

218 XgOS User’s Guide • September 2014ExampleDisplaying ACLs and RulesUse the show acl command to display configured ACLs or their component rules.Thi

Chapter 12 Access Control Lists 219ExamplesDisplay all ACLs on the system.Display an ACL by name (“renoset”) and its rules.Removing ACLsUse the remove

220 XgOS User’s Guide • September 2014Note – If you need to change an ACL rule, you do not need to remove the rule. Youcan change the rule in real-tim

Chapter 12 Access Control Lists 221▼ Deny Egress TrafficTake the following steps to deny egress traffic:1. Create a named policy set (empty by default

222 XgOS User’s Guide • September 20143. Issue a commit after the ACL is defined:This command collects all the multiple configuration steps of your pol

Chapter 12 Access Control Lists 2237. Display ACL statistics.In this example, the “acl-deny-pkt-counter” is equal to “6”, which indicatespackets are b

xxvUsing This DocumentationThis document provides information about the XgOS CLI and on upgrading XgOSfor the Oracle Fabric Interconnect. “Related Do

224 XgOS User’s Guide • September 2014

225CHAPTER13Link Aggregation Groups (LAGs)A link aggregation group (LAG) is a grouping of physical Ethernet ports, whichenables you to combine multipl

226 XgOS User’s Guide • September 2014Note – In many ways, configuration and management of LAGs is similar toconfiguration and management of Ethernet

Chapter 13 Link Aggregation Groups (LAGs) 227When a LAG contains multiple ports, traffic is mapped to the appropriate port basedon a hashing algorithm

228 XgOS User’s Guide • September 2014 LAG port changes are not revertive. As a result, if a port in the LAG goes down,traffic flows are remapped bas

Chapter 13 Link Aggregation Groups (LAGs) 229SyntaxParameter Descriptionadd lag <name> port <port-number> -lacpset lag {<*|*.*|<name

230 XgOS User’s Guide • September 2014LAG Configuration OptionsThis section documents some examples of setting options for the LAG. Be aware thatsetti

Chapter 13 Link Aggregation Groups (LAGs) 231The following series of commands shows you how to set LAG options individually,but you can specify them a

232 XgOS User’s Guide • September 2014Commands on peer:There is no dependency for when to configure the peer or the Oracle FabricInterconnect, so thes

Chapter 13 Link Aggregation Groups (LAGs) 233Note – Total number of ports that you can add to a LAG depends on the number ofLAGs configured, with the

xxvi XgOS User’s Guide • September 2014Support and AccessibilityOracle customers have access to electronic support through My Oracle Support. Forinfor

234 XgOS User’s Guide • September 2014▼ Configure a LAG for “Passive” Mode (DynamicLAG)When configuring a passive-mode LAG, you configure a LAG on the

Chapter 13 Link Aggregation Groups (LAGs) 2354. When all ports have been configured in the LAG, verify that the LAG wascorrectly added to the Oracle F

236 XgOS User’s Guide • September 2014Deleting a LAGYou can delete a LAG at any time by issuing the remove lag command. Wheneveryou delete a LAG, reme

Chapter 13 Link Aggregation Groups (LAGs) 237Delete a Single LAG from a 10-Port GE ModuleTo delete all LAGs from a specified 10-Port GE Module, issue

238 XgOS User’s Guide • September 2014

239CHAPTER14ClustersThis chapter explains cluster configuration in the following sections: “Virtual I/O Fabric” on page 239 “OpenSM Decoupling” on p

240 XgOS User’s Guide • September 2014The Oracle Fabric Interconnect also supports a decoupled Subnet Manager (SM),which is part of a cluster environm

Chapter 14 Clusters 241XDS Registration ProcessOn initial boot up, the Oracle Fabric Interconnect starts an XDS registration processto determine which

242 XgOS User’s Guide • September 2014A chassis first becomes a standby XDS, then a master. Only a standby XDS canbecome a master. This approach enabl

Chapter 14 Clusters 243In the figure, different virtual resources (vNICs and vHBAs) have been configuredon server profiles on two different Oracle Fab

1CHAPTER1XgOS CLI OverviewThe XgOS command-line interface (CLI) includes commands to configure everyaspect of the Oracle Fabric Interconnects F1-15 an

244 XgOS User’s Guide • September 2014Note – Certain SMs are qualified to work with the Oracle Fabric Interconnect.Contact Oracle customer support for

Chapter 14 Clusters 245nameservers 192.168.8.3, 192.168.8.2model-num F1-15-CH-SDRserial-num 050610240ipconfig dhcpdefault-ga

246 XgOS User’s Guide • September 2014

247CHAPTER15User Authorization and AccessControlOracle’s Identity Management System (IMS) service authenticates users and grantsthem suitable privileg

248 XgOS User’s Guide • September 2014Configuring IMSThe following figure shows how the Oracle Fabric Interconnect handles a loginrequest when using t

Chapter 15 User Authorization and Access Control 249SyntaxParameter Descriptionset ims -cache-timeout=[<number> default]set ims -maps-to-root=&l

250 XgOS User’s Guide • September 2014Refer to “Using Active Directory as the IMS” on page 254 or ““Using Role Group Mappingsfor AD/LDAP Users” on pag

Chapter 15 User Authorization and Access Control 251If you do not specify a role for a user, the user will have the operators role (read-only privileg

252 XgOS User’s Guide • September 20145. Test the new user account:How Access is Controlled By User RolesUser privileges determine administrative abil

Chapter 15 User Authorization and Access Control 253▼ Grant Privileges to a Local User Account1. Add the user account.For example, the following adds

2 XgOS User’s Guide • September 2014Command Syntax ConventionsEntering Commands and Getting HelpThe command-line interface (CLI) enables you to access

254 XgOS User’s Guide • September 2014Using Active Directory as the IMSMicrosoft Active Directory (AD) uses either Kerberos or simple (default) userau

Chapter 15 User Authorization and Access Control 255▼ Configure AD Users and RolesFor AD to work as the IMS for the Oracle Fabric Interconnect, you mu

256 XgOS User’s Guide • September 20144. If you need to give everyone under in a particular group administrative access,assign that group to administr

Chapter 15 User Authorization and Access Control 257Example: Configure Kerberos as a Secondary ADServerThis example configures Kerberos as a secondary

258 XgOS User’s Guide • September 2014If the configuration is not correct, the state will be “up/down”. The error field willshow the corresponding war

Chapter 15 User Authorization and Access Control 259Example: Display All AD Server ConfigurationThe chassis maintains a connection between IMS and the

260 XgOS User’s Guide • September 2014Note – It is important to understand that regular expressions are used to match theuser’s groups against the rol

Chapter 15 User Authorization and Access Control 261Interaction Between Existing Groups and RoleGroup MappingsIn previous versions of the XgOS IMS mod

262 XgOS User’s Guide • September 2014SyntaxParameter DescriptionRole group mapping commands take the following options:Example: Configure Role Group

Chapter 15 User Authorization and Access Control 263When you are configuring a role group mapping, you can do so either of thefollowing ways: Add the

Chapter 1 XgOS CLI Overview 3 Scripting Engine—Enables you to run scripts within the CLI for each I/O card.The engine also enables you to define new

264 XgOS User’s Guide • September 2014Example: Add Role Group Mapping With aRegular ExpressionBy using a regular expression, you can simplify the crea

Chapter 15 User Authorization and Access Control 265When deleting the role group mapping the AD groups remain configured on theAD/LDAP server. The rem

266 XgOS User’s Guide • September 2014Example: RADIUS IMS Server With DefaultAuthenticationWhen configuring IMS to use a RADIUS server, you can use th

Chapter 15 User Authorization and Access Control 267Configure RADIUS Users and RolesWhen using RADIUS for IMS, you configure the IMS and then add user

268 XgOS User’s Guide • September 2014Example: Set IMS to a RADIUS ServerThe following shows the command to set IMS to a RADIUS server.Example: Displa

Chapter 15 User Authorization and Access Control 269Common IMS OperationsThe examples in this section are the same for all IMS services, regardless of

270 XgOS User’s Guide • September 2014The chassis has a local cache to store role information for 240 minutes by default.The next time you log in with

Chapter 15 User Authorization and Access Control 2713. Using vi or any other standard Linux-compliant file editor, display the contentsof .bashrc.For

272 XgOS User’s Guide • September 2014

273CHAPTER16Monitoring XgOSThis chapter provides reference and procedural information about monitoring XgOSand its managed objects. It contains the fo

iiiContentsUsing This Documentation xxv1. XgOS CLI Overview 1Command Syntax Conventions 2Entering Commands and Getting Help 2Command Completion 3Onlin

4 XgOS User’s Guide • September 2014For example, to get command-completion hints and context-sensitive help aboutadding a vNIC:Online HelpIn addition

274 XgOS User’s Guide • September 2014SyntaxNote – If you are entering a description with internal blank spaces (for exampleXsigo Systems) you must en

Chapter 16 Monitoring XgOS 275Replace <IPaddress> with the IP address of the system where you are going toreceive SNMP traps.Note – Trap IDs are

276 XgOS User’s Guide • September 2014The following table lists statistics available in the ifTable.XSIGO-IODIRECTOR-ENTITY-MIBThe following tables re

Chapter 16 Monitoring XgOS 277Note – If you need to integrate/compile the Xsigo MIBs, you can get them from theOracle Xsigo Support Portal (http://www

278 XgOS User’s Guide • September 2014With symbolic object name:With numeric OID:With symbolic object name:With numeric OID:Physical I/O Port StatusEa

Chapter 16 Monitoring XgOS 279With numeric OID:With symbolic object name:XSIGO-IODIRECTOR-ENTITY-MIB::xsigoPortLocation.9 = STRING: 10/9XSIGO-IODIRECT

280 XgOS User’s Guide • September 2014With numeric OID:Fan StatusThe Oracle Fabric Interconnect contains eight fan, and every fan can be monitored.The

Chapter 16 Monitoring XgOS 281With symbolic object name:With numeric OID:Temperature SensorsThe Oracle Fabric Interconnect contains multiple intra-cha

282 XgOS User’s Guide • September 2014XSIGO-IODIRECTOR-ENTITY-MIB::xsigoTemperatureProbeIndex.7 = INTEGER: 7XSIGO-IODIRECTOR-ENTITY-MIB::xsigoTemperat

Chapter 16 Monitoring XgOS 283XSIGO-IODIRECTOR-ENTITY-MIB::xsigoTemperatureProbeLocation.7 = STRING:fabricCardXSIGO-IODIRECTOR-ENTITY-MIB::xsigoTemper

Chapter 1 XgOS CLI Overview 5Editing Commands on the Command LineWhile entering a command, you can move around in the command-line text and editit. Th

284 XgOS User’s Guide • September 2014With numeric OID:$ snmpwalk -c public -v2c -mALL 192.168.10.100 -On xsigoTemperatureProbeTable.1.3.6.1.4.1.24440

Chapter 16 Monitoring XgOS 285Power Supply (PSU) StatusThe Oracle Fabric Interconnect is capable of operating on only one power supplyunit (PSU) even

286 XgOS User’s Guide • September 2014With symbolic object name:With numeric OID:System StatusYou can monitor system information about the Oracle Fabr

Chapter 16 Monitoring XgOS 287System Controller (SCP) StatusYou can monitor utilization of the CPU on the System Control Processor (SCP) andutilizatio

288 XgOS User’s Guide • September 2014With numeric OID:Virtual Interface StatusAll virtual interfaces should be up.With symbolic object name:With nume

Chapter 16 Monitoring XgOS 289With symbolic object name:With numeric OID:With symbolic object name:With numeric OID:Server Profile StatusA server prof

290 XgOS User’s Guide • September 2014With numeric OID:AlarmsIssue show alarms to display alarms in the system database.SyntaxExampleAlarms have a sev

Chapter 16 Monitoring XgOS 291Xsigo ProWatch OverviewThe Xsigo ProWatch feature supports periodically transmitting the contents of logfiles and the ou

292 XgOS User’s Guide • September 2014 when major or critical alarms occurWhen you configure periodic transmission of data, the Oracle Fabric Interco

Chapter 16 Monitoring XgOS 293ProWatch Command SyntaxProWatch Parameter DescriptionsAs always when working with the CLI, enclose values in quotation m

6 XgOS User’s Guide • September 2014The variable vnics contains a vector of lines containing the output from the show-list vnics command.WildcardsYou

294 XgOS User’s Guide • September 2014<minutes>m|<hours>h|<days>d|off Sets the timer for the phone snooze period, or disables an in-

Chapter 16 Monitoring XgOS 295Optional QualifiersInternet Connection RequirementThe Xsigo ProWatch data is transmitted as an HTTP POST transfer. For t

296 XgOS User’s Guide • September 2014port to connect to the Internet. Make sure that the Oracle Fabric Interconnect canconnect to:http://phone-home.x

Chapter 16 Monitoring XgOS 297The following section documents how to configure Xsigo ProWatch with yourspecific parameter values. Before performing th

298 XgOS User’s Guide • September 20144. Specify the email address of a person within your company who Oracle cancontact.For example:5. Specify whethe

Chapter 16 Monitoring XgOS 29911. When prompted for confirmation, answer “yes” (y).For example:12. Display the Xsigo ProWatch configuration to verify

300 XgOS User’s Guide • September 2014Snoozing ProWatchThe snooze feature allows any configured phone home to be temporarily delayed foran amount of y

Chapter 16 Monitoring XgOS 3012. (Optional) If you need to deactivate the current snooze interval, issue the setsystem phone-home off command.Displayi

302 XgOS User’s Guide • September 2014Parameter DescriptionParameter Descriptionwatch {ethernet-port|ethernet-ports|fc-port|fc-ports|ioport|ioports|vh

Chapter 16 Monitoring XgOS 303log [debug|syslog] Displays the logs. The show system log and show systemlog debug commands are interactive, and do not

Chapter 1 XgOS CLI Overview 7PipesYou can use pipes to control the display of output in the CLI. Pipes in the XgOS CLIare like standard UNIX pipes, an

304 XgOS User’s Guide • September 2014Example: Monitor I/O Port Statususer Displays internal information about the current user.version [-all] Display

Chapter 16 Monitoring XgOS 305Example: Display Operating System DetailsUse show system to display information about either the Oracle FabricInterconne

306 XgOS User’s Guide • September 2014Example: Display the Log LevelUse the show system loglevel to show the event levels configured for differentproc

Chapter 16 Monitoring XgOS 307Displaying System StatisticsThe system collects real-time statistics, which are displayed whenever you issue ashow <x

308 XgOS User’s Guide • September 2014Tracing End-to-End IB Path ContinuityA diagnostic command that supports tracing the IB path from host server, th

Chapter 16 Monitoring XgOS 309 You can reset statistics to zero to allow them to accumulate by using the optional-clear argument. Statistics are res

310 XgOS User’s Guide • September 20144. Clear the counters on the server (brick) to get a fresh batch of statistics.5. Issue the show diagnostics ib-

Chapter 16 Monitoring XgOS 311 the magenta text shows another link in the overall IB path. These entries showhow the IB path flows through the variou

312 XgOS User’s Guide • September 2014

313CHAPTER17System ManagementThis chapter provides reference and procedural information about managing XgOS.It contains the following sections: “Syst

8 XgOS User’s Guide • September 2014Expressions can be combined using “and”, “or”, and “xor”. Expressions can also beenclosed in parentheses.For examp

314 XgOS User’s Guide • September 2014 File Transfer Protocol (FTP) Local fileTFTP system upgrades are not supported.Before upgrading your operating

Chapter 17 System Management 315When issuing this command, the file name will autocomplete if you omit the URLscheme or use the file:// option.▼ Upgra

316 XgOS User’s Guide • September 20142. Issue the system upgrade command and supply the full path to the newsystem image.Here is an example of each o

Chapter 17 System Management 3173. If you get the following error during the upgrade: Installation failed(Unable to unpack package file xsigo-<buil

318 XgOS User’s Guide • September 2014System ConfigurationIssue the show config command to display the running configuration in tableformat. There is

Chapter 17 System Management 319Example: Print the ConfigurationSystem ControlUse the system command to control various system attributes.Syntaxprintc

320 XgOS User’s Guide • September 2014Parameter DescriptionExample: Broadcast a MessageTo broadcast a system message to all CLI users logged into the

Chapter 17 System Management 321Examples: Initiate Immediate Cold Start To perform an immediate cold restart of the system: To perform a cold-restar

322 XgOS User’s Guide • September 2014Network Time Protocol (NTP) ServerSyntaxParametersLogin MethodsYou can log into the CLI using the console or SSH

Chapter 17 System Management 323 Data bits: 8 Stop bits: 1 Parity: none Flow control: noneThe default username is “admin”. The default password is

Chapter 1 XgOS CLI Overview 9 Characters accepted in the names of vNICs and vHBAs include alphanumericsand underscore (_). Avoid using other characte

324 XgOS User’s Guide • September 2014▼ Change root PasswordThe default root password is root. To change your root password:1. Log in as the administr

Chapter 17 System Management 325Use set cli idle-timeout 0 to configure an infinite CLI time-out (no time-out).For information about creating using ac

326 XgOS User’s Guide • September 2014 the minimum number of numbers required for Oracle Fabric Interconnectpasswords. the minimum number of special

Chapter 17 System Management 327SyntaxParametersExampleIn this example, the password for non-default local user accounts must be at least 8characters,

328 XgOS User’s Guide • September 2014Setting the Oracle Fabric InterconnectManagement IP AddressTo use the Oracle Fabric Interconnect’s management in

Chapter 17 System Management 3294. If show login indicates that others are logged on, issue a system broadcast towarn them of the change.For example:N

330 XgOS User’s Guide • September 2014The qualifiers for the set system management-interface command areavailable as individual commands also. For exa

Chapter 17 System Management 331Restoring Factory DefaultsXgOS supports resetting any Oracle Fabric Interconnect to its factory defaults, whichis the

332 XgOS User’s Guide • September 2014Power Down and Power UpBecause this command removes all configuration, you will typically only use thiscommand s

Chapter 17 System Management 333Exampleshow software## System status #############################################################Booted on: Wed Mar 1

10 XgOS User’s Guide • September 2014Server Profile CommandsServer profiles are containers that hold vNICs/vHBAs and are assigned to physicalservers.

334 XgOS User’s Guide • September 2014Getting System Log FilesXgOS supports gathering information from the Oracle Fabric Interconnect and somehost inf

Chapter 17 System Management 335Parameter DescriptionExample: Redirect show tech-supportUse the redirection switch ( >) to send the current show te

336 XgOS User’s Guide • September 2014Example: Gather All Files With get log-files-allUse the get log-files command to gather all available files, log

Chapter 17 System Management 337Upgrading Host HCA Option ROM andFirmwareEach host server connected to a Oracle Fabric Interconnect has at least one H

338 XgOS User’s Guide • September 2014ConsiderationsWhen you perform the upgrade, be aware of the following: You can selectively upgrade. You upgrade

Chapter 17 System Management 339 It is important to understand that the in-band firmware upgrade procedure is notcomplete until the HCA is rebooted.

340 XgOS User’s Guide • September 2014Install Option ROM and Firmware and Pushing itto HostsWhen the Option ROM and firmware images are installed on t

Chapter 17 System Management 341Parameter DescriptionThe Option ROM and firmware upgrade command have the following options:Resetting the HCAIf needed

342 XgOS User’s Guide • September 2014For example, if you have link state for the HCA but the following error is displayed,you would want to use the r

Chapter 17 System Management 343Displaying All Firmware Images on theOracle Fabric InterconnectAt any time, you can display a list of all the firmware

Chapter 1 XgOS CLI Overview 11vNIC Command Examples Create a new vNIC for xserver1 and assign it to port 2 on the Ethernet module inslot 8: Give vni

344 XgOS User’s Guide • September 2014Removing the FirmwareIf needed you can delete an installed Option ROM image from the Oracle FabricInterconnect b

Chapter 17 System Management 3453. When you find the correct firmware version, download it to the Oracle FabricInterconnect.For example:When this step

346 XgOS User’s Guide • September 201411. Upgrade the firmware by issuing the set physical-server command.For example:Note – The CLI will temporarily

Chapter 17 System Management 347Applying System PatchesA system patch is an XPF (Xsigo Package File) that provides a focused fix for aspecific file or

348 XgOS User’s Guide • September 2014Command SyntaxParameter DescriptionThe system patch commands take the following command options:▼ Apply a PatchP

Chapter 17 System Management 349The following procedure assume that you are using the system patch command.To apply a patch, follow this procedure:1.

350 XgOS User’s Guide • September 2014b. Run the system unpatch command against the patch.For example:3. To upgrade minus the patch:a. When the downgr

351CHAPTER18Scripting XgOS CommandsThe XgOS CLI scripting engine provides the Aikido scripting language, completedscripts for simplified user commands

352 XgOS User’s Guide • September 2014Aikido Scripting LanguageAll onboard scripts were created using the Aikido Language System. Aikido is aninterpre

Chapter 18 Scripting XgOS Commands 353Example: Move and Rename Filescat /bin/mv#> Rename files/* * (C) 2004,2005 XSIGO SYSTEMS Inc. All rights rese

12 XgOS User’s Guide • September 2014vHBA Command Examples Create a new vHBA for xserver1 and assign it to port 1 on the FC module in slot15: Displa

354 XgOS User’s Guide • September 2014SEDIT Script EditorThe Script Editor (SEDIT) is a simple but powerful onboard text editor that runsfrom within t

Chapter 18 Scripting XgOS Commands 355SEDIT runs as a script named sedit:See help sedit for documentation:▼ Create Your Own CommandsUse the Xsigo Scri

356 XgOS User’s Guide • September 2014

357CHAPTER19Source RPM: Building OVN HostDriversOracle provides source RPM Package Managers (RPMs) for advanced users anddevelopers to help support a

358 XgOS User’s Guide • September 2014OverviewOracle distributes two types of host driver RPMs—binary and source. Binary RPMsare compiled for a specif

Chapter 19 Source RPM: Building OVN Host Drivers 359headers, kernel symbol-files, kernel config (.config), additional patches, updates,and fixes. In s

360 XgOS User’s Guide • September 2014Then install the binary RPM:The SPEC FileOften, a user will find it necessary to customize some aspect of the dr

Chapter 19 Source RPM: Building OVN Host Drivers 361infer_ib_devel_headers This option allows you to build the Oraclehost drivers against updated OFED

362 XgOS User’s Guide • September 2014Environment VariablesWhen building the drivers, you might need to override some default locations andvalues. The

Chapter 19 Source RPM: Building OVN Host Drivers 363 Dependencies: kernel-devel RPMIn this scenario, all of your kernel source and devel-headers/obje

Chapter 1 XgOS CLI Overview 13 Request an unbound vHBA to logout of the SAN fabric: Display vHBA targets:See “Virtual Host Bus Adapters (vHBAs)” on

364 XgOS User’s Guide • September 2014Build Option 3: Kernel With UpgradedOFED StackSource RPMs are available by request from Oracle Customer Support.

Chapter 19 Source RPM: Building OVN Host Drivers 365Build Option 4: Combination ofCustomer Kernel and Upgraded OFEDStackSource RPMs are available by r

366 XgOS User’s Guide • September 2014While Oracle intends their drivers to be installed on a system which leverages theRPM (Redhat Package Manager),

Chapter 19 Source RPM: Building OVN Host Drivers 367Example:Note the first < is part of the command and the <> denotes the file name.RDMA Hea

368 XgOS User’s Guide • September 2014If running against a OFED-1.2.5.X IB stack, the following kernel log message(dmesg) is benign:Required Informati

369CHAPTER20Upgrading XgOSThis section provides information of upgrading the XgOS software on the OracleFabric Interconnect. It contains the following

370 XgOS User’s Guide • September 2014 file, for upgrading from a file that has already been downloaded to the OracleFabric Interconnect. This option

Chapter 20 Upgrading XgOS 371Note – When importing a backed-up configuration, it is very important that thehardware configuration on the Oracle Fabric

372 XgOS User’s Guide • September 2014Basic Upgrade ProcessIf you are upgrading from XgOS 3.5.0 to XgOS 3.6.0 or later, you do not need to keepthe Ora

Chapter 20 Upgrading XgOS 373▼ Upgrade OS on the Oracle Fabric Interconnect1. Log in to the Oracle Fabric Interconnect as admin.2. (Optional) If any o

iv XgOS User’s Guide • September 2014vNIC Command Examples 11vHBA Commands 11vHBA Command Examples 12vHBA Prescan Examples 12I/O Card Commands 13I/O C

14 XgOS User’s Guide • September 2014Miscellaneous Show Commands Display the XgOS version: Display the current system configuration: Display manage

374 XgOS User’s Guide • September 2014 Using FTP, type:If you upgrade using FTP, you will be prompted for a password.Note – If you get the this error

Chapter 20 Upgrading XgOS 3755. Wait for the I/O cards in the Fabric Interconnect to finish initializing beforeproceeding.To determine whether the I/O

376 XgOS User’s Guide • September 2014While the first Fabric Interconnect was unavailable, host servers that were using itfailed over to use the other

Chapter 20 Upgrading XgOS 377 ConnectX and ConnectX-2: 2.7.0 and laterIt requires option ROM 2.8.7 to support SAN boot. If your firmware and XgBootve

378 XgOS User’s Guide • September 2014e. Select the most recent firmware (the one displayed first).You will need to reboot for the firmware upgrade to

Chapter 20 Upgrading XgOS 3797. Reboot the server.This completes the Linux host server upgrade. If you have more servers to upgrade,complete that task

380 XgOS User’s Guide • September 2014Caution – Make sure to select the compatible pair of drivers. If you attempt toinstall an incompatible Xsigo dri

Chapter 20 Upgrading XgOS 381Upgrading Windows Host ServersWhen using vNICs in an HA configuration, system .DLL files are in use. Thisprevents the upg

382 XgOS User’s Guide • September 2014Note – The space following the equals sign (=) is mandatory.This command causes the service to delay its start u

Chapter 20 Upgrading XgOS 3834. When prompted, enter 1 to enter the Flash HCA Firmware Menu.5. When prompted, select the firmware version that you wan

Chapter 1 XgOS CLI Overview 15 dash (-)The names of virtual resources are restricted to the following lengths: vNICs: between 2 and 10 characters v

384 XgOS User’s Guide • September 2014The following example shows updating the HCA with firmware version 5.2.0.6. Press Enter to exit the update scrip

Chapter 20 Upgrading XgOS 385For example, for lanmanserver (the server service):sc config lanmanserver depend= xgdependrootNote – The space following

386 XgOS User’s Guide • September 2014You must upgrade one ESX Server and one at a time. After they reboot running thenew software version, you will u

Chapter 20 Upgrading XgOS 387Compatible Software VersionsYou will typically need different host drivers depending on your version of ESXServer softwar

388 XgOS User’s Guide • September 20144. Save your current I/O configuration:Where xgos-3.9.0.xml is the existing configuration file.5. Disable the se

Chapter 20 Upgrading XgOS 3899. Install the new Xsigo drivers package:10. Confirm that the updated packages have been installed:Note – Do not reboot t

390 XgOS User’s Guide • September 2014When you issue the system upgrade command, the Fabric Interconnect begins theupgrade. While the upgrade occurs,

Chapter 20 Upgrading XgOS 39116. When the I/O cards all show up/up, check the state of the vNICs and vHBAs:The state of the vNICs and vHBAs should be

392 XgOS User’s Guide • September 2014b. For vHBAs, type:When the State field shows active, the vHBA is up and connected.19. Verify that the new softw

Chapter 20 Upgrading XgOS 393When you have finished, your system configuration resembles that shown in thefigure.3. Log in to Fabric Interconnect 2 as

16 XgOS User’s Guide • September 2014

394 XgOS User’s Guide • September 20146. Use VMotion to restore your initial configuration.Your system configuration should now resemble that shown in

395GlossaryAActive Directory Active Directory (AD) is an implementation of LDAP directory services byMicrosoft for use primarily in Windows environmen

396 XgOS User’s Guide • September 2014upper-level protocols (FC-4). Each of these levels defines a different andseparate part of how the FC equipment

397I/O Module A physical card that is installed in one of 15 slots in the chassis’ card bay.There are two types of I/O module: Ethernet and Host Bus A

398 XgOS User’s Guide • September 2014MManaged Object An object-oriented representation of a resource managed in a device. Thiscan be a physical or lo

399QQuality of Service The Quality of Service (QoS) object allows the data traffic of individualapplications or interfaces to be managed. The performa

400 XgOS User’s Guide • September 2014SCSI Small Computer Systems Interface. In the early 1980s, SCSI was the standarddirect-attach storage interface

401VM Virtual Machine. A VM is a software entity that runs its own operatingsystems and applications, as if it were a physical computer. A VM behavese

402 XgOS User’s Guide • September 2014

403IndexSymbols* (wildcard), 6Numerics10GE VLAN examples, 12610-Port GE VLAN examples, 1261-port 10GbE I/O modules, 27AAAA, 247access mode, 120access

17CHAPTER2Configuring Hardware ElementsWhen configuring virtual I/O, you must refer to the various hardware elements ofthe Oracle Fabric Interconnect.

404 XgOS User’s Guide • September 2014collecting debug information, 49command completion, 3command history, 5command-line interface, 1, 369command com

Index 405ESX Server configuration, 182persistent mapping, 143, 146prescan vHBA, 148removing prescan information, 150rescanning, 150resetting I/O module

406 XgOS User’s Guide • September 2014displaying search order, 269using internal, 250using local, 250predefined user roles, 250using RADIUS, 265in-band

Index 407see link aggregation groupsNIC teamingsee link aggregation groupsNIC teaming with ESX Server, 188no-confirm, 137no-lun-masking, 137, 174NPIV,

408 XgOS User’s Guide • September 2014root fs logout timer, setting, 270root login, 323root password, 324rpmbuild, 359RSCN, 147rule modifier, 214, 216r

Index 409show, command introduction, 14slots, numbering, 17SM, 20SNMP, 273add snmp trap-dest, 274SNMP MIBs, monitoring, 276source RPM, 357SPEC file, 36

410 XgOS User’s Guide • September 2014virtual I/O fabric, 239virtual I/O resourcesnaming restrictions, 14virtual LANs, 117virtual Network Interface Ca

18 XgOS User’s Guide • September 2014The following figure illustrates the InfiniBand and I/O ports on an Oracle FabricInterconnect F1-4.When referring

Chapter 2 Configuring Hardware Elements 19In command output, the module and slot consists of the following informationelements: connection type, for

20 XgOS User’s Guide • September 2014The Oracle Fabric Interconnect contains an embedded Subnet Manager (SM) thatmanages the switching and pathing tab

Chapter 2 Configuring Hardware Elements 21chassis-port ServerPort19id 2c90200204929state N/A/upm-key 0lid 4sm-lid

22 XgOS User’s Guide • September 2014Example: Display the Physical Servers Connectedto the ChassisThe OVN host drivers communicate with Xsigo’s OpenSM

Chapter 2 Configuring Hardware Elements 23I/O ModulesUse show iocard command to display available I/O line card information in thesystem.There are fea

Contents vExamples 29Determining HCA Ports and Checking Firmware Version in Servers 31Hardware Status and Environmentals 32Syntax 32Example: Display H

24 XgOS User’s Guide • September 2014The field “v-resources” indicates the number of Xsigo virtual resources (vNICs andvHBAs,) that are associated wit

Chapter 2 Configuring Hardware Elements 25The command shows information about a 10-Port GE module in slot 2 including theVLAN number on the port, the

26 XgOS User’s Guide • September 2014Parameter DescriptionCaution – If you are pre-provisioning, when you actually install hardware modules,make sure

Chapter 2 Configuring Hardware Elements 27Example: Shut Down a Single I/O ModuleTo shut down a single I/O module:Example: Bring Up an I/O ModuleTo bri

28 XgOS User’s Guide • September 2014 128 vNICs per card Card-level High Availability (HA) Access Control List (flow) policing QoS on the vNICs co

Chapter 2 Configuring Hardware Elements 29I/O PortsUse show ioport to display I/O port information on an I/O port.SyntaxExamplesdescrtype nwEthern

30 XgOS User’s Guide • September 20142/2 nwEthernet1GbPort up/up 02/3 nwEthernet1GbPort up/up 02/4 nwEthernet1GbPort up/up 02/5 nwEthernet1GbPort up/u

Chapter 2 Configuring Hardware Elements 31Determining HCA Ports and CheckingFirmware Version in ServersServers can contain single- or dual-port HCA ca

32 XgOS User’s Guide • September 2014The Oracle Fabric Interconnect uses only memory-free HCAs. Because of the wayWindows queries the HCA for firmware

Chapter 2 Configuring Hardware Elements 33Example: Display Hardware Status for an OracleFabric Interconnect F1-15The show hardware command displays co

vi XgOS User’s Guide • September 2014Displaying CLI Attributes 56Syntax 56Example: Display the CLI Mode 56XgOS CLI Example: Configure the Idle Session

34 XgOS User’s Guide • September 2014-----------------------------------------------------------------4 nwEthernet4Port10GbCardEthIb up in=34 ou

Chapter 2 Configuring Hardware Elements 35## Front Panel Environment status ############################################state temperatures voltages---

36 XgOS User’s Guide • September 2014Example: Show Fabric Board Information for anOracle Fabric Interconnect F1-15 (QDR Fabric)The show hardware comma

Chapter 2 Configuring Hardware Elements 37Also, the show fabric-port command shows the fabric type and speed for anindividual Fabric Board with a conn

38 XgOS User’s Guide • September 2014Finally, you can use the show system info command to display a quick summaryof the Oracle Fabric Interconnect’s e

Chapter 2 Configuring Hardware Elements 39The show hardware command displays comprehensive output of all the importanthardware information for a Oracl

40 XgOS User’s Guide • September 20141 record displayed## Front Panel Environment status ############################################state temperature

Chapter 2 Configuring Hardware Elements 41Examples: Show Fabric Board Information for anOracle Fabric Interconnect F1-4 (QDR Fabric)The show hardware

42 XgOS User’s Guide • September 2014Also, the show fabric-port command shows the fabric type and speed for anindividual Fabric Board with a connected

Chapter 2 Configuring Hardware Elements 43Finally, you can use the show system info command to display a quick summaryof the Oracle Fabric Interconnec

Contents viiSyntax 70Parameter Descriptions 70Optional Modifiers 71▼ Create a Server Profile 71Default Gateway 72Syntax 73Parameter Descriptions 73Opt

44 XgOS User’s Guide • September 2014Interfaces and Interface StateEach slot/port has its own interface (if) with state information (if-state):ipconfi

45CHAPTER3XgOS File System Access andLoggingThe XgOS CLI provides a basic, unix-like file system. This chapter present thefollowing topics about using

46 XgOS User’s Guide • September 2014Default LoginThe default login home directory is /home/admin:All user data is stored in the User data partition o

Chapter 3 XgOS File System Access and Logging 47Parameter Descriptionfile hash <filename>file list [-long] [-recursive] [-short]file move <fi

48 XgOS User’s Guide • September 2014file upload <filename> Specifies the file on the Oracle Fabric Interconnect that willbe uploaded to ftp.xsi

Chapter 3 XgOS File System Access and Logging 49Note – The copy schemes are used by the system upgrade command. See“System Image Upgrades” on page 313

50 XgOS User’s Guide • September 2014Example: Archive and CompressTo create an archive then compress it:Example: Upload and DownloadTo upload a file n

Chapter 3 XgOS File System Access and Logging 51LoggingLog files are stored in /log.The last bootup data of the chassis is stored in “dmesg”:Standard

52 XgOS User’s Guide • September 2014Example:User debugging goes to “user-debug.log” where log rotation also occursautomatically::Jun 6 00:00:01 iowa

53CHAPTER4Configuring the XgOS CLIThis chapter describes commands that configure the XgOS CLI itself or display thatconfiguration. It contains the fol

viii XgOS User’s Guide • September 2014Example: Watch an Ethernet Card 92Gigabit Ethernet Port State 92Example: Show an Ethernet Port 93Example: Show

54 XgOS User’s Guide • September 2014SyntaxParameter Descriptionset cli autocommit {off|on} [-noconfirm]set cli block-entry {off|on}set cli color {off

Chapter 4 Configuring the XgOS CLI 55Example: Controlling Echo on the Command Lineecho {off|on} Displays all CLI communication. The on option will ech

56 XgOS User’s Guide • September 2014Displaying CLI AttributesUse the show cli command to display different attributes of the CLI itself.SyntaxExample

Chapter 4 Configuring the XgOS CLI 57XgOS CLI Example: Configure the Idle SessionTime-outDisplaying CLI Output Vertically(Wrapping)When the terminal d

58 XgOS User’s Guide • September 2014CLI Display FiltersDisplay output can be sent through different CLI display filters. By default, the CLIdisplay i

Chapter 4 Configuring the XgOS CLI 59Example: Show Configuration in a ListExample: Show Configuration in XML FormatExample: Sort CLI Output by Columns

60 XgOS User’s Guide • September 2014To specify multiple columns:This command will use “name” as the primary sort and “if” as the secondary.To perform

Chapter 4 Configuring the XgOS CLI 61Example: Set CLI Terminal Screen RowsCLI HistoryUse the show cli history command to display the history of issued

62 XgOS User’s Guide • September 2014▼ Search the CLI History1. Press Ctrl-R to initiate a history search:Ctrl-C will interrupt the search. Repeated C

Chapter 4 Configuring the XgOS CLI 63The following example shows a simple script of displaying vNICs. During the CLIrecording phase, the commands issu

Contents ixTCP Segmentation Offload 111Requirements 111Syntax 112Parameter Description 112▼ Configure TCP Segmentation Offoad 112Receive Batching 114R

64 XgOS User’s Guide • September 2014The final part of this example is running the script:type dhcpvlans noneqos ----------------------

Chapter 4 Configuring the XgOS CLI 65vlans noneqos -------------------------------------------------------------------name pubstest.sun

66 XgOS User’s Guide • September 2014Saving and Restoring ConfigurationsBefore you perform a firmware upgrade in XgOS, Oracle recommends you exportyou

Chapter 4 Configuring the XgOS CLI 67Example: Save and Restore System ConfigurationThe -xml option is the default behavior. You can omit it.system exp

68 XgOS User’s Guide • September 2014

69CHAPTER5Server Profiles and GatewaysThis chapter describes how to configure the Oracle server profiles and the defaultgateway. “Server Profiles” on

70 XgOS User’s Guide • September 2014SyntaxParameter Descriptionsadd server-profile <name> <physical-server>add server-profile <name>

Chapter 5 Server Profiles and Gateways 71Optional Modifiers▼ Create a Server ProfileTake the following steps to create a server profile:1. Add a serve

72 XgOS User’s Guide • September 20142. Select the desired server and create the server profile:3. Verify the profile was created correctly:No I/O res

Chapter 5 Server Profiles and Gateways 73SyntaxParameter DescriptionsOptional Modifiersadd gateway <gw-name> <ip-addr> <dns> <dom