Task 5: Run the discover Command to Discover Hardware Components

The next step in the configuration process is the discovery of all system (hardware) components. In addition to configuring the system topology by discovering all hardware components, the discover command also configures the administration network and interconnect and populates the configuration and management database (CMDB).

The discover process differs if HP server blades and enclosures are present in the hardware configuration. Follow the discovery instructions in one of the following sections:

Discovering Non-Blade Hardware Configurations

Follow this procedure if the hardware configuration does not contain HP server blades and enclosures:

Begin this procedure as the root user on the head node.
Start a script to capture command output into a file. This step is optional, but HP recommends doing so.
# script your_filename

Change to the configuration directory:

# cd /opt/hptc/config/sbin

NOTE: Follow this procedure before you run the discover command if you want to locate the console port of a non-blade head node on the administration network and not on the external network:

Set the IP address for the head node console port to a static IP address that is not currently in use by the HP XC system. Typically, this address can be 172.31.47.240, which is the top end of addresses defined for the HP XC switches defined in the /opt/hptc/config/base_addrV2.ini file.
Add the address to the top portion of the /etc/hosts file. The top portion of this file is reserved for user customizations. Add the entry similar to the following:
172.31.47.240 cp-n0

Start the discovery of all network components:
# ./discover --system \ [--super] \ [--oldmp] \ [--outfile file_name] \ [--ic={AdminNet|Ethernet|Infiniband|Myrinet|Quadrics}] \ [--verbose]
Notes About the discover Command-Line Options
- The --super option is required for large-scale systems (systems with up to 1024 compute nodes) with a hardware configuration that consists of a Super Root Switch into which multiple Root Administration Switches are connected.
- The --oldmp option is required on HP Integrity servers (such as the rx8620) if their management processors (MP) have statically set IP addresses and are not configured to use DHCP. The --oldmp option is no longer required if the HP Integrity server has been upgraded with MP firmware Version 3.15 or newer.
  Do not include the --oldmp option on the command line for HP ProLiant nodes because that hardware family uses iLO and LO-100i as their console port management devices and uses DHCP to obtain their IP addresses.
- The --outfile file_name option saves a copy of the HP XC system information that is written to the configuration and management database. The file name you specify must already exist on the head node. Saving this information optional, but it enables you to use the --infile file_name option if it becomes necessary to restore the HP XC system to the point in the installation just after the discover command was run but before the cluster_config utility is run.
- The --ic={AdminNet|Ethernet|Infiniband|Myrinet|Quadrics} option specifies the type of interconnect to configure. If you do not specify this option, the discover utility configures the fastest interface it finds available in the hardware configuration. Your entries are case sensitive.
  When the interconnect is configured on the administration network, a single LAN is used. The administration network and the interconnect share the same ports and switches.
  All other interconnect types (Myrinet, InfiniBand, and Quadrics) are discovered automatically based on the interconnect found on the head node. You are not required to specify these interconnects on the command line.
- The --verbose option provides useful feedback during the discovery process that enables you to follow along. HP recommends including it on the command line.
- Table 3-2 and discover(8) contain information about additional keywords you can add to the command line to omit some of the questions that will be asked during the discovery process. Use of these keywords is optional.
- If you encounter problems during the discovery process, see “Troubleshooting the Discovery Process” for troubleshooting guidelines.
- The discover command does not properly discover HP ProLiant DL140 and DL145 servers until the password is set. Running the discover command now determines the IP address of the console ports so you can use the telnet command to access the console ports and set the password. This process is described in “Modify the Default Password for HP ProLiant DL140 and DL145 Hardware Models”.

Look at the screen and follow along with the command output. Table 3-2 describes each prompt and provides information to help you with your answers.

The sample output shown in Example 3-1 was created by using the --verbose option on a small HP XC system with six HP ProLiant servers (Opteron architecture).
The sample output shown in Example 3-2 was created on an large-scale HP XC system with more than one region.

The output you see will be different. The information you are prompted to supply depends on whether or not you entered additional keywords on the command line.

Example 3-1 discover Command Output On A Small Non-Blade Configuration

Enter the actual total number of nodes in this cluster: 6
Enter the number of nodes that are workstations: 0 

Discovering Root switches...
Enter the MAC address of the admin root switch
in the format xx:xx:xx:xx:xx:xx : your_MAC_address    1
Please enter the ProCurve switch Administrator password: your_password  2
Please re-enter password: your_password
Restarting dhcpd

Enter the common user name for all console port management 
devices: your_user_name   3
Please enter the password for your_user_name: your_password
Please re-enter password: your_password

Discovering 172.20.65.2 port 39 ... Console Port OK
Restarting dhcpd
discovered_cps is 4
Checking if all console ports are reachable ...
number of cps to check, 3
pinging 172.21.0.13  no response from 172.21.0.13

pinging 172.21.0.15  no response from 172.21.0.15

pinging 172.21.0.14  no response from 172.21.0.14

Following console ports did not respond:
 172.21.0.13 172.21.0.15 172.21.0.14

number of cps to check, 3
pinging 172.21.0.13
pinging 172.21.0.15
pinging 172.21.0.14  .done
Opening /etc/hosts
Opening /etc/hosts.new.XC
Opening /etc/powerd.conf
Building /etc/powerd.conf ... Querying cp-n13
Querying cp-n14
Querying cp-n15  4
done
Attempting to start hpls power daemon ... done
Waiting for power daemon ... done

switchName necs1-1 switchIP 172.20.65.2 type 2650
switchName nems1-1 switchIP 172.20.65.1 type 2848
Attempting to power on nodes with nodestring 8n[13-15]
Powering on all known nodes ... done

Discovering Nodes...
running port_discover on 172.20.65.1
nodes Found = 1 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 1 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 1 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 1 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 3 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 3 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 3 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 3 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 3 nodes Expected = 4

running port_discover on 172.20.65.1
nodes Found = 4 nodes Expected = 4

All nodes initialized.
Powering off all nodes but head node ... done
Switch 172.20.65.1 port 42 ... Node Found
Switch 172.20.65.1 port 41 ... Node Found
Switch 172.20.65.1 port 40 ... Node Found
Switch 172.20.65.1 port 39 ... Node Found
Switch 172.20.65.1 port 38 ... NO Node Found  5
Restarting dhcpd
node n14 set to model ProLiant DL145 G1
node n13 set to model ProLiant DL145 G2
node n15 set to model ProLiant DL145 G1
node n16 set to model ProLiant DL585 G1
Opening /etc/hosts
Opening /etc/hosts.new.XC
Head Node CP device type set to iLO
Waiting for power daemon to restart... done

1	Enter the MAC address of the switch that is connected to the administration ports. Do not enter the MAC address of the switch connected to the console ports.
2	Enter the password for the Root Administration Switch that you previously defined when you prepared the hardware. If you did not preset a password, press the Enter key.
3	Enter the common user name and password that you previously defined for the console port management devices (the iLO, LO-100i, or MP devices) when you prepared the hardware. If you did not predefine these items, press the Enter key.
4	If the discover process hangs while trying to discover console ports, see Chapter 12.
5	This is expected behavior. Because this is a cluster discovery process, the command output `No Switch Found` or `No Node Found` is expected. This message does not indicate a failure unless a network component is plugged into that port on the switch. If necessary, see Chapter 12 for information about troubleshooting problems you might encounter during the discovery process.

Example 3-2 shows the unique command output for a large-scale system with two regions; all other command output is similar to the previous example.

Example 3-2 discover Command Output For Large-Scale Systems

The discover process has detected 2 regions. Is this correct? [y/n] y
switchName nems0-1-0 switchIP 172.20.65.1 type 2848 
Enter the actual total number of nodes in region 1: 526
Enter the number of nodes that are workstations: 0
Enter the actual total number of nodes in region 2: 504
Enter the number of nodes that are workstations: 0
discoverSystem called with switch nems1-1-1 and Region Number 1

If the hardware configuration contains HP workstations and you installed SVA, turn on power to the render and display workstations. Then, when prompted, turn off power to the same nodes, leaving the head node power turned on.
If you captured the output of the discover command in a file (described in step 2), press Ctrl-d to end the script session now.
This file is for your information only. Store this file in a directory where you keep administrative data.
Do one of the following:
- Proceed to “Modify the Default Password for HP ProLiant DL140 and DL145 Hardware Models” if the hardware configuration contains HP ProLiant DL140 and DL145 hardware models.
- Proceed to “Task 6: Set Up the System Environment” if the hardware configuration does not contain HP ProLiant DL140 and DL145 hardware models.

Discovering Hardware Configurations With Server Blades and Enclosures

The HP XC System Software has been designed to communicate directly with the Onboard Administrator on each enclosure. Thus, the discover command obtains the required configuration information directly from the Onboard Administrator to automatically discover all components in the hardware configuration.

Discovering hardware configurations with server blades and enclosures is a multiple-step process. First, the switches are discovered, which activates the administration network. Next, you perform hardware preparation tasks such as setting up passwords and making BIOS settings. Then, the enclosures and nodes are discovered.

Complete these tasks in the following order:

Discover Switches

Follow this procedure to discover the switches and activate the administration network. Before you begin, you must have already returned the Onboard Administrator to its original configuration and you must be logged in to the head node through the external network connection.




	NOTE: The following procedure assumes that all enclosures have been physically set up and populated with nodes, all components have been cabled together as described in the HP XC Hardware Preparation Guide, you have prepared the head node and the non-blade server nodes according to the instructions in the HP XC Hardware Preparation Guide, and the server blade head node is installed with HP XC System Software.

Begin this procedure as the root user on the head node.
Start a script to capture command output into a file. This step is optional, but HP recommends doing so.
# script your_filename
Change to the following directory:
# cd /opt/hptc/config/sbin

Discover the switches:

# ./discover --enclosurebased --network [--ic=AdminNet] --verbose




	NOTE: The [--ic=AdminNet] option is required only if you are configuring the interconnect on the administration network.

Command output looks similar to the following:

Discovery - XC Cluster version HP XC V3.1 RC2 20061022

Enter the MAC address of the switch the head node plugs into
in the format xx:xx:xx:xx:xx:xx : your_MAC_address
Please enter the Procurve switch Administrator password : your_password
Please re-enter password: your_password

Discovering Switches...
Restarting dhcpd
Waiting for IP addresses to stabilize .................... done

discoverSwitches: IP: 172.31.32.1 name: blc1nxcsw000000000000-0
model: 2824 MaxPorts: 24
Checking switch 172.31.32.1 for neighboring switches ... done

discoverSwitches: IP: 172.31.63.252 name: blc1nxcsw001708ad3740-24
model: 2626 MaxPorts: 26
Checking switch 172.31.63.252 for neighboring switches ... done

found switch blc1nxcsw000000000000-0 in both database and switch Hash, 
ignoring 
Restarting dhcpd waiting for network component at 172.31.32.2 to 
become available.
........
switchName blc1nxcsw001708ad3740-24 switchIP 172.31.32.2 type 2626
switchName blc1nxcsw000000000000-0 switchIP 172.31.32.1 type 2824

Proceed to “Set the Onboard Administrator Password and Make BIOS Settings”.

Set the Onboard Administrator Password and Make BIOS Settings

Discovering the switches activated the administration network, so you can now log in to the Onboard Administrator on every enclosure and set a common user name and password and make the appropriate BIOS settings on all server blade nodes. These tasks are documented in the HP XC Hardware Preparation Guide (BIOS settings depend upon the hardware model type).

Return here when you have finished with those tasks and proceed to “Discover All Nodes and Enclosures”.

Discover All Nodes and Enclosures

Follow this procedure to discover all enclosures and all nodes (including server blades) in the hardware configuration. This discovery process assigns IP addresses to all hardware components:

Begin this procedure as the root user on the head node.
Start a script to capture command output into a file. This step is optional, but HP recommends doing so.
# script your_filename
Change to the following directory:
# cd /opt/hptc/config/sbin

Discover all enclosures:

# ./discover --enclosurebased --enclosures

Discovery - XC Cluster version HP XC V32 20061022

Enter the common user name for all console port management devices: 
 your_username
Please enter the password for Administrator: your_password
Please re-enter password: your_password
Discovering blade enclosures ...
Checking switch 172.31.32.2 for active ports ...done
Getting MAC addresses from switch 172.31.32.2 ... done
Checking switch 172.31.32.1 for active ports ...done
Getting MAC addresses from switch 172.31.32.1 ... done
Enclosure blc1n-enc09USE6391TF5 found
Discovering virtual enclosures ...
Checking switch 172.31.32.2 for active ports ... done
Getting MAC Addresses from switch 172.31.32.2 ... done
Checking switch 172.31.32.1 for active ports ... done
Getting MAC Addresses from switch 172.31.32.1 ...done

Discover all nodes:

# ./discover --enclosurebased --nodesonly --verbose

Command output is similar to the following:

Discovery - XC Cluster version HP XC Vn.n <timestamp>

Enter the common user name for all console port management devices:  
your_username
Please enter the password for Administrator: your_password
Please re-enter password: your_password
Discovering Blades ...
Blade found in enclosure blc1n-enc09USE6391TF5 bay 1, name is blc1n1 
Blade found in enclosure blc1n-enc09USE6391TF5 bay 2, name is blc1n2 
Blade found in enclosure blc1n-enc09USE6391TF5 bay 3, name is blc1n3 
Blade found in enclosure blc1n-enc09USE6391TF5 bay 4, name is blc1n4 
Blade found in enclosure blc1n-enc09USE6391TF5 bay 5, name is blc1n5 
Discovering Non-Blade systems ...
Setting system name to blc1n0
uploading database
Restarting dhcpd
Opening /etc/hosts
Opening /etc/hosts.new.XC
Opening /etc/powerd.conf
Building /etc/powerd.conf ... done
Attempting to start hpls power daemon ... done 
Waiting for power daemon ... done

Checking if all console ports are reachable ...
number of cps to check, 5
checking 172.31.16.5
checking 172.31.16.1
checking 172.31.16.4
checking 172.31.16.3
checking 172.31.16.2  .done
Starting CMF for discover...
Stopping cmfd:                                             [FAILED] 1
Starting cmfd:                                             [  OK  ]
Waiting for CMF to establish console connections .......... done

uploading database
Restarting dhcpd
Opening /etc/hosts
Opening /etc/hosts.new.XC
Opening /etc/powerd.conf
Building /etc/powerd.conf ... done
Attempting to start hpls power daemon ... done 
Waiting for power daemon ... done

uploading database

1	The discover command turns off the console management facility (CMF) daemon. If the CMF daemon is not running, a “FAILED” message is displayed. This message is expected, and you can ignore it.

Do one of the following:
- Proceed to “Modify the Default Password for HP ProLiant DL140 and DL145 Hardware Models” if the hardware configuration contains HP ProLiant DL140 and DL145 hardware models.
- Proceed to “Task 6: Set Up the System Environment” if the hardware configuration does not contain HP ProLiant DL140 and DL145 hardware models.

Modify the Default Password for HP ProLiant DL140 and DL145 Hardware Models

Perform this task only if the hardware configuration contains HP ProLiant DL140 and DL145 hardware models (G2 and G3) to modify the default console management device password. Changing the default password is not required, but HP recommends changing the factory default value for security purposes. Omit this step for all other server models.

Use the method of your choice to view the /etc/dhcpd.conf file and look for the characters cp- in host names to determine console port names.
Use the telnet command and the internal name of the console port to log in to each node's console management device and change the default password. Supply the factory default user name admin and the default password admin to log in:
# telnet cp-node_name login: admin password: admin

The interface you use to change the password differs depending upon the BMC firmware version. Thus, do one of the following:

For BMC Firmware Version 1.03:

Press Esc and Shift-9 to enter the command-line mode.

Use the C[hange Password] option to change the console port password. The factory default password is admin; change it to the password of your choice. This password must be the same on every node in your system.

Lights-Out> C 
Type the current password> admin 
Type the new password (max 16 characters)> your_password 
Retype the new password (max 16 characters)> your_password 
New password confirmed.
Lights-Out> exit

For BMC Firmware Version 1.24 or higher:
1. Press Esc and Shift-9 to enter into the command-line mode.
2. Change to the following directory:
  /directory_name/-> cd map1/accounts
3. List the pre-defined users (by default, 16 users have been pre-defined):
  /directory_name/-> show
4. One user at a time, use the show command until you find the first instance of the user name admin . Start with user1 and continue executing the show command for each user in sequential order:
  /directory_name/-> show user1 /directory_name/-> show user2 {...userN}
  For the purposes of this example, assume that user3 is the first instance of the user name admin .
5. Change directory to the user directory obtained in the previous step:
  /directory_name/-> cd user3
6. Set the password. Be very careful with your key strokes; there is no password verification step:
  /directory_name/-> set password=your_password
7. Exit from the interface:
  /directory_name/-> exit

Repeat this procedure to change the console management device password on every HP ProLiant DL140 and DL145 node in the hardware configuration.
Rerun the discover command with the same options.

Task 5: Run the discover Command to Discover Hardware Components

Technical documentation

» Table of Contents

» Glossary

» Index