Jump to content United States-English
HP.com Home Products and Services Support and Drivers Solutions How to Buy
» Contact HP
More options
HP.com home
Managing Serviceguard Version A.11.16, Eleventh EditionSecond Printing > Chapter 7 Cluster and Package Maintenance

Reconfiguring a Cluster

» 

Technical documentation

Complete book in PDF
» Feedback
Content starts here

 » Table of Contents

 » Index

You can reconfigure a cluster either when it is halted or while it is still running. Some operations can only be done when the cluster is halted. Table 7-1 “Types of Changes to Permanent Cluster Configuration ” shows the required cluster state for many kinds of changes.

Table 7-1 Types of Changes to Permanent Cluster Configuration

Change to the Cluster Configuration

Required Cluster State

Add a new node

All cluster nodes must be running. Serial heartbeat must not be configured.

Delete a node

A node can be deleted even though it is unavailable or unreachable.

Add a volume group

Cluster may be running or halted.

Delete a volume group

Cluster may be running or halted. Packages that use the volume group will not be able to start again until their control scripts are modified.

Change Maximum Configured Packages

Cluster must not be running.

Change Timing Parameters

Cluster must not be running.

Change Quorum Server Configuration

Cluster must not be running.

Change Cluster Lock Configuration

Cluster must not be running.

Change serial device filesCluster must not be running.
Change IP addresses for heartbeats or monitored subnetsCluster must not be running.

Change Access Control Policy (Serviceguard 11.16 or later)

Cluster and package may be running or halted.

Failover Optimization to enable or disable Faster Failover product

Cluster must not be running.

 

Reconfiguring a Halted Cluster

You can make a permanent change in cluster configuration when the cluster is halted. This procedure must be used for changes to the quorum server or lock disk configuration, changes in timing parameters, and changes to the Maximum Number of Packages parameter, but it can be used for any other cluster configuration changes as well.

Use the following steps:

  1. Halt the cluster on all nodes, using Serviceguard’s Halt Cluster command, or cmhaltcl on the command line.

  2. On one node, reconfigure the cluster as described in the chapter “Building an HA Cluster Configuration.” You can do this by using Serviceguard Manager (but only for Serviceguard version 11.16), or by issuing cmquerycl on the command line to generate an ASCII file, which you then edit.

  3. Make sure that all nodes listed in the cluster configuration file are powered up and accessible. To copy the binary cluster configuration file to all nodes, use Serviceguard’s Apply button, or cmapplyconf on the command line. This file overwrites any previous version of the binary cluster configuration file.

  4. Start the cluster on all nodes or on a subset of nodes. Use Serviceguard’s Run Cluster Admin command, or cmruncl on the command line.

Using Serviceguard Manager to Change MAX_CONFIGURED_PACKAGES

(Serviceguard 11.16 only, requires root login to the cluster.) First halt the cluster. Select it on the tree or map. From the Actions menu, select Administering Serviceguard, then Halt Cluster.

When halted, select the cluster in the map or tree. From the Actions menu, select Configuring Serviceguard. When the Configuring Cluster window opens, click the Parameters tab. Enter the new number. Click Apply. Close the configuration window. (After refresh, check the cluster’s Properties to see the change.)

Using Serviceguard Commands to Change MAX_CONFIGURED_PACKAGES

The cluster must be halted.

Use the cmgetconf command to obtain a current copy of the cluster's existing configuration. Example:

cmgetconf -C clconfig.ascii 

Edit the clconfig.ascii file to include the desired value for MAX_CONFIGURED_PACKAGES. Then use the cmcheckconf command to verify the new configuration. Time can be significantly reduced if you use the -k or -K options with cmcheckconf. Using -k or -K option with the cmcheckconf command, can significantly reduce the response time.

Use the cmapplyconf command to apply the changes to the configuration and send the new configuration file to all cluster nodes. Time can be significantly reduced if you use the -k or -K options with cmapplyconf.

Reconfiguring a Running Cluster

You can add new nodes to the cluster configuration or delete nodes from the cluster configuration while the cluster is up and running. Note the following, however:

  • You cannot change the quorum server or lock disk configuration while the cluster is running.

  • You cannot remove an active node from the cluster. You must halt the node first.

  • You cannot delete an active volume group from the cluster configuration. You must halt any package that uses the volume group and ensure that the volume is inactive before deleting it.

  • You cannot change cluster timing parameters.

  • The only configuration change allowed while a node is unreachable (for example, completely disconnected from the network) is to delete the unreachable node from the cluster configuration. If there are also packages that depend upon that node, the package configuration must also be modified to delete the node. This all must be done in one configuration request (cmapplyconf command).

Changes to the package configuration are described in a later section.

The following sections describe how to perform dynamic reconfiguration tasks using Serviceguard Manager or Serviceguard commands.

Using Serviceguard Manager to Add Nodes to the Configuration While the Cluster is Running

Select the cluster on the tree or map. Choose Configuring from the Actions menu. You need root permission on the cluster. On the Nodes tab, under Available nodes, highlight the node you want to add, and click Add. Then click Apply. After Refresh, check the cluster’s Properties to confirm the change.

Using Serviceguard Commands to Add Nodes to the Configuration While the Cluster is Running

Use the following procedure to add a node with HP-UX commands. For this example, nodes ftsys8 and ftsys9 are already configured in a running cluster named cluster1, and you are adding node ftsys10.

  1. Use the following command to store a current copy of the existing cluster configuration in a temporary file:

    # cmgetconf -C temp.ascii
  2. Specify a new set of nodes to be configured and generate a template of the new configuration. Specify the node name (31 bytes or less) without its full domain name; for example, specify ftsys8 and not ftsys8.cup.hp.com:

    # cmquerycl -C clconfig.ascii -c cluster1 \
    -n ftsys8 -n ftsys9 -n ftsys10
  3. Edit the file clconfig.ascii to check the information about the new node.

  4. Verify the new configuration:

    # cmcheckconf -C clconfig.ascii
  5. Apply the changes to the configuration and send the new binary configuration file to all cluster nodes:

    # cmapplyconf -C clconfig.ascii

Use cmrunnode to start the new node, and, if desired, set the AUTOSTART_CMCLD parameter to 1 in the /etc/rc.config.d/cmcluster file to enable the new node to join the cluster automatically each time it reboots.

NOTE: If you add a node to a running cluster that uses CVM disk groups, the disk groups will be available for import when the node joins the cluster.

Using Serviceguard Manager to Delete Nodes from the Configuration While the Cluster is Running

The node must be halted. If it is not, select it and choose Administering Serviceguard from the Actions menu. Choose Delete Node.

Select the cluster on the tree or map. Choose Configuring Serviceguard from the Actions menu. (You need root permission on the cluster.) On the Nodes tab, under Available nodes, highlight the node to remove, and click Delete. Then click Apply. After Refresh, check the cluster’s Properties to confirm the change.

If the node you wish to delete is unreachable (disconnected from the LAN, for example), you can delete the node only if there are no packages which specify the unreachable node. If there are packages that depend on the unreachable node, halt the cluster or use Serviceguard commands as described in the next section.

Using Serviceguard Commands to Delete Nodes from the Configuration While the Cluster is Running

Use the following procedure to delete a node with HP-UX commands. For this example, nodes ftsys8, ftsys9 and ftsys10 are already configured in a running cluster named cluster1, and you are deleting node ftsys10.

  1. Use the following command to store a current copy of the existing cluster configuration in a temporary file:

    # cmgetconf -C temp.ascii
  2. Specify the new set of nodes to be configured (omitting ftsys10) and generate a template of the new configuration:

    # cmquerycl -C clconfig.ascii -c cluster1 -n ftsys8 -n ftsys9
  3. Edit the file clconfig.ascii to check the information about the nodes that remain in the cluster.

  4. Verify the new configuration:

    # cmcheckconf -C clconfig.ascii
  5. Apply the changes to the configuration and send the new binary configuration file to all cluster nodes:

    # cmapplyconf -C clconfig.ascii
NOTE: If you are attempting to remove an unreachable node that has many packages dependent on it, especially if the dependent packages use a large number of EMS resources, you may see the following message:
The configuration change is too large to process while the cluster is running. 
Split the configuration change into multiple requests or halt the cluster.

In this situation, you must halt the cluster to remove the node.

Using Serviceguard Manager to Change the LVM Configuration While the Cluster is Running

Select the cluster on the tree or map. Choose Configuring Serviceguard from the Actions menu. (You need root permission on the cluster.) On the Logical Volumes tab highlight the node to add or remove, and click Add or Delete. Then click Apply. After Refresh, check the cluster’s Properties to confirm the change.

You cannot change the cluster lock volume group or physical volume configuration while the cluster is running.

NOTE: If you are removing a volume group from the cluster configuration, make sure that you also modify or delete any package control script that activates and deactivates this volume group. In addition, you should use the LVM vgexport command on the removed volume group from each node that will no longer be using the volume group.

Using Serviceguard Commands to Change the LVM Configuration While the Cluster is Running

Use the cmgetconf command to obtain a current copy of the cluster's existing configuration. Example:

cmgetconf -c clconfig.ascii 

Edit the file clconfig.ascii to add or delete volume groups. Then use the cmcheckconf command to verify the new configuration. Use the cmapplyconf command to apply the changes to the configuration and send the new configuration file to all cluster nodes.

Following is an example for adding two volume groups:

# cmcheckconf -C clconfig.ascii vgname1 vgname2

If there are a large number of volume groups, you can use a reference file that lists all the volume groups. Example, using a reference file:

# cmcheckconf -C clconfig.ascii vgreferencefile

Following are examples of removing the volume groups that were added in the preceding examples:

# cmcheckconf -C clconfig.ascii vgname1 -R vgname2
# cmcheckconf -C clconfig.ascii vgreferencefile

Use the cmapplyconf command to apply the changes to the configuration and send the new configuration file to all cluster nodes. Syntax for the options with cmapplyconf is the same as given for the cmcheckconf command above.

NOTE: If you are deleting from the cluster a volume group that is currently activated by a package, the configuration will be changed but the deletion will not take effect until the package is halted; thereafter, the package will no longer be able to run without further modification, such as removing the volume group from the package control script.

Changing the VxVM or CVM Storage Configuration

You can add VxVM disk groups to the cluster configuration while the cluster is running. To add new CVM disk groups, the cluster must be running.

Create CVM disk groups from this node. Open the configuration ASCII file of the package that uses the CVM storage; add the CVM storage group in a STORAGE_GROUP statement. Then issue the cmapplyconf command.

Similarly, you can delete VxVM or CVM disk groups provided they are not being used by a cluster node at the time.

NOTE: If you are removing a disk group from the cluster configuration, make sure that you also modify or delete any package control script that imports and deports this disk group. If you are removing a CVM disk group, be sure to remove the STORAGE_GROUP entries for the disk group from the package ASCII file.
Printable version
Privacy statement Using this site means you accept its terms Feedback to webmaster
© Hewlett-Packard Development Company, L.P.