Page 8
All caution and danger statements in this documentation begin with a number. This number is used to cross reference an English caution or danger statement with translated versions of the caution or danger statement in the IBM Safety Information book.
Page 9
Statement 1: DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. v Connect all power cords to a properly wired and grounded electrical outlet.
Page 10
Statement 2: CAUTION: When replacing the lithium battery, use only IBM Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer.
Page 11
Statement 4: ≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb) CAUTION: Use safe practices when lifting. Statement 5: CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device.
Page 12
If you suspect a problem with one of these parts, contact a service technician. Statement 10: CAUTION: Do not place any object on top of rack-mounted devices. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Safety Information This document is in PDF on the IBM Documentation CD. It contains translated caution and danger statements. Each caution and danger statement that appears in the documentation has a number that you can use to locate the corresponding statement in your language in the Safety Information document.
Problem Determination and Service Guide This document is in PDF on the IBM Documentation CD. It contains information to help you solve problems yourself, and it contains information for service technicians. Depending on the server model, additional documentation might be included on the IBM Documentation CD.
Features and specifications The following information is a summary of the features and specifications of the server. Depending on the server model, some features might not be available, or some specifications might not apply. Notes: 1. Racks are marked in vertical increments of 4.45 cm (1.75 inches). Each increment is referred to as a unit, or “U.”...
Page 16
Eight nodes System BIOS, diagnostics, service v 32-way operation processor, BMC, and SAS microcode v 128 DIMMs v 48 SAS hard disk drives v 48 PCI-X adapters IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
The baseboard management controller also provides remote server management capabilities through the OSA SMBridge management utility program. v IBM Director IBM Director is a workgroup-hardware-management tool that you can use to ® centrally manage IBM System x and xSeries servers. For more information, see the IBM Director documentation on the IBM Director CD.
Page 18
The Remote Supervisor Adapter II SlimLine also provides system monitoring, event recording, and dial-out alert capability. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Error correcting code (ECC) L2 cache and system memory v Fault-resistant startup v Hot-swap hard disk drives v IBM Director workgroup-hardware-management tool v Information and light path diagnostics LED panels v Optional service processor adapter for remote system management...
2000 Server, Windows XP Professional, Red Hat Linux, SUSE Linux, and Novell NetWare. For a complete list of operating systems that support IBM Director, see the IBM Director Compatibility Document. This document is in Portable Document Format (PDF) at http://www.ibm.com/pc/support/site.wss/document.do?lndocid= MIGR-61788.
Server controls, connectors, LEDs, and power This section describes the controls, connectors, and light-emitting diodes (LEDs) and how to turn the server on and off. Front view The following illustration shows the controls, LEDs, and connectors on the front of the server.
Page 22
DVD drive is in use. DVD-eject button: (Standard on some models only) Press this button to release a CD or DVD from the DVD drive. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Rear view The following illustration shows the connectors and LEDs on the rear of the server. Video connector: Connect a monitor to this connector. USB 1 connector: Connect a USB device to this connector. SP Ethernet 10/100 connector: Use this connector to connect the service processor to a network.
The power-on LED flashes to indicate that the server is connected to ac power but not turned on. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Turning on the server Approximately 20 seconds after the server is connected to ac power, the power-control button becomes active, and one or more fans might start running to provide cooling while the server is connected to power. You can turn on the server and start the operating system by pressing the power-control button.
Page 26
If the Wake on LAN feature turned on the server, the Wake on LAN feature can turn off the server. v You can turn off the server through a request from the service processor. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
The default position is pins 1 and 2. Move the jumper to pins 2 and 3 to prevent a Wake on LAN packet from waking the system when the system is in the powered-off state. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Memory-card connectors The following illustration shows the connectors on the memory card. DIMM 1 DIMM 2 DIMM 3 DIMM 4 Memory-card LEDs The following illustration shows the LEDs on the memory card. Light path diagnostics button Light path diagnostics button power LED Memory card error LED DIMM 1 error LED DIMM 2 error LED...
VRM 3 error LED Microprocessor 2 Microprocessor 3 error LED socket Microprocessor 3 socket Microprocessor 1 Microprocessor 4 error LED error LED Microprocessor 2 Microprocessor 4 socket error LED IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
The following illustration shows the connectors on the SAS backplane. SAS hard disk drive connectors Front of SAS backplane SAS signal cable 1 SAS signal cable 2 SAS power Back of SAS backplane IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
See the instructions for removing or installing a specific hot-swap component for any additional procedures that you might have to perform before you remove or install the component. v For a list of supported options for the server, see http://www.ibm.com/servers/ eserver/serverproven/compat/us/. System reliability guidelines...
Handle the device carefully, holding it by its edges or its frame. v Do not touch solder joints, pins, or exposed circuitry. v Do not leave the device where others can handle and damage it. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
v While the device is still in its static-protective package, touch it to an unpainted metal part on the outside of the server for at least 2 seconds. This drains static electricity from the package and from your body. v Remove the device from its package and install it directly into the server without setting down the device.
Page 36
There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 37
Locking latch Locking handle (open) Power supply 2 (PS2) Power supply 1 (PS1) AC power LED (green) DC power LED (green) To remove a hot-swap power supply, complete the following steps: 1. Read the safety information that begins on page v and “Installation guidelines” on page 21.
1. The blue handle that comes with the adapter is required to install the adapter. 2. In multi-node configurations, only two nodes can contain a ServeRAID-8i adapter. To install the ServeRAID-8i adapter, complete the following steps: IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 39
ServeRAID-8i adapter ServeRAID-8i slot 1. Read the safety information that begins on page v and “Installation guidelines” on page 21. 2. Turn off the server and peripheral devices, and disconnect the power cords. Remove the cover (see “Removing the cover and bezel” on page 23). 3.
Page 40
Push the orange adapter retention latch toward the rear of the server and open the tab. The power LED for the slot turns off. c. Remove the expansion-slot cover. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 41
d. Touch the static-protective package that contains the adapter to any unpainted surface on the outside of the server; then, grasp the adapter by the top edge or upper corners of the adapter and remove it from the package. e. Carefully grasp the adapter by its top edge or upper corners, and align it with the connector on the PCI-X board.
3. Touch the static-protective package that contains the hard disk drive to any unpainted surface on the outside of the serve; then, remove the hard disk drive from the package. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 43
2. If the server will be configured for RAID operation using a ServeRAID controller, you must configure the disk arrays before installing the operating system. See the ServeRAID documentation on the IBM ServeRAID Support CD for additional information about RAID operation and complete instructions for using ServeRAID Manager.
Memory card order Memory card DIMM pair First 1 and 3 2 and 4 Second 1 and 3 2 and 4 Third 1 and 3 2 and 4 IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Note: Add odd numbered DIMMs to each available memory card first, then add the even numbered pairs. Active Memory Active Memory is an IBM technology that improves the reliability of the DIMMs ™ through the memory mirroring, memory scrubbing, and Memory ProteXion features.
Page 46
DIMM after it is installed. v Memory ProteXion reassigns memory bits to new locations within memory when recoverable errors have been detected. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
When a recoverable error is found by memory scrubbing, the Memory ProteXion feature writes the data that was to be stored in the damaged memory locations to spare memory locations within the same DIMM. Adding and replacing a memory card At least one memory card with one pair of DIMMs must be installed for the server to operate correctly.
1. Read the safety information that begins on page v and “Installation guidelines” on page 21. 2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables necessary to replace the device. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 49
3. Remove the memory card. a. Open the memory card retention levers on the top of the memory card. b. While holding the retention levers open, lift the memory card out of the server. 4. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up.
Page 50
When moving the memory card, do not allow it to touch any components or structures inside the server. Make sure that the memory hot-swap enabled LED is lit. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 51
3. Remove the memory card. a. Open the memory card retention levers on the top of the memory card. b. While holding the retention levers open, lift the memory card out of the server. 4. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up.
Page 52
When moving the memory card, do not allow it to touch any components or structures inside the server. 3. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 53
Attention: To avoid breaking the DIMM retaining clips or damaging the DIMM connectors, open and close the clips gently. 4. Open the retaining clip on each end of the DIMM connector. 5. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the outside of the server;...
The voltage regulators for microprocessors 1 and 2 are integrated on the microprocessor board; the VRMs for microprocessors 3 and 4 come with the microprocessor options and must be installed on the microprocessor board. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
To download the most current level of BIOS code for your server, see http://www.ibm.com/support/. v Obtain an SMP-capable operating system. For a list of supported operating systems, see http://www.ibm.com/servers/eserver/serverproven/compat/us/. v You can use the Configurations/Setup utility program to determine the specific type of microprocessor in the server.
Lift the microprocessor-tray release latch. Microprocessor-tray release latch Air baffle Microprocessor-tray lever Microprocessor-tray retention latch (both sides of tray) Microprocessor-tray lever d. Open the microprocessor-tray levers. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 57
e. Pull out the microprocessor tray until it stops; then, push in on the microprocessor tray retention latches on each side of the tray and pull the tray out of the server. Attention: The microprocessor tray is heavy. Pull the tray partially out of the server, reposition your hands to grasp the body of the tray, and press in on the release latches on each side of the tray;...
Page 58
14. If you have other microprocessors to install, do so now by repeating steps 5 through 13. 15. Install the air baffle in the microprocessor tray. 16. Reinstall the microprocessor tray in the server: IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
a. Make sure that the microprocessor-tray release latch is open; then, push the microprocessor tray into the server. b. Close the tray levers and make sure that they are securely latched. c. Press the microprocessor-tray release latch down. d. Reinstall the fans and memory cards in the server. If you have other options to install or remove, do so now;...
Gigabit Ethernet 2 Gigabit Ethernet 1 Front view Power-control button Information LED Release latch USB connector Power-on LED System-error LED Hard disk drive activity LED Locator LED IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
1. Update the BIOS code and the service processor firmware. To download the most current level of BIOS code and service processor firmware, go to http://www.ibm.com/support/. 2. Make sure that each System x3950 E node contains a minimum of one microprocessor and one memory card with one pair of DIMMs.
Page 62
To cable a four-node configuration for up to 16-way operation, complete the following steps: 1. Remove the protective covers from the connectors on the ends of the cables. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 63
Protective cover 2. Label each end of the SMP Expansion cables according to where it will be connected to each server. See the following illustration. Node 1 Node 2 Node 3 Node 4 3. Connect the SMP Expansion cables to node 1: a.
Page 64
1. Remove the protective covers from the connectors on the ends of the cables. Protective cover 2. Label each end of the SMP Expansion cables according to where it will be connected to each server. See the following illustration. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 66
Connect one end of an SMP Expansion cable to port 1 on node 6; then, route the cable through the node 6 cable-management arm. Use a 2.3-m (7.6-foot) SMP Expansion cable for this connection. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 67
b. Locate the SMP Expansion cable that is connected to port 2 on node 3; then, connect the opposite end of the cable to port 2 of node 6. Next, route the cable through the node 6 cable-management arm. c. Locate the SMP Expansion cable that is connected to port 3 on node 5; then, connect the opposite end of the cable to port 3 of node 6.
Page 68
IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Select this choice to view the machine type and model of the server, the serial number, the revision level or issue date of the BIOS and diagnostics code IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 71
See “Administrator password” on page 63 for more information. This choice is on the Configuration/Setup Utility menu only if an IBM Remote Supervisor Adapter II SlimLine is installed. v Start Options Select this choice to view or change the start options.
Page 72
Select this choice to view information and to change baseboard management controller (BMC) settings. - BMC firmware Ver This is a nonselectable menu item that displays the BMC firmware version. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 73
Select this choice to view the BMC system event log, which contains all system error and warning messages that have been generated. Use the arrow keys to move between pages in the log. If an optional IBM Remote Supervisor Adapter II SlimLine is installed, the full text of the error messages is displayed;...
The following illustration shows the location of the power-on password override, boot recovery, and Wake on LAN (WOL) bypass jumpers. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Configuration/Setup Utility menu. You can use any combination of up to seven characters (A–Z, a–z, and 0–9) for the password. The Administrator Password choice is on the Configuration/Setup Utility menu only if an optional IBM Remote Supervisor Adapter II SlimLine is installed.
When you use the ServerGuide Setup and Installation CD, you do not need setup diskettes. You can use the CD to configure any supported IBM server model. The setup program provides a list of tasks that are required to set up the server model.
If you have already configured the server hardware and you decide not to use the ServerGuide program to install your operating system, complete the following steps to download the latest operating-system installation instructions from the IBM Support Web page: 1. Go to http://www.ibm.com/support/.
Setup Key Stroke Select this choice to specify the key strokes to start the PXE boot agent utility. You can select Ctrl+S (default), or Ctrl+B. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
If you send a wake-up packet to the server while it is turned on and you are then unable to turn off the server, see “Power problems” in the Problem Determination and Service Guide on the IBM Documentation CD.
For SOL operation on the server, you must configure the Linux operating system to expose the Linux initialization (booting) process. This enables users to log in to IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 81
the Linux console through an SOL session and directs Linux output to the serial console. See the documentation for your specific Linux operating-system type for information and instructions. Use one of the following procedures to enable SOL sessions for your Linux operating system.
Page 82
Original /etc/lilo.conf contents prompt timeout=50 default=linux boot=/dev/hda map=/boot/map install=/boot/boot.b message=/boot/message linear image=/boot/vmlinuz-2.4.9-e.12smp label=linux initrd=/boot/initrd-2.4.9-e.12smp.img read-only root=/dev/hda6 image=/boot/vmlinuz-2.4.9-e.12 label=linux-up initrd=/boot/initrd-2.4.9-e.12.img read-only root=/dev/hda6 IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 83
Modified /etc/lilo.conf contents prompt timeout=50 default=linux-Monitor boot=/dev/hda #map=/boot/map install=/boot/boot.b #message=/boot/message linear # This will allow you to only Monitor the OS boot via SOL image=/boot/vmlinuz-2.4.9-e.12smp label=linux-Monitor initrd=/boot/initrd-2.4.9-e.12smp.img read-only root=/dev/hda6 append="console=ttyS1,19200n8 console=tty1" # This will allow you to Interact with the OS boot via SOL image=/boot/vmlinuz-2.4.9-e.12smp label=linux-Interact initrd=/boot/initrd-2.4.9-e.12smp.img...
Page 84
Red Hat Enterprise Linux ES (2.4.9-e.12smp) root (hd0,0) kernel /vmlinuz-2.4.9-e.12smp ro root=/dev/hda6 initrd /initrd-2.4.9-e.12smp.img title Red Hat Enterprise Linux ES-up (2.4.9-e.12) root (hd0,0) kernel /vmlinuz-2.4.9-e.12 ro root=/dev/hda6 initrd /initrd-2.4.9-e.12.img IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 85
Modified /boot/grub/grub.conf contents #grub.conf generated by anaconda # Note that you do not have to rerun grub after making changes to this file # NOTICE: You have a /boot partition. This means that all kernel and initrd paths are relative to /boot/, eg. root (hd0,0) kernel /vmlinuz-version ro root=/dev/hda6 initrd /initrd-version.img...
Page 86
# This will allow you to Interact with the OS boot via SOL title linux SOL Interactive kernel (hd0,1)/boot/vmlinuz root=/dev/hda2 acpi=oldboot vga=791 console=tty1 console=ttyS1,19200 initrd (hd0,1)/boot/initrd title floppy IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 87
Modified /boot/grub/menu.lst contents Notes root chainloader +1 title failsafe kernel (hd0,1)/boot/vmlinuz.shipped root=/dev/hda2 ide=nodma apm=off vga=normal nosmp disableapic maxcpus=0 3 initrd (hd0,1)/boot/initrd.shipped Note 1: The kernel line is shown with a line break. In your file, the entire entry must all be on one line. You must restart the Linux operating system after completing these procedures for the changes to take effect and to enable SOL.
2. Insert the OSA BMC Management Utility CD into the drive. The InstallShield wizard starts, and a window similar to that shown in the following illustration opens. 3. Follow the prompts to complete the installation. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Linux operating system, complete the following steps. You must be logged in as a root user to perform these procedures. 1. Go to http://www.ibm.com/support/, download the utility program, and create the OSA BMC Management Utility CD. 2. Insert the OSA BMC Management Utility CD into the drive.
To update the firmware, download the Linux or Windows operating-system update package that is available from http://www.ibm.com/support/. If you have installed the OSA device driver and IBM Mapping layer, the update can be done without a reboot. Otherwise, extract to a firmware update diskette on a USB diskette drive and reboot.
Using ServeRAID Manager Use ServeRAID Manager, which is on the IBM ServeRAID Support CD, to: v Configure a redundant array of independent disks (RAID) array v Restore a SCSI hard disk drive to the factory-default settings, erasing all data...
5. Click the icon to add the drives to the array. 6. If you want to configure a hot-spare drive, complete the following steps: a. Click the Spares tab. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
b. Select the physical drive that you want to designate as the hot-spare drive, and click the icon to add the drive. 7. Click Next. The “Configuration summary” window opens. 8. Review the information in the “Configuration summary” window. To change the configuration, click Back.
Page 94
Note: The Remote Supervisor Adapter II Web Interface must be open to view, create, delete, or manage scalable partitions. Make sure that the Web Interface is open before you continue. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 95
6. In the navigation pane, click Status under Scalable Partitioning. Use the Scalable Partition Status page to view information about the current and new scalable partitions. A page similar to the one in the following illustration is displayed. 7. In the navigation pane, click Create Partition. Only perform this step if you are cabling the configuration or changing the host name.
Page 96
In the Scalable Partition Members field, select the nodes that will be assigned to the scalable partition. You can select all nodes or select individual nodes. e. Click Create. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
9. In the navigation pane, click Control Partition and follow the instructions on the Control Scalable Partition page to manage the scalable partition. Use the Control Scalable Partition page to replace a current scalable partition with a new scalable partition. You can also start or stop a scalable partition. A page similar to the one in the following illustration is displayed.
Page 98
IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Chapter 4. Updating IBM Director If you plan to use IBM Director to manage the server, you must check for the latest applicable IBM Director updates and interim fixes. Complete the following steps to install the IBM Director updates and any other applicable updates and interim fixes: 1.
Page 100
IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Web sites. The materials at those Web sites are not part of the materials for this IBM product, and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
When referring to processor storage, real and virtual storage, or channel volume, KB stands for approximately 1000 bytes, MB stands for approximately 1 000 000 bytes, and GB stands for approximately 1 000 000 000 bytes. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
IBM makes no representations or warranties with respect to non-IBM products. Support (if any) for the non-IBM products is provided by the third party, not IBM. Some software may differ from its retail version (if available), and may not include user manuals or all program functionality.
Page 104
EEE on the environment and human health due to the potential presence of hazardous substances in EEE. For proper collection and treatment, contact your local IBM representative. IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 106
33 hard disk drive 30 module 32 hot-swap hard disk drive 30 port power LED 33 memory 36 memory card memory modules 36 adding 35 microprocessor 42 IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 107
memory card (continued) hot-replace 35 rack, installing your server in 47 memory hot-swap enabled LED 33 RAS features 7 memory mirroring 34 release latch 10 Memory ProteXion 5, 34 reliability 7 memory-card connector and LED illustration 17 Remote Supervisor Adapter II SlimLine microprocessor 4, 6 error LED 11 installation 42...
Page 108
65 video connector 11 Web site ServerGuide 63 weight 4 working inside the server with the power on 22 X-Architecture technology 5 XpandOnDemand cable kits 49 IBM System x3950 Type 8872 and System x3950 E Type 8874: User’s Guide...
Page 110
Part Number: 31R1856 Printed in USA (1P) P/N: 31R1856...