Page 8
All caution and danger statements in this documentation begin with a number. This number is used to cross reference an English caution or danger statement with translated versions of the caution or danger statement in the IBM Safety Information book.
Page 9
Statement 1: DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. v Connect all power cords to a properly wired and grounded electrical outlet.
Page 10
Statement 2: CAUTION: When replacing the lithium battery, use only IBM Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer.
Page 11
Statement 4: ≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb) CAUTION: Use safe practices when lifting. Statement 5: CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device.
Page 12
If you suspect a problem with one of these parts, contact a service technician. Statement 26: CAUTION: Do not place any object on top of rack-mounted devices. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Safety Information This document is in PDF on the IBM System x Documentation CD. It contains translated caution and danger statements. Each caution and danger statement that appears in the documentation has a number that you can use to locate the corresponding statement in your language in the Safety Information document.
Problem Determination and Service Guide This document is in PDF on the IBM System x Documentation CD. It contains information to help you solve problems yourself, and it contains information for service technicians. Depending on the server model, additional documentation might be included on the IBM System x Documentation CD.
Features and specifications The following information is a summary of the features and specifications of the server. Depending on the server model, some features might not be available, or some specifications might not apply. Notes: 1. Racks are marked in vertical increments of 4.45 cm (1.75 inches). Each increment is referred to as a unit, or “U.”...
Page 16
Eight nodes System BIOS, diagnostics, service v 32-way operation processor, BMC, and SAS microcode v 128 DIMMs v 48 SAS hard disk drives v 48 PCI-X adapters IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
IBM Director IBM Director is a workgroup-hardware-management tool that you can use to centrally manage IBM System x and xSeries servers. For more information, see the IBM Director documentation on the IBM Director CD. v IBM Enterprise X-Architecture technology IBM X-Architecture technology combines proven, innovative IBM designs to make your x86-based server powerful, scalable, and reliable.
Page 18
You can obtain the measurement values through the systems-management interface, and can view them using IBM Director. For more information, including the required levels of IBM Director and PowerExecutive, see the IBM Director documentation on the IBM Director CD, or go to http://www.ibm.com/servers/eserver/xseries/systems_management/ibm_director /extensions.
Error correcting code (ECC) L2 cache and system memory v Fault-resistant startup v Hot-swap hard disk drives v IBM Director workgroup-hardware-management tool v Information and light path diagnostics LED panels v Optional service processor adapter for remote system management...
Reduced service and support costs For more information about IBM Director, see the documentation on the IBM Director CD that comes with the server, the IBM Director Information Center at http://publib.boulder.ibm.com/infocenter/eserver/v1r2/topic/diricinfo/fqm0_main.html, and the IBM System x and xSeries Systems Management Web page at http://www.ibm.com/servers/eserver/xseries/systems_management/, which presents...
Server controls, connectors, LEDs, and power This section describes the controls, connectors, and light-emitting diodes (LEDs) and how to turn the server on and off. Front view The following illustration shows the controls, LEDs, and connectors on the front of the server.
Page 22
DVD drive is in use. DVD-eject button: (Standard on some models only) Press this button to release a CD or DVD from the DVD drive. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Rear view The following illustration shows the connectors and LEDs on the rear of the server. Video connector: Connect a monitor to this connector. USB 1 connector: Connect a USB device to this connector. SP Ethernet 10/100 connector: Use this connector to connect the service processor to a network.
The power-on LED flashes to indicate that the server is connected to ac power but not turned on. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Turning on the server Approximately 20 seconds after the server is connected to ac power, the power-control button becomes active, and one or more fans might start running to provide cooling while the server is connected to power. You can turn on the server and start the operating system by pressing the power-control button.
Page 26
If the Wake on LAN feature turned on the server, the Wake on LAN feature can turn off the server. v You can turn off the server through a request from the service processor. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
The default position is pins 1 and 2. Move the jumper to pins 2 and 3 to prevent a Wake on LAN packet from waking the system when the system is in the powered-off state. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Memory-card connectors The following illustration shows the connectors on the memory card. DIMM 1 DIMM 2 DIMM 3 DIMM 4 Memory-card LEDs The following illustration shows the LEDs on the memory card. Light path diagnostics button Light path diagnostics button power LED Memory card error LED DIMM 1 error LED DIMM 2 error LED...
VRM 3 error LED Microprocessor 2 Microprocessor 3 error LED socket Microprocessor 3 socket Microprocessor 1 Microprocessor 4 error LED error LED Microprocessor 2 Microprocessor 4 socket error LED IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
The following illustration shows the connectors on the SAS backplane. SAS hard disk drive connectors Front of SAS backplane SAS signal cable 1 SAS signal cable 2 SAS power Back of SAS backplane IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
To download firmware updates for your server, go to http://www.ibm.com/servers/eserver/support/xseries/index.html, select System x3950 or System x3950 E from the Hardware list, click Go, and then click the Download tab.
When you are finished working on the server, reinstall all safety shields, guards, labels, and ground wires. v For a list of supported optional devices for the server, see http://www.ibm.com/ servers/eserver/serverproven/compat/us/. System reliability guidelines To help ensure proper system cooling and system reliability, make sure that the...
Handling static-sensitive devices Attention: Static electricity can damage the server and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them. To reduce the possibility of damage from electrostatic discharge, observe the following precautions: v Limit your movement.
220 V ac input. If you install or remove a power supply, observe the following precautions: Statement 8: IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 37
CAUTION: Never remove the cover on a power supply or any part that has the following label attached. Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
The optional Integrated xSeries Adapter (IXA) can be installed only in slot 2. You must move jumpers J35 and J40 on the IXA. For details about installing the IXA, see the documentation that comes with the adapter. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 39
v An optional ServeRAID-8i adapter can be installed only in its dedicated connector on the PCI-X board. See the following illustration for the location of the connector on the PCI-X board. The ServeRAID-8i adapter is not cabled to the server and no rerouting of the SAS cables is required.
Page 40
Open the blue PCI-X retaining bar by lifting the front edge. b. Push the orange adapter retention latch toward the rear of the server and open the tab. The power LED for the slot turns off. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 41
c. Remove the expansion-slot cover. d. Touch the static-protective package that contains the adapter to any unpainted surface on the outside of the server; then, grasp the adapter by the top edge or upper corners of the adapter and remove it from the package.
3. Touch the static-protective package that contains the hard disk drive to any unpainted surface on the outside of the serve; then, remove the hard disk drive from the package. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 43
2. If the server will be configured for RAID operation using a ServeRAID controller, you must configure the disk arrays before installing the operating system. See the ServeRAID documentation on the IBM ServeRAID Support CD for additional information about RAID operation and complete instructions for using ServeRAID Manager.
Memory card order Memory card DIMM pair First 1 and 3 2 and 4 Second 1 and 3 2 and 4 Third 1 and 3 2 and 4 IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Note: Add odd numbered DIMMs to each available memory card first, then add the even numbered pairs. Active Memory Active Memory is an IBM technology that improves the reliability of the DIMMs ™ through the memory mirroring, memory scrubbing, and Memory ProteXion features.
Page 46
DIMM after it is installed. v Memory ProteXion reassigns memory bits to new locations within memory when recoverable errors have been detected. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
When a recoverable error is found by memory scrubbing, the Memory ProteXion feature writes the data that was to be stored in the damaged memory locations to spare memory locations within the same DIMM. Adding and replacing a memory card At least one memory card with one pair of DIMMs must be installed for the server to operate correctly.
1. Read the safety information that begins on page v and “Installation guidelines” on page 21. 2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables necessary to replace the device. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 49
3. Remove the memory card. a. Open the memory card retention levers on the top of the memory card. b. While holding the retention levers open, lift the memory card out of the server. 4. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up.
Page 50
When moving the memory card, do not allow it to touch any components or structures inside the server. Make sure that the memory hot-swap enabled LED is lit. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 51
3. Remove the memory card. a. Open the memory card retention levers on the top of the memory card. b. While holding the retention levers open, lift the memory card out of the server. 4. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up.
Page 52
When moving the memory card, do not allow it to touch any components or structures inside the server. 3. Place a memory card on a flat, static-protected surface with the DIMM connectors facing up. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 53
Attention: To avoid breaking the DIMM retaining clips or damaging the DIMM connectors, open and close the clips gently. 4. Open the retaining clip on each end of the DIMM connector. 5. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the outside of the server;...
The voltage regulators for microprocessors 1 and 2 are integrated on the microprocessor board; the VRMs for microprocessors 3 and 4 come with the microprocessor options and must be installed on the microprocessor board. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
To download the most current level of BIOS code for your server, see http://www.ibm.com/servers/eserver/support/xseries/index.html. v Obtain an SMP-capable operating system. For a list of supported operating systems, see http://www.ibm.com/servers/eserver/serverproven/compat/us/. v You can use the Configurations/Setup utility program to determine the specific type of microprocessor in the server.
Lift the microprocessor-tray release latch. Microprocessor-tray release latch Air baffle Microprocessor-tray lever Microprocessor-tray retention latch (both sides of tray) Microprocessor-tray lever d. Open the microprocessor-tray levers. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 57
e. Pull out the microprocessor tray until it stops; then, push in on the microprocessor tray retention latches on each side of the tray and pull the tray out of the server. Attention: The microprocessor tray is heavy. Pull the tray partially out of the server, reposition your hands to grasp the body of the tray, and press in on the release latches on each side of the tray;...
Page 58
14. If you have other microprocessors to install, do so now by repeating steps 5 through 13. 15. Install the air baffle in the microprocessor tray. 16. Reinstall the microprocessor tray in the server: IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
a. Make sure that the microprocessor-tray release latch is open; then, push the microprocessor tray into the server. b. Close the tray levers and make sure that they are securely latched. c. Press the microprocessor-tray release latch down. d. Reinstall the fans and memory cards in the server. If you have other options to install or remove, do so now;...
Gigabit Ethernet 2 Gigabit Ethernet 1 Front view Power-control button Information LED Release latch USB connector Power-on LED System-error LED Hard disk drive activity LED Locator LED IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
1. Update the BIOS code and the service processor firmware. To download the most current level of BIOS code and service processor firmware, go to http://www.ibm.com/servers/eserver/support/xseries/index.html. 2. Make sure that each System x3950 E node contains a minimum of one microprocessor and one memory card with one pair of DIMMs.
Page 62
To cable a four-node configuration for up to 16-way operation, complete the following steps: 1. Remove the protective covers from the connectors on the ends of the cables. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 63
Protective cover 2. Label each end of the SMP Expansion cables according to where it will be connected to each server. See the following illustration. Node 1 Node 2 Node 3 Node 4 3. Connect the SMP Expansion cables to node 1: a.
Page 64
1. Remove the protective covers from the connectors on the ends of the cables. Protective cover 2. Label each end of the SMP Expansion cables according to where it will be connected to each server. See the following illustration. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 66
Connect one end of an SMP Expansion cable to port 1 on node 6; then, route the cable through the node 6 cable-management arm. Use a 2.3-m (7.6-foot) SMP Expansion cable for this connection. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 67
b. Locate the SMP Expansion cable that is connected to port 2 on node 3; then, connect the opposite end of the cable to port 2 of node 6. Next, route the cable through the node 6 cable-management arm. c. Locate the SMP Expansion cable that is connected to port 3 on node 5; then, connect the opposite end of the cable to port 3 of node 6.
Page 68
IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Select this choice to view the machine type and model of the server, the serial number, the revision level or issue date of the BIOS and diagnostics code IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 71
See “Administrator password” on page 63 for more information. This choice is on the Configuration/Setup Utility menu only if an IBM Remote Supervisor Adapter II SlimLine is installed. v Start Options Select this choice to view or change the start options.
Page 72
Select this choice to view and change Remote Supervisor Adapter II SlimLine settings. Select Save Values and Reboot RSA II to save the changes you have made in the settings and restart the Remote Supervisor Adapter II SlimLine. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 73
Select this choice to view the BMC system event log, which contains all system error and warning messages that have been generated. Use the arrow keys to move between pages in the log. If an optional IBM Remote Supervisor Adapter II SlimLine is installed, the full text of the error messages is displayed;...
The following illustration shows the location of the power-on password override, boot recovery, and Wake on LAN (WOL) bypass jumpers. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Configuration/Setup Utility menu. You can use any combination of up to seven characters (A–Z, a–z, and 0–9) for the password. The Administrator Password choice is on the Configuration/Setup Utility menu only if an optional IBM Remote Supervisor Adapter II SlimLine is installed.
When you use the ServerGuide Setup and Installation CD, you do not need setup diskettes. You can use the CD to configure any supported IBM server model. The setup program provides a list of tasks that are required to set up the server model.
If you have already configured the server hardware and you decide not to use the ServerGuide program to install your operating system, complete the following steps to download the latest operating-system installation instructions from the IBM Support Web page: 1. Go to http://www.ibm.com/servers/eserver/support/xseries/index.html.
Select this choice to enable or disable the PXE setup prompt. Disable is the default setting. When the prompt is enabled, the prompt Press Ctrl+S to enter the setup menu appears under the initializing prompt. v Setup Key Stroke IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
If you send a wake-up packet to the server while it is turned on and you are then unable to turn off the server, see “Power problems” in the Problem Determination and Service Guide on the IBM System x Documentation CD.
Press Esc to exit the Start Options section of the Configuration/Setup Utility program. g. Select Save Settings; then, press Enter. h. Press Enter to confirm. i. Select Exit Setup; then, press Enter. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 81
j. Make sure that Yes, exit the Setup Utility is selected; then, press Enter. Configuring Linux For SOL operation on the server, you must configure the Linux operating system to expose the Linux initialization (booting) process. This enables users to log in to the Linux console through an SOL session and directs Linux output to the serial console.
Page 82
Original /etc/lilo.conf contents prompt timeout=50 default=linux boot=/dev/hda map=/boot/map install=/boot/boot.b message=/boot/message linear image=/boot/vmlinuz-2.4.9-e.12smp label=linux initrd=/boot/initrd-2.4.9-e.12smp.img read-only root=/dev/hda6 image=/boot/vmlinuz-2.4.9-e.12 label=linux-up initrd=/boot/initrd-2.4.9-e.12.img read-only root=/dev/hda6 IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 83
Modified /etc/lilo.conf contents prompt timeout=50 default=linux-Monitor boot=/dev/hda #map=/boot/map install=/boot/boot.b #message=/boot/message linear # This will allow you to only Monitor the OS boot via SOL image=/boot/vmlinuz-2.4.9-e.12smp label=linux-Monitor initrd=/boot/initrd-2.4.9-e.12smp.img read-only root=/dev/hda6 append="console=ttyS1,19200n8 console=tty1" # This will allow you to Interact with the OS boot via SOL image=/boot/vmlinuz-2.4.9-e.12smp label=linux-Interact initrd=/boot/initrd-2.4.9-e.12smp.img...
Page 84
Red Hat Enterprise Linux ES (2.4.9-e.12smp) root (hd0,0) kernel /vmlinuz-2.4.9-e.12smp ro root=/dev/hda6 initrd /initrd-2.4.9-e.12smp.img title Red Hat Enterprise Linux ES-up (2.4.9-e.12) root (hd0,0) kernel /vmlinuz-2.4.9-e.12 ro root=/dev/hda6 initrd /initrd-2.4.9-e.12.img IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 85
Modified /boot/grub/grub.conf contents #grub.conf generated by anaconda # Note that you do not have to rerun grub after making changes to this file # NOTICE: You have a /boot partition. This means that all kernel and initrd paths are relative to /boot/, eg. root (hd0,0) kernel /vmlinuz-version ro root=/dev/hda6 initrd /initrd-version.img...
Page 86
# This will allow you to Interact with the OS boot via SOL title linux SOL Interactive kernel (hd0,1)/boot/vmlinuz root=/dev/hda2 acpi=oldboot vga=791 console=tty1 console=ttyS1,19200 initrd (hd0,1)/boot/initrd title floppy IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 87
Modified /boot/grub/menu.lst contents Notes root chainloader +1 title failsafe kernel (hd0,1)/boot/vmlinuz.shipped root=/dev/hda2 ide=nodma apm=off vga=normal nosmp disableapic maxcpus=0 3 initrd (hd0,1)/boot/initrd.shipped Note 1: The kernel line is shown with a line break. In your file, the entire entry must all be on one line. You must restart the Linux operating system after completing these procedures for the changes to take effect and to enable SOL.
2. Insert the OSA BMC Management Utility CD into the drive. The InstallShield wizard starts, and a window similar to that shown in the following illustration opens. 3. Follow the prompts to complete the installation. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Linux operating system, complete the following steps. You must be logged in as a root user to perform these procedures. 1. Go to http://www.ibm.com/servers/eserver/support/xseries/index.html, download the utility program, and create the OSA BMC Management Utility CD. 2. Insert the OSA BMC Management Utility CD into the drive.
To update the firmware, download the Linux or Windows operating-system update package that is available from http://www.ibm.com/servers/eserver/support/xseries/ index.html. If you have installed the OSA device driver and IBM Mapping layer, the update can be done without a reboot. Otherwise, extract to a firmware update diskette on a USB diskette drive and reboot.
Using ServeRAID Manager Use ServeRAID Manager, which is on the IBM ServeRAID Support CD, to: v Configure a redundant array of independent disks (RAID) array v Restore a SCSI hard disk drive to the factory-default settings, erasing all data...
5. Click the icon to add the drives to the array. 6. If you want to configure a hot-spare drive, complete the following steps: a. Click the Spares tab. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
b. Select the physical drive that you want to designate as the hot-spare drive, and click the icon to add the drive. 7. Click Next. The “Configuration summary” window opens. 8. Review the information in the “Configuration summary” window. To change the configuration, click Back.
Page 94
Note: The Remote Supervisor Adapter II Web Interface must be open to view, create, delete, or manage scalable partitions. Make sure that the Web Interface is open before you continue. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 95
6. In the navigation pane, click Status under Scalable Partitioning. Use the Scalable Partition Status page to view information about the current and new scalable partitions. A page similar to the one in the following illustration is displayed. 7. In the navigation pane, click Create Partition. Only perform this step if you are cabling the configuration or changing the host name.
Page 96
In the Scalable Partition Members field, select the nodes that will be assigned to the scalable partition. You can select all nodes or select individual nodes. e. Click Create. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
9. In the navigation pane, click Control Partition and follow the instructions on the Control Scalable Partition page to manage the scalable partition. Use the Control Scalable Partition page to replace a current scalable partition with a new scalable partition. You can also start or stop a scalable partition. A page similar to the one in the following illustration is displayed.
Page 98
IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Chapter 4. Updating IBM Director If you plan to use IBM Director to manage the server, you must check for the latest applicable IBM Director updates and interim fixes. To install the IBM Director updates and any other applicable updates and interim fixes, complete the following steps.
Page 100
IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Web sites. The materials at those Web sites are not part of the materials for this IBM product, and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
IBM. Maximum memory may require replacement of the standard memory with an optional memory module. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
IBM makes no representations or warranties with respect to non-IBM products. Support (if any) for the non-IBM products is provided by the third party, not IBM. Some software may differ from its retail version (if available), and may not include user manuals or all program functionality.
Page 104
EEE on the environment and human health due to the potential presence of hazardous substances in EEE. For proper collection and treatment, contact your local IBM representative. IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 106
33 hard disk drive 30 module 32 hot-swap hard disk drive 30 port power LED 33 memory 36 memory card memory modules 36 adding 35 microprocessor 42 IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 107
memory card (continued) hot-replace 35 rack, installing your server in 47 memory hot-swap enabled LED 33 RAS features 7 memory mirroring 34 release latch 10 Memory ProteXion 5, 34 reliability 7 memory-card connector and LED illustration 17 Remote Supervisor Adapter II SlimLine microprocessor 4, 6 error LED 11 installation 42...
Page 108
65 video connector 11 Web site ServerGuide 63 weight 4 working inside the server with the power on 22 X-Architecture technology 5 XpandOnDemand cable kits 49 IBM System x3950 Type 8878 and System x3950 E Type 8879: User’s Guide...
Page 110
Part Number: 31R1871 Printed in USA (1P) P/N: 31R1871...