Page 1: Front Cover
Installation Guide Describes the technical details of the new 64-bit server Covers Windows Server 2003 and SuSE Linux Enterprise Server Helps you prepare for and perform an installation David Watts Gerry McGettigan Michael L. Nelson Lubos Nikolini Jose Rodriguez Ruibal ibm.com/redbooks...
Page 3 International Technical Support Organization IBM ^ xSeries 450 Planning and Installation Guide July 2003...
Page 4 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (July 2003) This edition applies to the IBM ^ xSeries 450, machine type 8688. This document was updated on July 1, 2003. © Copyright International Business Machines Corporation 2003. All rights reserved.
Page 5: Table Of Contents
1.5.2 Processor-board assembly ....... . 15 1.6 IBM XceL4 Server Accelerator Cache......17 1.7 System memory .
Page 6 5.1 The Remote Supervisor Adapter ....... 118 IBM ^ xSeries 450 Planning and Installation Guide...
Page 7 IBM Redbooks collections ........
Page 8 IBM ^ xSeries 450 Planning and Installation Guide...
Page 9: Notices
IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
Page 10: Trademarks
SET, SET Secure Electronic Transaction, and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC. Other company, product, and service names may be trademarks or service marks of others. IBM ^ xSeries 450 Planning and Installation Guide viii...
Page 11: Preface
IBM ^ xSeries 440 Planning and Installation Guide . He has a Bachelor of Engineering degree from the University of Queensland (Australia) and has worked for IBM for over 14 years. He is an IBM ^ Certified Specialist for xSeries and an IBM Certified IT Specialist.
Page 12 Academy. He holds a Bachelor of Science in Multimedia Technology from Glasgow Caledonian University and has been with IBM for over five years. His area of expertise is xSeries systems and hardware. Michael L. Nelson is a Performance Consultant in IBM ^ Solutions Engineering working in Raleigh.
Page 13 The redbook team (l-r): David, Jose, Gerry, Mike, Lubos Thanks to the following IBM employees for their contributions to this project: Henry Artner, Service Education Curriculum Manager, Raleigh Charlotte Brooks, ITSO Project Leader for Tivoli® Storage, San Jose Pat Byers, Program Director, Linux xSeries Alliances & Marketing...
Page 14: Become A Published Author
John F Stewart Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or customers.
Page 15: Chapter 1. Technical Description
Technical description Chapter 1. The IBM ^ xSeries 450 is the latest IBM top-of-the-line server and is the first full implementation of the 64-bit IBM XA-64 chipset, code named “Summit”, as part of the Enterprise X-Architecture strategy. The x450 completes the xSeries product family, leveraging the proven Enterprise X-Architecture used in the x440 to deliver commercially viable 64-bit systems.
Page 16: The X450 Product Line
6 MB 2 GB (4x 512 MB) IBM had ealier announced models that were based on the Itanium 2 “McKinley” processor, but these have been withdrawn due to a bug in these processors. These models are listed in Table 1-2.
Page 17: Ibm Xa-64 Chipset
PCI bridges: two PCI bridges, code named “Winnipeg”, per x450 located on the PCI-X board and the I/O board that control both the PCI-X and Remote I/O. Figure 1-1 on page 4 shows the various IBM XA-64 components in an x450 configuration. Chapter 1. Technical description...
Page 18 10. To ensure the processors are optimally used, the x450 has a 64 MB XceL4 Server Accelerator Cache, comprised of 200 MHz DDR memory. This L4 system cache services all CPUs. IBM ^ xSeries 450 Planning and Installation Guide...
Page 19: Extensible Firmware Interface
Memory used in the x450 is standard PC2100 ECC DDR SDRAM DIMMs. With 2 GB DIMMs, up to 40 GB can be installed using 20 of the 28 DIMM sockets. The memory is two-way interleaved; however, four-way interleaving is also supported in order to ensure that the memory subsystem can supply data fast enough to match the throughput of the CPUs.
Page 20 USB key-specific functions would have to be added to the firmware to support booting from a USB device, and finally, the OS loader would have to be modified to use these functions. IBM ^ xSeries 450 Planning and Installation Guide...
Page 21: Guid Partition Table Disk
The same situation with the EFI would be dramatically simplified. The OS loader calls unified (not vendor-specific) EFI API functions for booting. These functions are not dependent on the boot device used, so when a new boot device type is added to the platform and the firmware is modified to recognize it, the operating system can immediately boot.
Page 22: Efi System Partition
EFI directory. The ESP may also contain other files necessary to boot the system, such as drivers. Note: The EFI System Partition is shareable among all installed operating systems. To support multiple operating system installations, create multiple data partitions. IBM ^ xSeries 450 Planning and Installation Guide...
Page 23 An example directory structure for an EFI System Partition present on a hard disk with SuSE and Windows Server 2003 installed is as follows: \EFI \Microsoft \WINNT50 \EFIDrivers \SuSE \MSUtils There can be only one ESP on a single disk. The size of the ESP is determined using the following algorithm: ESP = max(100 MB, min(1% of physical disk, 1GB)) In other words, the size of the ESP must be the larger of these two numbers, 100...
Page 24: Efi And Legacy-Free Concept
1.5 or 3 MB 3, 4 or 6 MB Frontside bus 266 MHz 400 MHz, 128 bit 400 MHz, 128 bit Frontside bus bandwidth 2.1 GBps 6.4 GBps 6.4 GBps Pipeline stages IBM ^ xSeries 450 Planning and Installation Guide...
Page 25 This additional level of cache saves decode time on cache hits. The x450 also implements a Level 4 cache as described in 1.6, “IBM XceL4 Server Accelerator Cache” on page 17. Intel has also introduced a number of features associated with its Itanium micro-architecture.
Page 26 – Enables faster calculations and data analysis – Allows for faster storage and movement of large models (CAD, CAE) – Speeds up simulation and rendering times IBM ^ xSeries 450 Planning and Installation Guide...
Page 27: System Assembly
For more information about the features of the Itanium 2 processor, go to: http://www.intel.com/design/itanium2 1.5 System assembly Unlike the x440, then x450 does not use a single SMP Expansion Module, which contains the processors, memory, XceL4 Server Accelerator Cache, and respective controller.
Page 28: Memory-Board Assembly
This location allows for easy access to all memory DIMMs without having to remove any components from the system. IBM ^ xSeries 450 Planning and Installation Guide...
Page 29: Processor-Board Assembly
Memory Port 1 There are 14 DIMM slots in each of the two ports, for a total of 28 DIMMs. Memory Port 2 Figure 1-8 Memory-board assembly, showing the two memory ports The memory-board assembly contains 28 DIMM slots. All DIMM slots can be used when 512 MB or 1 GB DIMMs are used.
Page 30 Pressing this button while the processor-board assembly is not attached to AC power will illuminate any light path LEDs that had been lit while the system was under power for a total of 10 seconds. IBM ^ xSeries 450 Planning and Installation Guide...
Page 31: Ibm Xcel4 Server Accelerator Cache
1.6 IBM XceL4 Server Accelerator Cache Integrated into the processor-board assembly is 64 MB of Level 4 cache, which is shown in Figure 1-1 on page 4. This XceL4 Server Accelerator Cache provides the necessary extra level of cache to maximize CPU throughput by reducing the need for main memory access under demanding workloads, resulting in an overall enhancement to system performance.
Page 32 The error is then reported so that preventative maintenance can be performed. As long as there are enough good locations to allow the proper operation of the server, no further action is taken other than recording the error in the error IBM ^ xSeries 450 Planning and Installation Guide...
Page 33 logs. Errors from scrubbing are not reported unless bit steering has already been invoked. If the error is not recoverable, then memory scrubbing sends an error message to the light path diagnostics, which then turns on the proper lights and LEDs to guide you to the defective DIMM. If memory mirroring is enabled, then the mirrored copy of the data in the damaged DIMM is used until the system is powered down and the DIMM replaced.
Page 34 POST or memory configuration, the server can automatically disable the failing memory bank and continue operating with reduced memory capacity. You can manually re-enable the memory bank after the problem is corrected via the Setup menu in BIOS. IBM ^ xSeries 450 Planning and Installation Guide...
Page 35: Pci Subsystem
Memory mirroring, Chipkill, and Memory ProteXion provide multiple levels of redundancy to the memory subsystem. Combining Chipkill with Memory ProteXion enables up to two memory chip failures per memory port (14 DIMMs) on the x450. An x450 with its two memory ports could sustain up to four memory chip failures.
Page 36 Gigabit Ethernet connection, ensure your network infrastructure is capable of the necessary throughput to match the server’s I/O capacity. SVGA with 8 MB video memory (ATI RageXL chipset). IBM ^ xSeries 450 Planning and Installation Guide...
Page 37: Redundancy
Three USB ports (one on the front panel, two on the rear). All USB ports are 2.0 compliant. One RS-232 serial port, located on the rear of the machine. Remote Supervisor Adapter (RS-485 ASM interconnect bus, 10/100 Ethernet and serial ports). Note: There are no PS/2 keyboard or mouse ports on the x450.
Page 38 System-error light (amber) Blank media DVD/CD-RW drive Information light (amber) Light Path Diagnostics SCSI activity light (green) panel (pulls out) Locator light (blue) Figure 1-13 Front panel of the xSeries 450 IBM ^ xSeries 450 Planning and Installation Guide...
Page 39: Light Path Diagnostics
1.10 Light path diagnostics To limit the need to slide the server out of the rack to diagnose problems, a light path diagnostics panel has been incorporated in the front of the x450, as shown in Figure 1-14. This panel can be ejected from the server to view all light path diagnostics-monitored server subsystems.
Page 40: Remote Supervisor Adapter
PCI slot beneath the PCI-X adapter area of the system. Rear of x450 External power ASM interconnect 10/100 supply (RS-485) port Ethernet port Error LED Power LED Management (amber) (green) COM port Figure 1-15 Remote Supervisor Adapter connectors IBM ^ xSeries 450 Planning and Installation Guide...
Page 41: Operating System Support
The Remote Supervisor Adapter offers the following capabilities: In-band and out-of-band remote server access and alerting through IBM Director Full Web browser support with no other software required Enhanced security features Graphics/text console redirection for remote control Dedicated 10/100 Ethernet access port...
Page 42 Note: While operating systems may support large systems, scalability is a function of both the operating system and the application/workload. Few applications are designed to take advantage of larger SMP systems. IBM ^ xSeries 450 Planning and Installation Guide...
Page 43: Chapter 2. Positioning
Chapter 2. In this chapter we discuss topics that help you to understand how the x450 can be useful for your business. The topics covered are: x450 application solutions Why choose x450? © Copyright IBM Corp. 2003. All rights reserved.
Page 44: X450 Application Solutions
Four-way x450 configurations can be used as database servers and application servers providing a highly available platform. These configurations require an external storage enclosure or SAN, depending on the size of the database that is driven by the number of users. IBM ^ xSeries 450 Planning and Installation Guide...
Page 45 Database applications with memory-sensitive workloads that require working data sets larger than 4 GB to be loaded in memory will benefit from the larger memory support of the 64-bit platform. The following is an example from the field. Microsoft SQL Server Enterprise Edition uses AWE memory only for the buffer pool.
Page 46: Business Logic
Terabytes. In contrast, traditional 32-bit processors most often only address a maximum of 4 Gigabytes. Key database software available for Itanium 2 systems include IBM DB2® Universal Database™ 8.1 (both Linux and Windows version), Microsoft SQL Server 2000 (currently beta 2 version), and Oracle 9i Database (Linux/Windows).
Page 47: E-Business And Security Transactions
interaction, customer service, and order tracking. ERP can also include application modules for the finance and human resources aspects of a business. Typically, an ERP system uses or is integrated with a relational database system. Key server attributes for ERP applications are availability, scalability, and performance.
Page 48: In-House Developed Compute-Intensive Applications
In most cases, existing 32-bit code will not require a complete rewrite, but only recompilation. ******DAVID!!!*****The important message for developers is that IA-64 parallelism managed by the compiler itself, application development is uncharged of using IBM ^ xSeries 450 Planning and Installation Guide...
Page 49: Science And Technology Industries
450 is evidence that this is not going to change with future IA-64 technology. With close cooperation between IBM and Intel, the xSeries 450 will continue to be an excellent platform for the most demanding 64-bit enterprise applications.
Page 50 64-bit technology (IBM pSeries™ and zSeries™ servers) into the development of the x450. All of these advantages make the xSeries 450 production enterprise-level server a viable alternative to RISC-based architectures, while protecting many years of investments and knowledge gained from IA-32 platform development.
Page 51 The parallelism is there, but it is not as obvious to the processor and more work has to be done by the hardware before it can be utilized. Itanium 2 supports parallelism on multiple levels. Instruction-level parallelism (ILP) is the ability to execute multiple bundles (three instructions in a bundle) at the same time.
Page 52 64-bit platform offers. xSeries 450 is built to scale, process, and access larger amounts of data to yield significant performance increases of data compute-intensive applications than any other Intel-based server before.
Page 53: Chapter 3. Planning
In this chapter we discuss topics you need to consider before you finalize the configuration of your x450 system and before you begin implementing the system. The topics covered are: System hardware Cabling and connectivity Storage considerations Rack installation Power considerations Solution Assurance Review © Copyright IBM Corp. 2003. All rights reserved.
Page 54: System Hardware
These are discussed in this section. 3.1.1 Processors xSeries 450 servers combines copper-based, XA-64 Enterprise X-Architecture technologies with 64-bit, Intel Itanium 2 processors. Table 3-1 lists the processors standard in each x450 model and the part number of additional processors.
Page 55: Memory
73P2030 Go to the ServerProven® site for the latest information on supported memory modules: http://www.ibm.com/pc/us/compat When installing memory DIMMs, they must be installed in matched pairs (size and technology), in the order shown in Table 3-3. Table 3-3 DIMM order...
Page 56 Port 1 Port 2 Figure 3-2 DIMM locations on the memory-board assembly Memory mirroring Memory mirroring is supported by the x450 for increased fault tolerance and high levels of availability. IBM ^ xSeries 450 Planning and Installation Guide...
Page 57 Key configuration rules relating to memory mirroring: Memory mirroring must be enabled in the System Setup (it is disabled by default). Enabling memory mirroring halves the amount of memory available to the operating system. You must install two pairs of DIMMs at a time. These four DIMMs (known as a bank ) must be identical.
Page 58: Pci Slot Configuration
32-bit adapters will run in 32-bit mode, and the 64-bit adapters will run in 64-bit mode. Tip: Take the time to understand these rules and to select the best slots for your adapters. Incorrect choices can result in a loss of PCI adapter performance. IBM ^ xSeries 450 Planning and Installation Guide...
Page 59 As extreme configuration examples, you could configure either of the following: Six 33 MHz PCI adapters, all operating at 33 MHz. Six 133 MHz PCI-X adapters, with two operating at 133 MHz (buses C and D), two at 100 MHz (bus B) and two at 66 MHz (bus A). Important: A PCI-X and a PCI adapter can be installed in slots on the same bus.
Page 60 The search order is: a. CD-ROM b. Disk drives c. Integrated SCSI devices d. x450 PCI-X slots (in the order 1, 2, 6, 5, 3, 4) IBM ^ xSeries 450 Planning and Installation Guide...
Page 61: Broadcom Gigabit Ethernet Controller
PRO/1000 XT Server adapter, part 22P6801. However, this may only be supported in specific slots. See the following for details: http://www.pc.ibm.com/us/compat/x450/ibm_22P6801.html If you have a mixed fiber/copper Gigabit server switch network, use the Broadcom-based 22P7801, NetXtreme 1000 SX Fiber Ethernet adapter.
Page 62: Cabling And Connectivity
The rear panel of the x450 showing the locations of cable connectors is illustrated in Figure 3-4 on page 49. For more details about ports on the Remote Supervisor Adapter, refer to 3.2.1, “Remote Supervisor Adapter connectivity” on page 50. IBM ^ xSeries 450 Planning and Installation Guide...
Page 63 RXE Expansion Port (B) Serial connector connector Remote Supervisor Adapter connectors Gigabit Ethernet connectors SCSI connector RXE Expansion Port (A) connector USB ports RXE Management Port Video connector Figure 3-4 x450 rear view Of note are the following items: There are no PS/2 keyboard or mouse ports on the x450. Only USB devices are supported.
Page 64: Remote Supervisor Adapter Connectivity
Important: An external power supply is not officially supported in the x450. 9-pin serial port, which supports systems management functions through null modem or modem connections. This port is dedicated and can only be used for RSA purposes. IBM ^ xSeries 450 Planning and Installation Guide...
Page 65: Remote Expansion Enclosure
For detailed instructions on cabling ASM interconnect networks, refer to the redbook Implementing Systems Management Solutions using IBM Director , SG24-6188. Note : The x450 does not include the necessary dongle to connect the Remote Supervisor Adapter to an ASM interconnect bus using the RS-485 port on the adapter.
Page 66 32-bit adapters can be installed in any of the slots and will run in 32-bit mode. 32-bit and 64-bit adapters can coexist in 64-bit slots in the same bus. The 32-bit adapters will run in 32-bit mode, and the 64-bit adapters will run in 64-bit mode. IBM ^ xSeries 450 Planning and Installation Guide...
Page 67 When installing a 133 MHz PCI-X adapter, it must be installed in the first or odd-numbered slot in the bus (that is in slots 1, 3 or 5). Like the x450, a PCI-X and a PCI adapter can be installed in slots on the same bus in the RXE-100.
Page 68 A (in) Port RXE-100 connector RXE Management A (out) Port connector RXE Management B (in) Port connector RXE Expansion Port connectors Figure 3-8 Connecting the RXE-100 to the x450 (12 slots in the RXE-100) IBM ^ xSeries 450 Planning and Installation Guide...
Page 69: Serial Connections
The short interconnect management cable to connect Management A (out) Port to Management B (in) Port is supplied with the second set of PCI slots. The second Remote I/O data cable is optional. However, it is recommended because it provides redundancy if the other Remote I/O cable fails, and it also increases throughput from the PCI adapters in the RXE-100 to the x450.
Page 70: Storage Considerations
LSI controller. Typically the x450 will be attached to an external disk enclosure for data storage requirements. Some of the supported IBM storage options are: SCSI RAID adapters and storage enclosures Fibre Channel adapters and Storage Area Networks (SANs)
Page 71 This section discusses some of the available xSeries storage solutions and related technologies, as well as tape backup and performance considerations. Note: All the IBM Storage Solutions are supported under Linux, as well as under Windows. For more information see: http://www.storage.ibm.com/linux...
Page 72 Booting any operating system from the ServeRAID card will not be supported. IBM Fibre Array Storage Technology The IBM Fibre Array Storage Technology (FAStT) family of Fibre Channel storage solutions is designed for high-availability, high-capacity requirements. FAStT solutions can support transfers over distances up to 10 km (6.2 miles) at rates of up to 200 MBps.
Page 73 EXP500 enclosures. Each RAID controller unit also contains 128 MB of battery-backup cache. Tip: The FAStT200 ships with IBM FAStT Storage Manager 7.10. When we wrote this redbook, there was no Storage Manager version for IA-64 architecture.
Page 74 ESS provides an image of a set of logical disk devices to attached servers. The logical devices are configured to emulate disk device types that are compatible with the attached servers. The logical devices access a logical volume that is IBM ^ xSeries 450 Planning and Installation Guide...
Page 75: Tape Backup
This allows ESS to connect to all IBM servers, from zSeries to iSeries™, pSeries and xSeries, directly or through a SAN, thus helping the x450 fit into a heterogeneous environment containing a variety of server architectures. ESS offers several choices of host I/O interface attachment methods, including SCSI and Fibre Channel for xSeries.
Page 76: Rack Installation
(110 lb.). Therefore, this system requires two people to install it in a rack. If you use a non-IBM rack, the cabinet must meet the EIA-310-D standards with a depth of at least 28 inches. Also, adequate space (approximately two inches for...
Page 77: Power Considerations
RXE-100. See 3.2.2, “Remote Expansion Enclosure” on page 51 for RXE-100 cabling information. Since the x450 is rack optimized, the IBM xSeries rack configurator should be used to ensure correct placement. The configurator can be downloaded from: For EMEA: http://www.pc.ibm.com/europe/configurators/...
Page 78: Solution Assurance Review
3.6 Solution Assurance Review Some level of Solution Assurance Review (SAR) should be performed for all IBM solutions. The level of SAR (self, peer, or expert) should match the complexity of the solution. For example, simpler solutions may need only a self review.
Page 79 — Electronic Solution Assurance Review There is also an eSAR tool available to help you establish whether you require an expert review. This is available from: For IBM employees: , then click eSAR http://w3.ibm.com/support/assure For Business Partners: http://www.ibm.com/support/assure/esar Chapter 3. Planning...
Page 80 IBM ^ xSeries 450 Planning and Installation Guide...
Page 81: Chapter 4. Installation
4.3, “Installing SuSE Linux Enterprise Server” on page 98 Prior to commencing installation, you need to download the latest firmware and drivers. These are all available from the x450 driver matrix at: http://www.pc.ibm.com/qtechinfo/MIGR-4JTS2T.html © Copyright IBM Corp. 2003. All rights reserved.
Page 82: Using The Extensible Firmware Interface
, dir , copy , move , rm and use cd , dir , cp , mv , rm commands. See partitions commands “File operations in the EFI shell” on page 71. IBM ^ xSeries 450 Planning and Installation Guide...
Page 83 When you boot the x450, you automatically enter EFI Boot Manager menu (as shown in Figure 4-1). The menu is a starting point from which you initiate any actions. After installing an operating system, the option to start the operating system becomes the first one.
Page 84: The Efi Shell
The EFI automatically maps known file systems on the block file system identifier devices to their FSx mappings (FSx is referred to as the IBM ^ xSeries 450 Planning and Installation Guide...
Page 85 Here are some tips for easier identification of devices in the list: Even with no storage devices, the server has at least two default mappings — the MemMap entries listed as fs0: and fs1: in Example 4-2 on page 70. These are read-only RAM disks created during POST so they will always be available.
Page 86 If the USB device is attached to a USB hub (for example a memory key plugged into the USB port of a USB keyboard), then two USB strings will appear in the entry, as shown in Figure 4-4 on page 73. IBM ^ xSeries 450 Planning and Installation Guide...
Page 87 Shell> map Device Mapping Table fs0 : MemMap(0:FF000000-FFFFFFFF) fs1 : MemMap(0:FF800200-FFBFFFFF) fs2 : Acpi(PNP0A03,0)/Pci(5|2)/Usb(0,0)/Usb(3,0)/HD(Part1,Sig00000000) blk0 : MemMap(0:FF000000-FFFFFFFF) blk1: MemMap(0:FF800200-FFBFFFFF) blk2: Acpi(PNP0A03,0)/Pci(5|1)/Ata(Primary,Master) blk3: Acpi(PNP0A03,1)/Pci(3|0)/Scsi(Pun1,Lun0) blk4: Acpi(PNP0A03,0)/Pci(5|2)/Usb(0, 0)/Usb(3, 0) blk5: Acpi(PNP0A03,0)/Pci(5|2)/Usb(0,0)/Usb(3,0)/HD(Part1,Sig00000000) Figure 4-4 Map command - USB memory key connected to the USB keyboard 5.
Page 88 In the following steps, we describe the process of first creating a RAID-1 array, then installing the operating system once the logical volume has been created. Boot devices: Booting from any disks other than those attached to the internal LSI controller is not supported. IBM ^ xSeries 450 Planning and Installation Guide...
Page 89 To run the LSI Logic SCSI Setup utility to create and configure mirror volume, perform the following steps: 1. Boot your server to the Boot Manager menu. Invoke the EFI shell from the menu. Run drvcfg to determine the device handle number for the LSI driver. The output will be similar to the following: Shell>...
Page 90 3. Use the right arrow key to select Format (initially this option is off the screen to the right) and press Enter 4. Press Enter to begin the format. 5. Select Mirroring Properties . A window similar to Figure 4-5 on page 77 appears. IBM ^ xSeries 450 Planning and Installation Guide...
Page 91 Figure 4-5 Enable mirroring on the LSI adapter 6. For both disks, change disk properties in the Mirrored Pair column. The possible values are Primary, Secondary and Hot spare. Pressing the Spacebar key marks one of the disks as Primary and the other as Secondary. The physical disks in the internal drive bays are highlighted (SCSI ID 0 and 1).
Page 92 To delete the content of the disk, perform the following steps: 1. Download the DISKPART.EFI drive partitioning utility. Transfer it to the x450 using a device such as a USB memory key or CD-R. This is available from: http://developer.intel.com/technology/efi/diskutil_overview.htm IBM ^ xSeries 450 Planning and Installation Guide...
Page 93 2. Invoke the EFI shell from the Boot Manager menu. Change to the device where the diskpart utility is (for example, CD-ROM or USB memory key) and run it. A DiskPart prompt appears, similar to the following: DiskPart Version 1.0 Based on EFI core release Version 1.2.1.0 DiskPart>...
Page 94: Flash Update
If you want to delete the files from ESP, enter the EFI shell, identify the EFI System Partition and use the rm command (for the exact syntax, use the help command). IBM ^ xSeries 450 Planning and Installation Guide...
Page 95 How to recognize update files used with Flash Update: Diagnostics update file are named MZYT*.US1, where * will be a two-digit number indicating the level of the ROM Diagnostics code followed by optional additional characters. For example, MZYT05A.US1. Firmware POST/BIOS update file are named MZKT*.FLS. For example, MZKT19AUS.FLS.
Page 96 Remote Supervisor Adapter firmware update To update the Service Processor flash, we use the IBM Remote Supervisor utility, which besides updating the flash allows us to configure RSA itself. The utility is...
Page 97: Configuration And Setup Utility
Figure 4-7 Configuration and Set Up utility Enabling memory mirroring Memory mirroring (part of IBM’s Active Memory technology) provides an additional level of fault tolerance to the memory subsystem. For detailed information and guidelines on memory mirroring, see 1.7, “System memory” on page 17.
Page 98: Diagnostic Utility
If you made no changes, you will be returned to the EFI boot menu. Note: When adding or replacing memory to the xSeries 450, you may need to run the Setup program for the new memory to work.
Page 99: Boot Maintenance Menu
Figure 4-8 Diagnostic utility In the utility, only data non-destructive tests are available by default. To enable all the tests (including destructive SCSI Disk Write/Format Tests), choose Options → Toggle Hidden Test Display . Note: Multiprocessor tests were not available in the Diagnostic utility at the time of writing this book.
Page 100: Installing Windows Server 2003
SystemGuid-->[FFFFFFFF-FFFF-FFFF-FFFF-FFFFFFFFFFFF] SerialNumber-->[No Data] Figure 4-9 Boot option maintenance menu 4.2 Installing Windows Server 2003 In this section, we discuss the specifics of installing Windows Server 2003, Enterprise Edition on the xSeries 450. IBM ^ xSeries 450 Planning and Installation Guide...
Page 101: Overall Process
– System diagnostics – Remote Supervisor Adapter firmware Download these from http://www.pc.ibm.com/support 4. Shut down the system and disconnect the RXE-100. Reconnect it after the installation is complete. 5. With the Windows Server 2003 CD-ROM in the drive, boot (or reboot) the system to the EFI Boot Manager menu.
Page 102: Microsoft Reserved Partition
When initially created, the size of the MSR partition depends on the size of the disk drive: On drives less than 16 GB in size, the MSR partition is 32 MB. On drives greater than or equal to 16 GB, the MSR partition is 128 MB. IBM ^ xSeries 450 Planning and Installation Guide...
Page 103: Windows Installation
Note: The MSR partition is not accessible to the operating system users by any means. For information on the partitioning required by a Windows 64-bit installation, see http://www.microsoft.com/technet/prodtechnol/winxppro/reskit/prkb_cnc_helm.asp 4.2.3 Windows installation The installation of Windows Server 2003 on the server consists of these five phases: Pre-installation phase Starting the installation...
Page 104: Starting The Installation
For three seconds, there will be a message on the screen Press any key to boot from CD-ROM . If you do not press any key, the installation will not start and you will return to EFI. IBM ^ xSeries 450 Planning and Installation Guide...
Page 105: Text-Mode Setup
Booting the installation CD manually Starting the installation process manually proceeds as follows: 1. Insert the installation CD-ROM into the drive. 2. Enter the EFI shell from the Boot Manager menu. Access the CD-ROM drive as described in “File operations in the EFI shell” on page 71. 3.
Page 106 S to change to a GUID Partition Table (GPT) partitioning structure. The OS loader and the boot partition must reside on a GPT disk. IBM ^ xSeries 450 Planning and Installation Guide...
Page 107: Gui Setup
Tip: Once created, the MSR partition is a reserved partition and cannot be deleted from the Disk partitioning menu. To delete the MSR partition, the entire disk can be deleted as described in “Deleting the disk content” on page 78. The sizes of the ESP and the MSR partition are calculated according to the rules described in 1.3.2, “EFI System Partition”...
Page 108 When the Windows Server 2003 installation has completed, you should perform install drivers for each of the unknown devices. For each one, right-click the entry in Device Manager and click Update Driver . Select the options that let you IBM ^ xSeries 450 Planning and Installation Guide...
Page 109 specify a location for the drivers and point the installer to the directory where you downloaded the drivers. If you have other devices installed, such as FAStT Fiber Channel or ServeRAID adapters, update or add the drivers for these. ServeRAID device drivers should be at the same level as the installed ServeRAID firmware and BIOS.
Page 110 Tip: After Windows Server 2003 is installed, use NVRBOOT.EFI to export the Windows boot record, then store the file in a safe location. If the system partition gets corrupted, you can easily recreate it and then restore the Windows boot record. IBM ^ xSeries 450 Planning and Installation Guide...
Page 111 In this section we show you how to save the Boot Manager menu and how to recover it in case of an NVRAM failure. In 1.3.1, “GUID Partition Table disk” on page 7, we describe how GPT disks are identified by their global unique identifier (GUID). The entries in the Boot Manager menu use the GUID to identify which device to boot from.
Page 112: Installing Suse Linux Enterprise Server
This section describes the installation of SuSE Linux Enterprise Server 8.0 on the x450. Tip: To begin the SuSE SLES 8 installation now, go directly to “Installing SuSE Linux Enterprise Server” on page 103. IBM ^ xSeries 450 Planning and Installation Guide...
Page 113: Background
Itanium 2 port of the kernel. This effort was also possible thanks to many companies and institutions that contributed on this development effort, such as Intel, IBM, Caldera (now SCO Group), the European Organization for Nuclear Research (CERN), Red Hat, SGI, SuSE, Turbolinux, and VA Linux Systems (now VA Software).
Page 114: Linux Ia-64 Kernel Overview
Models, as shown in Table 4-2. Table 4-2 Comparison table of C types between LP32 and LP64 Data type in C LP32 LP64 char short long long long pointer enum float double long double IBM ^ xSeries 450 Planning and Installation Guide...
Page 115: Choosing A Linux Distribution
Linux distributions built around the kernel. In this section, we discuss the major Linux distributors that work with IBM, and their different products available for Itanium 2 platform: Red Hat and UnitedLinux.
Page 116 Red Hat is working on a new release of their Advanced Server that will be available on Itanium 2 platforms (which currently runs on IA-32 architectures only). For the latest information on Red Hat’s plans and IBM’s support plans, go http://www.redhat.com/software/itanium http://www.pc.ibm.com/us/compat/nos/redchat.html...
Page 117: Installing Suse Linux Enterprise Server
The SCO Group, previously called Caldera, has announced a version of their SCO Linux product for the Itanium family. This product is called Caldera SCO Linux 64. To find out about SCO’s products on Linux for 64-bit platforms or IBM support for SCO products, go to: http://www.sco.com/products/openlinux64 http://www.pc.ibm.com/us/compat/nos/thecscocgroup.html...
Page 118 ReiserFS file system, go to: http://www.namesys.com/ Installation procedure The installation procedure of SuSE Linux Enterprise Server Version 8 is like any other SuSE Linux installation, except that you work on a different architecture, so IBM ^ xSeries 450 Planning and Installation Guide...
Page 119 the bootable CD-ROM will not boot directly, as it would do on any IA-32 architecture. These are the steps to follow for a SuSE SLES 8 installation: 1. Power on the server and immediately insert the first SuSE CD-ROM in the drive.
Page 120 8. Add user: the installation program will ask you to create a user. You need to create this user to continue the installation. This is done for security reasons. You should log on as a normal user, and use the root account as little as possible. IBM ^ xSeries 450 Planning and Installation Guide...
Page 121: Linux Boot Process
9. Desktop settings: you will be prompted to configure your desktop settings and choose which mode, text or graphical, you want to use the next time the machine is booted. 10.Hardware configuration: if you have some additional hardware, such as network interfaces, you can configure them here.
Page 122: Information About The Installed System
CPU number 0. On multiprocessor systems, we will find all the information regarding every CPU. Example 4-3 /proc/cpuinfo output linux:~ # cat /proc/cpuinfo processor : 0 vendor : GenuineIntel arch : IA-64 family : Itanium 2 IBM ^ xSeries 450 Planning and Installation Guide...
Page 123: Memory Information
model revision archrev features : branchlong cpu number : 0 cpu regs cpu MHz : 900.000000 itc MHz : 900.000000 BogoMIPS : 1132.46 Memory information We used 3 GB of DDR memory, and it was fully recognized by Linux. We also set up some swap memory, but it was never used during our tests.
Page 124 0 [keybdev hid mousedev joydev evdev] usb-uhci 60088 0 (unused) usbcore 145016 1 [hid usb-uhci] nls_iso8859-1 4432 1 (autoclean) nls_cp437 5936 1 (autoclean) lvm-mod 123432 0 (autoclean) ide-scsi 21728 reiserfs 495352 mptscsih 75456 IBM ^ xSeries 450 Planning and Installation Guide...
Page 125 mptbase 80128 3 [mptscsih] Notice that the Broadcom driver, bcm5700, is used by only one Ethernet card. This is because we were using only one port during our tests and also that SuSE SLES 8 provides LVM support by default. Partitions on IA-64 Linux The EFI system implements a new way to work with partitions.
Page 126: Using The Serial Port For The Linux Console
Example 4-8 Redirection of kernel messages to the serial port with syslogd daemon # This is only a part of the /etc/syslog.conf file # Your file may be different. Here we will send all the kernel IBM ^ xSeries 450 Planning and Installation Guide...
Page 127: Expansion Enclosure
# warning messages to the serial port kern.warn; /dev/ttyS0 To activate the changes you made in the syslog daemon, enter the command: /etc/init.d/syslog restart Refer to the syslog daemon man page for more information about the configuration. 4.3.8 RXE-100 Expansion Enclosure The RXE-100 Expansion Enclosure is now fully supported under Linux.
Page 128: Upgrading Drivers
Figure 4-17 PCI information on YaST 4.3.9 Upgrading drivers Any update to the Linux installation should be done via the official support service provided from IBM and SuSE. To visit the xSeries support page, go to: http://www.pc.ibm.com/support IBM ^ xSeries 450 Planning and Installation Guide...
Page 129 At the time of the writing, there was no official kernel update to support the new 64-bit chipset. The x450 will work in 64-bit native mode without any kernel patches. If IBM or SuSE release any specific patch for the XA-64 chipset, you will find more information about how to upgrade your current kernel on the xSeries support page: http://www.pc.ibm.com/support...
Page 130 IBM ^ xSeries 450 Planning and Installation Guide...
Page 131: Chapter 5. Management
Out of band management with IBM Director Managing the x450 using the Remote Supervisor Adapter Important: At the time of writing, a 64-bit version of IBM Director Agent was not available for either Windows or Linux. Consequently, this chapter concentrates on out-of-band alerting and management through the Remote Supervisor Adapter.
Page 132: The Remote Supervisor Adapter
Point-to-point protocol (PPP) support Simple Network Management Protocol (SNMP) support Domain Name System (DNS) and Dynamic Host Configuration Protocol (DHCP) support Remote power control Remote firmware update and access to critical server settings IBM ^ xSeries 450 Planning and Installation Guide...
Page 133: The Remote Supervisor Adapter
Out-of-band means bypassing the operating system and connecting to the adapter directly. Important: At the time of writing, a 64-bit version of IBM Director Agent was not available for either Windows or Linux. Consequently, this chapter concentrates on out-of-band alerting and management through the Remote Supervisor Adapter.
Page 134 IDs before you put your server into production. Access to the Remote Supervisor Adapter should be carefully restricted. 8. Once you are connected, the main menu should appear. IBM ^ xSeries 450 Planning and Installation Guide...
Page 135: Configuring A Static Ip Address
Figure 5-2 Remote Supervisor Adapter Web interface 9. You should change the adapter name (via System Settings) and host name (via Network Interfaces). We recommend you make these two names the same to eliminate confusion. 10.We also recommend that you configure a static IP address for your Remote Supervisor Adapter.
Page 136 4. Enter the command flash2 and press Enter. 5. Select Configuration Settings . 6. Select Ethernet Settings . The Ethernet Settings window opens, as shown in Figure 5-3 on page 123. IBM ^ xSeries 450 Planning and Installation Guide...
Page 137 Figure 5-3 RSA Ethernet settings 7. Enter the values specific to your organization for the IP address, subnet mask, and gateway. 8. Enter your host name. To eliminate confusion, consider making this field the same value as the system name under General . For detailed information about the Ethernet settings, see the Remote Supervisor Adapter User’s Guide .
Page 138: Connecting Via The Asm Interconnect
Standard Cat5 Ethernet cable (not crossover) Follow the instructions that ship with the cable kit, or review the redbook Implementing Systems Management Solutions using IBM Director , SG24-6188. Once you have connected the x450 Remote Supervisor Adapter to other service processors including another Remote Supervisor Adapter, do the following: 1.
Page 139: Installing The Device Driver
The device driver is on the Resource CD-ROM that is shipped with the server. The latest version of the driver is also available from: http://www.pc.ibm.com/support Installation procedures are documented in the following sections: Windows: “Installing additional drivers” on page 93 Linux: 4.3.9, “Upgrading drivers”...
Page 140: Management Using The Remote Supervisor Adapter
“The Remote Supervisor Adapter” on page 118, you can then use the adapters to manage x450 by forwarding events to IBM Director. IBM Director can then be configured to act upon those events in a variety of ways (for example, by sending e-mail or a pager alert).
Page 141: Configuring Snmp
These options are applicable only when the IBM Director Agent is installed on the x450. When the agent is installed and those options are selected, the events are sent to IBM Director agent and appear as sourced from the x450. 5.2.2 Configuring SNMP The Remote Supervisor Adapter supports the sending of alerts to IBM Director using the Simple Network Management Protocol (SNMP).
Page 142: Sending Alerts Directly To Ibm Director
Adapter you configured. You can choose to make this name more descriptive for your environment by right-clicking and choosing Rename . 7. Proceed to 5.2.4, “Creating a test event action plan in IBM Director” on page 130 for instructions on how to verify the functionality of the Remote Supervisor Adapter.
Page 143 By default, this list is empty. Click on an empty link (labeled ~not used~) to configure a remote recipient. 4. To configure IBM Director as a remote recipient, you will need to enter the following values. All fields not listed can be left in their default (blank) state:...
Page 144: Creating A Test Event Action Plan In Ibm Director
IBM Director. Click and drag All Events to the event action plan you just created. This will add the filter to the action plan. The All Events filter will cause any event generated by the system to be reported to IBM Director, and is good for testing.
Page 145 Forwarding, continue with step 13. If you chose to configure your adapter using SNMP, jump to step 14. 13.In the IBM Director Console, click and drag your test event to your IBM Director Server system in the middle pane. See Figure 5-8 on page 132 for how your configuration should look.
Page 146 Figure 5-8 Completed configuration 14.In the IBM Director Console, click and drag your completed test configuration to the Remote Supervisor Adapter for the x450 located in the middle pane. 15.In either case, a pop-up window will appear notifying you that the event action plan has been added (Figure 5-9 on page 133).
Page 147 Figure 5-9 Event action plan added 16.To complete testing, we recommend removing one of the fans from the top of the x450. Within approximately 10 seconds, an alert should appear on the Director Console similar to the one in Figure 5-10. Figure 5-10 Message alert Once functionality has been confirmed, you can now build event action plans to suit your environment.
Page 148 IBM ^ xSeries 450 Planning and Installation Guide...
Page 149: Related Publications
The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redbook. IBM Redbooks For information on ordering these publications, see “How to get IBM Redbooks” on page 137. Tuning IBM ^ xSeries Servers for Performance , SG24-5287...
Page 150 IBM ^ xSeries 450 Planning and Installation Guide IBM ^ xSeries 450 Planning and Installation Guide...
Page 151: How To Get Ibm Redbooks
How to get IBM Redbooks You can order hardcopy Redbooks, as well as view, download, or search for Redbooks at the following Web site: ibm.com/redbooks You can also download additional materials (code samples or diskette/CD-ROM images) from that site.
Page 152 IBM ^ xSeries 450 Planning and Installation Guide IBM ^ xSeries 450 Planning and Installation Guide...
Page 153: Index
Broadcom 22, 47 adapter teaming 47 Broadcom driver fans 23–24 Windows 2000 94 features 1 Broadcom Gigabit Ethernet controller 22 Fibre Channel storage options 58 flash updates 80 flash2 command 82 cabling © Copyright IBM Corp. 2003. All rights reserved.
Page 154 McKinley 2 Contact us xii memory 17 redundancy 23 Active Memory 17 Remote Expansion I/O port 5 Chipkill memory 20 Remote Supervisor Adapter disabling during POST 20 connectivity 50 memory mirroring 19 IBM ^ xSeries 450 Planning and Installation Guide...
Page 155 driver Device Manager 94 Windows 2000 94 installing 86 features 26 RXE-100 95 firmware updates 82 support 27 RS-485 23 winnipeg chip 3 rules PCI slots 44 RXE-100 52 XA-64 chipset 3 RXE-100 51, 113 X-Architecture 1 cabling 53 XceL4 Server Accelerator Cache 17 slots 52 Xeon Processor MP 10 scan order, PCI 46...
Page 156 IBM ^ xSeries 450 Planning and Installation Guide...
Page 160 Back cover ® xSeries 450 Planning and Installation Guide The IBM ^ xSeries 450 is IBM’s new 64-bit Itanium Describes the INTERNATIONAL technical details of Processor Family (IPF) Architecture server and is the first TECHNICAL implementation of the 64-bit IBM XA-64 chipset, as part of the...

IBM xSeries 450 Planning And Installation Manual

Notices

Preface

Chapter 1. Technical Description

Chapter 2. Positioning

Chapter 3. Planning

Chapter 4. Installation

Chapter 5. Management

Related Publications

Index

Quick Links

Front cover

Installation Guide

Related Manuals for IBM xSeries 450

Summary of Contents for IBM xSeries 450

Table of Contents