hit counter script
NEC Express5800 Series User Manual
NEC Express5800 Series User Manual

NEC Express5800 Series User Manual

Express5800 series;
Hide thumbs Also See for Express5800 Series:
Table of Contents

Advertisement

Quick Links

NEC Express5800 Series
N8800-090F, EXP320B
NEC Express5800/320Fa-L
N8800-091F, EXP320A
NEC Express5800/320Fa-LR
User's Guide

Advertisement

Table of Contents
loading

Summary of Contents for NEC Express5800 Series

  • Page 1 NEC Express5800 Series N8800-090F, EXP320B NEC Express5800/320Fa-L N8800-091F, EXP320A NEC Express5800/320Fa-LR User's Guide...
  • Page 3 N8800-090F, EXP320B NEC Express5800/320Fa-L N8800-091F, EXP320A NEC Express5800/320Fa-LR User's Guide 2nd Edition 9-2006 856-126408-101-01...
  • Page 4 The NEC product(s) discussed in this document are warranted in accordance with the terms of the Warranty Statement accompanying each product. However, actual performance of each such product is dependent upon factors such as system configuration, customer data, and operator control.
  • Page 5 Keep this User's Guide handy for quick reference when necessary. SAFETY INDICATIONS To use NEC Express5800 series safely, follow the instructions in this User's Guide. This guide explains components that pose a danger, types of dangers, and actions taken to prevent them;...
  • Page 6 SYMBOLS USED IN THIS USER'S GUIDE AND WARNING LABELS Attention Indicates a risk of an electric shock. Indicates a risk of a personal injury due to heat. Indicates a risk of catching your fingers. Indicates a risk of a fire or smoke. Indicates a general precaution or warning that is not defined herein.
  • Page 7 Mandatory actions Unplug the server. There is a risk of an electric shock or fire. Indicates a general action to take that is not defined herein. Make sure to follow the instructions.
  • Page 8 NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
  • Page 9 NEC Express5800 WARNING CAUTION CAUTION...
  • Page 11 CLASS 1 LASER PRODUCT –...
  • Page 12 Trademarks and Patents NEC EXPRESSBUILDER and NEC ESMPRO are trademarks of NEC Corporation. Microsoft, and Windows are registered trademarks of Microsoft Corporation in the United States and other countries. Avocent and Dambrackas Video Compression (DVC) are trademarks or registered trademarks of Avocent Corporation in the United States and other countries.
  • Page 13: Preface

    (5) NEC assumes no liability arising from the use of this product, nor any liability for incidental or consequential damage arising from the use of this manual regardless of (4) above.
  • Page 14: About This User's Guide

    This chapter describes how to make settings of built-in basic input/output system. It also describes factory-shipped parameters. Chapter 5 Installing and Using Utilities This chapter describes features and operating procedures of a standard utility “NEC EXPRESSBUILDER.” It also describes procedures to install and operate various software programs contained in its CD-ROM.
  • Page 15 Keep the accessories in a safe place. You will need them when you perform setup, addition of options, or replacement of failed components. To check NEC EXPRESSBUILDER components, see the attached list. Be sure to fill out and mail the software registration card that is attached to your operating system.
  • Page 16: Table Of Contents

    CONTENTS PREFACE ............................i ABOUT THIS USER'S GUIDE.......................ii Chapter 1 Precautions for Use..................1-1 WARNING LABELS........................1-2 Server Chassis ......................... 1-2 CPU/IO modules ........................1-3 CPU/IO modules ........................1-4 PRECAUTIONS FOR SAFETY ....................1-5 General ............................ 1-5 Use of Power Supply and Power Cord ..................1-6 Installation, Relocation, Storage and Connection..............
  • Page 17 Chapter 3 Linux Setup and Operation ................. 3-1 HARD DISK CONFIGURATIONS THAT CAN BE BUILT ON THE NEC Express5800/ft series .............................3-2 REPLACING 3.5-INCH HARD DISK DRIVE ................3-3 How to Locate Failed Disks .....................3-3 Restoring Redundant Configuration Manually.................3-5 SETTING THE VIDEO MODE....................3-10 Notes ............................3-11...
  • Page 18 Startup and Exit of System Diagnostics .................. 6-7 OFF-LINE MAINTENANCE UTILITY..................6-11 Starting the Off-line Maintenance Utility ................6-11 Features of Off-line Maintenance Utility................6-11 RELOCATING/STORING THE NEC Express5800/ft series............ 6-13 Chapter 7 Troubleshooting ................... 7-1 TO LOCATE THE ERRORS....................... 7-2 ERROR MESSAGES ........................7-3 Error Messages by LED Indication ..................
  • Page 19 Installing DIMM ........................8-22 Removing DIMM........................8-23 Replacing DIMM ........................8-24 PROCESSOR (CPU)........................8-25 Installing CPU (Model with Heat Sink) .................8-26 Removing CPU (Model with Heat Sink)................8-29 Replacing CPU........................8-30 ft Remote Management Card......................8-31 Installing ft Remote Management Card .................8-32 Removing ft Remote Management Card................8-33 PCI BOARD ..........................8-34 Installing PCI Board.......................8-36 Removing PCI Board ......................8-37...
  • Page 20 viii (This page is intentionally left blank.)
  • Page 21: Chapter 1 Precautions For Use

    Chapter 1 Precautions for Use This chapter includes information necessary for proper and safe operation of the server.
  • Page 22: Warning Labels

    1-2 Precautions for Use WARNING LABELS Warning labels are placed in certain parts of the system so that the user stays alert to possible risks (Do not remove or damage these labels). If some label is missing, about to peel off, or illegible, contact your sales agent. Server Chassis Tower model Front...
  • Page 23 Precautions for Use 1-3 Rack model Front Rear...
  • Page 24: Cpu/Io Modules

    1-4 Precautions for Use CPU/IO modules The following shows the place on CPU/IO modules where the label is attached.
  • Page 25: Precautions For Safety

    NEC assumes no liability for any accidents or damage to physical assets resulting from the use of this equipment in such systems or facilities.
  • Page 26: Use Of Power Supply And Power Cord

    1-6 Precautions for Use Use of Power Supply and Power Cord WARNING Do not handle a power plug with a wet hand. Do not plug/unplug a power cord with a wet hand. There is a risk of an electric shock. Do not connect the ground wire to a gas pipe.
  • Page 27: Installation, Relocation, Storage And Connection

    Precautions for Use 1-7 Installation, Relocation, Storage and Connection WARNING Disconnect the power cord(s) before installing or removing the equipment. Be sure to power off the equipment and unplug its power cords from the wall outlet before installation/relocation. All voltage is removed only when the power cords are unplugged.
  • Page 28 Do not use any non-designated interface cable. Use only interface cables designated by NEC; identify which component or connector to attach beforehand. If you use a wrong cable or make a wrong connection, there is a risk of short-circuit that could lead to a fire.
  • Page 29: Cleaning And Handling Of Internal Devices

    Precautions for Use 1-9 Cleaning and Handling of Internal Devices WARNING Do not disassemble, repair, or alter the server. Unless described herein, never attempt to disassemble, repair, or alter the equipment. There is a risk of an electric shock or fire as well as malfunction. Do not look into the CD-ROM drive.
  • Page 30: During Operation

    1-10 Precautions for Use CAUTION Protect the unused connectors with the protective cap. The unused power cord connectors are covered with the protective cap to prevent short circuits and electrical hazards. When removing the power cord connector from the internal devices, attach the protective cap to the connector. Failure to follow this warning may cause a fire or an electric shock.
  • Page 31: Rack-Mount Model

    Precautions for Use 1-11 Rack-mount Model CAUTION Do not install the equipment on a nonconforming rack. Install the equipment on a 19-inch rack conforming to the EIA standard. Do not use the equipment without a rack or install it on a nonconforming rack. The equipment may not function properly, and there is a risk of damage to physical assets or injuries.
  • Page 32: For Proper Operation

    Before turning off the power or ejecting a disk, make sure that the access LED is off. When you have just turned off the power, wait at least 30 seconds before turning it on again. Once you have turned on the server, do not turn it off until the "NEC" logo appears on the screen.
  • Page 33 It is recommended to use NEC's genuine option products. Some competitors’ products are compatible with this server. However, servicing for trouble or damage resulting from such a...
  • Page 34 1-14 Precautions for Use SAFETY INDICATIONS WARNING CAUTION...
  • Page 35 Precautions for Use 1-15 WARNING CAUTION...
  • Page 36 1-16 Precautions for Use CAUTION...
  • Page 37 Precautions for Use 1-17 WARNING CAUTION...
  • Page 38 1-18 Precautions for Use CAUTION CAUTION...
  • Page 39 Precautions for Use 1-19 WARNING CAUTION...
  • Page 40 1-20 Precautions for Use CAUTION...
  • Page 41: Disposal Of Equipment And Consumables

    Precautions for Use 1-21 DISPOSAL OF EQUIPMENT AND CONSUMABLES When you dispose of the main unit, hard disk drives, floppy disks, CD-ROMs, optional boards, etc., you need to observe your local disposal rules. Dispose the attached power cable along with the equipment to avoid being used with other equipment. For details, ask your municipal office.
  • Page 42: If System Trouble Is Suspected

    If the period is not specified, the repair parts are kept for 5 years after discontinuance of the product. ABOUT OUR WEB SERVICE Information on NEC Express5800/ft series including modification modules is also available on our web site, NEC Express5800 Web Site Asia Pacific, at...
  • Page 43 Precautions for Use 1-23 Advice for Your Health Prolonged use of a computer may affect your health. Keep in mind the following to reduce stresses on your body: Sit in a good posture Sit on your chair with your back straight. If the desk height is appropriate, you will slightly look down at the screen and your forearms will be parallel to the floor.
  • Page 44 1-24 Precautions for Use (This page is intentionally left blank.)
  • Page 45 Chapter 2 General Description This chapter describes what you need to know to use the NEC Express5800/ft series. Refer to this chapter when you want to know about certain components and how to operate them.
  • Page 46 NEC ESMPRO Off-line Maintenance Utility NEC DianaScope Ready-to-use Easy and Fine Setup Quick cableless connection: hard disk, NEC EXPRESSBUILDER (system setup CPU/IO module, POWER utility) SETUP (BIOS setup utility) SCSISelect (SCSI device utility) Fault-tolerant Feature Redundant modules achieved within a...
  • Page 47: Chapter 2 General Description

    NEC Express5800/ft series detects status changes, errors and other events and notifies the user of these events. If you use an alarm notification tool, you can configure NEC Express5800/ft series to notify you when certain events occur.
  • Page 48 NEC Express5800/ft series automatically maintains data as the current data. Automatic detection and notification of faults NEC Express5800/ft series detects and sorts out all events such as general status changes and faults, and records these events to syslog. Transparent migration NEC Express5800/ft series constantly monitors events.
  • Page 49 GUI that enables monitoring and setting of NEC Express5800/ft series. NEC ESMPRO can be used both locally and remotely on work station PCs or server PCs. Syslog function When a trouble or other event is detected on NEC Express5800/ft series, they will be recorded in syslog. In-service repairing...
  • Page 50: Names And Functions Of Components

    2-6 General Description NAMES AND FUNCTIONS OF COMPONENTS Names and functions of components are shown below: (1) Front door The cover to protect devices in the front in daily operations: this cover can be locked by the security key shipped together.
  • Page 51: Front View (Inside)

    General Description 2-7 Front View (inside) The following illustrations show components in the front of the tower model and the rack model. Tower model (with the front door open)
  • Page 52 2-8 General Description POWER LED (green) This LED illuminates when the power supply is switched on (see page 2-22). DISK ACCESS LED (green/amber) This LED illuminates in green when the internal hard disk drives are accessed. If any internal hard disk drive is failing, the LED illuminates in amber (see page 2-22). FT status LED (green/amber) This LED indicates the status of the server (see page 2-23).
  • Page 53 General Description 2-9 (12) CPU/IO module #0 This is a module with a set of CPU (processor), memory (DIMM), PCI board, and cooling fan unit (see page 2-18). (13) CPU/IO module #1 This is a module with a set of CPU (processor), memory (DIMM), PCI board and cooling fan (see page 2-18).
  • Page 54 2-10 General Description (27) HCS1 error LED See page 2-26. (28) Heat warning LED See page 2-26. (29) Backup device bays These bays are used to install optional drives such as DAT or AIT drives.
  • Page 55 General Description 2-11 Rack model (with the front door open) POWER LED (green) This LED illuminates when the power supply is switched on (see page 2-22). DISK ACCESS LED (green/amber) This LED illuminates in green when the internal hard disk drives are accessed. If any internal hard disk drive is failing, the LED illuminates in amber (see page 2-22).
  • Page 56 2-12 General Description UID LED (blue) This LED blinks by a command from software. POWER switch This switch is used to power on/off the server. The POWER LED illuminates and the server is powered on when this switch is pressed once (see page 2-30). The power supply is turned off when the switch is pressed once again (see page 2-31).
  • Page 57 General Description 2-13 (20) Fan 2 error LED See page 2-25. (21) Fan 1 error LED See page 2-25. (22) Memory group 2 error LED See page 2-25. (23) Voltage error LED See page 2-26. (24) Memory group 1 error LED See page 2-25.
  • Page 58: Cd- Rom Drive

    2-14 General Description CD- ROM Drive Status LED An LED that stays on while the loaded CD-ROM is accessed. CD tray eject button A button for ejecting the CD tray. Manual release hole When the eject button does not work, insert a metal pin into this hole to forcefully eject the CD tray.
  • Page 59: Rear View

    General Description 2-15 Rear View Tower model Rack model...
  • Page 60 Management LAN port This is a LAN port dedicated to management and can be used when a ft remote management card is installed. The port is used when the remote management function or NEC DianaScope is used (optional for 320Fa-L, 320Fa-LR models).
  • Page 61 General Description 2-17 (16) SCSI connector This connector is used to connect the internal backup device (optional) and N8803-032 SCSI board (only for tower model).
  • Page 62: Cpu/Io Module

    2-18 General Description CPU/IO Module Module handle Cooling fan unit 1 Heat sink (CPU#1) PCI slot DIMM For more information on slot numbers, see the figure on next page. CPU/IO module (without a water-cooling kit) (320Fa-L/320FaLR model)
  • Page 63 General Description 2-19 CPU/IO module board DIMM slots (1)-1 DIMM slotA1 (1)-2 DIMM slot B1 (1)-3 DIMM slot A2 (1)-4 DIMM slot B2 (1)-5 DIMM slot A3 (1)-6 DIMM slot B3 ft remote management card connector LAN1 connector LAN2 connector Riser card connector PCI board slot (6)-1 PCI board slot (unavailable)
  • Page 64 2-20 General Description LED board connector Fan connector Jumper switch for CMOS/password clearing Lithium battery (10) (11) Processor #1 socket (CPU#1) Processor #2 socket (CPU#2) (12) HCS-A connector (unavailable) (13) (14) Fan connector (unavailable) (15) HCS-B connector (unavailable) Jumper switch for BMC configuration (16)
  • Page 65: Ft Remote Management Card

    This port supporting 100Mbps/10Mbps is used to connect to a network. You cannot use this port to connect to a telephone line directly. This port is also used for management by NEC DianaScope, the management software shipped with the server.
  • Page 66: Leds

    2-22 General Description LEDs This section describes indications and meanings of the LEDs on NEC Express5800/ft series. See “NAMES AND FUNCTIONS OF COMPONENTS” (pages 2-6 through 2-17) for the locations of each LED. POWER LED This LED illuminates in green while the server is powered on. When power is off, this LED does not illuminate.
  • Page 67 General Description 2-23 FT Status LED The LED stays green while the server is running normally in DUPLEX mode. If this LED does not illuminate or illuminates/blinks in amber, there is something wrong with the server. The table below shows indications of the FT Status LED and their meanings. FT status LED Description Action...
  • Page 68 2-24 General Description CPU/IO Module # 0 Status LED CPU/IO Module # 1 Status LED These LEDs illuminate in green when this device is running successfully. If a LED is off, blinks in green, or illuminates/blinks in amber, the device has a problem. The table below shows indications of CPU/IO module status LEDs, their meanings, and actions to be taken.
  • Page 69 General Description 2-25 UID LED This LED blinks in blue by NEC ESMPRO Manager, NEC DianaScope or remote management of WEB server functions to identify the targeted device for maintenance. Use this LED when you have two or more of this device model on a single rack.
  • Page 70 2-26 General Description Power Supply Unit Error LED This LED illuminates in amber when the corresponding power supply unit located at the rear of the server has a problem. Voltage Error LED This LED illuminates in amber when the voltage of the CPU/IO module is not within an appropriate range.
  • Page 71 General Description 2-27 LAN Connector LED LINK/ACT LED The LINK/ACT LED shows the status of a standard network port. It is green if power is supplied to the main unit and hub, and they are connected correctly (“LINK”). It blinks green while the network port sends or receives data (ACT).
  • Page 72: Basic Operation

    2-28 General Description BASIC OPERATION This section describes basic operation procedures of NEC Express5800/ft series. Security lock (front door lock) (for tower model) The security lock located at the front of this server locks the front door. Open the front door to power on/off the server, operate the CD-ROM drive or 5.25-inch device, or install/remove a hard...
  • Page 73: Installing/Removing The Front Bezel

    General Description 2-29 Installing/Removing the Front Bezel When you power on/off the server, operate the CD-ROM drive, or remove/install a hard disk drive or CPU/IO module, remove the front bezel. IMPORTANT: Front bezel cannot be opened without inserting the attached security key into the slot to release the lock.
  • Page 74: Power On

    2-30 General Description Power ON To power on NEC Express5800/ft series, press the POWER switch located on the right of the front panel. Follow the steps below to turn on the power. Power on the display unit and other peripheral devices connected to the server.
  • Page 75: Power Off

    General Description 2-31 Power OFF Follow the steps below to turn off the power. If NEC Express5800/ft series is plugged to a UPS, see manuals included with the UPS or the application that controls the UPS. Perform a normal shutdown from Linux by running the shutdown command.
  • Page 76 2-32 General Description Flow of POST This section walks you through how POST is performed. When you power on the system, one selected CPU/PCI module will start up. POST will be performed on this selected CPU/PCI module. Memory check starts. A message appears at the upper left of the screen to show that the basic and expanded memories are being counted.
  • Page 77 General Description 2-33 Upon completion of POST, the password entry screen appears prior to OS startup. The password entry screen will appear after the normal termination of POST only if you have set a password in the BIOS setup utility “SETUP.” You can enter a password up to three times.
  • Page 78: Floppy Disk Drive (Option)

    To format a floppy disk, see your OS manual. If you power on or restart NEC Express5800/ft series with a floppy disk left in the drive, the server will access the floppy disk to start the system. Unless a system exits on the FD, the server will be unable to start.
  • Page 79 Data loss could also be caused by faulty operation and computer trouble. To avoid such possible data loss, it is recommendable to back up important data regularly. (Be sure to make back-up copies of the floppy disks that are included with NEC Express5800/ft series.)
  • Page 80: Cd-Rom Drive

    2-36 General Description CD-ROM Drive NEC Express5800/ft series has a CD-ROM drive on the front panel. It is a device used to read data from a CD-ROM (compact disc read-only memory). Compared to a floppy disk, a CD-ROM allows for larger volume and fast data readout.
  • Page 81 General Description 2-37 To remove the CD-ROM, press the CD-tray-eject button as you did in setting the CD-ROM. When the access LED illuminates in orange, it indicates the CD-ROM is being accessed. Make sure the access LED is not illuminating in orange before you press the CD-tray-eject button. Press the locking part in the center of the tray and pick the CD-ROM gently.
  • Page 82 2-38 General Description Handling CD-ROMs Observe the following when you use a CD-ROM on NEC Express5800/ft series: As for a disk such as a noncompliant “copy-protected CD,” we shall not guarantee that you can use a CD player to play it with this server.
  • Page 83: Chapter 3 Linux Setup And Operation

    Chapter 3 Linux Setup and Operation This chapter describes setup procedures to make NEC Express5800/ft series ready for use.
  • Page 84: Hard Disk Configurations That Can Be Built On The Nec Express5800/Ft Series

    HARD DISK CONFIGURATIONS THAT CAN BE BUILT ON THE NEC Express5800/ft series In the NEC Express5800/ft series, all built-in disks need RAID configuration. Configure RAID 1 using software for the NEC Express5800/ft series. The hard disks on the same slot location of the PCI module configure RAID. As shown in the following figure, hard disk drives in Slot 0 and Slot 3, Slot 1 and Slot 4, Slot 2 and Slot 5 should be paired to configure RAID.
  • Page 85: Replacing 3.5-Inch Hard Disk Drive

    Linux Setup and Operation 3-3 REPLACING 3.5-INCH HARD DISK DRIVE Follow the procedure below to remove the failed hard disk. If the hard disk fails, it should be replaced with new device with the server powered-on. How to Locate Failed Disks This section describes a procedure to locate failed disks.
  • Page 86 3-4 Linux Setup and Operation See the path information in [General Information] of [SCSI Slot (ID: 41/1)]. It shows that PCI module, SCSI adapter, and SCSI bus are 10, 5, and 0, respectively. This allows you to find that SCSI Slot (ID: 41/1) belongs to Group 1. SCSI slots under SCSI Enclosure (ID: 41) correspond to Group 1.
  • Page 87: Restoring Redundant Configuration Manually

    Linux Setup and Operation 3-5 Restoring Redundant Configuration Manually This section describes procedure to change the built-in disk on which failures occurred and re-establish the dual configuration of hard disks. IMPORTANT: Manual restoration of redundant configuration must be performed by a root user. While recovery operation of RAID, the status of two disks configuring RAID become “resync”...
  • Page 88: Linux Setup And Operation

    3-6 Linux Setup and Operation 4 Remove Full Disks 5 Status(Raid) 6 Status(All Disks) 9 <= Return Command:2 [Remove Half Disk] Which scsi SLOT?[0-5]:3 mdadm: set /dev/hadb2 faulty in /dev/md1 mdadm: hot removed /dev/hadb2 mdadm: set /dev/hadb3 faulty in /dev/md2 mdadm: hot removed /dev/hadb3 mdadm: set /dev/hadb1 faulty in /dev/md0 mdadm: hot removed /dev/hadb1...
  • Page 89 Linux Setup and Operation 3-7 1 Bring Down(System Disk) 2 Bring Up(System Disk) 3 Status(System Disks) 9 <= Return Command:1 [Bring Down(System Disk)] Which scsi SLOT?[0-5]:3 Command Action 1 Bring Down(System Disk) 2 Bring Up(System Disk) 3 Status(System Disks) 9 <= Return Command:3 <<<...
  • Page 90 3-8 Linux Setup and Operation Command Action 1 Bring Down(System Disk) 2 Bring Up(System Disk) 3 Status(System Disks) 9 <= Return Command:9 (Restoring RAID) Command Action 1 => RAID 2 => SCSI 9 Quit Command:1 Command Action 1 New Disks 2 Remove Half Disk 3 Repair Disk 4 Remove Full Disks...
  • Page 91 Linux Setup and Operation 3-9 <<<Perform recovery to each md device. After a while, use the following command and check the status again.>>> #service diskdmp initialformat #diskdumpctl /dev/hadb6 <<<For boot disks (Slot0 and Slot3), initialize the diskdump partition and regisrer the disk devices again.>>> Command Action 1 New Disks 2 Remove Half Disk...
  • Page 92: Setting The Video Mode

    3-10 Linux Setup and Operation SETTING THE VIDEO MODE This section describes how to configure the video mode on the server. The server needs to be restarted in order to enable the video mode setting. Log on with the root authority and open /boot/grub/grub.conf with an editor. IMPORTANT: grub.conf is an extremely imporatant file for the system.
  • Page 93: Notes

    Linux Setup and Operation 3-11 Notes X server that supports the ft feature always operates in the same video mode as the console. The Xrandr feature is not supported. You cannot change screen resolution from X server. “IPMI Management Utility” cannot be used. “OpenIPMI”...
  • Page 94: Dump Initialization

    3-12 Linux Setup and Operation DUMP INITIALIZATION 1. Checking partition for diskdump 1-1. Check /var/crash (Dump file storage area) # df Filesystem 1K-blocks Used Available Use% Mounted on /dev/md1 40313912 5152136 33113896 14% /dev/md0 194366 17729 166602 10% /boot none 1035356 1035356 /dev/shm...
  • Page 95 Linux Setup and Operation 3-13 2-2. Restart the dump partition Run the following command to reboot the dump driver. # /etc/init.d/diskdump restart 3. Formatting the dump partition Run the following command to format the dump partition. # /etc/init.d/diskdump initialformat 4. Registering a device to diskdump or removing it 4-1.
  • Page 96: Keyboard Settings For X Window System

    3-14 Linux Setup and Operation KEYBOARD SETTINGS FOR X WINDOW SYSTEM The keyboard for X Window System is set to Japanese by default. (Keyboard model: jp106, Keyboard layout: jp) If you use a non-Japanese keyboard, follow the procedure below to change your keyboard settings.
  • Page 97 Linux Setup and Operation 3-15 Change the underlined values on the previous page to those below. The settings may vary depending on the keyboard you use. <For US keyboard> [Before changed] Option "XkbModel" "jp106" Option "XkbLayout" "jp" [After changed] Option "XkbModel"...
  • Page 98: Accessing Usb Fdd

    # tar cf /dev/sdb files Files are written into the disk A unintentionally Partitions are corrupted CHECK: It is a specification of the NEC Express5800/ft series to change the device name of the device file when incorporating and disconnecting the system.
  • Page 99: Chapter 4 System Configuration

    Chapter 4 System Configuration This chapter describes Basic Input Output System (BIOS) configuration. When you install the Express5800 fault tolerant server for the first time or install/remove optional devices, thoroughly read this chapter for better understanding and correct setups.
  • Page 100: System Bios ~ Setup

    4-2 System Configuration SYSTEM BIOS ~ SETUP ~ The SETUP utility is provided to make basic hardware configuration for the server. This utility is pre-installed in the flash memory of the server and ready to run. The server is configured with the correct parameters using the SETUP utility and shipped in the best conditions.
  • Page 101: Starting Setup Utility

    System Configuration 4-3 Starting SETUP Utility Powering on the server starts POST (Power On Self-Test) and displays its check results. If the NEC logo is displayed, press Esc. After a few seconds, either of the following messages appears at bottom left on the screen depending on your system configuration.
  • Page 102: Description Of On-Screen Items And Key Usage

    4-4 System Configuration Description of On-Screen Items and Key Usage Use the following keyboard keys to work with the SETUP utility. (Key functions are also listed at the bottom of the screen.) Shows the current menu. Options to be configured Online help window Denotes there are...
  • Page 103 System Configuration 4-5 F10: Shows the following: Enter If you select “Yes” and then press the key, the setup will complete with all changes you have made saved. If you select Enter “No” and then press either the key, the status before pressing the key is restored.
  • Page 104: Configuration Examples

    The following describes examples of configuration required to use software-link features or for system operations. Link with Management Software To control power supply of the server with NEC ESMPRO Manager via the network <Using the LAN connector on the motherboard> Select [Advanced]...
  • Page 105 To display POST check results Select [Advanced] - [Boot-time Diagnostic Screen] - [Enabled]. You can also press Esc while the NEC log is on the screen to display POST check results. To control from the HW console Remote operation via LAN Select [Server] - [Console Redirection], and make necessary settings.
  • Page 106 4-8 System Configuration Saving the Configuration Data To save the BIOS configuration data Select [Exit] - [Exit Saving Changes] To discard changes to the BIOS configuration data Select [Exit] - [Exit Discarding Changes] To restore the default BIOS configuration data (the data may differ from the factory-setting) Select [Exit] - [Load Setup Defaults].
  • Page 107: Menu And Parameter Descriptions

    System Configuration 4-9 Menu and Parameter Descriptions The SETUP utility has the following six major menus: Main Advanced Security Server Boot Exit To configure detailed settings of functions, select a submenu from the above menus. Below describes configurable functions and parameters and the factory settings displayed in the screen for each menu.
  • Page 108 4-10 System Configuration Available options in the Main and descriptions are listed below. Option Parameter Description System Time HH:MM:SS Specify the system time. System Date MM/DD/YYYY Specify the system date. ] factory - set IMPORTANT: Check and adjust the system clock before operation in the following conditions. - After transporting the equipment - After storing the equipment - After the equipment halt under the conditions which is out of the guranteed environment...
  • Page 109 System Configuration 4-11 Processor Settings When you select “Processor Settings” in the Main menu, the following screen appears. Refer to the table below for information on options. Option Parameter Description Processor Speed Setting Displays the speed of the processor. Processor 1 CPUID CPUID When the processor 1 in installed, its CPU ID is displayed.
  • Page 110 Specify whether to display the Power On Diagnostic Screen Self-Test (POST) screen at start-up. If Enabled "Disabled" is selected, the NEC logo appears while POST is in progress. (To display POST check results, press Esc and F2.) If "Console Redirection” is set to "Enabled,”...
  • Page 111 System Configuration 4-13 Memory Configuration When you select “Memory Configuration” in the Advanced menu, the following screen appears. Refer to the table below for information on options. Option Parameter Description Memory Size Displays the memory size. DIMM Group #1 Status Normal Displays the memory status.
  • Page 112 4-14 System Configuration PCI Configuration When you select “PCI Configuration” in the Advanced menu, the following screen appears. If you select a menu with the “ ” mark and press Enter, its submenu appears. Refer to the table below for information on options. Option Parameter Description...
  • Page 113 System Configuration 4-15 SCSI Controller When you select “SCSI Controller” in the Advanced menu, the following screen appears. Refer to the table below for information on options. Option Parameter Description SCSI Controller [Enabled] If “Disabled” is selected, chip Disabled stays in the reset status. In this status, the SCSI Controller is totally disabled and not recognized by the PnP OS.
  • Page 114 4-16 System Configuration LAN Controller When you select “LAN Controller” in the Advanced menu, the following screen appears. Refer to the table below for information on options. Option Parameter Description LAN Controller [Enabled] If “Disabled” is selected, chip stays Disabled in the reset status.
  • Page 115 System Configuration 4-17 Advanced Chipset Control When you select “Advanced Chipset Control” in the Advanced menu, the following screen appears. Refer to the table below for information on options. Option Parameter Description Wake on LAN [Disabled] Select whether or not to enable the Enabled remote power-on function via the LAN connector on motherboard.
  • Page 116 4-18 System Configuration Security Move the cursor onto "Security" to display the Security menu. Select "Set Supervisor Password" or "Set User Password" and press Enter to display the following pop-up screen. The screen below shows when "Set Supervisor Password" is selected. Set a password on this pop-up screen.
  • Page 117 System Configuration 4-19 See the table below for setup options on the screen. Option Parameter Description User Password [Clear] Indicates User password setup status (view only). Supervisor [Clear] Indicates User password setup status (view only). Password is Press Enter to display the user password entry Set User [Enter] Password...
  • Page 118 4-20 System Configuration Server Move the cursor onto [Server] to display the Server menu. The following describes options you can configure in the Server menu and their functions. Select an option with the " " mark and press Enter to display its submenu. Refer to the table below for information on options.
  • Page 119 System Configuration 4-21 The table below lists how selections for "AC LINK" determine the power status of the server when the power supply to the server restarts. Parameter State before powered off Stay Off Last State Power On In service Out of service (DC power: Off) Forced shutdown * Pressing the POWER switch for over four seconds shuts down the power to the server.
  • Page 120 4-22 System Configuration Option Parameter Description BMC Firmware Revision Displays the BMC information. SDR Revision Displays the revision of SDR (sensor device information). PIA Revision Displays the PIA (plat form information) revision. Module#0 BMC MAC Address* Displays the BMC MAC address of CPU/IO module#0.
  • Page 121 System Configuration 4-23 Option Parameter Description Flow Control* [None] Select a flow control method. XON/XOFF [CTS/RTS] CTS/RTS+ CD PC-ANSI Select a console type. Console Type* [VT100+] VT-UTF8 ]: Factory-set * Displayed only when the BIOS Redirection Port menu is enabled.
  • Page 122 4-24 System Configuration Event Log Configuration Select "Event log Configuration” on the System Hardware menu and press Enter to display the following screen. See the table below for setup options on the screen. Option Parameter Description To clear event logs of the working module, press the Clear Online Event Logs [Press Enter] Enter key and select “Yes.”...
  • Page 123 Select whether or not to enable the timer for boot 5 minutes monitoring at startup. If you are starting up from an OS [10 minutes] with no NEC ESMPRO Agent installed, disable this 15 minutes option. If you use Disaster Recovery Option for 20 minutes ARCServe, select [Disabled].
  • Page 124 You can change the boot device order using and + or –. Move the cursor to select the device or , and then change the priority using + or –. IMPORTANT: Specify the device boot order as shown above to start the NEC EXPRESSBUILDER.
  • Page 125 System Configuration 4-27 Exit Move the cursor onto "Exit" to display the Exit menu.
  • Page 126 4-28 System Configuration The following describes each option on the Exit menu: Exit Saving Changes Select this option to save the current configuration data into the CMOS (non-volatile memory) and exit the SETUP utility. Select “Exit Saving Changes” to display the right screen.
  • Page 127 System Configuration 4-29 Discard Changes Select this option if you want to restore previous values before saving values in CMOS. When you select “Discard Changes,” you will see the dialogue box as shown on the right. If you select “Yes” in the dialogue box, changes you have made are discarded and previous settings are restored.
  • Page 128: Scsi Bios (Scsiselect)

    4-30 System Configuration SCSI BIOS (SCSISelect) The “SCSISelect” utility makes settings of the SCSI controller on a motherboard. You can start it up by simple key operation during POST execution without using any special startup disk. IMPORTANT: Because the server is installed with the latest version of the SCSISelect utility, your screen display may be different from the one described in this guide.
  • Page 129 System Configuration 4-31 3. Use the cursor to select a channel in the “Bus:Device” box, and then press the Enter key. The SCSI controller of the motherboard has two channels. The channel A (08:01:00) shows the hard disk drive of ID0, ID1 and ID2 while the channel B (08:01:01) shows the hard disk drive of ID3, ID4 and ID5.
  • Page 130 4-32 System Configuration Configure/View SCSI Controller Settings When you select “Configure/View Host Adapter Settings” in the “Options” menu, the following screen appears. The following describes menus and parameters. Read the descriptions to optimize your system. SCSI Bus Interface Definitions Use arrow keys to select SCSI BUS Interface Definitions. The following table provides information on options and their functions.
  • Page 131 System Configuration 4-33 Additional Options Use arrow keys to select Additional Options. Boot Device Configurations When you select “Boot Device Configurations” and press the Enter key, the display changes as shown below: SCSI Device Configuration When you select “SCSI Device Configuration” and press the Enter key, the display changes as shown below: IMPORTANT: You can make settings on a SCSI ID basis.
  • Page 132 4-34 System Configuration The following table provides information on options and their functions on the menu. Option Parameter Description Sync Transfer Rate [320] 33.3 Typically, set “320.” This value may need to be changed depending on the option connected. For (MB/Sec) 20.0 more information, see the manual attached to the...
  • Page 133 System Configuration 4-35 Advanced Configuration When you select “Advanced Configuration” and press the Enter key, the display changes as shown below: The following table provides information on options and their functions. Option Parameter Description Set “Enabled.” Reset SCSI Bus at IC [Enabled] Initialization Disabled...
  • Page 134 4-36 System Configuration SCSI Disk Utilities SCSI Disk Utilities scans a device connected to the selected channel and displays information on the device. If the device is a hard disk drive, you can perform low-level formatting or verification. When you choose “SCSI Disk Utilities” in the “Options” menu, which is shown after selecting a channel to be configured, the screen for scanning SCSI IDs is displayed.
  • Page 135: Forced Shutdown And Clear

    System Configuration 4-37 FORCED SHUTDOWN AND CLEAR Read this section if your server does not operate as expected, or if you want to return all setup values to those made at shipment. Forced Shutdown Use this function when an OS command does not shut down the server, the POWER switch does not turn off the server, or resetting does not work.
  • Page 136: Clear Cmos/Password

    4-38 System Configuration CLEAR CMOS/PASSWORD With the pre-installed SETUP utility, you can set desired passwords to protect data stored on the server from unauthorized user access. If you forget the password, you can clear them by following the procedure described in this section. You can also use the same procedure to clear the CMOS data in the server.
  • Page 137 How to Clear CMOS Power off the NEC Express5800/ft series and unplug the both power cords. Remove the both CPU/IO modules (#1 and #2) from the NEC Express5800/ft series (see “Removing CPU/IO Module” on page 8-17). Make setting of jumper switch for clearing CMOS of CPU/IO # 0.
  • Page 138 4-40 System Configuration Example ------------------------------------------------------------------------------------------------- Phoenix ServerBIOS 3 Release 6.0 Copyright 1985-2003 Phoenix Technologies Ltd. All Rights Reserved GPJ1. HA. XXXX. X. XXXXXXXXXX IGPJ BIOS Release X. X Build Time: XX/XX/XX XX : XX : XX 2x Intel (R) Xeon (R) CPU 3.60GHz 3072M System RAM Passed 2048K Cache SRAM Passed System BIOS shadowed...
  • Page 139: How To Clear Passwords

    HOW TO CLEAR PASSWORDS Power off NEC Express5800/ft series and unplug the both power cords. Remove the both CPU/IO modules (#1 and #2) from the NEC Express5800/ft series (see “Removing CPU/IO Module” on page 8-17). Make setting of jumper switch for clearing the password of CPU/IO module # 0...
  • Page 140 4-42 System Configuration By referring to “Installing CPU/IO Module” on page 8-19, install both CPU/IO modules on the server. Connect both power cords.
  • Page 141 By this operation, BMC settings required in NEC DianaScope or remote management functions for connection with the server will be cleared as well. If you are using NEC DianaScope, store the settings required to connect to NEC DianaScope in media such as a floppy disk before this operation, and configure the settings after the operation again.
  • Page 142: Remote Management Function

    4-44 System Configuration REMOTE MANAGEMENT FUNCTION 320Fa-L and 320Fa-LR models are equipped with the optional card, N8815-001A ft Remote Management Card on the server. By connecting to a network via their management LAN port, BMC (Baseboard Management Controller), an LSI for system management, installed on the server allows remote monitoring and controlling of the server such as keyboard, video and mouse (KVM) control over management network.
  • Page 143: Initial Settings On The Server

    !! Refer to BMC configuration manual !! The message above may appear in a different screen during POST with the NEC logo shown and paused. In that case, press the Esc key to display the diagnosis screen to check whether or not the above message is shown.
  • Page 144: Setting A Management Pc

    Click “Software Setup” and then “NEC DianaScope,” and then run the installer of JRE, which you find in the NEC DianaScope install menu. When the OS of the management PC is Linux: The JRE installer (Linux) is stored in the following directory of the NEC EXPRESSBUILDER CD-ROM: /dianascope/jre_x For installing JRE, log on as root user or obtain the root authority by the su command.
  • Page 145 * If you want to install the latest Java Runtime, download it from the following site. If you use NEC DianaScope on the same management PC, use Java2 Runtime Environment, which you can find in the “NEC EXPRESSBUILDER”CD-ROM. http://java.sun.com/j2se/ If you access the logon page without installing Java2 Runtime Environment, the following message may appear.
  • Page 146: Using Remote Management

    4-48 System Configuration Using Remote Management Overview You can control power of this server and use the remote KVM console from a web browser by using web server functions of BMC. This function is achieved by Java Applet. How to get connected From a Web browser on the management PC, access the following URL.
  • Page 147 System Configuration 4-49 (2) If you cannot use the default IP “192.168.1.1,” start up the “NEC EXPRESSBUILDER” CD-ROM on the server and select [Tools] [System Management] [Set System Management Parameters] [Configuration]. Select [New] to register new settings, or [Change] to change the settings. Then, set IP addresses of the managed LAN ports on the [BMC Configuration] menu.
  • Page 148 4-50 System Configuration TIPS: To disable the remote management console function, make the following settings from the NEC EXPRESSBUILDER CD-ROM. Load the NEC EXPRESSBUILDER CD-ROM on the server, and from the main menu, select [Tools] [System Management] [Set FT Remote Management Card (LAN1/LAN2)]. Select [Disable] on [Remote Management Console] and register the setting.
  • Page 149 System Configuration 4-51 TIPS: If you use SSL for access, the “Warning - Security” dialogue box(es) for server certification may be displayed for SSL in addition to the dialogue box shown above. Logon and logout Logon When the logon page appears, enter the user name and password, and then click [Login]. When you login for the first time, use the following default user name and password.
  • Page 150 4-52 System Configuration Logout Click the File menu and select Exit to logout. When you log out, the main window closes and you will return to the login page on the browser.
  • Page 151 System Configuration 4-53 Main Window (1) Click this to show the File menu. Click “Exit” to quit this applet. (2) Click this to show the Window menu. From the Window menu, you can open windows including the KVM console window. (3) Main frame A window is shown here.
  • Page 152 4-54 System Configuration (1) Displays the BMC host name or IP address (2) Displays the LCD of the server. (3) The power lamp of the server telling you of the power status (4) The same as pressing the POWER switch of the server, but pressing it for 4 or more seconds (the forced power off) is not supported.
  • Page 153 Set the resolution of the device to one of these values. If any value other than these values, nothing will be shown on the remote KVM console. The mouse cannot be used on the remote KVM console on the operation window of NEC EXPRESSBUILDER.
  • Page 154 4-56 System Configuration Starting up the remote KVM console window Click the startup icon [ ] on the remote KVM console on the control panel to display the KVM console window. IMPORTANT: NEVER open the remote KVM console when you log on to the BMC from a local console. If you do so, data entry from the keyboard or mouse becomes disabled.
  • Page 155 System Configuration 4-57 (5) Screen refresh icon: use this icon to refresh the window. (6) KVM properties icon. (7) Enlarge icon: use this icon to enlarge the view. (8) Shrink icon: use this icon to reduce the view. (9) Equal size icon: use this icon to display images in the same magnification. (10) Window size icon: use this icon to adjust the window size to the screen size.
  • Page 156 4-58 System Configuration Virtual keyboard When you click the virtual keyboard icon [ ], the virtual keyboard appears. You can select either 104 or 109 keyboard from the tab. By clicking buttons corresponding to each key, you can make entry to the host server. Zoom-in and zoom-out of the view Click the [ ] icon to zoom in the view.
  • Page 157 System Configuration 4-59 IPMI information System event logs (SEL), sensor data record (SDR), or field replacement unit (FRU) can be displayed. Such information is referred to as the IPMI information. The information can be used to examine errors and events on the server and identify which part should be replaced. System Event Log (SEL) When you click the icon to start up system event logs [ ] on the control panel, SEL information...
  • Page 158 4-60 System Configuration Sensor Data Record (SDR) When you click the icon to start up sensor device information (SDR) [ ]on the control panel, the SDR information is collected from the BMC and shown on the sensor device information (SDR) window as shown below.
  • Page 159 System Configuration 4-61 Field Replaceable Unit (FRU) When you click the icon to start up information on parts to be replaced for maintenance (FRU) [ on the control panel, FRU information is collected from the BMC and shown on the window for parts to be replaced for maintenance (FRU) as shown below.
  • Page 160 4-62 System Configuration BMC Configuration You can configure the BMC settings. Starting up the BMC Configuration window When you click the icon to start up the BMC configuration [ ] on Control Panel, the BMC configuration window appears as shown below. (1) Reads the BMC configuration file (2) Saves the BMC configuration file (3) Edits the BMC configuration...
  • Page 161 System Configuration 4-63 User Settings Here you cam make user account settings. When you click [User] on the left pane of the BMC configuration window, total of 20 accounts appear in the right pane. When you select the account you want to modify or add and click the icon for editing [ ], the following window for editing a user account appears.
  • Page 162 4-64 System Configuration Network Settings Here you can make network settings of BMC such as IP address configuration. IMPORTANT The following ports are used for the remote management functions. If your network environment has any firewall, you also need to have configuration for the firewall. Module name Port Protocol...
  • Page 163 System Configuration 4-65 - LAN (1) The MAC address of the BMC (2) Lets you choose whether or not to acquire an IP address automatically by DHCP. (3) Lets you make the IP address settings if the address is not acquired automatically by DHCP. If the address is acquired automatically by DHCP, the data acquired is shown here.
  • Page 164 4-66 System Configuration - DNS (1) Lets you select whether or not to automatically acquire the IP address of the DNS server by DHCP. (2) If you have selected not to automatically acquire the IP address by DCHP, make settings here. If the address is acquired automatically by DHCP, the acquired address appears here.
  • Page 165 System Configuration 4-67 - Host name (1) The default host name to be used when no host name is set when DHCP is used (2) Set the BMC host name. If this option is not configured, the default host name mentioned in 1) will be used.
  • Page 166 4-68 System Configuration WEB server settings Here you can make web server settings such as HTTP port settings for the BMC. When you click [Web Server] on the left pane of the BMC configuration window, the right pane shows the overall information of the web server settings. IMPORTANT: When you change the HTTP port number, settings of SSL (enable/disable), or SSL port number, the current connection will be temporarily disconnected.
  • Page 167 System Configuration 4-69 When you click the icon for editing [ ], the window for editing appears as shown below. (1) Specify the HTTP port number. (2) Specify whether or not to enable SSL communication. If you select the check box for enabling, connection by HTTPS (SSL enabled) is enabled.
  • Page 168 4-70 System Configuration If you click [Default], the default values for HTTP port number, SSL port number, logon trial period, number of logon retries and the account lock period are displayed. The SSL check box configuration remains the same. When you click [OK], all of what you have set will be written into the BMC. When you click [Cancel], the editing window closes without saving what you have edited.
  • Page 169 System Configuration 4-71 - Basic (1) Specify whether or not to enable the alert mail functions by the check box. When you select the check box, you can make mail-related settings. (2) Select a notice level from six levels. Levels are categorized according to severity of factor events.
  • Page 170 4-72 System Configuration - Message (1) Specify mail address of receivers to whom alert mail is sent. You can specify up to four addresses. (2) Specify the sender’s address used in alert mail. (3) Enter the subject to be given to alert mail. (4) Select whether or not to enable the body messages for all alert mail, which is configured in the next step.
  • Page 171 System Configuration 4-73 - SMTP (1) Specify the address of the SMTP server. You can enter the IP address or host name. (2) Specify the port number of the SMTP server. (3) Specify the number to be made if sending a mail has failed. (4) Specify the time period in seconds to wait for next retry.
  • Page 172 4-74 System Configuration - Option (1) Specify information to be attached to the body of alert mail. The information you specify here will be contained in the body of alert mail with the message you specified in the message box in the message tab. Product Information Product name, code, number of the server IP Address...
  • Page 173 System Configuration 4-75 Firmware Update You can update applets, KVM firmware, BMC firmware, sensor device information (SDR), and platform information (PIA). Starting up the firmware update window When you click the icon to start up firmware update [ ] on the control panel, each pieces of revision information is loaded from the BMC to display the following firmware update window.
  • Page 174 4-76 System Configuration Loading update data files When you click the icon for adding update files [ ], the window to select a file appears. Specify an update data file. When you click [Open] after specifying the file, loading of the file begins. Wait for file loading to complete.
  • Page 175 System Configuration 4-77 CHECK: Check each revision carefully because downgrading is possible as well. If you click the icon for clearing update data [ ], all loaded data will be discarded. When you click [Cancel], the update window will be closed without saving any loaded data. Selecting what to be upgraded Select check boxes of update targets.
  • Page 176 4-78 System Configuration As shown below, the window showing writing process appears for each update target. If any error is detected during the writing process, an error message is displayed and the process terminates. End of writing When writing is completed, the “Status” column displays the result for each target. CHECK: To apply updates for targets other than applet, reboot the server or power off and then on the server.
  • Page 177: Troubleshooting

    System Configuration 4-79 Troubleshooting Error Messages When using the remote management, an error dialog box may appear on the management PC if some problem occurs. Messages and actions for the errors are described below. Fatal errors Error message Action Fatal error. JavaVM quits. Try logging in again.
  • Page 178 4-80 System Configuration Error message Action representative. Check the network environment. The RMCP+ transmission failed. If there is no network problem, contact your service representative. Check the network environment. The specified RMCP+ protocol If there is no network problem, contact your service cannot be used.
  • Page 179 System Configuration 4-81 Error message Action If you do not find any problem, contact your service representative. This is not a problem. Click [OK] and close the The KVM request was aborted. message box. Check the network environment and server. UDP packet transmission failed.
  • Page 180 4-82 System Configuration BMC configuration errors Error message Action Check the network environment and try again. Failed to make settings: Contact your service representative if the error persists. Check the network environment and try again. Failed to acquire BMC Contact your service representative if the error Configuration: persists.
  • Page 181 System Configuration 4-83 Error message Action You can use only alphanumeric characters, minus Invalid host name sign (–), and underscore (_) for a host name. A host name should be 64 characters or less. You can use only alphanumeric characters, minus Invalid domain name sign (–), and underscore (_) for a domain name.
  • Page 182 4-84 System Configuration Error message Action Try again. If the error persists, contact your service Failed to create rollback image. representative because a failure may have occurred in BMC. Try again. If the error persists, contact your service Failed to erase. representative because a failure may have occurred in BMC.
  • Page 183 System Configuration 4-85 Error message Action Some update files may be corrupted. Obtain update Invalid line length: files again. Some update files may be corrupted. Obtain update Unexpected EOF is detected: files again. Some update files may be corrupted. Obtain update Unexpected token is detected: files again.
  • Page 184 4-86 System Configuration (This page is intentionally left blank.)
  • Page 185: Chapter 5 Installing And Using Utilities

    Chapter 5 Installing and Using Utilities This section describes how to use the NEC EXPRESSBUILDER CD-ROM that comes with your server and to install the utilities stored on the NEC EXPRESSBUILDER.
  • Page 186: Nec Expressbuilder

    The NEC EXPRESSBUILDER, integrated setup software, can automatically detect the hardware connected to an NEC Express5800/ft series machine to advance the processing. The hardware subject to setup with the NEC EXPRESSBUILDER should have the same configuration as that for operation.
  • Page 187 Inserting NEC EXPRESSBUILDER CD-ROM after Windows startup The "Master Control Menu" (see the figure below) starts automatically after you place the "NEC EXPRESSBUILDER" in the CD-ROM drive. A dialog box called “Master Control Menu” will appear. For this dialog, see “Master Control Menu” described later.
  • Page 188: Nec Expressbuilder Top Menu

    5-4 Installing and Using Utilities NEC EXPRESSBUILDER Top Menu The NEC EXPRESSBUILDER top menu is used for the setup of hardware and the setup and installation of OS. Start Start the NEC EXPRESSBUILDER top menu following the procedure below: Turn on the powers of peripherals and the power of the server in this order.
  • Page 189 Tools Menu The Tools Menu is used to start each of the several utilities stored in the NEC EXPRESSBUILDER CD-ROM individually for manual setup by operator. Use the Tools Menu to provide settings that the setup program cannot do automatically or detailed settings.
  • Page 190 Allow you to make settings of BMC (Baseboard Management Controller) to use its report functions and remote control from the management PC. Help Indicates the descriptions on several features of the NEC EXPRESSBUILDER. Return to the Top Menu Indicates the NEC EXPRESSBUILDER top menu.
  • Page 191: Master Control Menu

    Installing and Using Utilities 5-7 Master Control Menu Load the attached “NEC EXPRESSBUILDER” CD-ROM in the CD-ROM drive of the computer that runs Windows (Windows 95 or later, or Windows NT 4.0 or later). The Master Control Menu starts automatically.
  • Page 192: Nec Esmpro Agent And Manager

    CD-ROM "NEC EXPRESSBUILDER" and "NEC ESMPRO Agent" is bundled to Linux for NEC Express5800/ft series Back Up CD-ROM. This manual describes the functions and features provided by NEC ESMPRO Manager and NEC ESMPRO Agent and the notes on their operations.
  • Page 193 Installing and Using Utilities 5-9 Effects of using NEC ESMPRO Manager and Agent NEC ESMPRO Manager and NEC ESMPRO Agent have sufficient effects on a variety of needs in versatile and complicated system environments. Detection of server fault NEC ESMPRO Agent collects a variety of fault information on NEC Express5800 series systems to identify the states of the systems.
  • Page 194 NEC ESMPRO Manager and NEC ESMPRO Agent can set the threshold for each source in the server. If the value of a source exceeds the threshold, NEC ESMPRO Agent reports the alert to NEC ESMPRO Manager.
  • Page 195 CPU, memory, fans, power supply, and temperature. Below is a list of functions of data viewer’s items and their availability if NEC ESMPRO Agent is installed. Function name...
  • Page 196 5-12 Installing and Using Utilities Function name Supported Function description Storage Function to monitor storage devices (e.g., hard disk drive) and controller File system Function to view file system configuration and monitor usage rate Disk array Function to monitor disk array system of LSI Logic Corporation Other Supports OS stall monitoring by Watch Dog Timer...
  • Page 197: Nec Esmpro Agent

    Installing and Using Utilities 5-13 Monitoring of NEC Express5800/ft series NEC Express5800/ft series is a fault tolerant system. It can continue the operation even if a major component fails. NEC Express5800/ft series improves the system availability with the hardware, NEC ESMPRO, and system software functions.
  • Page 198 5-14 Installing and Using Utilities Collective Management of Distributed Servers The excellent GUI provided by NEC ESMPRO Manager allows servers on a network to be managed collectively. The management screen is designed in the Explorer format to indicate the components in a server hierarchically for effective server management.
  • Page 199 Installing and Using Utilities 5-15 Data Viewer The data viewer indicates the server source configuration information in the Explorer format. In addition, it changes the status color of the failed server component. This enables you to identify the failed portion. Alert Viewer The Alert Viewer manages fault reports sent from servers together.
  • Page 200 5-16 Installing and Using Utilities NEC ESMPRO Agent NEC ESMPRO Agent is a utility which acts as an agent (proxy) between NEC Express5800/ft series and NEC ESMPRO Manager. For details on the operating environment, the settings required before the setup, and the installation procedure, see the separate volume, User’s Guide (Setup).
  • Page 201 SCSI slot 5 on SCSI enclosure 41/5 The figure below shows the actual locations of the device names displayed on the NEC ESMPRO screen. In the case of the tower model, modules are mounted vertically instead of horizontally. CPU/IO module #1...
  • Page 202 Dual registration of syslogs At some types of errors, two syslogs may be registered for a single occurrence. (However, in the case of NEC ESMPRO Manager, one log is reported for one occurrence.) Such errors are as follows: - Temperature error...
  • Page 203 LAN Monitoring Threshold Because hardware faults on the network are found in the driver level, NEC ESMPRO Agent does not monitor line faults. Community Authority Depending on your OS type or its version, settings for community, SNMP service’s security...
  • Page 204 If the server status monitoring by NEC ESMPRO Manager is on (default: ON), NEC ESMPRO Manager regularly issues a request to NEC ESMPRO Agent to get the current status of the server. In response, NEC ESMPRO Agent checks the status of the server. As a result, the CPU load ratio of SNMP Service increases temporarily.
  • Page 205 Current Status of Temperature, Voltage and Fan Sensors Some modes are equipped with temperature/voltage/fan sensors that do not have information on status, current values, rpm, threshold etc. Therefore, if you view such a sensor on NEC ESMPRO Manager, it may be displayed as follows: The status becomes “Unknown”...
  • Page 206 If so, the report "server access disabled" is issued and the status color of the server icon becomes gray. This cannot indicate whether the NEC ESMPRO Agent machine is shut down or entered into the sleep state. Keep these in mind when operating the system where systems to be monitored may enter the sleep state.
  • Page 207 Monitoring NEC Storage NEC ESMPRO Agent (Linux) does not monitor the failure status in NEC Storage. If you go to Data Viewer and select [ESMPRO] – [File System], the File System status is indicated as “Unknown.” However, this will not affect your system operation.
  • Page 208: Nec Esmpro Manager

    To monitor the state of the NEC Express5800/ft series on a management computer with installation of NEC ESMPRO Manager, the data viewer is used. If you click each of the modules and items to be checked sequentially on the tree view in the Windows Explorer format, the data viewer indicates their states on the right side of the screen.
  • Page 209 Allows the configuration and other information on the CPU modules to be viewed. Maintenance Allows the start/stop, MTBF information clear and dump acquisition of the CPU modules to be provided. See "Maintenance of NEC Express5800/ft series" described later for the start/stop and MTBF information clear of the CPU modules.
  • Page 210 Allows the device identification information of the CPU modules to be viewed and BIOS of the CPU modules to be updated. See "Maintenance of NEC Express5800/ft series" described later for the update of BIOS of the CPU modules. The detailed device identification information can be checked by selecting [ESMPRO] tree [Hardware] tree [Field Replaceable Unit] tree.
  • Page 211 Allows the configuration and other information of the IO modules to be viewed. Maintenance Allows the start/stop, MTBF information clear, and diagnostics of the IO modules to be provided. See "Maintenance of NEC Express5800/ft series" described later for the start/stop and MTBF information clear of the IO modules.
  • Page 212 5-28 Installing and Using Utilities Monitoring PCI Slots and Devices on IO Module To monitor the PCI slots and devices on the IO modules, see the [PCI slot] tree. To see the information on the [PCI slot] tree, select [PCI Module] [PCI module (containing PCI slot to be seen)] [PCI slot] of the [ft] tree.
  • Page 213 Installing and Using Utilities 5-29 PCI Device – General Allows the information of devices on the PCI slot to be viewed. PCI Device – Detailed information Allows the detailed information of a device on the PCI slot to be viewed.
  • Page 214 5-30 Installing and Using Utilities Monitoring BMC on IO Module To monitor the base management controller (BMC), controller for system management, on the IO modules, see the [BMC] tree. To see the information on the [BMC] tree, select [PCI Module] - [PCI module (containing BMC to be seen)] - [BMC] of the [ft] tree.
  • Page 215 Installing and Using Utilities 5-31 Monitoring SCSI Enclosure To monitor the SCSI enclosure, see the [SCSI enclosure] tree. To see the information on the [SCSI enclosure] tree, select [SCSI enclosure] of the [ft] tree. You can see the following information of the SCSI enclosure from the [SCSI enclosure] tree. General Allows the configuration and other information of the SCSI enclosure to be viewed.
  • Page 216 5-32 Installing and Using Utilities Monitoring Mirror Disk To monitor the mirror disk components, see the [Mirror] tree. To view information on [Mirror] tree, select [Mirror] under [ft] tree. You can see the redundancy status of the mirrors and the device IDs of the SCSI slots into which these hard disk components are connected.
  • Page 217 Installing and Using Utilities 5-33 Monitoring Hard Disk To monitor the hard disks and detect disk failures at an early stage, use the NEC ESMPRO Manager and Agent. You can see configurations and information of hard disk in the Data Viewer.
  • Page 218 5-34 Installing and Using Utilities Confirmation of mirror status To check the redundancy status of the failed mirror disk, open [Mirror] screen under [ft]. On this screen, you can check the redundancy status of the mirror and the status of the mirrored hard disks.
  • Page 219 Installing and Using Utilities 5-35 IMPORTANT: The Mirror Disk screen shows a pair of two hard disks as a mirror. Disk pairs are shown in the same manner even if a few volumes are created within a single disk or one volume spans a few disks (span volume).
  • Page 220 See [1. Confirm of hard disk failure] above. (2) Removing the hard disk Disconnect the hard disk with the problem. At this time, NEC ESMPRO Agent reports the following alert to manager. And icons related to the hard disk with problem change the state of warning in the data viewer.
  • Page 221 Installing and Using Utilities 5-37 When one hard disk with problem was disconnected, SCSI slot changes the status to "Warning.” [SCSI Slot] [General] IMPORTANT: The status color of the SCSI slot differs depending on the connection of mirrored hard disks: If one of the mirrored disks was removed: Warning If both of the mirrored disks were removed: Gray Also, at this time, the redundant status of mirrored disks is changed to "Warning.”...
  • Page 222 5-38 Installing and Using Utilities (3) Mounting a hard disk drive. Mount a hard disk drive. When a hard disk drive is inserted, an alert report is sent and the information on a Data Viewer changed. A hard disk drive is mounted and the SCSI slot status becomes “Online.” [Details] of alert report TIPS: The device ID (for example, “41/1”) on the “Details”...
  • Page 223 Installing and Using Utilities 5-39 The redundancy status becomes “Normal” because the hard disk drive constructing a mirror is mounted. [Mirror]...
  • Page 224: Server Maintenance Utility

    Server Maintenance Utility is a tool for managing server operation. It is used to configure operation patterns, to check status at replacement of parts, and to instruct operations. How to start NEC ESMPRO Agent Server Maintenance Utility that is installed on NEC Express5800/ft series server Go to the installation destination of NEC ESMPRO Agent.
  • Page 225 Installing and Using Utilities 5-41 System Information Chassis Information contains the following information: Item Description Type Chassis type of the server Part Number Parts number of the server chassis Serial Number Serial number of the server chassis System Information contains the following information: Item Description OS(Ver)
  • Page 226 5-42 Installing and Using Utilities System Configuration System Configuration contains the following information: Quick dump that is harvested at the same time of system reboot. Select the [Enable] radio button to obtain quick dump at a system crash. When a quick dump cannot be produced, a dump is produced by the standard dump function. Automatic firmware update.
  • Page 227 Installing and Using Utilities 5-43 MTBF Information contains the following information: Note: The MTBF information is displayed only when the [<MTBF Info>] button is pressed. Item Description Type Monitoring status of MTBF. Use Threshold: MTBF is calculated at a fault occurrence. The device is stopped when the calculated value is lower than the threshold.
  • Page 228 5-44 Installing and Using Utilities PCI Module(ID:n/m) PCI Module contains the following information: The MTBF information is displayed only when the [<MTBF Info>] button is pressed. Item Description Status Status of the PCI module MTBF Information contains the following information: Item Description Type...
  • Page 229 Installing and Using Utilities 5-45 SCSI Adapter(ID:n/m/o) SCSI Adapter contains the following information: Item Description Status Status of the SCSI adapter SCSI Bus(ID:n/m/o/p) The following information is displayed for SCSI Bus: Item Description Status Status of the SCSI bus (Primary or Secondary) The following information is displayed for SCSI Bus: Item Description...
  • Page 230 5-46 Installing and Using Utilities SCSI Enclosure(ID:n) The following information is displayed for SCSI Enclosure: Item Description Status Status of the SCSI enclosure The following information is displayed for SCSI Slot: Item Description Slot SCSI slot name Status Status of the SCSI slot * The last digit of SCSI slots corresponds to the slot number of built-in SCSI disk.
  • Page 231 Installing and Using Utilities 5-47 Firmware Update The following information is displayed for Firmware Update: Copy online BIOS image to offline. Select this radio button to copy online BIOS image to offline. Specify the file path to update. Select this radio button to specify the file path to update. Type the location of the firmware.
  • Page 232: Maintenance Of Nec Express5800/Ft Series

    5-48 Installing and Using Utilities Maintenance of NEC Express5800/ft series The server maintenance can be done in two ways; one is to use NEC ESMPRO Manager for remote maintenance and the other is to use the NEC ESMPRO Agent Server Maintenance Utility on the server for local maintenance.
  • Page 233 The maintenance operations in the table cannot be performed while collecting dump or updating firmware. Wait until such processing is finished to perform the operations in the table. The table below shows the component-specific maintenance functions executable from NEC ESMPRO.
  • Page 234 Start and Stop of Components To start or stop a component with NEC ESMPRO Manager, use the [Maintenance] tree of the component in the [ft] tree of the data viewer. Open the tree of the component to be started or stopped and select the [Maintenance] tree.
  • Page 235 CHECK: When stopping IO module, check that the status of Ethernet is “Duplex” on NEC ESMPRO Manager. Do not stop the IO module especially when LAN is connected only to the IO module on that side.
  • Page 236 5-52 Installing and Using Utilities Sample screen of NEC ESMPRO Manager 1 [Maintenance] screen of CPU module [CPU Module] – [CPU Module] – [Maintenance] Sample screen of NEC ESMPRO Manager 2 [Maintenance] screen of module [PCI Module] – [Maintenance]...
  • Page 237 Installing and Using Utilities 5-53 Procedure in the Server Maintenance Utility Start Select the target component from the main window of the Server Maintenance Utility. The screen of the target component appears. Check the current state of the target component with the LEDs. Select [Up] of the target component.
  • Page 238 MTBF. However, contact your maintenance personnel for the forced use of such a component. To clear the MTBF information of a component with NEC ESMPRO Manager, use the [Maintenance] tree of the component of the [ft] tree of the data viewer. Open the tree of the component whose MTBF information is to be cleared and select the [Maintenance] tree.
  • Page 239 Both of the target CPU module and IO module are stopped Start the component. CHECK: At this point, the "State" display on the target component screen is changed. Sample screen of NEC ESMPRO Manager [Maintenance] screen of IO module [PCI module] – [Maintenance]...
  • Page 240 5-56 Installing and Using Utilities Procedure in the Server Maintenance Utility Perform the procedure below before replacement of a module. Select the target module from the main window of the Server Maintenance Utility. The screen of the target module appears. Check the current state of the target module with the LEDs.
  • Page 241 For this server, CPU modules and IO modules can be diagnosed all together. To diagnose a component with the NEC ESMPRO Manager, use the [Maintenance] tree of the component in the data viewer. Open the tree of the component to be diagnosed and select the [Maintenance] tree.
  • Page 242 Information] tree of the component is changed. CHECK: When stopping IO module, check that the status of Ethernet is “Duplex” on NEC ESMPRO Manager. Do not stop the IO module especially when LAN is connected only to the IO module on that side.
  • Page 243 Installing and Using Utilities 5-59 Procedure in the Server Maintenance Utility Select a target component from the main window of the Server Maintenance Utility. The screen of the target component appears. Check the current state of the target component with the LEDs. Diagnose the component by selecting [Diagnose] in [PCI Module Diagnosis].
  • Page 244 (in which the system continues the operation but the component trying to update firmware or BIOS is stopped). To update firmware with NEC ESMPRO Manager, use the [Update] tree of the component in the data viewer. Open the tree of the component for which firmware is updated and select the [Update] tree.
  • Page 245 Stop the CPU module and then stop the PCI module. Click the [Firmware Update] button in the [Update] screen for the target component. Sample screen of NEC ESMPRO Manager [Update] screen of CPU module [CPU Module] – [Update]...
  • Page 246 [Yes]. CHECK: When stopping IO module, check that the status of Ethernet is “Duplex” on NEC ESMPRO Manager. Do not stop the IO module especially when LAN is connected only to the IO module on that side.
  • Page 247 Enable “Automatic module start” and “Automatic firmware update.” See “Setup of System Operation” in this chapter for the procedure to enable. Store the image data of the firmware for update in the NEC Express5800/ft series. Save it in the /etc directory under the name “BIOS.ROM.”...
  • Page 248 5-64 Installing and Using Utilities Sample screen of Server Maintenance Utility [CPU Module] screen Main window [Firmware Update] screen Even if you do not have the image data of firmware for update, the firmware can be copied from the other module. By starting the module, the firmware will be updated automatically.
  • Page 249 Installing and Using Utilities 5-65 Dump Collection To collect the dump file with NEC ESMPRO Manager, use [CPU Module] [Maintenance] tree in the data viewer. To collect the dump with the Server Maintenance Utility, use the utility screen of the component.
  • Page 250 (this can be viewed on Broken screen): Server Maintenance Shot Utility screen) Duplex Firmware Update Duplex Complete Diagnostics Passed Remote: Executable from remote management PC by using NEC ESMPRO Manager Local: Executable on local server by using Server Maintenance Utility –: Not support...
  • Page 251 Installing and Using Utilities 5-67 Procedure in the Server Maintenance Utility On the main window of the Server Maintenance Utility, select the target component. The screen of the target component appears. Check the current status of the target CPU module with the LEDs. Select a dump acquisition method on the CPU module screen, and select [Harvest].
  • Page 252 5-68 Installing and Using Utilities Setup of System Operation The following properties can be set as the operation setup of the whole system. Quick dump that is harvested at the same time of reboot If “Enable” is selected for this item, dump is collected as the system reboots when an error occurs in the system.
  • Page 253 OS at occurrence of system fault. Remote: Executable from remote management PC by using NEC ESMPRO Manager Local: Executable on local server by using Server Maintenance Utility –: Not support Configure the system settings using the Server Maintenance Utility in the following procedure. The system cannot be configured using the NEC ESMPRO Manager.
  • Page 254 The BMC firmware can be updated by using the BMC firmware update utility. Both NEC ESMPRO Manager and the Server Maintenance Utility can start the BMC firmware update utility. To update the BMC firmware, the firmware image file must be updated on the managed server in advance.
  • Page 255 Installing and Using Utilities 5-71 Procedure of Update from NEC ESMPRO Manager Menu Update firmware in the procedure as follows: Select [Tools] [BMC FW Update Utility] from the Operation Window’s menu. The [BMC FW Update] dialog box appears. Enter the device name and click [OK].
  • Page 256 5-72 Installing and Using Utilities Procedure of Update from the Server Maintenance Utility Update the firmware in the procedure as follows. Select [Firmware] on the main window of the Server Maintenance Utility. The [Firmware Update] screen appears. Select [Update]. The [BMC FW update Tool] screen appears. Select [BMC FW update Command] menu, and press Enter.
  • Page 257 Installing and Using Utilities 5-73 Changing Update Data Storage Destination Change the storage destination by using the Server Maintenance Utility in the procedure below. Select [Firmware] on the main window of the Server Maintenance Utility. The [Firmware Update] screen appears. Select [Update].
  • Page 258: Notes

    When remotely managing this server from NEC DianaScope, only LAN connection is available. Direct connection and connection via modem are not supported. NEC DianaScope cannot power off, power cycle or reset the server. The server does not support such functions.
  • Page 259: Chapter 6 Maintenance

    Chapter 6 Maintenance This chapter describes the daily maintenance of NEC Express5800/ft series and precautions when relocating or storing the server.
  • Page 260: Daily Maintenance

    Data Viewer Checking STATUS LEDs Check the LED indication on the front of the NEC Express5800/ft series, on hard disks installed in 3.5-inch hard disk drive bay, or on LCD display when the server is powered on or powered off by the shut down operation.
  • Page 261: Making Backup Copies

    Maintenance 6-3 Making Backup Copies NEC recommends you make backup copies of your valuable data stored in hard disks of the server on a regular basis. For backup storage devices suitable for the server and backup tools, consult with your sales agent.
  • Page 262 6-4 Maintenance Wipe the server with a dry cloth. Wipe off dust from the fan exhaust opening on the rear of the server with a dry cloth. Cleaning the Keyboard and Mouse IMPORTANT: A keyboard and a mouse use USB interface. Therefore it is not necessary to power off the server when connecting or disconnecting them.
  • Page 263 Maintenance 6-5 Cleaning the Floppy Disk Drive A read/write error may occur due to stains on the read/write head of the floppy disk drive. Use the cleaner dedicated for floppy disk drive to clean the read/write head. It is recommended to clean the head on regular basis.
  • Page 264 6-6 Maintenance Cleaning Tape Drive Dirt on the tape head may be a cause of unsuccessful backup and damage to tape cartridge. Clean the tape head regularly using a cleaning tape. For procedure and interval of cleaning as well as lifetime of a tape cartridge to use, see instructions included with the tape drive.
  • Page 265: System Diagnostics

    Maintenance 6-7 SYSTEM DIAGNOSTICS The System Diagnostics runs several tests on the server. Select [Tools] - [System Diagnostics] in the NEC EXPRESSBUILDER to diagnose the system. Test Items The following items are tested in system diagnostics. Memory CPU cache memory...
  • Page 266 6-8 Maintenance NEC EXPRESSBUILDER Top Menu Select [Tools]. Select [System Diagnostics]. The system diagnostics starts and will be completed in approximately three minutes. When the diagnostics is completed, the screen of the display changes as shown below: Diagnostics tool title...
  • Page 267 Changes the output destination of a log. <Reboot> Reboots the system. Select <Reboot> in the [Enduser Menu] above. The server restarts and the system is started from the NEC EXPRESSBUILDER. Exit the NEC EXPRESSBUILDER, and remove the CD-ROM from the CD-ROM drive.
  • Page 268 6-10 Maintenance Power off the server and unplug the power cord from the receptacle. Reconnect all the LAN cables that have been disconnected in Step 2 to the server. Plug the power cord. This completes the system diagnostics.
  • Page 269: Off-Line Maintenance Utility

    Utility can be used. IMPORTANT: The Off-line Maintenance Utility is intended for use of your sales agent. The NEC EXPRESSBUILDER CD-ROM and the Off-line Maintenance Utility Bootable FD you have created contain a file that describes operation of the utility, but do not attempt to use the utility by yourself.
  • Page 270 6-12 Maintenance System Information Viewer Provides the functions to view information on the processor (CPU) and the BIOS and export it to a text file. System Information Management Provides the function to make a back-up copy of your data. Without the backup data, the system-specific information and/or configuration may not be restored.
  • Page 271: Relocating/Storing The Nec Express5800/Ft Series

    Maintenance 6-13 RELOCATING/STORING THE NEC Express5800/ft series Follow the procedure below to relocate or store the server. (Users should not attempt to remove the rack-mountable server from the rack assembly.) CAUTION Observe the following instructions to use the server safely. There are risks of fire, personal injury, or property damage.
  • Page 272 6-14 Maintenance (This page is intentionally left blank.)
  • Page 273: Chapter 7 Troubleshooting

    Chapter 7 Troubleshooting If the product does not work properly, see this chapter before deciding that it is a breakdown.
  • Page 274: To Locate The Errors

    Use NEC ESMPRO to monitor the occurrence of fault during the system operation. Especially take note on whether any alert is reported to NEC ESMPRO Manager on the management PC. Check whether any alert is reported on the Operation Window, Data Viewer, or Alert Viewer of NEC ESMPRO Manager.
  • Page 275: Error Messages

    Error Messages by LED Indication The LEDs on the front and rear panels of the NEC Express5800/ft series and near the handles of hard disks inform the user of the various server statuses by the colors and the patterns of going on, going off, and flashing.
  • Page 276: Post Error Messages

    7-4 Troubleshooting POST Error Messages Powering on the server automatically starts the self-diagnostic program, POST (Power On Self-Test). When POST detects any error, it displays an error message and its measure on the display unit. Follow the table below to troubleshoot such errors. Phoenix BIOS 4.0 Release 6.0.XXXX CPU=Pentium III XXX MHz 0640K System RAM Passed...
  • Page 277 Troubleshooting 7-5 On-screen error message Cause Action 0251 System CMOS System CMOS configuration Reconfigure the system CMOS is changed. checksum bad-Default by using BIOS setup. configuration used Clear system CMOS using hardware jumper. Password is cleared. 0252 Password checksum Reconfigure by using BIOS bad -Password cleared setup.
  • Page 278 7-6 Troubleshooting On-screen error message Cause Action 0B83 BMC IBF or OBF Replace the CPU/IO module or ft RMC device is faulty. check Remote Management Card failed (option). 0B8A BMC SEL area full There is no space to write Clear system event logs after system event logs.
  • Page 279 Troubleshooting 7-7 On-screen error message Cause Action 0B9C BMC internal Replace the CPU/IO module or ft BMC device is faulty. exception Remote Management Card (option). 0B9D BMC A/D timeout error 0B9E SDR repository corrupt SDR data is faulty. If updating SDR does not help, replace the CPU/IO module or ft Remote Management Card (option).
  • Page 280 7-8 Troubleshooting On-screen error message Cause Action 8171 Processor 2 not Check supported CPUs and CPU frequency is incorrect. operating at intended replace the CPU. If replacing the frequency CPU does not help, replace CPU/IO module. 9064 Mixed CPU Steppings Different CPU steppings are detected found.
  • Page 281 Troubleshooting 7-9 On-screen error message Cause Action 9039 Not keep last boot Unintended operations such Reconfigure the boot option by order as incorrect DC off are using the BIOS setup. If performed. reconfiguring the boot option does not help, replace the CPU/IO module.
  • Page 282 7-10 Troubleshooting On-screen error message Cause Action 9027 Mounted CPU is CPU configuration may be mismatching. different between the CPU/IO modules. Replace the CPU. If this does not help, replace the CPU/IO module. 9028 Memory of the different types Memory of the different types is is installed.
  • Page 283 Troubleshooting 7-11 On-screen error message Cause Action 9058 - 905F This CPU/IO module detected CPU configuration may be the mismatch of CPUID different between the CPU/IO between the CPU/IO modules. modules. Replace the CPU. If this does not help, replace the CPU/IO module.
  • Page 284: Error Notification By Beep

    7-12 Troubleshooting Error Notification by BEEP An error message may not be displayed on the display unit even though the POST detected an error. In such a case, the beep sounds notifies you an error. The error contents are indicated by the combination of beep sound patterns.
  • Page 285: Linux Error Messages

    Troubleshooting 7-13 Linux Error Messages NEC Express5800/ft series displays messages on the console window when failures occur. Also, the same information is recorded as system logs. The following indicates the syslog messages, messages on the console, their meanings and actions:...
  • Page 286 7-14 Troubleshooting Message Meaning Action The driver failed the fast resync The driver was unsuccessful to If the message is recorded function of the CPU module. perform fast re-sync to the CPU frequently, there may be module. problem in the hardware environment.
  • Page 287 Contact your sales agent. The error occurred on the There was a South Bridge error. South Bridge. FT nonfatal error occurrred. NEC GeminiEngine HA System If the message is recorded Controller detected an error. frequently, there may be problem in the hardware The error occurred on the CPU There was a CPU module error.
  • Page 288 Contact your sales agent. Base address reading error. Base address reading error. There may be problem in (NEC GeminiEngine HA (NEC GeminiEngine HA System the hardware environment. System Controller I/O) Controller I/O) Contact your sales agent. Base address reading error.
  • Page 289 Troubleshooting 7-17 Message Meaning Action Memory check failed. Memory check failed. If the message is recorded frequently, there may be problem in the hardware environment. Contact your sales agent. Memory copy was started. Memory copy was started. The server is operating normally.
  • Page 290 7-18 Troubleshooting Message Meaning Action The driver failed to switch the The driver was unsuccessful to There may be problem in Secondary Module. switch the secondary module. the hardware environment. Contact your sales agent. The driver has already The CPU module has already The server is operating completed to bind the CPU been bound.
  • Page 291 Troubleshooting 7-19 Message Meaning Action The driver started to set the The driver started setting the The server is operating MTBF threshold. MTBF threshold. normally. The driver finished successfully The driver successfully set the to set the MTBF threshold. MTBF threshold. The driver started to set the The driver started setting the MTBF type.
  • Page 292 7-20 Troubleshooting Message Meaning Action [FT LED: Off] The FC device is [FT LED: Off] The FC device is Take necessary actions not duplex. not duplexed. referring to “Troubleshooting” in the Since removal of each device The CPU/IO module cannot be User’s Guide.
  • Page 293 Troubleshooting 7-21 Message Meaning Action It failed in the client attestation. Client authentication was Contact your sales agent. unsuccessful. It failed in the initialization of a Failed to initialize the transaction. transaction. Transaction task abort. The transaction is terminated because there was a communication error.
  • Page 294: Server Management Application Error Message

    7-22 Troubleshooting Server Management Application Error Message If the server management tool such as NEC ESMPRO Agent or NEC ESMPRO Manager has been installed in the NEC Express5800/ft series or management PC, you can obtain the error information from the display unit of the server or management PC.
  • Page 295: Solving Problems

    Make sure the POWER switch on the power unit is on. Did you press the POWER switch? Press the POWER switch on the front of the NEC Express5800/ft series to turn on the power (the POWER LED lights). Did you install the CPU/IO module properly? Check if the CPU/IO module is properly installed in the server.
  • Page 296 Make sure that the interface cables and power cord are properly connected. Also make sure that the cables are connected in the correct order. Is that device compliant with NEC Express5800/ft series? Operation of the server with unauthorized devices is not guaranteed.
  • Page 297 Troubleshooting 7-25 Is the power-on order correct? When the server has any external devices connected, power on the external devices first, then the server. Did you install drivers for connected optional devices? Some optional devices require specific device drivers. Refer to the manual that comes with the device to install its driver.
  • Page 298 Make sure that the cable is connected to the correct connector on the rear of the server. Are the keyboard and mouse are compliant with NEC Express5800/ft series? Operation of the server with unauthorized devices is not guaranteed. Does the server have drivers installed? Refer to the manual that comes with your OS to check that the keyboard and mouse drivers are installed.
  • Page 299 Fail to access the hard disk: Is the hard disk applicable to the server? Operation of any device that is not authorized by NEC is not guaranteed. Is the hard disk properly installed? Make sure to lock the hard disk with the lever on its handle. The hard disk is not connected to the internal connector when it is not completely installed (see Chapter 8).
  • Page 300 Have you modified kernel? Confirm that no patch for general kernel is applied or that the kernel that has been installed for NEC Express5800/ft series is not modified. IO module is not disconnected: When you attempt to disconnect IO module while network adapter and/or SCSI adapter and/or FC adapter is not in dual mode, the following message will be recorded to the system event log and the IO module will not be separated.
  • Page 301 Is the mirror of the hard disk not removed? Check [Disk Management], and reconfigure the mirror if the mirror is broken. (See “HARD DISK CONFIGURATIONS THAT CAN BE BUILT ON THE NEC Express5800/ft series” in Chapter 3 “Linux Setup and Operation.”) Relevant Disk LED and DISK ACCESS LED illuminate amber during the process of automatic mirror reconfiguration.
  • Page 302 ------------------------------------------------------------------------------------------------ 2. Run “udevstart.” All the Linux standard device names will be renamed to the ones for your NEC Express5800/ft series (such as e08030, e13030), and the network is duplexed. 3. Run “ifconfig -a |grep eth” again to confirm that no message appears.
  • Page 303: Event Log

    Event Log HAS Daemon-related logs are recorded in the system event log. When you manage servers using NEC ESMPRO Manager, the following message may be recorded in the system event log. This message does not indicate an event that impacts operations. However, if it is recorded frequently, there may be problem in OS or the software environment.
  • Page 304: Syslog

    7-32 Troubleshooting Syslog “A timeout occurred for waiting BMC response.” is recorded in the syslog. The following logs may be recorded while the system is running. These logs are recorded if the software that has acccess to BMC could not receive any response from BMA within a certain time period.
  • Page 305 Troubleshooting 7-33 “I/O error” is recorded in the syslog by the cable disconnection during the access to the Fibre Channel disk: When the Fibre Channel connected to the primary PCI module Cable is disconnected during the access to the Fibre Channel disk, logs may be recorded, which seem that “SCSI disk (/dev/sdd**)I/O error”(** represent numbers) occurred on the devices which are not running because the internal status managed by the OS and the actual status on the server side are different.
  • Page 306 7-34 Troubleshooting [aic79xx/scsi*] start to remove the HBA. [aic79xx/scsi*] unregister SCSI host on kernel. [aic79xx/scsi*] SCSI host was unregisterd. [aic79xx/scsi*] HBA was removed. [aic79xx/scsi*] ahd_stat_timer: HBA was lost. [aic79xx/scsi*] Reject the request. adapter was already removed. [aic79xx/scsi*] Reject the request. adapter lost(not notified to remove yet). FC-related logs are recorded to the system event log: FC driver records mounting and unmounting of a module in the system event log, but these events do not affect the system.
  • Page 307: Problems With Nec Expressbuilder

    Troubleshooting 7-35 Problems with NEC EXPRESSBUILDER When the server is not booted from the NEC EXPRESSBUILDER CD-ROM, check the following: Did you set the NEC EXPRESSBUILDER CD-ROM during POST and restart the server? If you do not set the NEC EXPRESSBUILDER CD-ROM during POST and restart the server, an error message will appear or the OS will boot.
  • Page 308: Problems With Nec Esmpro

    7-36 Troubleshooting Problems with NEC ESMPRO NEC ESMPRO Agent See Chapter 5. NEC ESMPRO Manager See Chapter 5. See also online document in NEC EXPRESSBUILDER CD-ROM for troubleshooting and other supplementary information.
  • Page 309: Collection Of Trouble Logs

    Collection of syslog The log file of Linux is created under the following directory in text format: /var/log/ The log file of NEC Express5800/ft series is also created in this directory, as with general log file of Linux. Collection of System Information...
  • Page 310: Collection Of The Memory Dump

    7-38 Troubleshooting Collection of the Memory Dump If a failure occurs, the memory data should be dumped to acquire the required information. IMPORTANT: Consult with your sales agent before dumping the memory. Executing memory dumping while the server is in the normal operation may affect the system operation. Restarting the system due to an error may display a message indicating insufficient virtual memory.
  • Page 311: Backup Of Ipmi Information

    - The screen may remain blank even if dump is being collected. Do not perform forced DC off. BACKUP OF IPMI INFORMATION Collect the IPMI information. NEC ESMPRO Agent must be installed to collect the information. Log on to the system as a user with a root authority.
  • Page 312 <Backup File Name>: Specify the path to the file on which you want to save the information. By default, the information is output to log/ipmi.dat which is under the directory where NEC ESMPRO Agent is installed. <Comment>: Describe the information which you want to output with. (Optional) For using the Server Maintenance Utility in Japanese, run the command below before starting it.
  • Page 313: Chapter 8 System Upgrade

    Be sure to use only optional devices and cables designated by NEC. Repair of the server due to malfunctions, failures, or damage resulted from installing such devices or cables will be...
  • Page 314: Safety Precautions

    8-2 System Upgrade SAFETY PRECAUTIONS Observe the following notes to install or remove optional devices safely and properly. WARNING Observe the following instructions to use the server safely. There are risks of death or serious personal injury. See “PRECAUTIONS FOR SAFETY”...
  • Page 315: Anti-Static Measures

    System Upgrade 8-3 ANTI-STATIC MEASURES The server contains electronic components sensitive to static electricity. Avoid failures caused by static electricity when installing or removing any optional devices. Wear wrist straps (arm belts or anti-static gloves). Wear wrist straps on your wrists. If no wrist strap is available, touch an unpainted metal part of the cabinet before touching a component to discharge static electricity from your body.
  • Page 316: Preparing Your System For Upgrade

    (place the module off-line) by using the Server Maintenance Utility of the NEC ESMPRO Agent or the NEC ESMPRO Manager from the management PC on the network. After a new module is installed to the server, enable the module using the Server Maintenance Utility or the NEC ESMPRO Manager.
  • Page 317: 3.5-Inch Hard Disk Drive

    SCA2 interface are installed. IMPORTANT: Do not use any hard disks that are not authorized by NEC. Installing a third-party hard disk may cause a failure of the server as well as the hard disk. Purchase hard disks of the same model in pair.
  • Page 318: Installing 3.5-Inch Hard Disk Drive

    8-6 System Upgrade Installing 3.5-inch Hard Disk Drive Follow the procedure below to install the hard disk. A hard disk may be installed in another slot in the same procedure. IMPORTANT: Make sure to read "ANTI-STATIC MEASURES" and "PREPARING YOUR SYSTEM FOR UPGRADE"...
  • Page 319 System Upgrade 8-7 Firmly hold the handle of the hard disk to install and insert the hard disk into the slot. TIPS: Insert the disk until the lever hook touches the server frame. Check the orientation of lever. Insert the hard disk with the lever unlocked.
  • Page 320: Removing 3.5-Inch Hard Disk Drive

    8-8 System Upgrade Removing 3.5-inch Hard Disk Drive Follow the procedure below to remove the hard disk. IMPORTANT: Make sure to read "ANTI-STATIC MEASURES" and "PREPARING YOUR SYSTEM FOR UPGRADE" before starting installing or removing options. Shutdown Linux. The system turns off automatically. Disconnect all the power cords from the power outlet.
  • Page 321: Replacing 3.5-Inch Hard Disk Drive

    System Upgrade 8-9 Replacing 3.5-inch Hard Disk Drive Follow the procedure below to remove the failed hard disk. If the hard disk fails, it should be replaced with new device with the server powered-on. IMPORTANT: Make sure to read “ANTI-STATIC MEASURES” and "PREPARING YOUR SYSTEM FOR UPGRADE"...
  • Page 322: Raid Configuration When Disks Are Added

    8-10 System Upgrade RAID CONFIGURATION WHEN DISKS ARE ADDED Use ftdiskadm to configure RAID when disks are added. From “SCSI” – “Bring Up,” specify slot numbers and add the disks to the system. Then, from “RAID” – “New Disks,” configure RAID. Following is an example of adding disks to Slot 2 and Slot 5 using ftdiskadm: (Example of adding disks to the system) #ftdiskadm...
  • Page 323 System Upgrade 8-11 Command Action 1 Bring Down(System Disk) 2 Bring Up(System Disk) 3 Status(System Disks) 9 <= Return Command:9 (Example of RAID configuration) Command Action 1 => RAID 2 => SCSI 9 Quit Command:1 Command Action 1 New Disks 2 Remove Half Disk 3 Repair Disk 4 Remove Full Disks...
  • Page 324 8-12 System Upgrade View the status of disks and confirm that the disks are added properly: Command Action 1 New Disks 2 Remove Half Disk 3 Repair Disk 4 Remove Full Disks 5 Status(Raid) 6 Status(All Disks) 9 <= Return Command:5 [Status(Raid)] Name Partition Status...
  • Page 325: 5.25-Inch Device

    System Upgrade 8-13 5.25-INCH DEVICE The server has two slots to which you can install magnetic tape backup devices. You need a SCSI controller, sold separately, to install a backup device Backup device tray...
  • Page 326: Installing 5.25-Inch Device

    8-14 System Upgrade Installing 5.25-inch Device See page 8-4 to prepare for installation. Loosen screws to remove the side cover. Loosen screws to remove the tray for adding devices. Remove the four screws securing the dummy cover, and remove the dummy cover.
  • Page 327: Removing 5.25-Inch Device

    System Upgrade 8-15 Fix the device to the tray for adding devices with the four screws. TIPS: Referring to the manual that comes with the 5.25-inch device you are to install, set the TermPower to Enable. Gently insert the device into the tray and secure it with the screw.
  • Page 328: Cpu/Io Module

    Removing the module being operating may cause unexpected trouble. Use the management software (e.g., Server Maintenance Utility or NEC ESMPRO Manager) to identify the module to be removed so that the module is removed when it is stopped, without fail Then remove the relevant module after verifying the Status LED on the CPU/IO module.
  • Page 329: Removing Cpu/Io Module

    Stop the CPU/IO module you want to remove. To this end, use the Server Maintenance Utility of the NEC ESMPRO Agent installed to your server or the Data Viewer of the NEC ESMPRO Manager. For the detailed procedure, see "Maintenance of NEC Express5800/ft series" of "NEC ESMPRO Agent and Manager"...
  • Page 330 8-18 System Upgrade Loosen the screws securing the CPU/IO module handle to press down the handle. The lock is unlocked and the CPU/IO module is pulled out. IMPORTANT: Before you pull out a CPU/IO module, check the rear of the server to make sure cables for Handle connection with peripheral equipment or network are disconnected.
  • Page 331: Installing Cpu/Io Module

    In such a case, check the status by using the Server Maintenance Utility or NEC ESMPRO Manager data viewer, and then power on by the module POWER switch or start up the IO and CPU modules.
  • Page 332: Dimm

    For more information on static electricity, see “ANTI-STATIC MEASURES.” Make sure to use the DIMM authorized by NEC. Installing a third-party DIMM may cause a failure of the DIMM as well as the server. Repair of the server due to failures or damage resulted from installing such a board will be charged.
  • Page 333: Precautions

    System Upgrade 8-21 DIMM slot A1 DIMM slot B1 DIMM slot A2 DIMM slot B2 DIMM slot A3 DIMM slot B3 Motherboard of the CPU/IO module Precautions Note the following to install or replace DIMM. The DIMMs with the same number are linked among the groups. When a DIMM is added to one group, another identical DIMM should be installed to the socket with the same number in another group.
  • Page 334: Installing Dimm

    8-22 System Upgrade Installing DIMM Follow the procedure below to install the DIMM. Shut down OS. The sever turns off automatically. Disconnect the power cords from the outlets. Remove the CPU/IO module referring to page 8-17. Check to be sure in which socket you are mounting the DIMM. DIMM connector cover Remove the connector cover from the socket.
  • Page 335: Removing Dimm

    System Upgrade 8-23 Removing DIMM Follow the procedure below to remove the DIMM. TIPS: Unless at least two DIMMs are installed, the server does not work. Shutdown OS. The system turns off automatically. Disconnect the power cords from the outlets. Remove the CPU/IO module referring to page 8-17.
  • Page 336: Replacing Dimm

    Identify the failed DIMM using the Data Viewer of NEC ESMPRO Manager. Remove the CPU/IO module referring to page 8-17. Replace the DIMM Install the CPU/IO module referring to page 8-19. Start up the CPU/IO module using NEC ESMPRO Manager or Server Maintenance Utility.
  • Page 337: Processor (Cpu)

    “ANTI-STATIC MEASURES.” Do not use the system before checking to see it works correctly. Make sure to use the CPU specified by NEC. Installing a third-party CPU may cause a failure of the CPU as well as the server.
  • Page 338: Installing Cpu (Model With Heat Sink)

    8-26 System Upgrade Installing CPU (Model with Heat Sink) Follow the steps below to mount a CPU. Information provided here is for the 320Fa-L and 320Fa-LR models, which have a heat sink installed. Shut down OS. The system turns off automatically. Unplug the power cords.
  • Page 339 System Upgrade 8-27 Place the CPU on the socket carefully. Pin marks TIPS: Pay attention to the orientation of the CPU. The CPU and socket have pin marks to prevent misinsertion. Check the pin marks of the CPU and the socket and insert the CPU correctly.
  • Page 340 8-28 System Upgrade Confirm that the heat sink is mounted horizontally to the motherboard. IMPORTANT: If the heat sink is not horizontally to the motherboard, dismount and remount it. The heat sink cannot be mounted correctly if: - the CPU is not mounted correctly - the screws are not fully fastened.
  • Page 341: Removing Cpu (Model With Heat Sink)

    System Upgrade 8-29 Removing CPU (Model with Heat Sink) When you remove a CPU, prepare for removal referring to the steps from 1 to 4 of “Installing CPU (Model with Heat Sink).” Then follow the installation steps from 12 to 7. To remove the heat sink, remove the screws, move the heat sink horizontally a little, and then remove it.
  • Page 342: Replacing Cpu

    8-30 System Upgrade Replacing CPU Follow the steps below to replace a failed CPU: Use Data Viewer of NEC ESMPRO Manager to identify the failed CPU. Remove the CPU/IO module referring to page 8-17. Replace the CPU. Install the CPU/IO module referring to page 8-19.
  • Page 343: Ft Remote Management Card

    Management Card, the messages below are displayed and the startup process temporally stops when starting the server (POST). The server may be in such a state when the NEC logo screen is displayed and the startup process is stopped. Press ESC to delete the logo screen and check the diagnostic message.
  • Page 344: Installing Ft Remote Management Card

    8-32 System Upgrade Installing ft Remote Management Card Follow the procedures below and install ft Remote Management Card. Remove CPU/IO module referring page 8-17. TIPS: If PCI board is already installed to the CPU/IO module, remove the PCI board referring to page 8-37.
  • Page 345: Removing Ft Remote Management Card

    System Upgrade 8-33 Check the slot for ft Remote Management Card and remove the connector cap installed in the slot. IMPORTANT: Keep and store the removed connector cap with care. Insert ft Remote Management Card slowly against the connecting part to the slot board on the motherboard.
  • Page 346: Pci Board

    8-34 System Upgrade PCI BOARD Up to three PCI boards can be installed to the CPU/IO module. IMPORTANT: The PCI board is extremely sensitive to static electricity. Make sure to touch the metal frame of the server to discharge static electricity from your body before handling the PCI board. Do not touch the PCI board terminals or onboard parts by a bare hand or place the PCI board directly on the desk.
  • Page 347 System Upgrade 8-35 List of option PCI boards and installable slots: N-code Product name 320Fa-L 320Fa-LR Remarks PCI-1 PCI-2 PCI slot 64bit/100MHz performance Slot size Low Profile PCI board type 3.3V Mountable board size N8804-002 1000BASE-T 1ch Only one board can be mounted board set when N8804-004 or N8803-033 is installed...
  • Page 348: Installing Pci Board

    8-36 System Upgrade Installing PCI Board Follow the procedure below to install the board to be connected to the PCI board slot. TIPS: To install the PCI board, make sure the shape of the board connector matches with the shape of the PCI board slot connector.
  • Page 349: Removing Pci Board

    System Upgrade 8-37 PCI board Gently insert the slot on the board against the connecting part of the board Insert the board for connecting part of the board to securely connect to the slot. IMPORTANT: If you have trouble installing the board, remove the board once and install it again. Be careful since the board gets damaged if you press it too hard.
  • Page 350: Replacing Pci Board

    8-38 System Upgrade Replacing PCI Board Follow the procedure below to replace the failed PCI board. Check the PCI board LED and identify the failed PCI board. When the PCI board is failed or incorrectly installed, the three LEDs associated with the PCI board slot are being turned off.
  • Page 351: Setup Of Optional Pci Board

    List of slots to install optional PCI boards Refer to “List of option PCI boards and installable slots:” on page 8-35. Installation procedure NEC Express5800/ft series sets dual configuration with optional PCI boards in pairs. See “Step 6: Set Dual LAN Card Configuration.” N8803-032 SCSI board List of slots to install optional PCI boards Refer to “List of option PCI boards and installable slots:”...
  • Page 352 #sync #reboot IMPORTANT: StoragePathSavior is required for connecting NEC Storage using N8803-033 Fiber Channel boards. Mount N8803-033 Fibre Channel boards after completing the OS installation. They are used in a pair or in a set of four. Mount each controller on the slot of the same position...
  • Page 353: Appendix A Specifications

    Number of processors 1 processor (the number of processors installed per module) Maximum Up to 2 processors (the number of processors installed per module) Chipset GeminiEngine (NEC original chipset) Memory Standard None Maximum 6GB (The standard DIMM must be replaced.)
  • Page 354 A-2 Specifications...
  • Page 355: Appendix B I/O Port Addresses

    Motherboard resource 000002F8 - 000002FF Motherboard resource 000003B0 - 000003BB PCI standard PCI-to-PCI bridge 000003B0 - 000003BA Graphics controller (NEC GA Driver) 000003C0 - 000003DF PCI standard PCI-to-PCI bridge 000003C0 - 000003DE Graphics controller (NEC GA Driver) 000003E8 - 000003EF...
  • Page 358 N8800-090F, EXP320B NEC Express5800/320Fa-L N8800-091F, EXP320A NEC Express5800/320Fa-LR User's Guide 2nd Edition 9-2006 856-126408-101-01...

This manual is also suitable for:

N8800-090f,exp320bN8800-091f, exp320a

Table of Contents