Information The BladeSymphony server name has been changed to Hitachi Compute Blade. If you are using BladeSymphony based server products, substitute references to Hitachi Compute Blade with BladeSymphony. The Hitachi Virtualization Manager (HVM) name has been changed to Hitachi logical partitioning manager (LPAR manager, or LP).
Page 3
Products, to be collected separately and to be recycled or discarded according to applicable local and national regulations. For further information, please contact your sales company where you purchased the Products. Products code Products name GVX-CC64G*BX, GVX-CC64G* Fibre Channel Board GVX-CC9FCCMB2BX, GVX-CC9FCCMB2 Combo Card For FCSW module...
Page 4
Export control To export this product, check the export control-related regulations and follow the necessary procedures. If you have any questions, contact our sales representative. Note that the same handling is required for peripheral equipment and pre-installed software shipped with this product. Notes on Deleting Data when Disposing of or Transferring the System Equipment Personal computers and system equipment are used for various purposes at the office...
Registered Trademarks and Trademarks Microsoft, Windows, and Windows Server are registered trademarks or trademarks of Microsoft Corp. in and outside the U.S. Pentium and Xeon are trademarks or registered trademarks of Intel Corporation in and outside the U.S. Linux is a registered trademark or trademark of Linus Torvalds in and outside the U.S. Red Hat is a registered trademark or trademark of Red Hat, Inc.
Introduction Thank you for purchasing Hitachi Gigabit Fibre Channel Adapter. This manual describes procedures for the use of Hitachi Gigabit Fibre Channel Adapter such as installation, connection, and handling. Notation Symbols Meanings of symbols used in this manual are as follows:...
Abbreviations for Operating Systems (OS) In this manual, the following abbreviations are used for OS name: Red Hat Enterprise Linux 7 Server (Hereinafter, referred to as Red Hat Enterprise Linux 7 or RHEL7) Red Hat Enterprise Linux 6 Server (Hereinafter, referred to as Red Hat Enterprise Linux 6 or RHEL6) ...
Information on Support and Service Missing Parts on Delivery The product is checked by local support personnel when it is delivered. In some cases, no checkout work is performed or no local support personnel visit you when the product is delivered. If you find any missing part or if you have any questions on the delivered product in such cases, contact your sales.
NOTICE ........................ xix First Aid for Electric Shock ..................xx 1 Install driver on Linux ..............1 Install driver to SAN with Hitachi Gigabit Fibre Channel Adapter ........1 Installing SLES 11 ....................2 Installing SLES 12 ....................8 Install SUSE driver ......................14 Installing SUSE driver ...................
Page 10
Adapter ........................46 Procedure for disabling Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter ........................48 Confirm the state of Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter ..........................49 Notes on using the Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter49 4 The setup to the interrupted CPU of the interrupt handler in Linux ....................
Precautions for Safe Use Notes related to safety issues are marked as shown below. This is a safety alert symbol. It calls attention to a potential safety hazard to humans. In order to avoid possible injury or death, follow the message provided after this symbol.
WARNING Abnormal heat, smoke, abnormal noise, or abnormal smell Should you find anything abnormal occurring, turn off the power and unplug all the power cords of the equipment (maximum of 5) from the electrical outlets. Using the power cord after such occurrences may lead to electric shock or fire. Do not place any objects around the electrical outlet to allow users to unplug the power cord immediately.
Page 13
WARNING Handling of the power cables Always use the power cables shipped with the equipment, and follow the instructions below: Failure to follow the correct handling practices may lead to damage to the power cables to expose the copper wires, or overheating due to short-circuiting or partial disconnection, which may cause electric shock or fire.
WARNING Contact failure and tracking of the power plug Comply with the following instructions for handling of the power plug. Otherwise, tracking or contact failure may cause a fire. Make sure that the power plug is fully and securely inserted into the electrical outlet.
WARNING Not designed to operate in a humid or dusty environment Do not use the equipment near a place where water is used such as sink, in a humid basement, or in a dusty place. Such conditions may lower electric insulation, leading to electric shock or fire.
CAUTION Contact with contact pins Do not touch the contact pins of connectors with your hand or any metal item. Do not any objects such as wire among the pins. Do not place the equipment in a place where there are metal pieces. Otherwise, contact failure may cause a malfunction.
Page 17
CAUTION Signal cables When wiring cables, take care not to trip over the cables. It could cause injury or failure of devices connected to the equipment. It could also cause loss of valuable data. Do not place heavy items on the cables. Avoid wiring cables close to a thermal appliance.
NOTICE Backing up data Always create backup copies of important data on the hard disk to auxiliary storage. If the hard disk fails, all data stored on it will be lost. Not designed to operate outdoors Do not operate the equipment outdoors. It could cause a failure. Disposal of the equipment For disposal by a business operator Check the industrial waste disposal regulations for your country and follow the...
Page 19
NOTICE Implementing a disk array You must not change the disk array during system operations. Otherwise, the system would lose all data. If you select [New Configuration], the hard disk will lose all data. Power operation Follow the prescribed procedure for power operation. Power input or output not according to the prescribed procedure may cause problems to the system equipment.
First Aid for Electric Shock First aid is the help you can provide before you can get professional medical help. For serious conditions, it is vitally important to take the victim to a doctor as soon as possible. Have someone call an ambulance at once while you apply first aid. Break the victim’s contact with the source of electricity in the quickest safe way possible.
Page 21
Warning labels Warning labels can be found at the following locations on the system equipment. <Hitachi Compute Blade system equipment>...
Install driver on Linux This chapter describes how to install, update and roll back the driver on Linux. Install driver to SAN with Hitachi Gigabit Fibre Channel Adapter In order to install OS to SAN, it is necessary to perform "(1) Make hfcldd media" of the...
(1) Make hfcldd driver media Please get the image file “dud-htc-hfcldd-<driver version>.iso” in the following directory of CD-ROM media (Hitachi Gigabit FC Adapter Driver CD for Linux) appended to this product. Image file is ISO format. Write the image to CD-R to using the appropriate writing software.
Page 24
(4) When the screen, "System Configuration and Boot Management" is displayed, choose "System Settings" and press the Enter key. (5) When "System Settings" screen is displayed, please choose "Adapters and UEFI Drivers" and press the Enter key.
Page 25
(6) When "Adapters and UEFI Drivers" screen is displayed, please press the Enter key. (7) Please choose "I-Hitachi PCI-X/PCIe Fibre channel Controller" and press the Enter key. (8) Please refer to "Procedure to set a Boot Function to Enable" of "HITACHI Gigabit Fibre Channel adapter user's guide (BIOS/EFI Edition)" and do the procedure.
Page 26
(9) When the menu screen for boot is displayed, please choose "Installation" and press the e key. (10) When the edit display of the "Installation" entry is displayed, please add "dud=1" to the end of the "linuxefi" line, and press the F10 key.
Page 27
(11) "Please choose the Driver Update medium." message is displayed, then change the hfcldd driver disk (dud-htc-hfcldd-<driver version>.iso) prepared at (1) to "SUSE Linux Enterprise Server installation" media. And please choose a USB DVD-ROM drive (example: sr0), and press Enter key. (12) When "Please choose the Driver Update medium."...
Page 28
(13) When the following screen is displayed, please install OS according to the installation manual of SUSE Linux Enterprise Server, and move on to "Install SUSE driver".
(1) Make hfcldd driver media Please get the image file “dud-htc-hfcldd-<driver version>.iso” in the following directory of CD-ROM media (Hitachi Gigabit FC Adapter Driver CD for Linux) appended to this product. Image file is ISO format. Write the image to CD-R to using the appropriate writing software.
Page 30
(4) When the screen, "System Configuration and Boot Management" is displayed, choose "System Settings" and press the Enter key. (5) When "System Settings" screen is displayed, please choose "Adapters and UEFI Drivers" and press the Enter key.
Page 31
(7) Please choose "I-Hitachi PCI-X/PCIe Fibre channel Controller" and press the Enter key. (8) Please refer to "Procedure to set a Boot Function to Enable" of "HITACHI Gigabit Fibre Channel adapter user's guide (BIOS/EFI Edition)" and do the procedure. (9) When the menu screen for boot is displayed, please choose "Installation" and press...
Page 32
(10) When the edit display of the "Installation" entry is displayed, please add "dud=1" to the end of the "linuxefi" line, and press the F10 key.
Page 33
(11) "Please choose the Driver Update medium." message is displayed, then change the hfcldd driver disk (dud-htc-hfcldd-<driver version>.iso) prepared at (1) to "SUSE Linux Enterprise Server installation" media. And please choose a USB DVD-ROM drive (example: sr0), and press Enter key. (12) When "Please choose the Driver Update medium."...
Page 34
(13) When the following screen is displayed, please install OS according to the installation manual of SUSE Linux Enterprise Server, and move on to "Install SUSE driver".
Installing SUSE driver SLES 11 (1) Get the RPM packages For Hitachi Compute Blade system, the RPM packages are stored in "Hitachi Gigabit FC Adapter Driver CD for Linux" CD-ROM and its directory is as follows. /hfc_media/linux/x86_64/<sles11*>/ <sles11*> : sles11sp3, sles11sp4...
Page 36
# reboot SLES 12 (1) Get the RPM packages For Hitachi Compute Blade system, the RPM packages are stored in "Hitachi Gigabit FC Adapter Driver CD for Linux" CD-ROM and its directory is as follows. /hfc_media/linux/x86_64/<sles12*>/ <sles12*> : sles12, sles12sp1, sles12sp2...
Page 37
Note 5) Be sure to install the both RPM packages, driver and utility. If no utility is installed, the error log required for failure analysis cannot be collected. (3) Confirm the driver version Check the version.txt stored in /opt/hitachi/drivers/hba, and confirm that the driver's version is same as the RPM package. [Example: Install log] more /opt/hitachi/drivers/hba/version.txt...
Confirm the driver version Be sure that all of the installed Hitachi FC HBA cards were recognized by linux. In case of SLES 11 # ls /proc/scsi/hfcldd 0 1 ..(SCSI host numbers of the recognized HBA cards are displayed) # cat /proc/scsi/hfcldd/<scsi host number>...
See "Notes at the time of renewal of RAMDISK" after uninstallation. (2) Check the uninstall log Check the messages in /tmp/hfcldd_uninstall.log, and confirm "Uninstall Success" is recorded. ---- Uninstall @Hitachi Fibre Channel Adapter Driver - Tue Nov 6 15:26:55 JST 2012 Modify /etc/modprobe.d/hfcldd_param.conf ---- Uninstall Success...
Page 40
See "Notes at the time of renewal of RAMDISK" after uninstallation. (2) Check the uninstall log Check the messages in /tmp/hfcldd_uninstall.log, and confirm "Uninstall Success" is recorded. ---- Uninstall @Hitachi Fibre Channel Adapter Driver - Fri Oct 30 10:02:12 JST 2015 Modify /etc/modprobe.d/hfcldd_param.conf ---- Uninstall Success...
Page 41
(3) Unload the driver Reboot the system to unload the driver. # reboot (4) Confirm the driver and utility uninstalled Confirm that don’t exists nothing display in /sys/class/scsi_host/host*/hfcldd_proc # more /sys/class/scsi_host/host*/hfcldd_proc...
Notes at the time of renewal of RAMDISK Note at the time of installing, updating or uninstalling the driver You have to update the RAMDISK image when installing, updating or uninstalling the driver. Update appropriate RAMDISK image with reference to the setting file of the boot loader such as grub.conf or elilo.conf.
Error log information The Hitachi Gigabit Fibre Channel Adapter provides the functions to gather the failure information (error log) when the various failures occurred. Linux Linux driver collects the various error log information using the daemon process (klogd) which outputs the kernel messages. Accordingly, klogd and syslogd must be executed to collect log information.
Error log information Display of title only The title information for the error log output by the adapter driver is output by the following command: #cat /var/log/messages | grep HFC_ Oct 15 18:58:57 Linux7 kernel: hfclddX:HFC_ERR6 Temporary FC Link error (ErrNo:0xXX) (Date) (Logical device name) (Error name or error title)
Page 45
Error numbers Error number List (2/4/8Gbps Fibre Channel Adapter) No. ErrNo Error name Contents Remarks – – Missing number – – Missing number – – Missing number HFC_ERR9 SCSI command was executed when status is HFC_OFFLINE HFC_ERR9 Iov_cnt more than specified value –...
Page 46
No. ErrNo Error name Contents Remarks HFC_ERRA Detected Time-Out in the scsi command operation. – – Missing number HFC_ERRA Detected Time-Out of Abort_Task_Set. – – Missing number – – Missing number HFC_ERRA Time-out was detected at Target_Reset HFC_EVNT4 Detected Time-Out in mailbox procedure at interrupt level HFC_ERR2 Detected MCKINT...
Page 47
No. ErrNo Error name Contents Remarks HFC_ERR9 Failed the allocation of Seg_info array structures HFC_ERR9 Failed the allocation of Seg_info array bitmap HFC_ERR9 Allocated area was not aligned to the designated boundary HFC_EVNT3 Allocated FS_ACC area was not aligned to the designated boundary HFC_ERR6 Nameserver rejects requests HFC_ERR9...
Page 48
No. ErrNo Error name Contents Remarks HFC_ERR6 It is MIH-LOG response of the interrupt level and is XCC≠80 or FSB≠00. HFC_ERRA SCSI command time-out HFC_EVNT3 In the TMT check, it is neither Target Reset nor Abort Task Set HFC_ERR6 It is GID_PN of the interrupt level and XCC=82.
Page 49
No. ErrNo Error name Contents Remarks HFC_ERR9 Failed the Adapter detection. (There is no effective Adapter.) HFC_OPTERR The unsupported optical transceiver is installed. HFC_ERR5 Detected the trouble of the adapter transceiver. HFC_ERR5 Detected the trouble of the optical transceiver. HFC_ERR5 The optical transceiver has come off.
Page 50
No. ErrNo Error name Contents Remarks HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W executes the LOGIN process. HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W executes the PDISC process. HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W...
Page 51
No. ErrNo Error name Contents Remarks HFC_EVNT3 Error threshold parameter at configuration file is invalid HFC_ERRF AddWWPN or VFCWWPN is invalid HFC_EVNT3 Failed to create virtual port HFC_EVNT3 PCIe Link_Width register inconsistency was detected HFC_ERR2 PCIe Link_Width register inconsistency was detected (Fatal) –...
Page 52
Please set a bigger value to the value of "LOGIN DELAY TIME" in that case. (*2) Mailbox procedure: Procedure that the driver of Hitachi Gigabit Fibre Channel Adapter directs the firmware the execution of processing other than the SCSI start.
Page 53
Error number List (16Gbps Fibre Channel Adapter) No. ErrNo Error name Contents Remarks – – Missing number – – Missing number – – Missing number HFC_ERR9 SCSI command was executed when status is HFC_OFFLINE HFC_ERR9 Iov_cnt more than specified value –...
Page 54
No. ErrNo Error name Contents Remarks HFC_ERRA Detected Time-Out in the scsi command operation. – – Missing number HFC_ERRA Detected Time-Out of Abort_Task_Set. – – Missing number – – Missing number HFC_ERRA Time-out was detected at Target_Reset HFC_EVNT4 Detected Time-Out in mailbox procedure at interrupt level HFC_ERR2 Detected MCKINT...
Page 55
No. ErrNo Error name Contents Remarks HFC_ERR9 Failed the allocation of Seg_info array structures HFC_ERR9 Failed the allocation of Seg_info array bitmap HFC_ERR9 Allocated area was not aligned to the designated boundary HFC_EVNT3 Allocated FS_ACC area was not aligned to the designated boundary HFC_ERR6 Nameserver rejects requests HFC_ERR9...
Page 56
No. ErrNo Error name Contents Remarks HFC_ERR6 It is MIH-LOG response of the interrupt level and is XCC≠80 or FSB≠00. HFC_ERRA SCSI command time-out HFC_EVNT3 In the TMT check, it is neither Target Reset nor Abort Task Set HFC_ERR6 It is GID_PN of the interrupt level and XCC=82.
Page 57
No. ErrNo Error name Contents Remarks HFC_ERR9 Failed the Adapter detection. (There is no effective Adapter.) HFC_OPTERR The unsupported optical transceiver is installed. HFC_ERR5 Detected the trouble of the adapter transceiver. HFC_ERR5 Detected the trouble of the optical transceiver. HFC_ERR5 The optical transceiver has come off.
Page 58
No. ErrNo Error name Contents Remarks HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W executes the LOGIN process. HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W executes the PDISC process. HFC_EVNT3 Failed to start the watchdog timer in the Mailbox indicating that F/W...
Page 59
No. ErrNo Error name Contents Remarks HFC_EVNT3 Error threshold parameter at configuration file is invalid HFC_ERRF AddWWPN or VFCWWPN is invalid HFC_EVNT3 Failed to create virtual port HFC_EVNT3 PCIe Link_Width register inconsistency was detected HFC_ERR2 PCIe Link_Width register inconsistency was detected (Fatal) HFC_EVNT2 Detected an error by Mailbox responses other than link...
Page 60
Please set a bigger value to the value of "LOGIN DELAY TIME" in that case. (*2) Mailbox procedure: Procedure that the driver of Hitachi Gigabit Fibre Channel Adapter directs the firmware the execution of processing other than the SCSI start.
Page 62
Configuration information of the driver and the system (about 3MB) + adapter port specific information (about 8.5MB) x mounted adapter port number. (ii) In the case of enabling the Multi-queue feature of HITACHI Gigabit Fibre Channel adapter. Syslog file size + Configuration information of the driver and the system (about 3MB) + adapter port specific information (about 8.5MB) x mounted adapter port...
Driver parameter setting when SCSI-MQ feature at Linux is enabled This chapter explains how to enable SCSI-MQ feature supported by SUSE Linux Enterprise Server and how to setup the driver parameter for SCSI-MQ feature. SCSI-MQ feature in Linux OS About SCSI-MQ feature From SLES12SP2 SCSI-MQ feature with multiple hardware queues for one SCSI device has been supported.
Support requirement of SCSI-MQ feature When you use the OS’s SCSI-MQ feature, please install the driver supporting SCSI-MQ feature in your system. FC Type Driver version supporting SCSI-MQ feaure earlier later x.x.21.4250 x.x.21.4252 8Gbps FC Adapter Not supported Not supported 16Gbps FC Adapter Not supported Supported...
Confirm the state of SCSI-MQ feature Please check whether SCSI-MQ feature setting is enabled or disabled according to the following procedures. # cat /sys/class/scsi_host/host*/use_blk_mq 1 [SCSI-MQ feature is enabled] 0 [SCSI-MQ feature is disabled]...
(ii) Storage direct connection configuration, Connection Type is Point to Point and Multiple PortID is Enable About Connection Type and Multiple Port ID refer to Hitachi Gigabit Fibre Channel Adapter UserPortID is BIOS/EFI Edition) for details. (5) Supported SCSI-MQ feature. Please refer to “Support requirement of SCSI-MQ...
Procedure for enabling Multi-queue feature for Hitachi Gigabit Fibre Channel Adapter If you set the Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter to enabled, please excute the below steps. (1) Enable SCSI-MQ feature of OS Please refer to “Procedure for enabling / disabling SCSI-MQ feature”.
Procedure for disabling Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter If you set the Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter to disabled,, please excute the below steps. (1) Enable SCSI-MQ feature of OS Please refer to “Procedure for enabling / disabling SCSI-MQ feature”.
Confirm the state of Multi-queue feature of Hitachi Gigabit Fibre Channel Adapter When you confirm whether the Multi-queue feature of the HITACHI Gigabit Fibre Channel adapter is enabled, please refer to "HITACHI Gigabit Fibre Channel Adapter USER’S GUIDE (Utility Software Edition)" for details.
The setup to the interrupted CPU of the interrupt handler in Linux This chapter explains the setup of the interrupted CPU of the interrupt handler in Linux. In Linux, the interrupt handlers may concentrate on one CPU, and one CPU may perform the interruption processing.
Disable SCSI-MQ feature (1) The check of an interrupt handler (irq) number Like the above-mentioned example, you can check by "more /proc/interrupts". In the above-mentioned example, the numbers of the interrupt handler (irq) of I/O processing termination processing are the left end number 35, 36, 38, and 39. (2) A setup of interrupted CPU of an interrupt handler # echo the bitmask of each CPU number >/proc/irq/<irq number>/smp_affinity The example in the case of setting so that the interruption may go up to CPU#0 for the...
The ErrNo:0x16 logs may be recorded in the syslog, when the adapter (except 16Gbps) is connected to Hitachi Virtual Storage Platform G200, G400, G600 or G800. However, there is no influence of this phenomenon on using the adapter except recording ErrorNo:0x16 logs in the syslog.
Driver parameters for SLES11 Link Down Time Parameter Notes about the waiting time (Link Down Time) which waits for linkup in order that the driver tries resending of the SCSI command after link down occurred at the time of SLES11 use are explained. In SLES11, in order that a driver tries resending of the SCSI command after link down occurred, When the change of waiting time (Link Down Time) which waits for linkup is needed, the rewriting of the "dev_loss_tmo"...
[Function] Setup of the initial value of dev_loss_tmo [Syntax] <Setup> /opt/hitachi/drivers/hba/hfcmgr -E hfc_dev_loss_tmo <setup value> After hfcmgr command execution, in order to reflect the setting, please update a RAMDISK image in the procedure of "updating procedure of a RAMDISK image."...
fast_io_fail_tmo changing by Device mapper multipath When you use Device mapper multipath in SLES11, Device mapper multipath may update the value of fast_io_fail_tmo automatically after OS starting. When the value is set except "off" to fast_io_fail_tmo, instead of dev_loss_tmo, the value of fast_io_fail_tmo is used on OS as “waiting time which waits for linkup in order that the driver tries resending of the SCSI command after link down occurred”.
"-p option of the hfcmgr command". Please refer to “HITACHI Gigabit Fibre Channel Adapter USER’S GUIDE (Utility Software Edition)” for the details of "-p option of the hfcmgr command."...
Notes at the time of SLES use The command “hfcmgr -t” Here, at the time of SLES use, explains the notes on the command “hfcmgr -t” in environment which connect to more than LU size of 2TB or connect to more than number of 511 LU.
Page 79
HITACHI Gigabit Fibre Channel Adapter USER’S GUIDE (SUSE Linux Enterprise Server driver Edition) Revision 9 Mar 2017 Hitachi Ltd. Reprint without permission is prohibited.