| Contents | Contents Installing and cabling disk shelves with IOM12 modules for a new system installation....................3 Requirements for installing and cabling disk shelves with IOM12 modules for a new system installation............................3 Considerations for installing and cabling disk shelves with IOM12 modules for a new system installation............................
The ISI addresses system setup and configuration for your new system. You use the ISI in conjunction with this procedure to install and cable the disk shelves. ISIs are also available on the Fujitsu Support Site. ETERNUS AX and ETERNUS HX Documentation Center...
| Installing and cabling disk shelves with IOM12 modules for a new system installation | Fujitsu Downloads: Disk Qualification Package • The best practice is to download and run Config Advisor after a new system installation. Running Config Advisor after a new system installation allows you to verify SAS connections are cabled correctly and that shelf IDs are unique within the HA pair or single-controller configuration.
Page 5
| Installing and cabling disk shelves with IOM12 modules for a new system installation | 3. If you are installing a DS460C disk shelf, install the components into the racked disk shelf; otherwise, go to the next step. If you purchased a partially populated disk shelf which does not have a drive in every drive slot, you must ensure that: •...
| Installing and cabling disk shelves with IOM12 modules for a new system installation | Table 1: Raised button on the right side of the drive carrier e) Lower the drive straight down, and then rotate the cam handle down until the drive snaps into place under the orange release latch.
Page 7
| Installing and cabling disk shelves with IOM12 modules for a new system installation | Procedure 1. Cable the shelf-to-shelf connections within each stack if the stack has more than one disk shelf; otherwise, go to the next step: For a detailed explanation and examples of shelf-to-shelf “standard” cabling and shelf-to-shelf “double- wide”...
Page 8
| Installing and cabling disk shelves with IOM12 modules for a new system installation | 5. Set the shelf IDs and complete system setup: You must set shelf IDs so they are unique within the HA pair or single-controller configuration, including the internal disk shelf in HX2000 systems. If...
Page 9
IDs within the system. If any SAS cabling or duplicate shelf ID errors are generated, follow the corrective actions provided. Fujitsu Downloads: Config Advisor You can also run the storage shelf show -fields shelf-id command to see a list of shelf IDs already in use (and duplicates if present) in your system.
| Hot-adding disk shelves with IOM12 modules | Hot-adding disk shelves with IOM12 modules You can hot-add one or more disk shelves with IOM12 modules to an existing stack of disk shelves with IOM12 modules or hot-add a stack of one or more disk shelves with IOM12 modules directly to a SAS HBA or an onboard SAS port on the controller.
Page 11
• The best practice is to have the current versions of disk shelf (IOM) firmware and disk drive firmware on your system before adding new disk shelves, shelf FRU components, or SAS cables. Current versions of firmware can be found on the Fujitsu Support Site. Fujitsu Downloads: Disk Shelf Firmware...
| Hot-adding disk shelves with IOM12 modules | Installing disk shelves with IOM12 modules for a hot-add For each disk shelf you are hot-adding, you install the disk shelf into a rack, connect the power cords, power on the disk shelf, and set the disk shelf ID before cabling the SAS connections. Procedure 1.
Page 13
| Hot-adding disk shelves with IOM12 modules | a) Reinstall any power supplies and IOMs you removed prior to installing your disk shelf into the rack. b) Open the top drawer of the shelf. c) Raise the cam handle on the drive to vertical. d) Align the two raised buttons on each side of the drive carrier with the matching gap in the drive channel on the drive drawer.
| Hot-adding disk shelves with IOM12 modules | Table 5: Attention: Possible loss of data access – Never slam the drawer shut. Push the drawer in slowly to avoid jarring the drawer and causing damage to the storage array. h) Close the drive drawer by pushing both levers towards the center. i) Repeat these steps for each drawer in the disk shelf.
Page 15
| Hot-adding disk shelves with IOM12 modules | Procedure 1. If you want to manually assign disk ownership for the disk shelves you are hot-adding, you need to disable disk ownership automatic assignment if it is enabled; otherwise, go to the next step. You need to manually assign disk ownership if disks in the stack are owned by both controllers in an HA pair.
Page 16
5. Download and run Config Advisor to verify that your SAS connections are cabled correctly. Fujitsu Downloads: Config Advisor If any SAS cabling errors are generated, follow the corrective actions provided. 6. Verify SAS connectivity for each hot-added disk shelf: storage shelf show -shelf shelf_name -connectivity You must run this command for each disk shelf you hot-added.
Page 17
| Hot-adding disk shelves with IOM12 modules | ------------ --------- -------------------------- ----------------------- ----------- ------ stor-8080-1 stor-8080-1 stor-8080-2 stor-8080-2 Errors: ------ 7. If you disabled disk ownership automatic assignment in Step 1, manually assign disk ownership, and then reenable disk ownership automatic assignment if needed: a) Display all unowned disks:storage disk show -container-type unassigned b) Assign each disk:storage disk assign -disk disk_name -owner owner_name You can use the wildcard character to assign more than one disk at once.
• You can verify shelf IDs already in use in your system by running Active IQ Config Advisor or using the storage shelf show -fields shelf-id command. Fujitsu Downloads: Config Advisor About this task • A valid shelf ID is 00 through 99.
Page 19
| Changing the disk shelf ID | • If ETERNUS AX/HX Series is running (controllers are available to serve data), and all disk drives in the shelf are unowned, spares, or part of offlined aggregate(s), wait at least 70 seconds. This time allows ETERNUS AX/HX Series to properly delete the old shelf address and update the copy of the new shelf address.
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations You can use the controller-to-stack cabling worksheets and cabling examples to cable your HA pair as a multipath HA configuration. •...
Page 21
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Multipath HA with one quad-port SAS HBA and two single-shelf stacks The following worksheet and cabling example uses port pairs 1a/1d and 1c/1b:...
Page 22
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Multipath HA with two quad-port SAS HBAs and two multi-shelf stacks Four port pairs are available for this configuration: 1a/2b, 2a/1d, 1c/2d, and 2c/1b. You can cable port pairs in the order in which they are identified (listed in the worksheet) or you can cable every other port pair (skip port pairs).
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Controller-to-stack cabling worksheets and cabling examples for multipath HA configurations with four onboard SAS ports You can use the completed controller-to-stack cabling worksheets and cabling examples to cable common multipath HA configurations that have four onboard SAS ports.
Page 24
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Multipath HA with four onboard SAS ports and two single-shelf stacks The following worksheet and cabling example uses port pairs 0a/0d and 0c/0b:...
Page 25
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations | Multipath HA with four onboard SAS ports, a quad-port SAS HBA, and two multi-shelf stacks Four port pairs are available for this configuration: 0a/1b, 1a/0d, 0c/1d, and 1c/0b. You can cable port pairs in the order in which they are identified (listed in the worksheet) or you can cable every other port pair (skip port pairs).
Page 26
| Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations |...
Controller-to-stack cabling worksheets and cabling examples for common HX2000 configurations You can use the completed controller-to-stack cabling worksheets and cabling examples to cable common HX2000 configurations. • If needed, you can refer to the “SAS cabling rules” section for information about supported configurations, shelf-to-shelf connectivity, and controller-to-shelf connectivity (including HX2000 port 0b same domain connectivity).
Page 28
| Controller-to-stack cabling worksheets and cabling examples for common HX2000 configurations | Multipath configuration with one multi-shelf stack The following worksheets and cabling examples use port pair 0a/0b. In this example, the controller is installed in slot A of the chassis. When a controller is located in slot A of the chassis, its internal storage port (0b) is in domain A (IOM A);...
Page 29
| Controller-to-stack cabling worksheets and cabling examples for common HX2000 configurations | In this example, the controller is installed in slot B of the chassis. When a controller is located in slot B of the chassis, its internal storage port (0b) is in domain B (IOM B); therefore, port 0b must connect to domain B (IOM B) in the stack.
Page 30
| Controller-to-stack cabling worksheets and cabling examples for common HX2000 configurations |...
Controller-to-stack cabling worksheet and cabling example for a quad-path HA configuration with two quad-port SAS HBAs You can use the completed controller-to-stack cabling worksheet and cabling example to cable a quad-path HA configuration that has two quad-port SAS HBAs. • If needed, you can refer to the “SAS cabling rules” section for information about supported configurations, the controller slot numbering convention, shelf-to-shelf connectivity, and controller-to-shelf connectivity (including the use of port pairs).
Page 32
| Controller-to-stack cabling worksheet and cabling example for a quad-path HA configuration with two quad-port SAS HBAs | Quad-path HA with two quad-port SAS HBAs and two multi-shelf stacks The following worksheet and cabling example uses port pairs 1a/2b (multipathed) and 2a/1d (quad-pathed) for stack 1, and port pairs 1c/2d (multipathed) and 2c/1b (quad-pathed) for stack2.
SAS cabling rules Disk shelves with IOM12 modules can be cabled in HA pair and single-controller configurations (for supported platforms) by applying the SAS cabling rules: configuration rules, controller slot numbering rules, shelf-to- shelf connection rules, controller-to-stack connection rules, and if applicable, mini-SAS HD SAS optical cable rules.
| SAS cabling rules | For example, if SAS HBAs occupied physical PCI slots 3, 5, and 7, they would be designated as slots 1, 2, and 3 for the purpose of applying the SAS cabling rules. • An onboard SAS HBA is defined as occupying PCI slot 0 just as it is labeled on a controller. •...
| SAS cabling rules | • Double-wide shelf-to-shelf connectivity requires two cable connections between disk shelves in each domain—domain A (IOM A) and domain B (IOM B). The first cable connection is cabled as standard shelf-to-shelf connectivity (using IOM ports 3 and 1); the second cable connection is cabled as double-wide shelf-to-shelf connectivity (using IOM ports 4 and 2).
Page 36
| SAS cabling rules | Controller B and D port connection rules (for non HX2000 configurations) • B and D ports are always the secondary paths to a stack. • B and D ports always connect to the logical last disk shelf in a stack. •...
Page 37
| SAS cabling rules | Port pair connection rules (for non HX2000 configurations) Controller SAS ports A, B, C, and D are organized into port pairs using a method that leverages all of the SAS ports for system resiliency and consistency when cabling controller-to-stack connections in HA pair and single- controller configurations.
Page 38
| SAS cabling rules | HX2000 controller 0b and 0a port connection rules to external disk shelves The HX2000 have a unique set of connection rules because each controller must maintain same domain connectivity between the internal storage (port 0b) and the stack. This means that when a controller is located in slot A of the chassis (controller 1) it is in domain A (IOM A) and therefore port 0b must connect to IOM A in the stack.
| SAS cabling rules | Mini-SAS HD SAS optical cable rules You can use mini-SAS HD SAS optical cables—multimode active optical cable (AOC) cables with mini-SAS HD-to- mini-SAS HD connectors and multimode (OM4) breakout cables with mini-SAS HD-to-LC connectors—to achieve long distance SAS connectivity for certain configurations that have disk shelves with IOM12 modules. •...
| Controller-to-stack cabling worksheet template for multipathed connectivity | Controller-to-stack cabling worksheet template for multipathed connectivity By completing the worksheet template, you can define the controller SAS port pairs you can use to cable controllers to stacks of disk shelves with IOM12 modules to achieve multipathed connectivity in an HA pair or single-controller configuration.
Page 41
| Controller-to-stack cabling worksheet template for multipathed connectivity | For example, in a multipath HA configuration with eight SAS ports and four stacks, port pair 1a/2b is cabled to stack 1, port pair 2a/1d is cabled to stack 2, port pair 1c/2d is cabled to stack3, and port pair 2c/1b is cabled to stack 4.
| How to read a worksheet to cable controller-to-stack connections for multipathed connectivity | How to read a worksheet to cable controller-to-stack connections for multipathed connectivity You can use this example to guide you through how to read and apply a completed worksheet to cable controller-to-stack connections for disk shelves with IOM12 modules for multipathed connectivity.
Page 43
| How to read a worksheet to cable controller-to-stack connections for multipathed connectivity | Procedure 1. Cable port pair 1a/2b on each controller to stack 1: a) Cable controller 1 port 1a to stack 1, first shelf IOM A port 1. b) Cable controller 2 port 1a to stack 1, first shelf IOM B port 1. c) Cable controller 1 port 2b to stack 1, last shelf IOM B port 3.
| Controller-to-stack cabling worksheet template for quad-pathed connectivity | Controller-to-stack cabling worksheet template for quad- pathed connectivity By completing the worksheet template, you can define the controller SAS port pairs you can use to cable controllers to stacks of disk shelves with IOM12 modules to achieve quad-pathed connectivity in an HA pair or single-controller configuration.
Page 45
| Controller-to-stack cabling worksheet template for quad-pathed connectivity | For example: 1b, 2b, 1d, 2d 3. In the boxes below the gray boxes, rewrite the D and B port list so that the first port in the list is moved to the end of the list. For example: 2b, 1d, 2d, 1b 4.
| How to read a worksheet to cable controller-to-stack connections for quad-pathed connectivity | How to read a worksheet to cable controller-to-stack connections for quad-pathed connectivity You can use this example to guide you through how to read and apply a completed worksheet to cable stacks of disk shelves with IOM12 modules for quad-pathed connectivity.
Page 47
| How to read a worksheet to cable controller-to-stack connections for quad-pathed connectivity | Procedure 1. Cable port pair 1a/2b on each controller to stack 1: This is the multipathed cabling for stack 1. a) Cable controller 1 port 1a to stack 1, first shelf IOM A port 1. b) Cable controller 2 port 1a to stack 1, first shelf IOM B port 1.
| Recommended AC power line sizes | Recommended AC power line sizes When installing your storage system, you must determine the AC power line lengths running from the storage system to the power source. By properly designing longer AC power feeds, you can preserve voltage levels to the equipment. The longer power feeds—the wiring from the breaker panel to the power strip, which supplies power to the storage system and disk shelves—can often exceed 50 feet.
Document update record When updates are made to this document, they are logged for your reference. Table 10: Feature release date Feature updates August 2019 • In the “Controller-to-stack cabling worksheet template for multipathed connectivity” section, step 4 supporting text for the second example, corrected the port pair used to connect to a fourth stack.
Page 50
• Removed the “SAS disk shelf safety information” section. All safety information can be found in the “Safety Information and Regulatory Notices” document on the Fujitsu Support Site. Fujitsu Support • Updated headings for multipathed connectivity worksheets to specify “multipathed connectivity”.
Page 51
| Document update record | Table 13: Feature release date Feature updates January 2017 • Updated content as needed to support the DS460C disk shelf: • Procedure for “Installing and cabling disk shelves with IOM12 modules for a new system installation” • Procedure for “Hot-adding disk shelves with IOM12 modules” •...
Fujitsu. The use or purchase of this product does not convey a license under any patent rights, trademark rights, or any other intellectual property rights of Fujitsu.
Trademark FUJITSU, FUJITSU logo, and ETERNUS are trademarks of Fujitsu. All other trademarks are the property of their respective owners. https://www.fujitsu.com/global/products/computing/storage/eternus/trademarks.html...
How to send comments about documentation and receive update notifications The latest version of this document and the latest information related to this device are available at the following site. https://www.fujitsu.com/global/support/products/computing/storage/manuals-list.html If necessary, refer to the manuals for your model.
Page 55
However, Fujitsu shall assume no responsibility for any operational problems as the result of errors, omissions, or the use of information in this manual. • Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any information in this manual. •...