Scale-Up X200 - Add HBA Card and JBOD
Due to supply chain constraints, some X200 4U90 Twin Servers were shipped without HBA cards installed. To support X200 scale up by connecting a new JBOD to these systems, you may need to first install HBA cards in a system already in use.
Important Information - X200 HBA Cards
-
If you are replacing an existing HBA card with the exact same HBA card type, you DO NOT need to perform the software changes outlined below. Refer to the _SReplace NIC and HBA Cards CRU replacement procedure.
-
The HBA 9500 card (AOC-SAS3-9500-8E) is only supported on ActiveScale OS version 6.3 and higher. Installing this on any older version of ActiveScale OS will yield in an unsable HBA card as there are no software drivers and kernel support. Upgrade to ActiveScale OS 6.3 or higher before starting the HBA card install procedure.
-
The HBA 9405 card (AOC-SAS3-9405W-16E) does not require a minimum ActiveScale OS version.
Note: You should execute this procedure for each of the X200 Twin Server nodes (top node and bottom node) at the same time. This will allow you to simultaneously rack and connect the JBOD and 4U90 Twin Server.
-
Stop the mona service on the converged node:
sudo service mona stop
-
Make sure no systemscan is running anymore. Wait for the processes to finish.
sudo ps faux | grep systemscanAn example of systemscan still running is below. You will find a running systemscan and your grep command.
marvin 15506 0.0 0.0 14224 988 pts/0 S+ 11:34 0:00 _ grep --color=auto system
mona 13836 0.0 0.0 4504 772 ? Ss 11:28 0:00 /bin/sh -c sudo -s -- <<"EC_EOF" /opt/ampli/apps/marvinbase/tools/systemscan.py --update-existing --prerequisites EC_EOF
root 13855 10.0 0.0 431396 59160 ? Rl 11:28 0:32 \_ /opt/ampli/apps/marvinbase/venv/bin/python /opt/ampli/apps/marvinbase/tools/systemscan.py --update-existing --prerequisites
An example of no systemscan running is below. Only your grep command is found.
marvin 20291 0.0 0.0 14224 964 pts/0 S+ 11:35 0:00 _ grep --color=auto system -
Start sherpa and update the node hardwaretype to X200 with SAS HBA (SMC_4U90_DE1CR90):
sherpa
%cpaste
hwtype = 'SMC_4U90_DE1CR90'
from marvin_lib.machine import get_machine_hwtype, set_machine_hwtype, get_machine_guid
old_hwtype = get_machine_hwtype()
m_guid = get_machine_guid()
m = cli.marvin.machine.get(m_guid)
if old_hwtype != hwtype or m['hardwaretype'] != hwtype:
set_machine_hwtype(hwtype)
m = cli.marvin.machine.update(m_guid, hardwaretype=hwtype)
print "Machine %s (%s) hardwaretype was updated from %s to %s" % (m['name'], m['guid'], old_hwtype, m['hardwaretype'])
else:
print "Machine %s (%s) hardwaretype was already the correct type: %s" % (m['name'], m['guid'], old_hwtype)
--
-
Shut down the system to continue with the FRU SAS HBA card installment:
cli.marvin.machine.shutdown(m_guid) -
Install the 9405 HBA card AOC-SAS3-9405W-16E) or 9500 HBA card (AOC-SAS3-9500-8E) into the 4U90 Twin Server. The 9500 HBA card is only supported in ActiveScale OS version 6.3 and higher!
Tools Required: Phillips Screwdriver
Step 1: Remove Node from Chassis
-
Disconnect all power supply cords and all network and system cables from the node.
Note: Before disconnecting cables, document the cable configuration. The cabling must be reconnected to the module in the exact same configuration.
-
Unlock the left and right latches on the side of the node.
-
Remove the node from the chassis and place on a flat surface.
Step 2: Remove Mezzanine Module
To access the card slots in the node, you will need to remove the mezzanine module from the node.
-
Unscrew the four screw thumbs on top of the module.
-
Lift the left and right latches to the unlock position.
-
Vertically lift the module out of the chassis. You will now have access to the card slots in node.
Item Name 1 HBA Card Slot
Step 3: Install New Card
-
Install the card by carefully pushing it down until it is completely seated into the appropriate keyed slot in the motherboard.
-
Insert the clip to connect the chassis to the card.
-
Tighten the captive screw where the top of the card meets the chassis.
Step 4: Install Mezzanine Module
-
Make sure the left and right latches are in the unlocked position. Align the mezzanine module vertically and lower into the compute module.
-
Rotate the left and right latches forward to the lock positions.
-
Carefully push down the middle section of the module to ensure connectors are fully engaged.
-
Fasten the 4 blue thumb screws on top of the module.
Step 5: Install Node into Chassis
-
Carefully slide the node back into the chassis.
-
Lock the left and right latches on the side of the compute module.
-
Reconnect the power cable to the power supply and all network and system cables to the compute node.
-
-
If you need to add additional drive sets to the system, refer to Scale Up X200 - Add Drives.
Note: Adding drives requires ActiveScale OS 6.3 and above to be installed on the system.
-
Follow the X200 Rack Installation documentation below to rack and connect a JBOD.
Note: JBOD Cabling instructions are available in the Hardware Installation instructions.
-
Power on the node. Wait for the node to completely boot up and allow up to 15 minutes for the inventoryscan to complete.
-
Check if the SAS HBA is recognised on the system:
sudo lspci | grep -i "Serial Attached SCSI controller" | wc -lIf the command returns 2, the SAS HBA is not recognised. Contact Quantum support to assist with troubleshooting.
If the command returns 3, the SAS card is recognised and the scale out is complete.