X200 Hardware Installation
Step 1: Unpacking the System
The topic describes information on unpacking an X200 system once it has been shipped to your site.
Required tools for unpacking and installation
-
Anti-static mat or anti-static foam
-
Box cutter
-
Cart to hold components
-
Level
-
# 2 Phillips head screwdriver with a 12” shaft. If you are using a torque screwdriver, set the torque to 212 in-lb or 24 N-m for mounting kit installation.
Understanding the unpacking process
The unpacking process involves alternating between unpacking and inspecting components. This sequence will help catch problems that might have occurred during packaging or shipping.
Because the requirements of every data center or customer installation are different, you might have to unpack the system in a different sequence than described. If this occurs, ensure that the installation team has thoroughly reviewed the information provided in this section and follows all safety and inspection steps.
As you unpack the ActiveScale™ X200 system, look for obvious signs of damage. The following scenarios are the most common ways a package can be damaged:
-
Crushed corners caused by dropping the package.
-
Split seams caused by excessive shearing force placed on the container.
-
Punctures caused by a sharp object striking the packaging.
-
Water damage caused by contact with a water source or storage in an overly humid environment.
WARNING: The JBOD and Twin Server chassis’s are heavy and require careful lifting
Pallet contents
ActiveScale™ X200 system is shipped on one half pallets and contains the X200 nodes and accessories:
Server Pallet Contents
|
Carton |
Contents |
|
4U90 Twin Server |
One Server Chassis Disk Drives (in carriers) = 30-90 count One Rail mounting kit C19-C20 power cables= 2 count (the following cables are shipped in box number 1) Blue = Management CAT 6A, RJ45 = 6 count Yellow = Direct Attach Cable (DAC) - 10/25 Gbe SFP28 = 12 count |
JBOD Pallet Contents
|
Carton |
Contents |
|
4U90 Twin Server |
One Server Chassis Disk Drives (in carriers) = 30-90 One Rail mounting kit C13-C14 power cables= 2 count (the following cables are shipped in box number 1) Blue = Management CAT 6A, RJ45 = 6 count White = Mini SAS-HD 8644 = 24 count |
Note: All cables will be located in Box number 1
Unpacking the system
Each box contains the Server or JBOD, Rails, cables, and drives in carriers.
To unpack pallets, perform the following:
-
Remove the overwrap covering the box.
-
Unpack the X200 system components. The top of the box contains the rails and the cables, then the Server/JBOD chassis , and disk drives installed in carriers as the bottom layer of boxes.
-
Inspect each component in the Storage Node box for damage.
-
Repeat this process for each accessory box on the pallet.
Step 2: Component Installation
This topic provides information on installing the components of an X200 system, including the instructions on installation in various types of racks.
An Introduction To Installing The X200
The X200 system hardware does not come installed in a rack and does not come with a power distribution unit (PDU). For the hardware installation, use the manufacturers PDFs that are included within these instructions. The PDF's will open in a separate window.
Note: It is important to record the password for the switches prior to installation. The password for the switches is located on a tag on the bottom of the device. Login user name is ADMIN for the data switch and admin for the IPMI switch.
Example of Data Switch Password Label
Example of IPMI Switch Label
Installing the 4U90 Twin Server
Note: Install components into the rack from bottom to top starting above the 1U position. The components are installed in the order alternating the Server then JBOD, Server then JBOD, until all are installed
Note: The placement of the rack data switches are the top two positions in the rack. The IPMI switch follows the data switches in the next slot below the data switches in the rack.
For expansion racks which utilize the TOR switches in the standard rack, only the IPMI switch is installed nd it is the top most rack position for that installation
Note: The compute module is replaced from the back of the rack. If the back door of the rack is a double door, there may be a door stop attached to the cross bar at the bottom. If the first unit is installed in the bottom rail position, it is highly likely the compute module will not clear the door stop when you try to remove the module.
This section describes how to install X200 Nodes and their associated mounting kits into a rack.
|
SMC 4U90 Twin Server |
Loading HDDs into the Chassis on a Rack
-
Press the release buttons on both of the front handles downward simultaneously and pull the chassis handles forward from the rack.
Opening The Chassis on a Rack
Caution: Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing. Failure to stabilize the rack can cause the rack to tip over. Slide rail mounted equipment is not to be used as a shelf or a work place.
-
Pull open the chassis so that a locking lever on each side of the chassis aligns with the front of the chassis cover and front of the rack, then press the lever down on each side to lock the open part of the chassis in place.
Locking in place the Open Chassis on a Rack
-
HDDs and their carriers can be loaded into the chassis, or removed from the chassis by pressing their release buttons to eject their handles and then pulling the drives out by the handles.
Note: All drive slots in the chassis should have drive carriers installed. The carriers help promote proper airflow through the drive bays.
Loading HDDs in the Chassis
Installing the Data Switches (2 each) - 48 port 25GbE + 100GbE uplink
|
|
|
|
Install a 1U filler panel on the rear of the switch on the rack.
Filler Panel
Filler Panel Mounting
Installing the IPMI Switch - Edge-Core ECS2100-28T 24 port 1GbE
PDU Cx Connector
The PDU connector is a Cx connector, which allows connector be configured as a C13 connector or a C19 connector.
To convert the C13 connector into a C19 connector, remove the white plastic housing from the connector.
Step 3: Cable the Components
Review the cable labels included with the system:
| Cable Labeling Example | Description |
|---|---|
|
If the Base System Chassis (BSC) cables contain a 1,2, or 3 number after "BSC". Examples:
|
This is the legacy cable labeling for the system. Follow the Legacy Cabling instructions below. |
|
If the Base System Chassis (BSC) cables do not contain a number after "BSC". Examples:
|
This is the updated cable labeling for the system. Follow the Updated Cabling instructions below. |
3.1 Legacy Cabling
All cables are labeled on each end. Please use the labels to identify proper cable connections.
Note: The expansion serial number identifies the cables for the group or set of three expansion chassis and not individual chassis serial numbers.
3.1.1 Cable Label Decoder
Blue = Management CAT 6A, RJ45
Yellow = Direct Attach Cable (DAC) - 10/25 Gbe SFP28
White = Mini SAS-HD 8644
| Key | System | Key | System |
|---|---|---|---|
| BSC | Base System Chassis | EXT | External Network |
| B/SEC | Base Server or Expansion Chassis | L | Left |
| SEC | Server Expansion Chassis | R | Right |
| JBOD | JBOD Expansion Chassis | P1 | Port 1 |
| MSW | Management Switch | P1 | Port 2 |
| SW1 | Internal Data Switch 1 | SAS-A | SAS Port A |
| SW2 | Internal Data Switch 2 | CBL18 | Cable Number 18 |
| -B | Bottom | M1 | Management Port 1 |
| -T | Top | N1 | Internal Data Port 1 |
| INT | Internal Network | Expansion SN | Serial Number of the three expansion chassis (not individual chassis) |
Twin Server Connections
JBOD Connections
Data Switch
IPMI Switch Connections
3.1.2 Cabling X200 Servers to Data Switches
All cables are labeled on each end. Please use the labels to identify proper cable connections.
| Assembly | Local Device | Local Port |
Wrap Label (1" X 1") |
Peer Port | Peer Device | Length (m) |
|---|---|---|---|---|---|---|
|
Base Server |
BSC1-B | IPMI | BSC1-B_IPMI:MSW_M1 | M1 | MSW | 2.1 |
| BSC1-T | IPMI | BSC1-T_IPMI:MSW_M2 | M2 | MSW | 2.1 | |
| BSC2-B | IPMI | BSC2-B_IPMI:MSW_M3 | M3 | MSW | 2.1 | |
| BSC2-T | IPMI | BSC2-T_IPMI:MSW_M4 | M4 | MSW | 2.1 | |
| BSC3-B | IPMI | BSC3-B_IPMI:MSW_M5 | M5 | MSW | 2.1 | |
| BSC3-T | IPMI | BSC3-T_IPMI:MSW_M6 | M6 | MSW | 2.1 | |
| BSC1-B | INT-LP1 | BSC1-B_INT-LP1:SW2_N1 | N1 | SW2 | 3 | |
| BSC1-T | INT-LP1 | BSC1-T_INT-LP1:SW2_N2 | N2 | SW2 | 3 | |
| BSC2-B | INT-LP1 | BSC2-B_INT-LP1:SW2_N3 | N3 | SW2 | 3 | |
| BSC2-T | INT-LP1 | BSC2-T_INT-LP1:SW2_N4 | N4 | SW2 | 3 | |
| BSC3-B | INT-LP1 | BSC3-B_INT-LP1:SW2_N5 | N5 | SW2 | 3 | |
| BSC3-T | INT-LP1 | BSC3-T_INT-LP1:SW2_N6 | N6 | SW2 | 3 | |
| BSC1-B | INT-RP1 | BSC1-B_INT-RP1:SW1_N1 | N1 | SW1 | 3 | |
| BSC1-T | INT-RP1 | BSC1-T_INT-RP1:SW1_N2 | N2 | SW1 | 3 | |
| BSC2-B | INT-RP1 | BSC2-B_INT-RP1:SW1_N3 | N3 | SW1 | 3 | |
| BSC2-T | INT-RP1 | BSC2-T_INT-RP1:SW1_N4 | N4 | SW1 | 3 | |
| BSC3-B | INT-RP1 | BSC3-B_INT-RP1:SW1_N5 | N5 | SW1 | 3 | |
| BSC3-T | INT-RP1 | BSC3-T_INT-RP1:SW1_N6 | N6 | SW1 | 3 | |
|
Server Expansion |
SEC1-B | IPMI | SEC1-B_IPMI:MSW_CBL7 | CBL7 | MSW | 2.1 |
| SEC1-T | IPMI | SEC1-T_IPMI:MSW_CBL8 | CBL8 | MSW | 2.1 | |
| SEC2-B | IPMI | SEC2-B_IPMI:MSW_CBL9 | CBL9 | MSW | 2.1 | |
| SEC2-T | IPMI | SEC2-T_IPMI:MSW_CBL10 | CBL10 | MSW | 2.1 | |
| SEC3-B | IPMI | SEC3-B_IPMI:MSW_CBL11 | CBL11 | MSW | 2.1 | |
| SEC3-T | IPMI | SEC3-T_IPMI:MSW_CBL12 | CBL12 | MSW | 2.1 | |
| SEC1-B | INT-LP1 | SEC1-B_INT-LP1:SW2_CBL7 | CBL7 | SW2 | 3 | |
| SEC1-T | INT-LP1 | SEC1-T_INT-LP1:SW2_CBL8 | CBL8 | SW2 | 3 | |
| SEC2-B | INT-LP1 | SEC2-B_INT-LP1:SW2_CBL9 | CBL9 | SW2 | 3 | |
| SEC2-T | INT-LP1 | SEC2-T_INT-LP1:SW2_CBL10 | CBL10 | SW2 | 3 | |
| SEC3-B | INT-LP1 | SEC3-B_INT-LP1:SW2_CBL11 | CBL11 | SW2 | 3 | |
| SEC3-T | INT-LP1 | SEC3-T_INT-LP1:SW2_CBL12 | CBL12 | SW2 | 3 | |
| SEC1-B | INT-RP1 | SEC1-B_INT-RP1:SW1_CBL7 | CBL7 | SW1 | 3 | |
| SEC1-T | INT-RP1 | SEC1-T_INT-RP1:SW1_CBL8 | CBL8 | SW1 | 3 | |
| SEC2-B | INT-RP1 | SEC2-B_INT-RP1:SW1_CBL9 | CBL9 | SW1 | 3 | |
| SEC2-T | INT-RP1 | SEC2-T_INT-RP1:SW1_CBL10 | CBL10 | SW1 | 3 | |
| SEC3-B | INT-RP1 | SEC3-B_INT-RP1:SW1_CBL11 | CBL11 | SW1 | 3 | |
| SEC3-T | INT-RP1 | SEC3-T_INT-RP1:SW1_CBL12 | CBL12 | SW1 | 3 | |
|
JBOD Expansion |
JBOD1-T | SAS-A | JBOD1-T_SAS-A:B/SEC1-T_SAS-A | SAS-A | B/SEC1-T | 1 |
| JBOD1-B | SAS-A | JBOD1-B_SAS-A:B/SEC1-B_SAS-A | SAS-A | B/SEC1-B | 1 | |
| JBOD1-T | SAS-B | JBOD1-T_SAS-B:B/SEC1-T_SAS-B | SAS-B | B/SEC1-T | 1 | |
| JBOD1-B | SAS-B | JBOD1-B_SAS-B:B/SEC1-B_SAS-B | SAS-B | B/SEC1-B | 1 | |
| JBOD2-T | SAS-A | JBOD2-T_SAS-A:B/SEC2-T_SAS-A | SAS-A | B/SEC2-T | 1 | |
| JBOD2-B | SAS-A | JBOD2-B_SAS-A:B/SEC2-B_SAS-A | SAS-A | B/SEC2-B | 1 | |
| JBOD2-T | SAS-B | JBOD2-T_SAS-B:B/SEC2-T_SAS-B | SAS-B | B/SEC2-T | 1 | |
| JBOD2-B | SAS-B | JBOD2-B_SAS-B:B/SEC2-B_SAS-B | SAS-B | B/SEC2-B | 1 | |
| JBOD3-T | SAS-A | JBOD3-T_SAS-A:B/SEC3-T_SAS-A | SAS-A | B/SEC3-T | 1 | |
| JBOD3-B | SAS-A | JBOD3-B_SAS-A:B/SEC3-B_SAS-A | SAS-A | B/SEC3-B | 1 | |
| JBOD3-T | SAS-B | JBOD3-T_SAS-B:B/SEC3-T_SAS-B | SAS-B | B/SEC3-T | 1 | |
| JBOD3-B | SAS-B | JBOD3-B_SAS-B:B/SEC3-B_SAS-B | SAS-B | B/SEC3-B | 1 | |
| JBOD1-B | IPMI | JBOD1-B_IPMI:MSW_CBL13 | CBL13 | MSW | 2.1 | |
| JBOD1-T | IPMI | JBOD1-T_IPMI:MSW_CBL14 | CBL14 | MSW | 2.1 | |
| JBOD2-B | IPMI | JBOD2-B_IPMI:MSW_CBL15 | CBL15 | MSW | 2.1 | |
| JBOD2-T | IPMI | JBOD2-T_IPMI:MSW_CBL16 | CBL16 | MSW | 2.1 | |
| JBOD3-B | IPMI | JBOD3-B_IPMI:MSW_CBL17 | CBL17 | MSW | 2.1 | |
| JBOD3-T | IPMI | JBOD3-T_IPMI:MSW_CBL18 | CBL18 | MSW | 2.1 | |
| MSW | SW1 | N47 | SW1_N47:MSW_N25 | N25 | MSW | 0.5 |
| PDU | PDU | NET | PDU_NET:MSW | MSW | 2.1 |
3.2 Updated Cabling
All cables are labeled on each end. Please use the labels to identify proper cable connections.
3.2.1 Cable Label Decoder
Blue = Management CAT 6A, RJ45
Yellow = Direct Attach Cable (DAC) - 10/25 Gbe SFP28
White = Mini SAS-HD 8644
| Key | System | Key | System |
|---|---|---|---|
| BSC | Base System Chassis | EXT | External Network |
| B/SEC | Base Server or Expansion Chassis | L | Left |
| SEC | Server Expansion Chassis | R | Right |
| JBOD | JBOD Expansion Chassis | P1 | Port 1 |
| MSW | Management Switch | P1 | Port 2 |
| SW1 | Internal Data Switch 1 | SAS-A | SAS Port A |
| SW2 | Internal Data Switch 2 | CBL18 | Cable Number 18 |
| -B | Bottom | M1 | Management Port 1 |
| -T | Top | N1 | Internal Data Port 1 |
| INT | Internal Network | Expansion SN | Serial Number of the three expansion chassis (not individual chassis) |
Twin Server Connections
JBOD Connections
Data Switch
IPMI Switch Connections
3.1.2 Cabling X200 Servers to Data Switches
All cables are labeled on each end. Please use the labels to identify proper cable connections.
| Assembly | Local Device | Local Port |
Wrap Label (1" X 1") |
Peer Port | Peer Device | Length (m) |
|---|---|---|---|---|---|---|
|
Base Server |
BSC-B | IPMI | BSC-B_IPMI:MSW_M1 | M1 | MSW | 2.1 |
| BSC-T | IPMI | BSC-T_IPMI:MSW_M2 | M2 | MSW | 2.1 | |
| BSC-B | INT-LP1 | BSC-B_INT-LP1:SW2_N1 | N1 | SW2 | 3 | |
| BSC-T | INT-LP1 | BSC-T_INT-LP1:SW2_N2 | N2 | SW2 | 3 | |
| BSC-B | INT-RP1 | BSC-B_INT-RP1:SW1_N1 | N1 | SW1 | 3 | |
| BSC-T | INT-RP1 | BSC-T_INT-RP1:SW1_N2 | N2 | SW1 | 3 | |
|
Server Expansion |
SEC-B | IPMI | SEC-B_IPMI:MSW_CBL3 | CBL3 | MSW | 2.1 |
| SEC-T | IPMI | SEC-T_IPMI:MSW_CBL4 | CBL4 | MSW | 2.1 | |
| SEC-B | INT-LP1 | SEC-B_INT-LP1:SW2_CBL3 | CBL3 | SW2 | 3 | |
| SEC-T | INT-LP1 | SEC-T_INT-LP1:SW2_CBL4 | CBL4 | SW2 | 3 | |
| SEC-B | INT-RP1 | SEC-B_INT-RP1:SW1_CBL3 | CBL3 | SW1 | 3 | |
| SEC-T | INT-RP1 | SEC-T_INT-RP1:SW1_CBL4 | CBL4 | SW1 | 3 | |
|
JBOD Expansion |
JBOD-T | SAS-A | JBOD-T_SAS-A:B/SEC-T_SAS-A | SAS-A | B/SEC-T | 1 |
| JBOD-B | SAS-A | JBOD-B_SAS-A:B/SEC-B_SAS-A | SAS-A | B/SEC-B | 1 | |
| JBOD-T | SAS-B | JBOD-T_SAS-B:B/SEC-T_SAS-B | SAS-B | B/SEC-T | 1 | |
| JBOD-B | SAS-B | JBOD-B_SAS-B:B/SEC-B_SAS-B | SAS-B | B/SEC-B | 1 | |
| JBOD-B | IPMI | JBOD-B_IPMI:MSW_CBL5 | CBL5 | MSW | 2.1 | |
| JBOD-T | IPMI | JBOD-T_IPMI:MSW_CBL6 | CBL6 | MSW | 2.1 | |
| MSW | SW1 | N47 | SW1_N47:MSW_N25 | N25 | MSW | 0.5 |
| PDU | PDU | NET | PDU_NET:MSW | MSW | 2.1 |
Step 4: Configure the Switches
The switches should come pre-configured when shipped. The switch LAN ports need to be set to a default so that a configuration file can be uploaded. This configuration should account for the maximum supported on a 1-Geo switch. This setting will most likely cover >75% of the installs. For multi-GEO sites or very big sites with multiple TOR switches, you can modify this configuration as needed
Prerequisite for Switch Configuration
-
RJ45 cable with USB for Windows and USB Type C for MAC.
-
TFTP Server Downloaded on laptop.
-
Putty Installed to connect to the serial port.
Note: Perform this procedure on both data switches
Verify the switches are configured by performing the following:
-
Connect your laptop to the LAN port of the switch you want to verify with the RJ45 CAT 5 network cable.
-
Ping the switch with the following IP address:
-
Data Switch - 192.168.123.123
-
-
Configure the device prompt and admin user:
Switch 1
SMIS# enable
SMIS# config t
SMIS(config)# device name SMIS-TOR1>
- SMIS-TOR1>(config)# username admin password quantum privilege 15
- SMIS-TOR1>(config)# exit
Switch 2
SMIS# enable
SMIS# config t
SMIS(config)# device name SMIS-TOR2>
SMIS-TOR2>(config)# username admin password quantum privilege 15
SMIS-TOR2>(config)# exit
-
If the pings fail, the switches are not configured. Perform the switch configuration procedures below.
Disable Zero Touch Provisioning
It is necessary to disable Zero Touch Provisioning by performing the following:
-
Connect to the console port with the RJ45 serial cable
-
For Mac's use an RJ45 to USB for Windows machine or an RJ45 to USB type C for a MAC.
-
-
Login to switch using the user name and passwords recorded from the label on the bottom of the switches.
-
Enter enable
-
Enter config t
-
Enter ztp disable
-
Enter exit
-
Verify with show system info
Example
Configure the Management IP Address of the Data Switches
Set up the IP address:
enable
config t
ip address 192.168.123.123/24
exit
show ip interface
Sample
Download the Data Switch Configuration Files
-
Connect the network cable to the LAN port on the switch
-
Copy the configuration files from the TFTP server to the switch.
-
Using the TFTP server, download the following configuration files to the TFTP directory on your laptop:
-
SW-TOR1-Column_0_Node1-36.cfg
-
SW-TOR2-Column_0_Node1-36.cfg
-
-
Type the following:
copy tftp://<IP address of laptop>/SW-TOR1-Column_0_Node1-36.cfg flash:SW-TOR1-Column_0_Node1-36.cfg -
Verify the files were copied by typing following:
SMIS-TOR1># list filesFile Name Size Time rcnfsrv.out 3987 Fri Jan 5 00:11:14 2001
rcnfsrv.key 2455 Thu Jan 11 04:08:32 2001 SW-TOR1-Column_0_Node1-36.cfg 5916 Sat Jan 20 01:40:19 2001 iss.conf 4859 Thu Jan 4 23:40:45 2001 lost+found 12288 Mon Jan 1 00:06:42 2001 rcnfsrv.pem 4199 Thu Jan 11 04:08:32 2001
bnm.txt 9980 Thu Jan 11 04:08:38 2001
cmd_his.log 7106 Sat Jan 20 01:40:24 2001
system_log 208 Fri Jan 5 00:10:14 2001
Total Space: 253871 KB
Free Space: 243562 KB
Block size: 1024 and free blocks: 243562
-
Copy from the flash to the start-up configuration
SMIS-TOR1># copy flash:SW-TOR1-Column_0_Node1-36.cfg startup-config -
Display the startup config to verify the correct file
SMIS-TOR1># show startup-configSample Return
SMC_CONFIG_1_0:
#Do not modify above line. All commands have to be below this line.
# ActiveScale TOR-1 SMC Switch SSE-F3548SR
username ADMIN password 04140F1A011853 privilege 15 admin encrypted
interface port-channel 1
exit
# Vlans and hybrid mode member ports configurations
vlan 1000
ports fx 0/37-46 untagged
exit
vlan 10,1000
exit
routing-context tftp-client data-plane
interface Fx 0/1
description ActiveScale Column_0_25G_Node1
switchport mode access
switchport access vlan 1000
interface Fx 0/2
description ActiveScale Column_0_25G_Node2
switchport mode access
switchport access vlan 1000
interface Fx 0/3
description ActiveScale Column_0_25G_Node3
switchport mode access
switchport access vlan 1000
interface Fx 0/4
description ActiveScale Column_0_25G_Node4
switchport mode access
switchport access vlan 1000
interface Fx 0/5
description ActiveScale Column_0_25G_Node5
switchport mode access
switchport access vlan 1000
interface Fx 0/6
description ActiveScale Column_0_25G_Node6
switchport mode access
switchport access vlan 1000
interface Fx 0/7
description ActiveScale Column_0_25G_Node7
switchport mode access
switchport access vlan 1000
interface Fx 0/8
description ActiveScale Column_0_25G_Node8
switchport mode access
switchport access vlan 1000
interface Fx 0/9
description ActiveScale Column_0_25G_Node9
switchport mode access
switchport access vlan 1000
interface Fx 0/10
description ActiveScale Column_0_25G_Node10
switchport mode access
switchport access vlan 1000
interface Fx 0/11
description ActiveScale Column_0_25G_Node11
switchport mode access
switchport access vlan 1000
interface Fx 0/12
description ActiveScale Column_0_25G_Node12
switchport mode access
switchport access vlan 1000
interface Fx 0/13
description ActiveScale Column_0_25G_Node13
switchport mode access
switchport access vlan 1000
interface Fx 0/14
description ActiveScale Column_0_25G_Node14
switchport mode access
switchport access vlan 1000
interface Fx 0/15
description ActiveScale Column_0_25G_Node15
switchport mode access
switchport access vlan 1000
interface Fx 0/16
description ActiveScale Column_0_25G_Node16
switchport mode access
switchport access vlan 1000
interface Fx 0/17
description ActiveScale Column_0_25G_Node17
switchport mode access
switchport access vlan 1000
interface Fx 0/18
description ActiveScale Column_0_25G_Node18
switchport mode access
switchport access vlan 1000
interface Fx 0/19
description ActiveScale Column_0_25G_Node19
switchport mode access
switchport access vlan 1000
interface Fx 0/20
description ActiveScale Column_0_25G_Node20
switchport mode access
switchport access vlan 1000
interface Fx 0/21
description ActiveScale Column_0_25G_Node21
switchport mode access
switchport access vlan 1000
interface Fx 0/22
description ActiveScale Column_0_25G_Node22
switchport mode access
switchport access vlan 1000
interface Fx 0/23
description ActiveScale Column_0_25G_Node23
switchport mode access
switchport access vlan 1000
interface Fx 0/24
description ActiveScale Column_0_25G_Node24
switchport mode access
switchport access vlan 1000
interface Fx 0/25
description ActiveScale Column_0_25G_Node25
switchport mode access
switchport access vlan 1000
interface Fx 0/26
description ActiveScale Column_0_25G_Node26
switchport mode access
switchport access vlan 1000
interface Fx 0/27
description ActiveScale Column_0_25G_Node27
switchport mode access
switchport access vlan 1000
interface Fx 0/28
description ActiveScale Column_0_25G_Node28
switchport mode access
switchport access vlan 1000
interface Fx 0/29
description ActiveScale Column_0_25G_Node29
switchport mode access
switchport access vlan 1000
interface Fx 0/30
description ActiveScale Column_0_25G_Node30
switchport mode access
switchport access vlan 1000
interface Fx 0/31
description ActiveScale Column_0_25G_Node31
switchport mode access
switchport access vlan 1000
interface Fx 0/32
description ActiveScale Column_0_25G_Node32
switchport mode access
switchport access vlan 1000
interface Fx 0/33
description ActiveScale Column_0_25G_Node33
switchport mode access
switchport access vlan 1000
interface Fx 0/34
description ActiveScale Column_0_25G_Node34
switchport mode access
switchport access vlan 1000
interface Fx 0/35
description ActiveScale Column_0_25G_Node35
switchport mode access
switchport access vlan 1000
interface Fx 0/36
description ActiveScale Column_0_25G_Node36
switchport mode access
switchport access vlan 1000
interface range Fx 0/37-46
description ActiveScale Column_0_FUTURE_RESERVED
interface Fx 0/47
description IPMI_1G_Uplink
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Fx 0/48
description Installer_1G_Port
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Cx 0/1
description ActiveScale Column_0_SCALEOUT_100G_TOR1_1
channel-group 1 mode active
interface Cx 0/2
description ActiveScale Column_0_SCALEOUT_100G_TOR1_2
channel-group 1 mode active
interface Cx 0/3
description ActiveScale Column_0_SCALEOUT_100G_TOR1_3
channel-group 1 mode active
interface Cx 0/4
description ActiveScale Column_0_SCALEOUT_100G_TOR1_4
channel-group 1 mode active
interface Cx 0/5
description ActiveScale Column_0_SCALEOUT_100G_TOR1_5
channel-group 1 mode active
interface Cx 0/6
description ActiveScale Column_0_SCALEOUT_100G_TOR1_6
channel-group 1 mode active
interface po 1
description ActiveScale PortChannel_for_Column_0_SCALEOUT_TOR1
mtu 9000
switchport mode trunk
switchport trunk native vlan 10
switchport trunk allowed vlan 10,1000-1127
exit
interface vlan 1000
description ActiveScale Column_0_Private_VLAN1
ip address 172.20.0.200 255.255.255.0
interface vlan 10
description ActiveScale Column_0_SCALEOUT_VLAN1
ip address 172.16.10.1 255.255.255.0
exit
-
Reload the configuration
SMIS-TOR1># reload
This command will reboot the switch.
Do you really want to reboot? [y/n]
Sample Return
Rebooting the switch...
SMIS-TOR1>#
telnet> quit
Connection closed.
installer@quantum-vm-installer:~$ ping 172.20.0.200
-
SMC Data Switch Configuration
Sample Configuration file for Data Switch and Sequence of Steps
1. TOR1 switch needs:
A default config with at least the IP address configured for the Console Port
Uploading Data Switch with a a new config file and reload it as a startup config
===========================================================
SMIS-TOR1># enable
SMIS-TOR1># copy tftp://172.20.0.242/SW-TOR1-Column_0_Node1-36.cfg flash:SW-TOR1-Column_0_Node1-36.cfg
Copied tftp://172.20.0.242/SW-TOR1-Column_0_Node1-36.cfg ==> flash:/cfg/SW-TOR1-Column_0_Node1-36.cfg
SMIS-TOR1># list files
File Name Size Time rcnfsrv.out 3987 Fri Jan 5 00:11:14 2001
rcnfsrv.key 2455 Thu Jan 11 04:08:32 2001 SW-TOR1-Column_0_Node1-36.cfg 5916 Sat Jan 20 01:40:19 2001 iss.conf 4859 Thu Jan 4 23:40:45 2001 lost+found 12288 Mon Jan 1 00:06:42 2001 rcnfsrv.pem 4199 Thu Jan 11 04:08:32 2001
bnm.txt 9980 Thu Jan 11 04:08:38 2001
cmd_his.log 7106 Sat Jan 20 01:40:24 2001
system_log 208 Fri Jan 5 00:10:14 2001
Total Space: 253871 KB
Free Space: 243562 KB
Block size: 1024 and free blocks: 243562
SMIS-TOR1># copy ?
EXEC commands :
copy debug-files {tftp://ip-address/filename}
copy startup-config {flash: filename | tftp://ip-address/filename}
copy {tftp://ip-address/filename startup-config | flash: filename startup-config}
copy {tftp://ip-address/filename | flash: filename} {tftp://ip-address/filename | flash: filename}
SMIS-TOR1># copy flash:SW-TOR1-Column_0_Node1-36.cfg startup-config
Copied flash:/cfg/SW-TOR1-Column_0_Node1-36.cfg ==> startup-config
SMIS-TOR1># show startup-config
SMC_CONFIG_1_0:
#Do not modify above line. All commands have to be below this line.
# ActiveScale TOR-1 SMC Switch SSE-F3548SR
username ADMIN password 04140F1A011853 privilege 15 admin encrypted
interface port-channel 1
exit
# Vlans and hybrid mode member ports configurations
vlan 1000
ports fx 0/37-46 untagged
exit
vlan 10,1000
exit
routing-context tftp-client data-plane
interface Fx 0/1
description ActiveScale Column_0_25G_Node1
switchport mode access
switchport access vlan 1000
interface Fx 0/2
description ActiveScale Column_0_25G_Node2
switchport mode access
switchport access vlan 1000
interface Fx 0/3
description ActiveScale Column_0_25G_Node3
switchport mode access
switchport access vlan 1000
interface Fx 0/4
description ActiveScale Column_0_25G_Node4
switchport mode access
switchport access vlan 1000
interface Fx 0/5
description ActiveScale Column_0_25G_Node5
switchport mode access
switchport access vlan 1000
interface Fx 0/6
description ActiveScale Column_0_25G_Node6
switchport mode access
switchport access vlan 1000
interface Fx 0/7
description ActiveScale Column_0_25G_Node7
switchport mode access
switchport access vlan 1000
interface Fx 0/8
description ActiveScale Column_0_25G_Node8
switchport mode access
switchport access vlan 1000
interface Fx 0/9
description ActiveScale Column_0_25G_Node9
switchport mode access
switchport access vlan 1000
interface Fx 0/10
description ActiveScale Column_0_25G_Node10
switchport mode access
switchport access vlan 1000
interface Fx 0/11
description ActiveScale Column_0_25G_Node11
switchport mode access
switchport access vlan 1000
interface Fx 0/12
description ActiveScale Column_0_25G_Node12
switchport mode access
switchport access vlan 1000
interface Fx 0/13
description ActiveScale Column_0_25G_Node13
switchport mode access
switchport access vlan 1000
interface Fx 0/14
description ActiveScale Column_0_25G_Node14
switchport mode access
switchport access vlan 1000
interface Fx 0/15
description ActiveScale Column_0_25G_Node15
switchport mode access
switchport access vlan 1000
interface Fx 0/16
description ActiveScale Column_0_25G_Node16
switchport mode access
switchport access vlan 1000
interface Fx 0/17
description ActiveScale Column_0_25G_Node17
switchport mode access
switchport access vlan 1000
interface Fx 0/18
description ActiveScale Column_0_25G_Node18
switchport mode access
switchport access vlan 1000
interface Fx 0/19
description ActiveScale Column_0_25G_Node19
switchport mode access
switchport access vlan 1000
interface Fx 0/20
description ActiveScale Column_0_25G_Node20
switchport mode access
switchport access vlan 1000
interface Fx 0/21
description ActiveScale Column_0_25G_Node21
switchport mode access
switchport access vlan 1000
interface Fx 0/22
description ActiveScale Column_0_25G_Node22
switchport mode access
switchport access vlan 1000
interface Fx 0/23
description ActiveScale Column_0_25G_Node23
switchport mode access
switchport access vlan 1000
interface Fx 0/24
description ActiveScale Column_0_25G_Node24
switchport mode access
switchport access vlan 1000
interface Fx 0/25
description ActiveScale Column_0_25G_Node25
switchport mode access
switchport access vlan 1000
interface Fx 0/26
description ActiveScale Column_0_25G_Node26
switchport mode access
switchport access vlan 1000
interface Fx 0/27
description ActiveScale Column_0_25G_Node27
switchport mode access
switchport access vlan 1000
interface Fx 0/28
description ActiveScale Column_0_25G_Node28
switchport mode access
switchport access vlan 1000
interface Fx 0/29
description ActiveScale Column_0_25G_Node29
switchport mode access
switchport access vlan 1000
interface Fx 0/30
description ActiveScale Column_0_25G_Node30
switchport mode access
switchport access vlan 1000
interface Fx 0/31
description ActiveScale Column_0_25G_Node31
switchport mode access
switchport access vlan 1000
interface Fx 0/32
description ActiveScale Column_0_25G_Node32
switchport mode access
switchport access vlan 1000
interface Fx 0/33
description ActiveScale Column_0_25G_Node33
switchport mode access
switchport access vlan 1000
interface Fx 0/34
description ActiveScale Column_0_25G_Node34
switchport mode access
switchport access vlan 1000
interface Fx 0/35
description ActiveScale Column_0_25G_Node35
switchport mode access
switchport access vlan 1000
interface Fx 0/36
description ActiveScale Column_0_25G_Node36
switchport mode access
switchport access vlan 1000
interface range Fx 0/37-46
description ActiveScale Column_0_FUTURE_RESERVED
interface Fx 0/47
description IPMI_1G_Uplink
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Fx 0/48
description Installer_1G_Port
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Cx 0/1
description ActiveScale Column_0_SCALEOUT_100G_TOR1_1
channel-group 1 mode active
interface Cx 0/2
description ActiveScale Column_0_SCALEOUT_100G_TOR1_2
channel-group 1 mode active
interface Cx 0/3
description ActiveScale Column_0_SCALEOUT_100G_TOR1_3
channel-group 1 mode active
interface Cx 0/4
description ActiveScale Column_0_SCALEOUT_100G_TOR1_4
channel-group 1 mode active
interface Cx 0/5
description ActiveScale Column_0_SCALEOUT_100G_TOR1_5
channel-group 1 mode active
interface Cx 0/6
description ActiveScale Column_0_SCALEOUT_100G_TOR1_6
channel-group 1 mode active
interface po 1
description ActiveScale PortChannel_for_Column_0_SCALEOUT_TOR1
mtu 9000
switchport mode trunk
switchport trunk native vlan 10
switchport trunk allowed vlan 10,1000-1127
exit
interface vlan 1000
description ActiveScale Column_0_Private_VLAN1
ip address 172.20.0.200 255.255.255.0
interface vlan 10
description ActiveScale Column_0_SCALEOUT_VLAN1
ip address 172.16.10.1 255.255.255.0
exit
SMIS-TOR1>#
SMIS-TOR1># reload
This command will reboot the switch.
Do you really want to reboot? [y/n]
Rebooting the switch...
SMIS-TOR1>#
telnet> quit
Connection closed.
installer@quantum-vm-installer:~$ ping 172.20.0.200
ports fx 0/37-46 untagged
exit
vlan 10,1000
exit
routing-context tftp-client data-plane
interface Fx 0/1
description ActiveScale Column_0_25G_Node1
switchport mode access
switchport access vlan 1000
interface Fx 0/2
description ActiveScale Column_0_25G_Node2
switchport mode access
switchport access vlan 1000
interface Fx 0/3
description ActiveScale Column_0_25G_Node3
switchport mode access
switchport access vlan 1000
interface Fx 0/4
description ActiveScale Column_0_25G_Node4
switchport mode access
switchport access vlan 1000
interface Fx 0/5
description ActiveScale Column_0_25G_Node5
switchport mode access
switchport access vlan 1000
interface Fx 0/6
description ActiveScale Column_0_25G_Node6
switchport mode access
switchport access vlan 1000
interface Fx 0/7
description ActiveScale Column_0_25G_Node7
switchport mode access
switchport access vlan 1000
interface Fx 0/8
description ActiveScale Column_0_25G_Node8
switchport mode access
switchport access vlan 1000
interface Fx 0/9
description ActiveScale Column_0_25G_Node9
switchport mode access
switchport access vlan 1000
interface Fx 0/10
description ActiveScale Column_0_25G_Node10
switchport mode access
switchport access vlan 1000
interface Fx 0/11
description ActiveScale Column_0_25G_Node11
switchport mode access
switchport access vlan 1000
interface Fx 0/12
description ActiveScale Column_0_25G_Node12
switchport mode access
switchport access vlan 1000
interface Fx 0/13
description ActiveScale Column_0_25G_Node13
switchport mode access
switchport access vlan 1000
interface Fx 0/14
description ActiveScale Column_0_25G_Node14
switchport mode access
switchport access vlan 1000
interface Fx 0/15
description ActiveScale Column_0_25G_Node15
switchport mode access
switchport access vlan 1000
interface Fx 0/16
description ActiveScale Column_0_25G_Node16
switchport mode access
switchport access vlan 1000
interface Fx 0/17
description ActiveScale Column_0_25G_Node17
switchport mode access
switchport access vlan 1000
interface Fx 0/18
description ActiveScale Column_0_25G_Node18
switchport mode access
switchport access vlan 1000
interface Fx 0/19
description ActiveScale Column_0_25G_Node19
switchport mode access
switchport access vlan 1000
interface Fx 0/20
description ActiveScale Column_0_25G_Node20
switchport mode access
switchport access vlan 1000
interface Fx 0/21
description ActiveScale Column_0_25G_Node21
switchport mode access
switchport access vlan 1000
interface Fx 0/22
description ActiveScale Column_0_25G_Node22
switchport mode access
switchport access vlan 1000
interface Fx 0/23
description ActiveScale Column_0_25G_Node23
switchport mode access
switchport access vlan 1000
interface Fx 0/24
description ActiveScale Column_0_25G_Node24
switchport mode access
switchport access vlan 1000
interface Fx 0/25
description ActiveScale Column_0_25G_Node25
switchport mode access
switchport access vlan 1000
interface Fx 0/26
description ActiveScale Column_0_25G_Node26
switchport mode access
switchport access vlan 1000
interface Fx 0/27
description ActiveScale Column_0_25G_Node27
switchport mode access
switchport access vlan 1000
interface Fx 0/28
description ActiveScale Column_0_25G_Node28
switchport mode access
switchport access vlan 1000
interface Fx 0/29
description ActiveScale Column_0_25G_Node29
switchport mode access
switchport access vlan 1000
interface Fx 0/30
description ActiveScale Column_0_25G_Node30
switchport mode access
switchport access vlan 1000
interface Fx 0/31
description ActiveScale Column_0_25G_Node31
switchport mode access
switchport access vlan 1000
interface Fx 0/32
description ActiveScale Column_0_25G_Node32
switchport mode access
switchport access vlan 1000
interface Fx 0/33
description ActiveScale Column_0_25G_Node33
switchport mode access
switchport access vlan 1000
interface Fx 0/34
description ActiveScale Column_0_25G_Node34
switchport mode access
switchport access vlan 1000
interface Fx 0/35
description ActiveScale Column_0_25G_Node35
switchport mode access
switchport access vlan 1000
interface Fx 0/36
description ActiveScale Column_0_25G_Node36
switchport mode access
switchport access vlan 1000
interface range Fx 0/37-46
description ActiveScale Column_0_FUTURE_RESERVED
interface Fx 0/47
description IPMI_1G_Uplink
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Fx 0/48
description Installer_1G_Port
no fec-mode
no negotiation
speed 1000
switchport mode access
switchport access vlan 1000
interface Cx 0/1
description ActiveScale Column_0_SCALEOUT_100G_TOR1_1
channel-group 1 mode active
interface Cx 0/2
description ActiveScale Column_0_SCALEOUT_100G_TOR1_2
channel-group 1 mode active
interface Cx 0/3
description ActiveScale Column_0_SCALEOUT_100G_TOR1_3
channel-group 1 mode active
interface Cx 0/4
description ActiveScale Column_0_SCALEOUT_100G_TOR1_4
channel-group 1 mode active
interface Cx 0/5
description ActiveScale Column_0_SCALEOUT_100G_TOR1_5
channel-group 1 mode active
interface Cx 0/6
description ActiveScale Column_0_SCALEOUT_100G_TOR1_6
channel-group 1 mode active
interface po 1
description ActiveScale PortChannel_for_Column_0_SCALEOUT_TOR1
mtu 9000
switchport mode trunk
switchport trunk native vlan 10
switchport trunk allowed vlan 10,1000-1127
exit
interface vlan 1000
description ActiveScale Column_0_Private_VLAN1
ip address 172.20.0.200 255.255.255.0
interface vlan 10
description ActiveScale Column_0_SCALEOUT_VLAN1
ip address 172.16.10.1 255.255.255.0
exit
-
Reload the configuration
SMIS-TOR1># reload
This command will reboot the switch.
Do you really want to reboot? [y/n]
Sample Return
Rebooting the switch...
SMIS-TOR1>#
telnet> quit
Connection closed.
installer@quantum-vm-installer:~$ ping 172.20.0.200
Edge-Core IPMI Switch Configuration
Edge Core switch passwords
“quantum”: 370757d2df51ae456bf63c165fc71817
“PASSWORD12”: 58e4fe3edf814d1f868e6d16fefb533a
Username: admin
Password:
CLI session with the ECS2100-28T is opened.
To end the CLI session, enter [Exit].
Vty-1#enable
Password:
Vty-1#
Vty-1#
Vty-1#dir
File Name Type Startup Modified Time Size (bytes)
Unit 1:
ECS2100_V1.2.2.29.bixOpCode Y2020-09-21 16:19:5612,574,984Factory_Default_Config.cfgConfig N2020-09-01 08:39:13455SW-IPMI-Column_0_Node1-12.cfgConfig N2020-09-02 10:08:395,121reloadConfig N2020-09-01 08:39:466,470startup1.cfgConfig Y2020-09-01 08:39:496,470Free space for compressed user config files: 18,870,272
Total space: 33,554,432
Vty-1#config
Vty-1(config)#boot ?
system Specifies the image used to start up the system
Vty-1(config)#boot system ?
<1-1>: Unit number
config: Configuration file
opcode: Runtime code
Vty-1(config)#boot system config:SW-IPMI-Column_0_Node1-12.cfg
Flash programming completed.
Success.
Vty-1(config)#dir
^
% Invalid input detected at '^' marker.
Vty-1(config)#exit
Vty-1#dir
File Name Type Startup Modified Time Size (bytes)
Unit 1:
ECS2100_V1.2.2.29.bixOpCodeY2020-09-21 16:19:5612,574,984Factory_Default_Config.cfgConfig N2020-09-01 08:39:13 455SW-IPMI-Column_0_Node1-12.cfgConfig Y2020-09-02 10:08:39 5,121
reloadConfig N2020-09-01 08:39:46 6,470
startup1.cfgConfig N2020-09-01 08:39:49 6,470
-------------------------------------------------------------------------------
Free space for compressed user config files: 18,870,272
Total space: 33,554,432
Vty-1#show running-config
Building running configuration. Please wait...
!<stackingDB>00</stackingDB>
!<stackingMac>01_90-3c-b3-5a-8c-23_03</stackingMac>
—————
Vty-1#copy tftp file
TFTP server IP address: 172.20.0.242
Choose file type:
1. config; 2. opcode: 1
Source file name: SW-IPMI-Column_0_Node1-12.cfg
Destination file name: SW-IPMI-Column_0_Node1-12.cfg
Flash programming started.
Flash programming completed.
Success.
Vty-1#dir
File Name Type Startup Modified Time Size (bytes)
Unit 1:
ECS2100_V1.2.2.29.bixOpCode Y2020-09-21 16:19:5612,574,984Factory_Default_Config.cfgConfig N2020-09-01 08:39:13455SW-IPMI-Column_0_Node1-12.cfgConfig Y2020-09-02 11:22:365,250reloadConfig N2020-09-01 08:39:466,470startup1.cfgConfig N2020-09-01 08:39:496,470Free space for compressed user config files: 18,870,272
Total space: 33,554,432
Vty-1#reload
System will be restarted. Continue <y/n>? y
Vty-1#Connection closed by foreign host.
installer@quantum-vm-installer:~$ ping 172.20.0.181
-
-
If a customer opts to use a 10 Gb/s network on the public facing side of ActiveScale, you will need to force down the network speed on the internal network to 10 Gb/s instead of the default 25 Gb/s speed. This is needed to avoid issues with the NICs not supporting two different network speeds at the same time.
Add the following to each interface definition section in the switch config:
no fec-mode
no negotiation
speed 10000
An interface definition example is below:
interface Fx 0/1
description ActiveScale Column_0_25G_Node1
no fec-mode
no negotiation
speed 10000
switchport mode access
switchport access vlan 1000
-
Verify the switches are configured by performing the following:
-
Reload the switch.
Interconnect1# reload
-
Connect your laptop.
-
