Shared by Tol.Luangsrinhotha@Quantum.com/SPS:

 

 

 Hi Team,

 

Just wanted to share – the Mellanox 40/56GbE HCA that we ship as an option for the Xcellis WFD/WFE does not come with sfp’s or cables.  Was not able to find this info from any of the Xcellis or Mellanox install/config guides. 

 

From Dan Byers:

Quantum does not offer an optical QSFP for this card. Only direct attached copper cables are offered by Quantum and need to be purchased separately.

This decision was made by the SN appliance core team when we released this 40G card on the SN 5.4 release.

I believe the cable kit P/N is 8-01743-01.

It’s a different world with 40G Ethernet. Unless it’s a Mellanox or Dell 40G QSFP then chances are the card is shutting down the port because it does not recognize the QSFP.  

------

 

We had an incident where customer installed the Xcellis hardware and PS went out to configure and couldn’t get links to the 40Gig ports and found that the installed sfp was incompatible.  SES is working to get a compatibility guide from engineering. 

Example - left one does not work and right one works:

 

 

From the site planning guide:

InfiniBand network connections require either IB cables with QSFPs built

into the cables, or QSFPs installed in

the InfiniBand ports connected to

InfiniBand cables.

 

 

Thanks,

Tol