Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

NetworkIP NetworkVLAN IDDescription
IPMI / Management

10.11.3.0/24

GW: 10.11.3.1

3003Connections to all IPMI interfaces on each server and the switch management interface
Public

10.11.4.0/24

GW: 10.11.4.1

3004Public network (able to reach the Internet), available to each server.

Servers and Switches

The 3 Gigabyte R281-T91 have 3 sets of dual port interfaces:

  • Mellanox Technologies MT27700 on PCI-e expansion slot - two ports on PCI addresses 0000:91:00.0 and 0000:91:00.0 (enp145s0f0 and enp14s0f1)
  • QLogic Corp. FastLinQ QL41000 Series integrated on the main board - two ports on PCI addresses 0000:0c:00.0 and 0000:0c:00.1 (enp12s0f0 and enp12s0f1 or eno1 and eno2)
  • Intel 10G X550T on PCI-e expansion slot - two ports on PCI address 0000:05:00.0 and 0000:05:00.1 (enp5s0f0 and enp5s0f1); not connected at the moment

In the table below, the switch ports for the 3 gigabyte servers are in the following order:

  • Mellanox MT27700 port 1
  • Mellanox MT27700 port 0
  • QLogic FaslinQ QL41000 port 0
  • QLogic FaslinQ QL41000 port 1


The ampere-jumphost2 has the following network interfaces:

  • Mellanox MT27710 on PCI-e expansion slot - two  ports at PCI addresses 0000:01:00.0 and 0000:01:00.1 (enp1s0f0 and enp1s0f1)
  • Intel Gigabit I210 on PCI-e expansion slowt - one port at PCI address 0002:01:00.0 (enP2p1s0); not connected at the moment

In the table below, the switch ports are in the following order:

  • MT27710 port 1
  • MT27710 port 0


Server NameIPMI AddressIPMI VLAN IDPublic Network AddressPublic Network VLAN IDSwitch Port(s)Serial ConnectionOS Installed
gigabyte410.11.3.14300310.11.4.143004gigabyte-edgecore2: left 40Bbe Port 1, right 40Gbe Port 2, left 10Gbe Port 7 Breakout 1,  right 10Gbe Port 7 Breakout 2Async 1/6CentOS 7.6
gigabyte510.11.3.15300310.11.4.153004gigabyte-edgecore2: left 40Bbe Port 3, right 40Gbe Port 4, left 10Gbe Port 7 Breakout 3, right 10Gbe Port 7 Breakout 4Async 1/7Ubuntu 18.04
gigabyte610.11.3.16300310.11.4.163004gigabyte-edgecore2: left 40Bbe Port 5, right 40Gbe Port 6, left 10Gbe Port 8 9 Breakout 1,  right 10Gbe Port 8 9 Breakout 2Async 1/8Ubuntu 18.04
ampere-jumphost210.11.3.18300310.11.4.183004gigabyte-edgecore2: left 10 Gbe Port 9 breakout 43, right 10 Gbe Port 9 breakout 34N/AUbuntu 18.04


Switch NameMgmt AddressVLAN IDSerial ConnectionOS Installed
gigabyte-egdecore210.11.3.93003Async 1/2SONiC

...