Overview

The ThunderX2 Pod 1 consists of 3 Arm®v8 based Gigabyte R281-T91 servers and 1 Ampere HR330A jumphost server with the following specifications per server:

...

2x 10Gbe SFP+ (connected)

1x 1Gbe BASE-T (not connected)

1x IPMI / Lights-out Management

Usage & Users

Blueprint(s) / Description(s): 

Primary Contact: 

Secondary Contact: 

Server Access

For the meantime when you request access to the Akraino Pods at UNH-IOL we will ask that you send us your public ssh key so we can add it to the root users of those machines.

If you wish to have your own user we can get that setup, but it is much quicker and easier if you just stick with the root user

IPMI Access

Once you have successfully connected to the VPN there is a file located in each machine in /opt called ipmi_info.txt, this file has the username and password for the IPMI interfaces.

IMPORTANT:

Please write down the information or copy the file somewhere safe in case of the machines getting reinstalled and the file will be gone. We are trying to prevent sending emails with passwords in them. If for some reason you did not have this info before it got wiped you can email akraino-lab@iol.unh.edu and we will help you by making a new file in the machines with the IPMI username and password.

You can access an IPMI interface like the example below:

gigabyte1-ipmi.akr.iol.unh.edu

Then enter the username and password provided from the file in /opt and now you can manage the system on your and will even be able to add your own public keys in the event of a reinstall of the machine.

If you have any issues with any of the IPMI interfaces please email akraino-lab@iol.unh.edu and we will assist you in anyway we can.

Networking

The networking within the pod is currently provided by a 10Gbe BASE-T switch, which only supports static configurations (i.e. no SDN control).  This switch will be replaced with an Edgecore 7816-64X that is currently on order, along with 40Gbe NICs to be installed on each server.

...

10.11.3.0/24

GW: 10.11.3.1

...

10.11.4.0/24

GW: 10.11.4.1

...

Image Removed

Servers and Switches

The 3 Gigabyte R281-T91 have 3 sets of dual port interfaces:

• Mellanox Technologies MT27700 on PCI-e expansion slot - two ports on PCI addresses 0000:91:00.0 and 0000:91:00.0 (enp145s0f0 and enp14s0f1)
• QLogic Corp. FastLinQ QL41000 Series integrated on the main board - two ports on PCI addresses 0000:0c:00.0 and 0000:0c:00.1 (enp12s0f0 and enp12s0f1 or eno1 and eno2)
• Intel 10G X550T on PCI-e expansion slot - two ports on PCI address 0000:05:00.0 and 0000:05:00.1 (enp5s0f0 and enp5s0f1); not connected at the moment

In the table below, the switch ports for the 3 gigabyte servers are in the following order:

• Mellanox MT27700 port 1
• Mellanox MT27700 port 0
• QLogic FaslinQ QL41000 port 0
• QLogic FaslinQ QL41000 port 1

The ampere-jumphost2 has the following network interfaces:

• Mellanox MT27710 on PCI-e expansion slot - two  ports at PCI addresses 0000:01:00.0 and 0000:01:00.1 (enp1s0f0 and enp1s0f1)
• Intel Gigabit I210 on PCI-e expansion slowt - one port at PCI address 0002:01:00.0 (enP2p1s0); not connected at the moment

In the table below, the switch ports are in the following order:

• MT27710 port 1
• MT27710 port 0

...

Refer to this page for the latest documentation: https://wiki.lfedge.org/display/LE/ThunderX2+Pod+2