Smart Data Transaction for CPS R7 Test Documentation
Introduction
This document describes the blueprint test environment for the Smart Data Transaction for CPS blueprint. The test results and logs are posted in the Akraino Nexus at the link below:
https://nexus.akraino.org/content/sites/logs/fujitsu/job/sdt/r7
Akarino Test Group Information
N/A
Testing has been carried out at Fujitsu Limited labs without any Akraino Test Working Group resources.
Overall Test Architecture
Tests are carried out on the architecture shown in the diagram below.
Test Bed
The test bed consists of 4 VMs running on x86 hardware, performing deploy and ci/cd and build and master node roles, two edge nodes on ARM64 (Jetson Nano) hardware, and two sensor nodes on ARM32 (Raspberry Pi) hardware.
Node Type | Count | Hardware | OS |
|---|---|---|---|
CI/CD | 1 | Intel i5, 2 cores VM | Ubuntu 20.04 |
Build | 1 | Intel i5, 2 cores VM | Ubuntu 20.04 |
Deploy | 1 | Intel i5, 2 cores VM | Ubuntu 20.04 |
Master | 1 | Intel i5, 2 cores VM | Ubuntu 20.04 |
Edge | 2 | Jetson Nano, ARM Cortex-A57, 4 cores | Ubuntu 20.04 |
Camera | 2 | H.View HV-500E6A | N/A (pre-installed) |
The Build VM is used to run the BluVal test framework components outside the system under test.
Test Framework
BluVal and additional tests are carried out using Robot Framework.
Traffic Generator
N/A
Test API description
Before running the tests below, ensure that the configuration in the chapter Verifying the Setup of Smart Data Transaction for CPS R7 Installation Guide has been implemented.
CI/CD Regression Tests: Node Setup
This set of test cases confirms the scripting to change the default runtime of edge nodes.
The Test inputs
The test scripts and data are stored in the source repository's cicd/tests/sdt_step2/install/ directory.
Test Procedure
The test bed is place in a state where all nodes are prepared with required software. No EdgeX or Kubernetes services are running.
Execute the test scripts:
robot cicd/tests/sdt_step2/install/
Expected output
The test scripts will change the default runtime of edge nodes from runc to nvidia.
The robot command should report success for all test cases.
Test Results
Nexus URL: https://nexus.akraino.org/content/sites/logs/fujitsu/job/sdt/r7/lfedge-install/14/
Pass (1/1 test case)
CI/CD Regression Tests: Images Build & Push
These test cases verify that the images for EdgeX microservices can be constructed, and pushed to private registry.
The Test inputs
The test scripts and data are stored in the source repository's cicd/tests/sdt_step2/build/ directory.
Test Procedure
The test bed is placed in a state where all nodes are prepared with required software and the Docker registry is running.
Execute the test scripts:
robot cicd/tests/sdt_step2/build/
Expected output
The test scripts will build images of changed services(sync-app/image-app/device-camera), add push the images to private registry.
The robot command should report success for all test cases.
Test Results
Nexus URL: https://nexus.akraino.org/content/sites/logs/fujitsu/job/sdt/r7/lfedge-build/5
Pass (2/2 test cases)
CI/CD Regression Tests: Cluster Setup & Teardown
These test cases verify that the Kubernetes cluster can be initialized, edge nodes added to it and removed, and the cluster torn down.
The Test inputs
The test scripts and data are stored in the source repository's cicd/tests/sdt_step2/cluster/ directory.
Test Procedure
The test bed is placed in a state where all nodes are prepared with required software and the Docker registry is running. The registry must be populated with the Kubernetes and Flannel images from upstream.
Execute the test scripts:
robot cicd/tests/sdt_step2/cluster/