cmti CA Wei Chen Deepak Kataria
//template
Introduction
<Details about Additional tests required for this Blue Print in addition to the Akraino Validation Feature Project>
Akarino Test Group Information
<The Testing Ecosystem>
Testing Working Group Resources
Overall Test Architecture
Describe the components of Test set up
Test Bed
Test Framework
Traffic Generator
Test API description
<Akraino common tests>
The Test inputs
Test Procedure
Expected output
Test Results
<Blueprint extension tests>
The Test inputs
Test Procedure
Expected output
Test Results
<Feature Project Tests>
The Test inputs
Test Procedure
Expected output
Test Results
<BluVal Tests>
The Test inputs
Test Procedure
Expected output
Test Results
Test Dashboards
Single pane view of how the test score looks like for the Blue print.
Total Tests | Test Executed | Pass | Fail | In Progress |
|---|---|---|---|---|
Additional Testing
Bottlenecks/Errata
Introduction
REC Blueprint is deployed and validated in Nokia Espoo and AT&T Middletown Radio Edge Cloud Validation Labs. Deployment of REC and test cases have been run automatically with different clusters such as Nokia OpenEdge, Dell and HP Gen 10. REC feature testing is based on Cloud TAF (Test Automation Framework), which tests basic k8s features. Results of deployments and testing are publicly available in LF Akraino nexus servers.
Overall Test Architecture
Test Bed
Five server cluster with REC software, as described in PCEI Validation Lab
Test Framework
Cloud TAF, robot based test framework for REC https://gerrit.akraino.org/r/gitweb?p=ta%2Fcloudtaf.git;a=summary Note that this Gerrit link is authoritative. In the event of discrepancies between this wiki page and Gerrit, Gerrit is correct. There is no mechanism for automatically updating this wiki page when tests are added to the test suite and no commitment on the part of the developers to do double entry of test cases. The testcases are located in *.robot files in the aptly named "testcases" subdirectory of the cloudtaf repository. The Jenkins servers clone the cloudtaf repo from Gerrit and run whatever tests are contained in it at that time.
Traffic Generator
N/A
Test API description
Test suites:
- post-install (8 test cases)
- kube-namespace (1 test case)
- kube-service (1 test case)
- smoke-tests (6 test cases)
- pm-supports (2 test cases)
...
Test execution logs: https://nexus.akraino.org/content/sites/logs/att/job/Cloudtaf_test_suite_Middletown_OE1/ or https://nexus.akraino.org/content/sites/logs/nokia/job/Cloudtaf_test_suite_Espoo_OE/
Test Dashboards
Single pane view of how the test score looks like for the Blue print.
| Total Tests | Test Executed | Pass | Fail | In Progress |
|---|---|---|---|---|
| 18 | 18 | 18 | 0 | 0 |
Additional Testing
ORAN RIC applications are installed after each REC deployment using Jenkins and results are pushed to LF nexus https://nexus.akraino.org/content/sites/logs/att/job/Install_RIC_on_OpenEdge1/