2021-06-08 - Anuket: Cloud-Native Full Stack Conformance Validation Framework
Topic Leader(s)
@Deepak Kataria
Topic Overview
60 minutes, @Deepak Kataria
BluVal (Blueprint Validation) Framework is a cloud native full stack test automation tool based on a disaggregated and layered approach for test and validation of implementations to ensure conformance. BluVal disaggregates the implementation and associated manifests into their layers and provides automated validation framework to test each layer one by one to achieve end-to-end validation of the implementation. All results are standardized by using Robot Framework which creates an html file of test results that is easy to read and interpret. By virtue of its modular design, the BluVal framework is extensible and provides a simple, declarative test harness for authoring and executing test suites. New functional tests can be written up from scratch in Robot, with simple human-readable commands, or existing upstream tests can be quickly integrated with a few lines of template code that can call any other testing or scripting tool. BluVal framework also provides a portal (User Interface) for viewing executed test result.
Slides & Recording
Slides presented, with live interactive demo, and Q&A.
Cloud-Native Full Stack Conformance Validation Framework.mp4
Agenda
Cloud-Native Full Stack Conformance Validation
Presentation
Demo
Q&A
Next Steps
Attendees
Minutes
Presentation: Refer to slides for details of the following shared:
Deepak presented an overview of the BluVal (Blueprint Validation) Framework, demonstrating a cloud-native full stack test automation tool based on a disaggregated and layered approach for test and validation of cloud implementations to ensure conformance.
Several existing use-cases shared where BluVal is used for validations today: e.g. Radio Edge Cloud, Connected Vehicle, Integrated Clud Native (ICN), etc.
End-to-End automated validation elements comprised of Layers of CD testing from Hardware and OS, to K8S, OpenStack, and Workloads.
CI/CD operates as a standalone, or integrated LF Edge networks for ingesting blueprints for validation, leveraging Jenkins to execute and publish results to a database, viewable from a User Interface (UI).
Value-add discussed for layered approached, allowing users to skip layers if not ready/desired, including performing pre-production workload tests from Unit, to Pre-Prod, to Production deployments.
Platform is versatile and robust to ingest Opensource test-frameworks and harnesses.
Evolutionary roadmap includes integration of Jenkins console for monitoring build executions and results.
Demo
Demo provided of the UI navigation, Registering a Lab, Selecting a Lab, and viewing Results.
Reviewed capability to view results, and drill down into the specific layer executed and failures observed.
Q&A
From Gergely Csatari
Q: Are these RA2 compliant Edge Cloud Deployments?
A: The Edge Cloud deployments shown in the PPT are 'RA2-like', leveraging kubernetes, but have not been tested with RC2 requirements and tests. Future scope includes integrated RC2 scope into BluVal.
From Saad Sheikh
Q: Have we tested some use cases E2E using this (BluVal) like 5G Core Infrastructure at Edge etc?
A: Yes, Radio Edge Cloud blueprints have been tested, which are part of the Telco appliance blueprint family, and Unicycle OVS-DPDK part of Network Cloud blueprint family. Refer to slides for more examples (pp 3-4).
From Cedric Ollivier
Q: Does BluVal use the OPNFV/OVP Database to store results, or another database?
A: It’s another (separate) opensource LF Edge database.
From Saad Sheikh
Q: Kindly can you share detail URL to know about Dis-agg testing details and if possible do you have some results ?
A: Refer to slides for details (pp 10,14).
From Mike Fix
Q: Are there any known limitations with the number of layers which can be utilized?
A: Layers are completely customizable, can be added/removed as needed per blueprint needs, and there are no limitations to the number of layers which can be added and executed.
From Cedric Ollivier
Q: What framework is used for executing and disaggregating testing (e.g. CI, CD)?
A: Jenkins and Robot are used either locally (i.e. independent CI), or within an LF-type deployment CI pipeline for blueprint executions, pushing results, and disaggregating results into the different layers in the database.
Next Steps
Consensus reached by community / attendees that there is value-add to extend the integration of RC2 requirements for Anuket into BluVal, and provides results and observations from that integrated validation.
More specifically, @Deepak Katariato (all opened 6/8 with presentation):
Attendees
@Deepak Kataria(Presenter)
@Michael Fix
@Jim Baker
@Cédric Ollivier
@Gergely Csatari
@Al Morton
Aneesh Kumar
Bala Gopala Krishna Ramanadam
@Georg Kunz
Gurpreet Singh
Hammad Zafar
@Ildiko
Loakeim Samaras
@jie niu
@Kevin Timoney
@Lincoln Lavoie
Manoj Mourya
Michael Pedersen
@Pankaj.Goyal
Quang-Huy Nguyen
Rihab Banday
Rohit Kumar
Saad Sheikh
@Scot Steele
Sirisha Gopigiri
@Sridhar Rao
@Ulrich Kleber
@Walter.kozlowski
Mallory