Skip to end of banner
Go to start of banner

Testing framework comparison

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

DRAFT (Table to be completed)




TestsuiteVTPOnap-tests...
Projectrepositoryhttps://git.onap.org/testsuite/https://git.onap.org/vnfsdk/refrepo/https://gitlab.com/Orange-OpenSource/lfn/onap/onap-tests
LeaderONAP Integration team (Brian, Yang, Gary, Marco, ..)VNFSDK (Kanag)Orange
Stats (February - may 2019)27 contributors / 95 patches / more than 5 different companies)3 contributors / 20 patches / 2 companies9 contributors / 145 patches/ 3 companies
LanguageRobotFramework, PythonJavaPython
Links

https://wiki.onap.org/display/DW/Robot+Framework+Development+Guide

https://wiki.onap.org/display/DW/Robot+Healthcheck+Tests+on+ONAP+Components

https://wiki.onap.org/pages/viewpage.action?pageId=43386304https://wiki.onap.org/pages/viewpage.action?pageId=6593670&preview=%2F6593670%2F54722733%2Fonap_tests.pdf
Current Usage in ONAP
  • Dublin use cases (e.g. 5G PNF)
  • Tosca verification
  • OOM Gating (LCM tests)
  • Third party VNF onboarding/instantiation
  • Python CLI

Item to do based on MVP pageAutomation Script(s) to on-board VSPYes
Yes
Automation Script(s) to Create VFYes
Yes
Automation Script(s) to Create ServiceYes
Yes
Automation Script(s) to Pre-Load ImageYes
Yes
Automation Script(s) to Submit PreloadsYes
yes
Automation Script(s) to Instantiate VNFYes
Yes
Automation Script(s) to Healthcheck VNFYes
Yes
Automation to create OpenStack resources (via openstacksdk/shade)

Yes
Automation to clean OpenStack resources

Yes
Automation to clean ONAP resources (Module, VNF, service instance)

Yes
Link with VNFREQTSyes

No


DescriptorsTosca support
Yes

No

but reuse of Tosca artifacts provided by SDC for runtime operations


Heat supportYes
Yes
Integration of VVP

Yes

as a linter on patch submission (check all the compliancy of all refrenced heat files) based on ONAP official VVP docker


CI/CD integrationWith jenkins in onapci

though xtesting framework (used also for infrastructure tests - same DB/API used by Dovetail for infra verification)

xtesting-onap with gitlabci for VVP verification on linting + chained-ci for On demand ONAP deployment + test


Results managementgrafana dashboard http://onapci.org/grafana

Based on xtesting, all results pushed to a mongo DB (same than for infrastructure tests)

Several web front end (grafana, Kibana, static web pages) used as dahsboards







  • No labels