/
2019-11-27 - [CNTT - RC - 01] - Meeting Agenda and Minutes

2019-11-27 - [CNTT - RC - 01] - Meeting Agenda and Minutes

Owned by Michael Fix
Last updated: Nov 27, 2019 by Mark Beierl

Attendees:

Please add your name in here:

Goals of Meeting/

  • Agenda Bashing
  • Antitrust: 
  • (see below) Confirm agreement on Table of Contents
  • (see below) Chapter Progress by Authors per recent PRs created
  • VNF & Storage Questions (discussion needed & path-forward)
    • Can we run SampleVNF and FuncTest VNF connectivity/validation?  (Owner?)
    • Owner to review StorePerf and start that work in POD10
    • Prototype Plan Status - is this something we can use today in POD10/15? (Trevor)
  • Deployment and Compliance Validation (Cedric) > unless covered in RI discussions
  • RM/RA requirements extraction (Rajesh, Sridhar) > unless covered in RI discussions

*****************************

Table of Contents + Owners:

  • RC: status | issues
    • NFVI
      • Ch01: Introduction: Rajesh, Kanagaraj, Manik (confirmed) - https://github.com/cntt-n/CNTT/pull/658
        • (Refer to PR https://github.com/cntt-n/CNTT/pull/658) 
        • Synopsis
        • Introduction
        • Principles & Guidelines
        • Goals & Objectives
        • Best Practices
        • Verification methodologies
        • Assumptions & Dependencies
        • Results Collation & Presentation
        • Measurements, Monitoring
        • Governance
        • Resources & References

      • Ch02: NFVI E2E C&V Framework Requirements: Cedric, Manik (confirmed) - https://github.com/cntt-n/CNTT/pull/701

        • Methodology
        • Certification Strategy & Vehicle
        • Profiles Reference
        • Compliance, Verification, and Certification
        • Entry & Exit Criteria
        • Frameworks: e.g. Functest (StorePerf, SampleVNF, others?)

      • Ch03: NFVI Test Case Requirements: Georg, Toshi (question)  https://github.com/cntt-n/CNTT/pull/702

        • Assumptions: Automatable, Integrated with CICD tool chain
        • Type of requirement: Bare metal, API, etc
        • Table showing Profile Catalog
        • Identify SW Reference
        • Identify HW Reference
        • Options Available / Configured
        • Extensions Available / Configured

      • Ch04: NFVI TC Traceability to RA Requirements: Rajesh, Dan, Ashok, Deepanshu (confirmed)-  https://github.com/cntt-n/CNTT/pull/703

        • SME: Functest knowledge
        • Define RM/RA-1 Openstack requirements
        • Map Framework to Requirements
    • VNF
      • VNF Prototype Plan - details, dates (Trevor)

      • Ch05: VNF E2E C&V Framework Requirements:  Kanagaraj, Cedric, Shiby (confirmed) -  https://github.com/cntt-n/CNTT/pull/704

        • Methodology
        • Introduction of Golden VNFs &/or Prototype VNFs
        • Certification Strategy & Vehicle
        • Profiles Reference
        • Compliance, Verification, and Certification process
        • Entry & Exit Criteria
        • Frameworks: Functest, SampleVNF, Prototype Family/Class

      • Ch06: VNF Test Case Requirements: Fu Qiao, Yan Yang (confirmed), Chuyi Guo, Kanagaraj, Shiby (confirmed) - https://github.com/cntt-n/CNTT/pull/705

        • Assumptions: Automatable, Integrated with CICD tool chain
        • Developer Deliverables (artifacts)
        • Type of requirement: Bare metal, API, etc
        • Type of Interactions: Extended Topology, Complex (Akraino), Functional, HA, Fault, Interoperability
        • Table showing Performance Profiles
        • Table of VNF Class/Family & Characteristics of Each

      • Ch07: VNF TC Traceability to RM Requirements: Rajesh, Kanagaraj, Yan Yang (confirmed) - https://github.com/cntt-n/CNTT/pull/706

        • SME: Functest knowledge
        • Define RM/RA-1 Openstack requirements
        • Map Framework to Requirements
    • Dev
      • Deployment Validations (Cedric)
      • Ch08: E2E Framework Integration: Cedric, Kanagaraj, Sridhar (question) Yan Yang (confirmed) - https://github.com/cntt-n/CNTT/pull/707
        • Identify Framework Needs, Goals, and Dependencies
        • Define Opensource Integration (OPNFV, OVP, Functest, CVC, others)
        • Provide Automation Toolchain (list, topology, flow)

      • Ch09: NFVI Tests Traceability to TC Requirements: Cedric, Deepanshu (confirmed)- https://github.com/cntt-n/CNTT/pull/708

        • Define RM/RA-1 Openstack requirements
        • Map Framework to Requirements
      • Ch10: VNF Tests Traceability to TC Requirements: Cedric, Liping Zhao (question), Shiby (confirmed) - https://github.com/cntt-n/CNTT/pull/709
        • Define RM/RA-1 Openstack requirements
        • Map Framework to Requirements
      • Ch11: Gap analysis & Development: Cedric, Kanagaraj, Shiby (confirmed) - https://github.com/cntt-n/CNTT/pull/710
        • Test Case Gaps (Analysis)
        • Automation Gaps
        • Open Stack release comparisons (Ocata, Pike, Queens, Stein, etc)


*******************************************************

Status | Milestones:

  • Work-stream
    1. NFVI (Lead = Rajesh, Mike)
      1. Issues:  6 open
      2. PRs: 0 open
      3. Assistance Needed
        • (In progress) 11/13 - Sridhar/Rajesh/Mark shifting ownership to RM/RA 1 team for extraction → Rajesh, work with Mark S., Sridhar  → work in progress
        • (In progress) Manifest validations vs. RA Req → discussed in the RI work stream call, work in progress as AirShip manifests were followed for installs, but confirmation needed to ensure RA requirements have been met; offline discussion happening in email to confirm if manifest require changing
        • Tune the declarative files to meet RA requirements (re-deploy)
      4. Status | Tasks (Work in progress)
        • Receive Lab (date)
        • (In progress) Translate RA requirements to Manifest Needs (See above for Assistance needed)
        • Tune Manifest to match RA requirements (Target End State Lab - POD15) - status of POD 10, then date for POD 15
        • Testing
          1. Prepare automation harness - connectivity, validation (POD10)? – Cedric?
            1. e.g. functest-smoke-cntt was just created. neutron-tempest-plugin-api is already conformed with the current API section.
          2. Create Test Plan
          3. Finalize Test Harness/Framework
          4. Perform Manifest Validations
          5. Results Collection & Normalization
    2. VNF (Lead = Mike)
      1. Issues: 6 open
      2. PRs: 0 open
      3. Assistance Needed
        1. Empirical Validations - VNF Prototype Plan / Strategy
        2. Trevor - details / dates for Network profiles and testing
      4. Status | Tasks (Work in progress)
        1. VNF Prototypes
          • (In Progress) Families Identified
          • (In Progress) Test Requirements Identified

          • Strategy

            1. Use POD10 for Network Intensive. 

            2. Measure stats related to the NFVi datapath capacity.

            3. Goal will be to demonstrate full automation of the environment (continuous deployment) with test cases with some useful test results (continuous testing).
            4. Status?  Then look at adding compute and storage intensive VNFs and identify test cases that map back to CNTT specified capabilities. (Luc, Sridhar, Al, Trevor - creating more detailed plan?).
        2. Testing
          1. Create Test Plan
          2. Finalize Test Harness/Framework
          3. Results Collection & Normalization
    3. Dev (Lead = Cedric)
      1. Issues: 15 total open
      2. PRs: 0 open
      3. Assistance Needed
        1. Deployment Validations and continuous deployment / integration 
      4. Status | Tasks (Work in progress)
        1. Jenkins setup
        2. VNF prototype
          1.  Development
          2. Connectivity to POD15

Notes:

Actions:

  • 11/27 Meeting
    • Owner: All →Review/respond to GitHub issues by    
    • Owner: Rajesh - determine a target date for POD15 installs, taking into consideration POD10 install completion, manifest validations, and API health/smoke tests, being done BEFORE POD15 installs by  
    • Owner: Fu Qiao - identify how to incorporate, or start developing, PDF and SDF co
  • 11/20 Meeting
    • Owner: All →Review/respond to GitHub issues by    
    • Owner: Mark (Victor) - Setup call to start Tracing RM Comp to RC Chapter sections by  
  • 11/13 Meeting
    • Owner: All →Review/respond to GitHub issues by    
    • Owner: Leads - Review / Add Milestones to the Minutes in the Appropriate 'Status | Milestones' section by  
  • 11/06 Meeting
    • Owner: All →Review/respond to GitHub issues by   
  • 10/30 Meeting
    • Owner: All →Review/respond to GitHub issues by  
    • Owner: Rajesh - get current status from Srihdar on POD10 installs, and open a GitHub issue to track the deployment by  
  • 10/23 Meeting
    • Owner: All →Review/respond to GitHub issues by 
    • Owner:  Leads - Assign / work action items by EOW  
    • Owner: Rajesh - Meet w/ Trevor + others to discuss overall CNTT Lab Requirements (needs - e.g. POD10, 15, 17-18 (AirShip), 19-Test Tools, etc) by  
      • Rajesh (host), Trevor, Mark, and Mike - met to discuss the Intel labs and their intended use; acknowledge 10/15/19 are used for CNTT PoC/TargetState/TestTools labs.  17 and 18 are being used by the Airship project, but not CNTT.  Next steps are to research the availability of a 2nd lab within Spirent, and to attend upcoming LF Lab Planning Sessions for future lab needs/support.
    • Owner: Cedric - open a GitHub issue for the setup of the Jenkins hosts for RI validation by  
  • 10/16 Meeting:  Yielded time to RI Kickoff discussions.  Refer to RI meeting notes for 10/16 for details
    • Setup recurring call for RC series starting 10/23
  • 10/9 Meeting
    • Owner: All → Review/respond to GitHub issues by  
    • Owner: Impacted Individuals (Test, Installer, Support) - needing access to POD15, request/receive access by    
    • Owner: Mike - confirm with Cedric O. (Orange) if he will be the "lead" to centralize Implementation & Adoption of Test Hardness/Framework efforts on/by  
    • Owner: Rajesh - confirm with Sridhar (Spirent) if he will be the "lead" to centralize s/w deployments on/by