Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Goals

Help user to understand the test behavior, and analyze the performance results from logs generated by VSPERF and Alert-Management solution to send alerts that will be notified to VSPERF.

...

Week

Activity

Week 1 - Week 3


  •  Deployment of Stable EFK StackStack (containers)
  •  Setting up Fluentd in client node 1 & 4 in POD12
  •  Receive, Process and Visualize Logs - BM
  • &  Receive, Process and Visualize Logs - OS

Week 4 - Week 6


  •  Deployment of K8s Cluster
  •  HA Deployment of EFK Stack in K8s
  •  Configure and Test Alerts
  •  Custom Handling of the Alerts
  •  Create Visualization of the alerts
  • Alerts - BM
  •  Configure and Test Alerts - OS
Week 7 - Week 9
  •  Automated deployment using Ansible
  •  Log Analysis - Trend/Pattern - BM & OS
  •  Log Analysis - Anamoly Detection - BM & OS
  •  Enhance the solution for K8S Logs
Week 10 - Week 12
  •  Release Complete Log-Analysis solution
  •  Log Analysis - Custom Analytics

Deliverables

...

  • Client-Side Ansible Playbook:
    • Deploy and Configure agents (Fluentd)
  • Server-Side Ansible playbooks
    • Deploy K8S Cluster
    • Deploy and configure EFK stack
    • Alerting Configuration
  • Jupyter Notebooks
    • Logs Analysis
  • Visualization and alert management in OPNFV airship.

Evaluation Criteria

  • 1st Evaluation (end of week 3):  Deploy EFK stack, setup fluentd in node 1 & 4 in POD 12 client node  and analyse logs coming from BM & OS.

  • 2nd Evaluation (end of week 6):  Configure  Deployment of K8s Cluster, HA Deployment of EFK Stack in K8s, Configure, Test and create visualization of Alerts

  • 3rd Evaluation (end of week 9):  Log Analysis, Anamoly Detection and enhancing the solution for K8S logs

  • Final Evaluation (end of week 12):  Custom analytics and complete Release of  Log Analysis

Deliverables not Completed

  • Visualization and alert management in OPNFV airship (OS)
    • Unfortunately the OPNFV-Airship deployments were not stable and the LMA components of the Airship constantly crashed.
    • OPNFV-Airship team could not fix the issues.


Results

            Image Added

  • Deployment

           Image Added

  • Elasticsearch

            Image Added

  • Jupyter-Notebook

          Image Added

Final Report

View file
nameLF Networking Mentorship - Log Analysis and Alerting.pdf
height250