This document compiles the release notes for the Gambia release of OPNFV Yardstick.
Date | Version | Comment |
November 9, 2018 | 7.0.0 | Yardstick for Gambia release |
December 14, 2018 | 7.1.0 | Yardstick for Gambia release |
January 25, 2019 | 7.2.0 | Yardstick for Gambia release |
The software delivered in the OPNFV Yardstick Project, comprising the Yardstick framework, and the Yardstick test cases is a realization of the methodology in ETSI-ISG NFV-TST001.
The Yardstick framework is installer, infrastructure and application independent.
This Gambia release provides Yardstick as a framework for NFVI testing and OPNFV feature testing, automated in the OPNFV CI pipeline, including:
For Gambia release, the Yardstick framework is used for the following testing:
The Yardstick framework is developed in the OPNFV community, by the Yardstick team.
Note
The test case description template used for the Yardstick test cases is based on the document ETSI-ISG NFV-TST001; the results report template used for the Yardstick results is based on the IEEE Std 829-2008.
- User Guide: <yardstick:userguide>
- Developer Guide: <yardstick:devguide>
- The Yardstick Docker image: https://hub.docker.com/r/opnfv/yardstick (tag: opnfv-7.0.0)
Context | Description |
Heat | Models orchestration using OpenStack Heat |
Node | Models Baremetal, Controller, Compute |
Standalone | Models VM running on Non-Managed NFVi |
Kubernetes | Models VM running on Non-Managed NFVi |
Note
Yardstick Gambia 7.0.0 adds 1 new Runner, “IterationIPC”.
Runner | Description |
Arithmetic | Steps every run arithmetically according to specified input value |
Duration | Runs for a specified period of time |
Iteration | Runs for a specified number of iterations |
IterationIPC | Runs a configurable number of times before it returns. Each iteration has a configurable timeout. |
Sequence | Selects input value to a scenario from an input file and runs all entries sequentially |
Dynamictp | A runner that searches for the max throughput with binary search |
Search | A runner that runs a specific time before it returns |
Category | Delivered |
Availability | Attacker:
HA tools:
Monitor:
|
Compute |
|
Networking |
|
Parser | Tosca2Heat |
Storage |
|
StorPerf | storperf |
NSB | vFW thoughput test case |
Note
Yardstick Gambia 7.2.0 adds no new test cases.
- (e.g.) OPNFV_YARDSTICK_TCO84 - SPEC CPU 2006 for VM
- (e.g.) OPNFV_YARDSTICK_TC093 - SDN Vswitch resilience in non-HA or HA configuration
This is the seventh tracked release of Yardstick. It is based on following upstream versions:
This is the seventh tracked version of the Yardstick framework in OPNFV. It includes the following documentation updates:
For Gambia 7.2.0, Yardstick was tested on the following scenarios:
Scenario | Apex | Compass | Fuel-arm | Fuel |
---|---|---|---|---|
os-nosdn-nofeature-noha | X | |||
os-nosdn-nofeature-ha | X | |||
os-odl-bgpvpn-noha | X | |||
os-nosdn-calipso-noha | X | |||
os-nosdn-kvm-ha | X | |||
os-odl-nofeature-ha | X | X | ||
os-odl-sfc-noha | X | |||
os-nosdn-ovs-ha | X | |||
k8-nosdn-nofeature-ha | X | |||
k8-nosdn-stor4nfv-noha | X | |||
k8-nosdn-stor4nfv-ha | X |
Test results are available in:
- jenkins logs on CI: https://build.opnfv.org/ci/view/yardstick/
Gambia 7.2.0:
JIRA REFERENCE | DESCRIPTION |
---|---|
YARDSTICK-1512 | [dovetail] split the sla check results into process recovery and service recovery for HA test cases. |
- wiki project page: https://wiki.opnfv.org/display/yardstick/Yardstick
- wiki Yardstick Gambia release planning page: https://wiki.opnfv.org/display/yardstick/Release+Gambia
- Yardstick repo: https://git.opnfv.org/yardstick
- Yardstick CI dashboard: https://build.opnfv.org/ci/view/yardstick
- Yardstick grafana dashboard: http://testresults.opnfv.org/grafana/
- Yardstick IRC channel: #opnfv-yardstick