Release Notes SD-WAN 6.8.0 Collector

Below please find the Release Notes for SD-WAN 6.8.0 collector. Please contact your Technical Account Manager (if applicable) or Systems Engineering Team or Support Team to discuss and plan the installation. Thank you for being a customer.

Browser Requirements

Minimum Resolution:1200x768 Browsers:

  • Modern, standards-compliant browser
  • JavaScript enabled
  • Pop-up blocker disabled for hostname/IP

The following browsers are supported in the current versions of SevOne.

Browser

Vendor Family
Google Chrome
Mozilla Firefox
Important: Please use the latest browser version for Chrome and Firefox.

Resources and Requirements

Resource Requirement
SevOne NMS Please refer to Compatibility Matrix below for SevOne NMS versions supported.
Helm 3.11.3
Kubernetes 1.27.1 (for upgrades)
1.27.1 (for new provisioning)
Important: If the installed Kubernetes version in your setup is not supported by SD-WAN collector you are provisioning, you will get an error message. Kubernetes must be upgraded prior to upgrading SD-WAN collector.
SOA >= 6.8.0
Kernel 4.18.0-513.9.1.el8_9.x86_64
Ports Required Please refer to SevOne NMS Port Number Requirements Guide > section Solutions Deployment.
VMware vSphere Client >= 6.5
Signature Tools
  • signature-tools- -build.<###>.tgz
  • signature-tools- -build.<###>.tgz .sha256.txt
For example,
  • signature-tools-v2.0.2-build.1.tgz
  • signature-tools-v2.0.2-build.1.tgz .sha256.txt
Other
File Type Nokia-Nuage Versa Viptela Fortinet VMware
RPM n/a sevonecli-2.6.0-13.el8.x86_64.rpm sevonecli-2.6.0-13.el8.x86_64.rpm n/a n/a
TAR sdwan-nuage-installation-v6.8.0-build.268036.tgz sevone_solutions_sdwan_versa-v6.8.0-build.30.tgz sevone_solutions_sdwan_viptela-v6.8.0-build.44.tgz sdwan-fortinet-installation-v6.8.0-build.5.tgz sdwan-velocloud-installation-v6.8.0-build.3.tgz
CHECKSUM sdwan-nuage-installation-v6.8.0-build.268036.tgz.sha256.txt sevone_solutions_sdwan_versa-v6.8.0-build.30.tgz.sha256.txt sevone_solutions_sdwan_viptela-v6.8.0-build.44.tgz.sha256.txt sdwan-fortinet-installation-v6.8.0-build.5.tgz.sha256.txt sdwan-velocloud-installation-v6.8.0-build.3.tgz.sha256.txt
OVA n/a sevone_solutions_sdwan_versa-v6.8.0-build.30.ova sevone_solutions_sdwan_viptela-v6.8.0-build.44.ova n/a n/a
QCOW2 n/a sevone_solutions_sdwan_versa-v6.8.0-build.30.qcow2.gz sevone_solutions_sdwan_viptela-v6.8.0-build.44.qcow2.gz n/a n/a
ISO n/a sevone_solutions_sdwan_versa-v6.8.0-build.30.iso sevone_solutions_sdwan_viptela-v6.8.0-build.44.iso n/a n/a
VHD n/a sevone_solutions_sdwan_versa-v6.8.0-build.30.vhd.gz sevone_solutions_sdwan_viptela-v6.8.0-build.44.vhd.gz n/a n/a

Facts and Limitations

The following notes are some facts and limitations that you must be aware of.

Important: SevOne NMS versions > 6.8.0 and SevOne Data Insight versions > 6.8 should ideally work with SD-WAN 6.8 unless there is some backward compatibility issue which may prevent it from working.
Important: Viptela Collector: vManage rate limits
The vManage overall rate limit is 450 requests per second. Currently, it has an API route related to device statistics which has a much lower rate limit of 43 requests per minute (or 0.72 requests per second). These rate limits are used as default rates in the Viptela collector configuration.

For the Viptela collector, each Agent has a vManage session.

Please refer to https://developer.cisco.com/docs/sdwan/#!browsing-returned-results-sorting-results-filtering-results-and-rate-limits/understanding-pagination for details.
Important: Viptela Collector: vManage data (Case change for names)
Collector handles the case change scenario for vManage data. Migration script removes the device / object group rules and adds new case-insensitive rules in the next run of deviceDescription / objectDescription agent.

Limitations:
  • Collector handles the case change only and not a complete name change.
  • In case of device name changes, collector does not change the actual device name in SevOne NMS. However, it keeps pushing data in the existing device.
  • In case of site / tenant name changes, collector does not update the device / object group name in SevOne NMS. However, it holds all the devices / objects available in the group.
  • In case of interface name changes, collector does not update the interface, interface queue, or tunnel name. However, it keeps pushing data for that object.
  • Collector does not support a scenario in which the device / interface name is same with a case difference in vManage. For example, device names, abc and ABC are not allowed.
Important: Viptela / Versa Collector
When upgrading the collector from a newly deployed SD-WAN 2.9 or SD-WAN 2.10 OVA to SD-WAN 6.8, please perform the steps mentioned in SD-WAN Viptela Collector Troubleshooting Guide or SD-WAN Versa Collector Troubleshooting Guide > section Upgrade Collector.
Important: Versa Collector
Tunnel data is coming from two different sources (sdwanB2BSlamLog and monStatsLog). Hence, the data gap might be visible in SevOne NMS.
Important: for Fresh Installs or Upgrades
The SOA version on SevOne NMS must be >= 6.8.0 otherwise, the pre-checks will fail. SD-WAN 6.8 package contains (SOA 6.8.0) .rpm file. Execute the following command to upgrade the SOA version on SevOne NMS.

Note: SOA Version
SOA must be on the latest version on all appliances in SevOne NMS cluster. Command Line Interface (CLI) must be used to upgrade SOA on all peers as the graphical user interface (GUI) only upgrades SOA for the NMS appliance you are connected to.

Execute the command to install / upgrade SOA only on NMS' Cluster Master and HSA

$ sevone-cli soa upgrade \
/opt/SevOne/upgrade/utilities/SevOne-soa-*.rpm

Execute the command to install / upgrade SOA on ALL peers in the NMS cluster

$ sevone-cli soa upgrade \
/opt/SevOne/upgrade/utilities/SevOne-soa-*.rpm \
--all-peers

Compatibility Matrix

Collector / Augmenter SevOne NMS / NMS REST API   SOA Version SevOne Data Insight Widget Version
  NMS REST API      
6.8 6.8.0 (T & S)
6.7.0 (T & S)
6.4.0 - 6.6.0 (S)
6.3.1 (T & S)
6.1.0 (S)
2.1.47
2.1.46
2.1.43 - 2.1.45
2.1.42
2.1.40
>= 6.8.0 6.8 (T & S)
6.7 (T & S)
6.5 - 6.6 (S)
3.13 - 3.14 (S)
6.8.0


CONTROLLERS

Nuage Versa Viptela Fortinet VMware
- VSD 20.10.6 / API v5, v6 (T & S)
- VSD 20.10.1 - .5 / API v5, v6 (S)
- VSD 20.5.1 - .3 / API v5, v6 (S)
- VSD 6.0.14 / API v5, v6 (S)
- VSD 6.0.11 / API v5, v6 (S)
- VSD 6.0.9 / API v5, v6 (S)
- VSD 6.0.8 / API v5, v6 (S)
- VSD 6.0.5 / API v5, v6 (S)
- VSD 5.4.1 / API v5 (S)
- VSD 5.2.3 / API v5 (S)
- VSD 5.2.2 / API v5 (S)
- 21.1.4 (T & S)
- 20.2.3 (S)
- 20.2.2 (S)
- 16.1 R2 S11 (S)
- 16.1 R2 S10.1 (S)
- 16.1 R2 S9 (S)
vManage: - 20.11.1.1 (T & S)
- 20.9.1 (S)
- 20.6.4 (T & S)
- 20.6.2.1 (S)
- 20.5.1.2 (S)
- 20.5.1 (S)
- 20.4.1.1 (S)
- 20.3.6 (S)
- 20.3.5 (T & S)
- 20.3.4.1 (S)
- 20.3.4 (S)
- 20.3.3.1 (S)
- 20.3.1 (S)
- 20.1.1 (S)
- 19.2.2 (S)
- 18.3.4 (S)

vEdge:
- 20.9.1 (T & S)
- 20.6.1 - .2 (T & S)
- 18.3.4 (S)

cEdge:
- 17.9.1 (T & S)
- 17.6.02 (T & S)
- 16.9.2 (S)
v7.4.1 FortiManager VMware SASE 5.4.0.0
Minimum resource needed on NMS:
CPU: 4 or more
RAM: 8GB or more
HDD: 20GB or more
Minimum resource needed on NMS:
CPU: 4 or more
RAM: 8GB or more
HDD: 20GB or more
Minimum resource needed on NMS:
CPU: 4 or more
RAM: 8GB or more
HDD: 20GB or more
Fortinet Plugin comes integrated with SevOne NMS. If there are specific NMS hardware sizing requirements, please contact IBM SevOne Support. VMWare Plugin comes integrated with SevOne NMS. If there are specific NMS hardware sizing requirements, please contact IBM SevOne Support.
Note: For additional details on hardware requirements such as, CPUs, RAM, flow limits, number of rack units, etc., for various hardware components, please contact your SevOne Technical Account Manager.
  • T & S - Tested & Supported
  • S - Supported
Note: SevOne Data Insight
  • Please refer to Release Notes SevOne Data Insight for details.

SevOne NMS
  • An administrator-level account in SevOne NMS. This is necessary in order for the SD-WAN Nokia-Nuage Networks Collector to communicate with SevOne NMS REST API.
  • User name and password for the administrator-level account.
  • IP address of the PAS.
  • 20k (vPAS_20K) appliance (minimum requirement).

Useful Guides

From IBM's Documentation Portal (https://www.ibm.com/docs/en/sevone-npm), please refer to the following SD-WAN / SevOne Data Insight guides for details.

SD-WAN Guides

General

  • SD-WAN Collector Widgets for Data Insight Installation / Upgrade Guide
  • SD-WAN Data Insight Widgets User Guide
  • SD-WAN Variables & Report Linking Usage Guide

Fortinet

  • SD-WAN Fortinet Solution Deployment / Configuration Guide

Nokia-Nudge Collector

  • SD-WAN Nokia-Nuage Collector ES / VSD Mandatory Fields Guide
  • SD-WAN Nokia-Nuage Collector Prerequisites & Common Questions
  • SD-WAN Nokia-Nuage Collector Syntax & Semantics / Variable Mappings Guide
  • SD-WAN Nokia-Nuage Networks Collector AMQP Alarms
  • SD-WAN Nokia-Nuage Networks Collector Architecture & Technical Insights / Features Guide
  • SD-WAN Nokia-Nuage Networks Collector Installation Guide

Versa Collector

  • Deployment
    • SD-WAN Versa Collector Prerequisites & Common Questions
    • SD-WAN Versa Collector Pre-Deployment Guide
    • SD-WAN Versa Collector Deployment / Configuration Guide
    • SD-WAN Versa Collector Upgrade Process Guide
  • Troubleshooting
    • Automated Build / Rebuild (Customer) Instructions - SD-WAN Versa Collector
    • SD-WAN Versa Collector Troubleshooting Guide
    • SD-WAN Versa Collector Use-Cases Guide
  • Others
    • SD-WAN Versa Collector Advanced Use-Case Guide
    • SD-WAN Versa Collector Agents Guide
    • SD-WAN Versa Collector Syntax & Semantics / Variable Mappings Guide

Viptela Collector

  • Deployment
    • SD-WAN Viptela Collector Prerequisites & Common Questions
    • SD-WAN Viptela Collector Pre-Deployment Guide
    • SD-WAN Viptela Collector Deployment / Configuration Guide
    • SD-WAN Viptela Collector Upgrade Process Guide
  • Troubleshooting
    • Automated Build / Rebuild (Customer) Instructions - SD-WAN Viptela Collector
    • SD-WAN Viptela Collector Troubleshooting Guide
    • SD-WAN Viptela Collector Use-Cases Guide
  • Others
    • SD-WAN Viptela Collector Advanced Use-Case Guide
    • SD-WAN Viptela Collector Agents Guide
    • SD-WAN Viptela Collector Syntax & Semantics / Variable Mappings Guide
    • SD-WAN Viptela Collector vManage Mandatory Fields Guide

VMware

  • SD-WAN VMware SDWAN Solution Deployment / Configuration Guide

SevOne Data Insight Guides

  • Automated Rebuild (Customer) Instructions
  • SevOne Data Insight Pre-Installation Guide
  • SevOne Data Insight Installation Guide
  • SevOne Data Insight Migrate Operating System & Data Guide
  • SevOne Data Insight Upgrade Process Guide
  • SevOne Data Insight Administration Guide
  • SevOne Data Insight Troubleshooting / Debug / Tools Guide
  • SevOne Data Insight User Guide
  • SevOne Data Insight Appliance Insert
  • SevOne Data Insight GraphQL Guide
  • SevOne Data Insight Report Linking URL Specification Guide

New Features and Enhancements

Operating System migrated from CentOS 7 to RHEL 8.

Resolved Issues

Component/s Key Release Notes
SDWAN Solution, SDWAN-Viptela SC-15201 Viptela Collector: A new configurable variable collectorConfig.vendor.vmanage_api.follow_redirects has been added to enable automatic following of HTTP redirects for vManage API calls. The default value is false.
SDWAN-Viptela SC-15220 Viptela Collector: Site name is now mapped correctly to location-based device groups. After completing the mapping process, kindly remove any incorrectly created sites manually.

2 issues

Known Issues

Warning: FYI
  • The default interval for the updation of the augmenter cache is 24 hours. If a policy is changed or added on vManage, it is necessary to update the cache forcefully to augment the flows correctly. Please run the PolicyParserAgent to update the cache forcefully.
    Note: Applicable to Viptela Collector only.
    • $ kubectl exec <COLLECTOR_POD_ID> -- ./collector-viptela -run PolicyParserAgent
      
    • To find the <COLLECTOR_POD_ID>, execute the following command.
      $ kubectl get pods
      
  • Data gaps might be seen on the graphs in SevOne NMS for indicators of the objects of type SD-WAN Device Health as they are being polled at different timestamps. For example, SevOne NMS shows the data for the following indicators related to SD-WAN Device Health object.
    • memory_utilization
    • disk_utilization
    • cpu_utilization

    When querying data for these indicators from vManage, if the data is missing for any of the indicators, then the data gap might be visible in SevOne NMS.
  • If you are using SevOne NMS version < 5.7.2.23 (without the NMS-75375 hotfix), you may experience an impact on the performance of the collector. At a same time, collectors will not support tunnels > 10k.
  • Widgets
    • When the alternate name is enabled in SevOne Data Insight, Network Topology Widget 2.8.x / 2.9 does not show any tunnels for SD-WAN 2.6 collectors.
Component/s Key Known Issues
SDWAN Cisco Catalyst S1NPM-77665 Viptela Collector: In addition to WAN interfaces, the new IOS-XE also includes support for tunnelxxx interfaces, sharing the same configurations with WAN interfaces. Also, the interface type iana-type-tunnel, associated with interfaces named Tunnelxxx, has been eliminated from the tunnel object creation, as these interfaces were generating unnecessary tunnels on SevOne NMS.
SDWAN Solution, SDWAN-Versa, SDWAN-Viptela SC-10410 Platform: Depending on the scale of the environment, Jaeger may quickly consume its allotted memory and in turn, restart. The maximum allotted memory can be adjusted when Jaeger is enabled.
SDWAN-Versa SC-14485 Versa / Viptela Collectors: After deleting a deployment using the command sevone-cli solutions stop_collector and attempting to reinstall the collector using the sevone-cli solutions reload command, an error is encountered stating provided port is already allocated.

Workaround: Please try to deploy the collector after ~ 10 minutes, as Kubernetes requires some time to clean up stale ports.
SDWAN Solution, SDWAN-Versa SC-14565 Versa Collector: Tunnel objects will be pinned to their respective object groups either after 24 hours or according to the discovery schedule in SevOne NMS.
SDWAN-Viptela SC-14941 Viptela Collector: DeviceDescriptionAgent log displays the following error from SevOne NMS device update API.

Cannot update the device. Device is locked by SevOne-discover-devices.

Workaround: Run DeviceDescriptionAgent on demand after all devices are discovered.
SDWAN-Viptela SC-14992 Viptela / Versa Collectors: When installing / upgrading the collector via GUI, you can proceed to the Upgrade SOA stage in the following scenarios:
  • Without selecting or updating the configuration file (in the Config stage).
  • Even if there are errors in the configuration file (in the Config stage).
SDWAN Solution, SDWAN-Versa SC-15522

Versa Collector: When upgrading the SD-WAN Versa Collector from version 2.15 or later to 6.8, you may encounter the following error.

msg": "Timeout when waiting...

To resolve this issue, perform the following steps:

  1. Login to master node, applicable for both single and multi-node scenarios.
  2. $ sevone-cli playbook reset
  3. $ sudo reboot
  4. $ sevone-cli cluster up
  5. $ sevone-cli playbook postcheck
SDWAN Cisco Catalyst S1NPM-109664 Viptela Collector: When the NEXT_HOP_IP field is not present in a flow, the following fields will be set to Unknown.
  • Wan Path Source (4323)
  • Wan Path Source Alternate Name (4354)
  • Wan Path Destination (4323)
  • Wan Path Destination Alternate Name (4355)
  • Tunnel (4353)
  • Tunnel Alternate Name (4356)
SDWAN Cisco Catalyst S1NPM-109666 Platform: Flow data loss due to DeviceDescriptionAgent failure resulting in PolicyParserAgent and NextHopTableAgent stop running as well.

Workaround:

# Identify redis master pod, if below command returns role:master then its master 
$ kubectl exec -it solutions-sdwan-viptela-redis-node-0 -- redis-cli info | grep role
Defaulted container "redis" out of: redis, sentinel
role:master

$ kubectl exec -it solutions-sdwan-viptela-redis-node-1 -- redis-cli info | grep role
Defaulted container "redis" out of: redis, sentinel
role:slave

$ kubectl exec -it solutions-sdwan-viptela-redis-node-2 -- redis-cli info | grep role
Defaulted container "redis" out of: redis, sentinel
role:slave

# Run below command in redis master pod
# Get last run stat for InstallerAgent
$ kubectl exec -it solutions-sdwan-viptela-redis-node-0 -- redis-cli hget "agentStat:lastRun" InstallerAgent
Defaulted container "redis" out of: redis, sentinel
"1718630725161"

# Use above timestamp and set value for DeviceDescriptionAgent
$ kubectl exec -it solutions-sdwan-viptela-redis-node-0 -- redis-cli hset agentStat:lastRun DeviceDescriptionAgent 1718630725161
Defaulted container "redis" out of: redis, sentinel
(integer) 0

# Check if it is updated
$ kubectl exec -it solutions-sdwan-viptela-redis-node-0 -- redis-cli hgetall "agentStat:lastRun"
Defaulted container "redis" out of: redis, sentinel
 1) "MigrationAgent"
 2) "1718630708228"
 3) "InstallerAgent"
 4) "1718630725161"
 5) "DeviceHealthAgent"
 6) "1718283934477"
 7) "InterfaceStatAgent"
 8) "1718283935780"
 9) "TunnelStatAgent"
10) "1718283938045"
11) "DeviceDescriptionAgent"
12) "1718630725161"

# Run PolicyParserAgent
$ sevone-cli solutions run_agent --deployment_name solutions-sdwan-viptela  --agent_name PolicyParserAgent  --log_level info

# Run NextHopTableAgent
$ sevone-cli solutions run_agent --deployment_name solutions-sdwan-viptela  --agent_name NextHopTableAgent  --log_level info 
SDWAN Cisco Catalyst S1NPM-110676 Viptela Collector: Upgrading the collector from version 6.7.5 or above to Red Hat Enterprise Linux (RHEL) versions 6.8 or above fails with the error No package matching 'convert2rhel' found because the yum metadata still refers to the previously installed CentOS package.

Workaround: Run the following command and repeat the upgrade process. For more details, please refer to SD-WAN Viptela Collector Upgrade Process Guide.
$ sudo yum clean metadata
SDWAN Solution S1NPM-112181

Interface statistics are not generated for the sub-interfaces; an expected behavior from Cisco. sdwan::device-interface objects for interfaces are created to provide interface statistics datapoints.


Since the mapping is performed for interface objects available in SevOne NMS, the ifIndex is not renamed to interface name for the sub-interfaces in SevOne NMS > Administration > Flow Configuration > Flow Interface Manager.

SDWAN Solution S1NPM-112216 The requester ID's data source is used to load the OOTB report during the post-check process. However, if multiple users are present in SevOne Data Insight, the post-check task that loads OOTB reports is expected to fail.

Workaround:

By following these steps, you should be able to retrieve the requester's user datasource, update the post-checks, and complete the post-check process without any errors.

  1. Create a backup of the current version of client.py file.
    
    $ cp /opt/SevOne/upgrade/ansible/playbooks/roles/reports/files/di_client/client.py \
    /opt/SevOne/upgrade/ansible/playbooks/roles/reports/files/di_client/client.py.bkp
  2. Run the following command to obtain the token.
    
    $ curl -X POST -L -k 'http://<hostname>/retinaserver' --header 'Content-Type: application/json' \
    --data-raw '{"query":"mutation($user:String!, $password:String!, $tenant:String!)
    {\nauthenticate(name: $user, password: $password, tenant: $tenant){\nsuccess\ntoken\n}\n}",
    "variables":{"user":"<user>","password":"<password>","tenant":"<tenant>"}}'
    Note:

    where,

    • <hostname> - collectorConfig.di.api[0].host in the config file
    • <user> - collectorService.di.api.username in the config file

      Run the following command to obtain the decoded username.

      
      $ echo -n <base64 encoded SevOne Data Insight username> | base64 --decode
    • <password> - collectorService.di.api.password in the config file

      Run the following command to obtain the decoded password.

      
      $ echo -n <base64 encoded SevOne Data Insight password> | base64 --decode
    • <tenant> - collectorConfig.di.api[0].tenant in the config file
  3. Run the following command, replacing <token> with the token obtained from the previous step.
    
    $ curl -X POST -L -k 'http://<hostname>/retinaserver' --header 'x-auth-token:<token>' \
    --header 'Content-Type: application/json' \
    --data-raw '{"query":"query getAllDatasources {\n users {\n  tenant {\n   datasources {\n    id\n    name\n    address\n   }\n  }\n }\n}","variables":"{}"}'
  4. Based on the output from the previous step, locate the entry where the datasources key is not None and take note of its index. If the output resembles the example below, the index is 1.

    Example:

    
    Output:
    
    [{'tenant': None},
    
    {'tenant': {'datasources': [{'id': 4, 'name': 'device01', 'address': 'http://example.net'}]}}},
    
    {'tenant': None}]
    
  5. Run the following command, replacing <your index here> with the index obtained from the previous step.
    
    $ sed -i "s/data = result\['data'\]\['users'\]\[0\]/data = result\['data'\]\['users'\]\[<your index here>\]/" \
    /opt/SevOne/upgrade/ansible/playbooks/roles/reports/files/di_client/client.py
  6. Rerun the post-check.
    $ sevone-cli playbook postcheck

The task Execute script to load the OOTB report has now completed successfully.

SDWAN Versa S1NPM-112339 Versa Collector: When upgrading a single-node or multi-node Versa setup from version 6.8.x or later to 7.1.x, executing the command below may trigger an error, which is an expected behavior.
$ /usr/local/sbin/SevOne-validate-image \
-i $(ls -Art /opt/SevOne/upgrade/sevone_solutions_sdwan_versa-*.tgz | tail -n 1) \
-s $(ls -Art /opt/SevOne/upgrade/sevone_solutions_sdwan_versa-*.tgz.sha256.txt | tail -n 1) \
--installer solutions  --installer-opts '--no_screen'

Error:

TASK [helm upgrade/install default/solutions-sdwan-versa] ***************************************************************************
fatal: [sevonek8s]: 
FAILED! => {"changed": true, "cmd": "helm upgrade solutions-sdwan-versa local/solutions-sdwan-versa -o json --install --create-namespace --namespace default --timeout=5m --insecure-skip-tls-verify --devel --atomic  -f /tmp/ansible.wLFGEx/solutions-sdwan-versa_custom_guii.yaml  \n", "delta": "0:10:02.543798", "end": "2023-03-27 02:44:03.478942", "msg": 
"non-zero return code", "rc": 1, "start": "2023-03-27 02:34:00.935144", "stderr": "W0327 02:34:02.451394  997524 warnings.go:70] spec.template.spec.containers[0].env[7].name: duplicate name \"MINER_DATA_SOURCE\"\nW0327 02:34:02.712946  997524 warnings.go:70] spec.template.spec.containers[0].env[4].name: 
duplicate name \"SECRETS_API_NAME\"\nW0327 02:39:03.266490  997524 warnings.go:70] spec.template.spec.containers[0].env[7].name: duplicate name \"MINER_DATA_SOURCE\"\nW0327 02:39:03.348819  997524 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"\nError: 
UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release solutions-sdwan-versa failed: timed out waiting for the condition", "stderr_lines": ["W0327 02:34:02.451394  997524 warnings.go:70] spec.template.spec.containers[0].env[7].name: 
duplicate name \"MINER_DATA_SOURCE\"", "W0327 02:34:02.712946  997524 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"", "W0327 02:39:03.266490  997524 warnings.go:70] spec.template.spec.containers[0].env[7].name: duplicate name \"MINER_DATA_SOURCE\"", "W0327 02:39:03.348819  997524 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"", 
"Error: UPGRADE FAILED: an error occurred while rolling back the release. original upgrade error: timed out waiting for the condition: release solutions-sdwan-versa failed: timed out waiting for the condition"], "stdout": "", "stdout_lines": []}

Workaround: Run the commands as shown below and proceed with the upgrade process.
$ ssh sevone@<SD-WAN collector 'control plane' node IP address or hostname>
$ sevone-cli cluster down
$ sevone-cli cluster up
SDWAN Cisco Catalyst S1NPM-112561 Viptela Collector: When upgrading a multi-node Viptela setup from version 6.8.x or later to 7.1.x, executing the command below may trigger an error, which is an expected behavior.
$ /usr/local/sbin/SevOne-validate-image \
-i $(ls -Art /opt/SevOne/upgrade/sevone_solutions_sdwan_viptela-*.tgz | tail -n 1) \
-s $(ls -Art /opt/SevOne/upgrade/sevone_solutions_sdwan_viptela-*.tgz.sha256.txt | tail -n 1) \
--installer solutions  --installer-opts '--no_screen'
Error:

TASK [helm : helm upgrade/install default/solutions-sdwan-viptela] *****************************************************
fatal: [sevonek8s]: FAILED! =>

{"changed": true, "cmd": "helm upgrade solutions-sdwan-viptela local/solutions-sdwan-viptela -o json --install --create-namespace --namespace default --timeout=5m --insecure-skip-tls-verify --devel --atomic  -f /tmp/ansible.phf6sgc1/solutions-sdwan-viptela_custom_guii.yaml   --set=multiTenant=False\n",
 "delta": "0:05:36.590937", "end": "2024-09-25 11:39:10.474620",
 "msg": "non-zero return code", "rc": 1, "start": "2024-09-25 11:33:33.883683",
 "stderr": "W0925 11:33:47.000633 1465726 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"\nW0925 11:38:48.180808 1465726 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"\nError: UPGRADE FAILED: release solutions-sdwan-viptela failed, and has been rolled back due to atomic being set: context deadline exceeded",
 "stderr_lines": ["W0925 11:33:47.000633 1465726 warnings.go:70] spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"", "W0925 11:38:48.180808 1465726 warnings.go:70]spec.template.spec.containers[0].env[4].name: duplicate name \"SECRETS_API_NAME\"", "Error: UPGRADE FAILED: release solutions-sdwan-viptela failed, and has been rolled back due to atomic being set: context deadline exceeded"],
 "stdout": "", "stdout_lines": []}

Workaround: Rerun the command above and proceed with the upgrade process. Refer to SD-WAN Viptela Collector Upgrade Process Guide.

14 issues