Guest

Preview Tool

Cisco Bug: CSCvt11905 - A/A: After ESC failover all management operations can fail

Last Modified

May 31, 2020

Products (1)

  • Cisco Elastic Services Controller

Known Affected Releases

5.0 5.1(0.131)

Description (partial)

Symptom:
After an A/A switchover a configuration change request can be accepted, but no action will result under specific conditions. 

Cause: 

Upon a new leader election (a leader switchover), the ConfD service is started on the new leader node and all previously configured subscriber(s) must reconnect to the new ConfD instance in order to receive new requests.  Under a specific workflow preexisting ConfD listeners are prevented from reconnecting to the new ConfD instance.

How to Identify:

Run command on the leader node, and check the output

 "/opt/cisco/esc/confd/bin/confd --status" 

At the bottom of the output check how many registered cdb client are, it should be 3 pairs (6 total) if the cluster has all 3 VMs. 

registered cdb clients:
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=8 priority=1 path=/esc_system_config
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=11 priority=1 path=/esc_datamodel
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=9 priority=1 path=/esc_system_config
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=10 priority=1 path=/esc_datamodel
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=6 priority=1 path=/esc_system_config
client name: esc_cdb_sub_daemon
type: subscriber
subscriptions:
db=running,twophase id=7 priority=1 path=/esc_datamodel

If the number of the pairs is less than the number of healthy ESC nodes in the cluster the condition has latched.

Conditions:
Based on internal testing the following workflow can latch this condition:
> Fresh deployed local A/A cluster without restart ESC services on all member nodes
> Perform a leader node switchover
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.