Guest

Preview Tool

Cisco Bug: CSCvv73735 - Fabric Interconnects reboot one at a time due to policyelem crash.

Last Modified

Oct 12, 2020

Products (1)

  • Cisco Unified Computing System

Known Affected Releases

4.1(1c)

Description (partial)

Symptom:
Under normal operation.


FI-A

Start time: Mon Jul 27 18:24:36 2020
Last election time: Mon Jul 27 18:39:13 2020

FI-B

Start time: Mon Jul 27 18:39:45 2020
Last election time: Mon Jul 27 18:39:51 2020

 
FI-A

Reset Reason for this card:
Image Version : 7.0(3)N2(4.11b)
Reset Reason (LCM): Unknown (0) at time Mon Jul 27 18:21:50 2020
Reset Reason (SW): Reset triggered due to HA policy of Reset (16) at time Mon Jul 27 18:15:15 2020
Service (Additional Info): policyelem hap reset
Reset Reason (HW): Unknown reason (0) at time Mon Jul 27 18:21:50 2020

csone/689579704/20200727191329_intersight_USADCSSUCSFIP04_UCSM.tar/20200727191329_intersight_USADCSSUCSFIP04_UCSM/UCSM_A_TechSupport.tar.gz/sw_techsupportinfo

1 1 1 policyelem 827 2020-07-27 18:12:28
1 1 1 policyelem 489 2020-07-27 18:15:13
1 1 1 policyelem 544 2020-07-27 18:15:15
Service: policyelem hap reset
2020 Jul 27 18:11:59 USADCSSUCSFIP04-A %$ VDC-1 %$ %SYSMGR-2-SERVICE_CRASHED: Service "policyelem" (PID 827) hasn't caught signal 6 (core will be saved).
2020 Jul 27 18:12:03 USADCSSUCSFIP04-A %$ VDC-1 %$ %SYSMGR-2-HAP_FAILURE_SUP_RESET: Service "policyelem" in vdc 1 has had a hap failure
Service: policyelem hap reset
Service: policyelem hap reset
Service: policyelem hap reset
533 S f4c92b57 1 - VU policyelem
533 1773 482 3678 0.33% policyelem
Service: policyelem
Executable: /isan/bin/svc_ifc_policyelem
Service: policyelem
Executable: /isan/bin/svc_ifc_policyelem
Service: policyelem
Executable: /isan/bin/svc_ifc_policyelem
533 147136512 0 762236928 ff97bcc0/ff97bbfc policyelem
Opc:MTS_OPC_MODIFY_ImL1VethIfPolicyelem(436497)

FI date: 2020-07-27
20200727191329_intersight_USADCSSUCSFIP04_UCSM/UCSM_A_TechSupport/sw_techsupportinfo
  `show cores`
  Module     Instance   Process-name       PID       Date(Year-Month-Day Time)  
--------------------------------------------------------------------------------
  ..snip..   2          lines              removed   :                          
  0          1          BC01_IBMC01_grep   990       2020-07-17 13:34:39        
  1          1          policyelem         827       2020-07-27 18:12:28        
  1          1          vntagc             16936     2020-07-27 18:14:16        
  1          1          policyelem         489       2020-07-27 18:15:13        
  1          1          policyelem         544       2020-07-27 18:15:15        

FI date: 2020-07-27
20200727191329_intersight_USADCSSUCSFIP04_UCSM/UCSM_B_TechSupport/sw_techsupportinfo
  `show cores`
  Module     Instance   Process-name   PID       Date(Year-Month-Day Time)  
----------------------------------------------------------------------------
  ..snip..   2          lines          removed   :                          
  1          1          vntagc         16513     2020-05-07 15:58:41        
  1          1          policyelem     826       2020-07-27 18:27:34        
  1          1          vntagc         16933     2020-07-27 18:29:34        
  1          1          policyelem     488       2020-07-27 18:30:19        
  1          1          policyelem     532       2020-07-27 18:30:28        


Core Decoder only shows

RLIMIT (Process Rlimit in MB)
4095.99999904633

Virtual Memory limit (Process Virtual Memory limit in MB)
4095.98828125

Conditions:
UCS-FI-6454

Versions= UCSM: 4.1(1c)A | FI-A: 4.1(1c)A | FI-B: 4.1(1c)A | Catalog: 4.1(1a)T

Issue happens due to memory leak in policyelem service. This service is responsible for handling config commands coming to NXOS. The repeated config commands will cause a leak and process memory to go beyond the allowed limit.
The repeated config change could be due to a link issue or a UCSM FSM stuck in a loop.
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.