Guest

Preview Tool

Cisco Bug: CSCuw28284 - Reserved RFD leak during forwarding shd trigger NPfastReset for recovery

Last Modified

Aug 08, 2018

Products (1)

  • Cisco ASR 9000 Series Aggregation Services Routers

Known Affected Releases

5.3.1.LC

Description (partial)

Symptom:
Ingress NP3 on 2*100GE typhoon LC was dropping packets for long time at PARSE_FAST_DISCARD_LOW_PRIORITY_DROP counters: 

[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_0: 2872526839
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_0: 2872526839
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_1: 2874687659
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_1: 2874687659
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_2: 2873805447
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_2: 2873805447
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_3: 2872603712
[np:NP3] PARSE_FAST_DISCARD_LOW_PRIORITY_DROP_3: 2872603712

and there was also huge increase in PARSE_UNKNOWN_DIR_3 counters on the affected NP: 


Show global stats counters for NP3, revision v2

Read 61 non-zero NP counters:
Offset  Counter                                         FrameValue   Rate (pps)
-------------------------------------------------------------------------------
  16  MDF_TX_LC_CPU                                       64275880           4
  21  MDF_TX_FABRIC                                 42156033198363           0
  29  PARSE_INTER_NP_RECEIVE_CNT                            113362           0
  37  PARSE_INTR_RECEIVE_CNT                            1726679278         517
  41  PARSE_INJ_RECEIVE_CNT                                  54984           0
  45  PARSE_ENET_RECEIVE_CNT                        42156109136879           0
  49  PARSE_TM_LOOP_RECEIVE_CNT                           15940858           5
  59  PARSE_UNKNOWN_DIR_2                                    24637           0
  60  PARSE_UNKNOWN_DIR_3                             371604897501           0

Conditions:
Reserved RFD leak into free pool just prior the drops started:

show prm server trace init location 0/4/CPU0:

prm_server/error 0/4/CPU0 t1  prm_rfd_leak_detector_core_check: Reserved RFD memory error in NP3: RFD[70] leaked into free pool
prm_server/error 0/4/CPU0 4329# t1  prm_rfd_leak_detector_core_check: Reserved RFD memory error in NP3: Reserved RFD[70] leaked into free pool

No trigger is know at the time: No config change, no unexpected message in logs, no change in traffic pattern that has been successfully transmitted for long months on the LC
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.