Guest

Preview Tool

Cisco Bug: CSCuo80368 - SGSN - Flow control issue observed between LC and PSC card

Last Modified

Feb 04, 2017

Products (1)

  • Cisco ASR 5000 Series

Known Affected Releases

14.0(43)

Description (partial)

Symptom:
Customer reported PSC card switchover from card 10 to card 12 in Noida SGSN. Post switchover, the card Line card 26 behind card 10 was not catering any traffic.

However, there was no service outage or any service degradation.

Conditions:
1.	The PSC card got switchover around 17:22 PM due to hardware failure in card 10 as uncorrectable parity error was detected on RDRAM.
 
[local]NOI-S57-SGSN1-COM# show card diag 10
Monday May 12 21:23:50 IST 2014
Card 10:
  Counters:
    Successful Warm Boots : 1
      (last at Monday May 12 17:26:38 IST 2014)
    Successful Cold Boots : 27
      (last at Saturday December 21 03:23:03 IST 2013)
    Total Boot Attempts   : 0
    In Service Date       : Fri Oct 14 09:23:53 2011 (Estimated)
  Status:
    IDEEPROM Magic Number : Good
    Boot Mode             : Normal
    Card Diagnostics      : Pass
    Current Failure       : None
    Last Failure          : Failure: Device=PSC_NPU_IXP28XX, Reason=NPU_IXP28XX_FAIL, (0x03002743)                                                      <<<<<
      (last at Monday May 12 17:22:59 IST 2014)
    Card Usable           : Yes
 
2.	Post Switchover of the PSC Card from Card 10 to Card 12, Line Card 26 becomes Active & LC Port 26/1, Master in LAG Group 2 is not Catering any Traffic.
 
Monday May 12 21:20:21 IST 2014
                                ------ Average Port Utilization (in mbps) ------
Port   Type                       Current           5min             15min    
                                 Rx      Tx      Rx       Tx       Rx     Tx
----- ------------------------  ------- -------  ------- -------  ------- -------
17/1  10G Ethernet              1178    726      1150    725      1137    716    
19/1  10G Ethernet              1129    734      1123    743      1121    737    
21/1  STM1/OC3 Channelized      0.125   0.242    0.123   0.305    0.138   0.333   
23/1  10G Ethernet              1841    750      1840    735      1807    727    
26/1  10G Ethernet              0       0        0       0        0       0                         <<<< port 26/1 has no traffic
28/1  STM1/OC3 Channelized      0.099   0.120    0.143   0.242    0.131   0.227   
30/1  10G Ethernet              64      1122     67      1102     67      1091   
32/1  10G Ethernet              65      1133     63      1125     62      1111   
 
This is because port has no peer Port LAG State  : 1:No LACP peer
 
 
[local]NOI-S57-SGSN1-COM# show card info 26
Monday May 12 21:21:12 IST 2014
Card 26:
  Slot Type               : LC
  Card Type               : 10 Gig Ethernet Line Card
  Operational State       : Standby                                                            <<<<<
  Redundancy Mode         : Port Mode
  Redundant With          : None
  Framing Mode            : Unspecified
  Last State Change       : Monday May 12 20:11:16 IST 2014
  Administrative State    : Enabled
  Card Lock               : Locked
  Halt Issued             : No
  Reboot Pending          : No
  Upgrade In Progress     : No
  Card Usable             : Yes
  Features                : PCS at 2.5Gbps 
  Single Point of Failure : n/a
  Attachment              : 15 (Packet Services Card 3)
  Temperature             : 44 C (limit 90 C) 
  Voltages                : Good
  Card LEDs               : Run/Fail: Green | Active: Off   | Standby: Green
 
3.	Post card 10 replacement, the LC 26 card started carrying the traffic
 
[local]NOI-S57-SGSN1-COM# show port utilization table
Tuesday May 13 02:10:11 IST 2014
                                ------ Average Port Utilization (in mbps) ------
Port   Type                       Current           5min             15min    
                                 Rx      Tx      Rx       Tx       Rx     Tx
----- ------------------------  ------- -------  ------- -------  ------- -------
17/1  10G Ethernet              306     320      315     330      445     354    
19/1  10G Ethernet              328     354      331     341      458     358    
21/1  STM1/OC3 Channelized      0.069   0.033    0.081   0.110    0.060   0.075   
23/1  10G Ethernet              453     320      465     339      686     366    
26/1  10G Ethernet              382     334      385     343      177     156               <<<<
28/1  STM1/OC3 Channelized      0.061   0.168    0.059   0.221    0.037   0.133   
30/1  10G Ethernet              245     344      231     344      121     443    
32/1  10G Ethernet              237     370      242     363      122     456    
 
 
4.	In the logs below, Port 26/1 is master port for LAG group but it is NOT in distributing state (overall that means that LACP messages are timing out and chassis cannot establish LACP over port 26/1).
 
26/1  Srvc 10G Ethernet              Enabled  -    Up   -        None  LA- 26/1 
           Untagged                  Enabled  Up   -    Active   -     -
           Tagged VLAN   115         Enabled  Up   -    Active   -     -
           Tagged VLAN   117         Enabled  Up   -    Active   -     -
           Tagged VLAN   119         Enabled  Up   -    Active   -     -
           Tagged VLAN   121         Enabled  Up   -    Active   -     -
           Tagged VLAN   123         Enabled  Up   -    Active   -     -
           Tagged VLAN   125         Enabled  Up   -    Active   -     -
           Tagged VLAN   127         Enabled  Up   -    Active   -     -
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.