Guest

Preview Tool

Cisco Bug: CSCvs68136 - Unknown trigger caused the pri and sub FC interfaces to update connectivity and gracefully reboot.

Last Modified

Oct 10, 2020

Products (1)

  • Cisco Unified Computing System

Known Affected Releases

3.2(3h)A

Description (partial)

Symptom:
Outage occurred when unknown trigger caused the pri and sub FC interfaces to update connectivity and gracefully reboot.

6332-16UP (in MST)

Creation Time: 2019-12-20T04:45:50.197
ID: 10444252
Description: [FSM:STAGE:ASYNC]: Uplink fc port configuration on A(FSM-STAGE:sam:dme:SwFcSanBorderDeploy:UpdateConnectivity)
Affected Object: sys/switch-A/border-fc
Trigger: Special
User: internal
Cause: Transition
Code: E4195286

portAG:

[INFO][0x73c906d0][Dec 20 04:45:49.520][app_sam_portAG:SC_noti] Intf: fc 1/1, New state: 3, reason: Gracefully shutdown
[INFO][0x73c906d0][Dec 20 04:45:50.171][app_sam_portAG:SC_noti] Intf: fc 1/2, New state: 3, reason: Gracefully shutdown
[INFO][0x73c906d0][Dec 20 04:45:50.176][app_sam_portAG:SC_noti] Intf: fc 1/3, New state: 3, reason: Gracefully shutdown
[INFO][0x73c906d0][Dec 20 04:45:51.462][app_sam_portAG:SC_noti] Intf: fc 1/4, New state: 3, reason: Gracefully shutdown
[INFO][0x73c906d0][Dec 20 04:45:51.467][app_sam_portAG:SC_noti] Intf: san-port-channel 3, New state: 3, reason: Gracefully shutdown


Corresponding 9396S MDS (in UTC)

2019 Dec 20 11:45:43 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: TX Credit Not Available has reached the rising threshold (port=fc1/13 [0x100c000], value=40) .
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-FOP_CHANGED: port-channel3: first operational port changed from fc1/13 to fc1/14
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-PORT_DOWN: port-channel3: fc1/13 is down
2019 Dec 20 11:45:44 ***MDS-A** %PORT-5-IF_DOWN_LINK_FAILURE: %$VSAN 20%$ Interface fc1/13 is down (Link failure Link reset failed due to timeout) port-channel3 ****fia002_FIA_1/1 
2019 Dec 20 11:45:44 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: Credit Loss Reco has reached the rising threshold (port=fc1/13 [0x100c000], value=1) .
2019 Dec 20 11:45:44 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: TX Credit Not Available has reached the rising threshold (port=fc1/14 [0x100d000], value=80) .
2019 Dec 20 11:45:44 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: TX Credit Not Available has reached the rising threshold (port=fc1/15 [0x100e000], value=80) .
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-FOP_CHANGED: port-channel3: first operational port changed from fc1/14 to fc1/15
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-PORT_DOWN: port-channel3: fc1/14 is down
2019 Dec 20 11:45:44 ***MDS-A** %PORT-5-IF_DOWN_LINK_FAILURE: %$VSAN 20%$ Interface fc1/14 is down (Link failure Link reset failed due to timeout) port-channel3 ****fia002_FIA_1/2 
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-FOP_CHANGED: port-channel3: first operational port changed from fc1/15 to fc1/16
2019 Dec 20 11:45:44 ***MDS-A** %PORT-CHANNEL-5-PORT_DOWN: port-channel3: fc1/15 is down
2019 Dec 20 11:45:44 ***MDS-A** %PORT-5-IF_DOWN_LINK_FAILURE: %$VSAN 20%$ Interface fc1/15 is down (Link failure Link reset failed due to timeout) port-channel3 ****fia002_FIA_1/3 
2019 Dec 20 11:45:46 ***MDS-A** %PORT-CHANNEL-5-FOP_CHANGED: port-channel3: first operational port changed from fc1/16 to none
2019 Dec 20 11:45:46 ***MDS-A** %PORT-CHANNEL-5-PORT_DOWN: port-channel3: fc1/16 is down
2019 Dec 20 11:45:46 ***MDS-A** %PORT-5-IF_DOWN_NONE: %$VSAN 20%$ Interface port-channel3 is down (None)   
2019 Dec 20 11:45:46 ***MDS-A** %PORT-5-IF_DOWN_LINK_FAILURE: %$VSAN 20%$ Interface fc1/16 is down (Link failure Link reset failed due to timeout) port-channel3 ****fia002_FIA_1/4 
2019 Dec 20 11:45:46 ***MDS-A** %PORT-5-IF_DOWN_NONE: %$VSAN 20%$ Interface port-channel3 is down (None)   
2019 Dec 20 11:45:46 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: Credit Loss Reco has reached the rising threshold (port=fc1/16 [0x100f000], value=1) .
2019 Dec 20 11:45:46 ***MDS-A** %PMON-SLOT1-3-RISING_THRESHOLD_REACHED: TX Credit Not Available has reached the rising threshold (port=fc1/16 [0x100f000], value=100) .
2019 Dec 20 11:45:46 ***MDS-A** %PORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: %$VSAN 20%$ Interface port-channel3 is down (No operational members)   
2019 Dec 20 11:47:27 ***MDS-A** %PORT-5-IF_UP: %$VSAN 20%$ Interface port-channel3 is up in mode F   
2019 Dec 20 11:47:33 ***MDS-A** %PORT-5-IF_UP: %$VSAN 20%$ Interface fc1/15 is up in mode F port-channel3 ****fia002_FIA_1/3 
2019 Dec 20 11:47:33 ***MDS-A** %PORT-5-IF_UP: %$VSAN 20%$ Interface fc1/16 is up in mode F port-channel3 ****fia002_FIA_1/4 
2019 Dec 20 11:47:33 ***MDS-A** %PORT-5-IF_UP: %$VSAN 20%$ Interface fc1/13 is up in mode F port-channel3 ****fia002_FIA_1/1

*************** Port Config Link Events Log ***************
----                            ------        -----  -----  ------
Time                            PortNo        Speed  Event  Reason
----                            ------        -----  -----  ------
Dec 20 11:47:27 2019  00780197  fc1/13         16G    UP    Not FL                  

Dec 20 11:47:27 2019  00766171  fc1/16         16G    UP    Not FL                  

Dec 20 11:47:27 2019  00708650  fc1/15         16G    UP    Not FL                  

Dec 20 11:47:27 2019  00676960  fc1/14         16G    UP    Not FL                  

Dec 20 11:45:46 2019  00119133  fc1/16         ---   DOWN   Link Reset Failed       

Dec 20 11:45:44 2019  00837802  fc1/15         ---   DOWN   Link Reset Failed       

Dec 20 11:45:44 2019  00828281  fc1/14         ---   DOWN   Link Reset Failed       

Dec 20 11:45:44 2019  00178214  fc1/13         ---   DOWN   Link Reset Failed

Conditions:
6332-16UP 3.2(3h) connected to 9396S 6.2(23) in an FC port-channel (4 interfaces per FI)
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.