Guest

Preview Tool

Cisco Bug: CSCvu74469 - Plural FEX aren't upgraded sequentially even when upgraded without parallel option

Last Modified

Jul 29, 2020

Products (1)

  • Cisco Nexus 9000 Series Switches

Known Affected Releases

8.4(2)

Description (partial)

Symptom:
We use "parallel" option when we want to upgrade plural FEX parallel.
Without this, I think FEX are upgraded sequentially. After first FEX upgraded, then next FEX becomes offline and upgraded.
But in our customer's and my test, FEX aren't upgraded like so. While another FEX are upgraded, next FEX upgrade starts. Following is the test result, checked with n7k-SUP1(test with 6.2.x) and n7k-SUP2(test with 8.4.x).

(1) 6.2.18 to 6.2.20 serial
(Result)
              offline        online
FEX101  09:41:42   09:43:09
FEX103  09:41:33   09:42:57
(Log)
BGL14.1-P.07-N7K-2# show fex
  FEX         FEX           FEX                       FEX
Number    Description      State            Model            Serial
------------------------------------------------------------------------
101        FEX0101                Online    N2K-C2232PP-10GE   SSI18080Axx
102        FEX0102               Offline   N2K-C2348UPQ-10GE   FOC1825R3xx
103        FEX0103                Online   N2K-C2248TP-E-1GE   SSI154100xx
...
BGL14.1-P.07-N7K-2# install all kickstart bootflash:n7000-s1-kickstart.6.2.20.bin system bootflash:n7000-s1-dk9.6.2.20.bin
Installer will perform compatibility check first. Please wait.
...
FEX: 101 Description: FEX0101   state: Online
  FEX version: 6.2(20) [Switch version: 6.2(20)]
...
06/16/2020 09:41:42.257757: Deleting route to FEX
06/16/2020 09:41:42.301294: Module disconnected
06/16/2020 09:41:42.303555: Module Offline
...
06/16/2020 09:43:09.61332: Module Online
...
FEX: 103 Description: FEX0103   state: Online
  FEX version: 6.2(20) [Switch version: 6.2(20)]
...
06/16/2020 09:41:33.198375: Deleting route to FEX
06/16/2020 09:41:33.261679: Module disconnected
06/16/2020 09:41:33.263541: Module Offline
...
06/16/2020 09:42:57.628944: Module Online

(2) 6.2.18 to 6.2.20 parallel
(Result)
              offline        online
FEX101  11:47:17   11:48:44
FEX103  11:47:13   11:48:38
(Log)
BGL14.1-P.07-N7K-2# show fex
  FEX         FEX           FEX                       FEX
Number    Description      State            Model            Serial
------------------------------------------------------------------------
101        FEX0101                Online    N2K-C2232PP-10GE   SSI18080Axx
102        FEX0102             Connected   N2K-C2348UPQ-10GE   FOC1825R3xx
103        FEX0103                Online   N2K-C2248TP-E-1GE   SSI154100xx
...
BGL14.1-P.07-N7K-2# install all kickstart n7000-s1-kickstart.6.2.20.bin system n7000-s1-dk9.6.2.20.bin parallel
Installer will perform compatibility check first. Please wait.
...
BGL14.1-P.07-N7K-2# show fex detail | no-more
FEX: 101 Description: FEX0101   state: Online
...
06/16/2020 11:47:17.930289: Deleting route to FEX
06/16/2020 11:47:17.973403: Module disconnected
06/16/2020 11:47:17.975370: Module Offline
...
06/16/2020 11:48:44.724048: Module Online
...
FEX: 103 Description: FEX0103   state: Online
...
06/16/2020 11:47:13.573539: Deleting route to FEX
06/16/2020 11:47:13.616192: Module disconnected
06/16/2020 11:47:13.618122: Module Offline
...
06/16/2020 11:48:38.202012: Module Online

(3) 8.4.1 to 8.4.2 serial
(Result)
              offline        online
FEX101  10:04:31   10:06:42
FEX102  10:06:25   10:10:16
FEX103  10:04:22   10:06:05
(Log)
BGL14.1-P.07-N7K-2-vdc1# show fex
  FEX             FEX                 FEX                            FEX
Number        Description            State                 Model               Serial
------------------------------------------------------------------------------------------
101           FEX0101                Online                N2K-C2232PP-10GE    SSI18080Axx
102           FEX0102                Online                N2K-C2348UPQ-10GE   FOC1825R3xx
103           FEX0103                Online                N2K-C2248TP-E-1GE   SSI154100xx
FEX: 101 Description: FEX0101   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
06/18/2020 10:04:31.259311: Deleting route to FEX
06/18/2020 10:04:31.309139: Module disconnected
06/18/2020 10:04:31.310373: Module Offline
...
06/18/2020 10:06:42.170186: Module Online
FEX: 102 Description: FEX0102   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
06/18/2020 10:06:25.38626: Deleting route to FEX
06/18/2020 10:06:25.88585: Module disconnected
06/18/2020 10:06:25.89832: Module Offline
...
06/18/2020 10:10:16.121329: Module Online
FEX: 103 Description: FEX0103   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
...
06/18/2020 10:04:22.310713: Deleting route to FEX
06/18/2020 10:04:22.371022: Module disconnected
06/18/2020 10:04:22.372256: Module Offline
...
06/18/2020 10:06:05.589529: Module Online

(4) 8.4.1 to 8.4.2 parallel
(Result)
              offline        online
FEX101  13:28:35   13:30:46
FEX102  13:30:19   13:34:11
FEX103  13:28:26   13:30:06
BGL14.1-P.07-N7K-2-vdc1# show fex
  FEX             FEX                 FEX                            FEX
Number        Description            State                 Model               Serial
------------------------------------------------------------------------------------------
101           FEX0101                Online                N2K-C2232PP-10GE    SSI18080Axx
102           FEX0102                Online                N2K-C2348UPQ-10GE   FOC1825R3xx
103           FEX0103                Online                N2K-C2248TP-E-1GE   SSI154100xx
BGL14.1-P.07-N7K-2-vdc1# sh fex detail | no-more
FEX: 101 Description: FEX0101   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
...
06/18/2020 13:28:35.804976: Deleting route to FEX
06/18/2020 13:28:35.855194: Module disconnected
06/18/2020 13:28:35.856485: Module Offline
...
06/18/2020 13:30:46.322107: Module Online
FEX: 102 Description: FEX0102   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
...
06/18/2020 13:30:19.322084: Deleting route to FEX
06/18/2020 13:30:19.372193: Module disconnected
06/18/2020 13:30:19.373460: Module Offline
...
06/18/2020 13:34:11.228748: Module Online
FEX: 103 Description: FEX0103   state: Online
  FEX version: 8.4(2) [Switch version: 8.4(2)]
...
06/18/2020 13:28:26.117416: Deleting route to FEX
06/18/2020 13:28:26.167226: Module disconnected
06/18/2020 13:28:26.168463: Module Offline
...
06/18/2020 13:30:06.192120: Module Online

Conditions:
8.4.1->8.4.2 Nexus7009(SUP2) + three FEX (101:N2K-C2232PP-10GE,102:N2K-C2348UPQ-10GE,103:N2K-C2248TP-E-1GE)
6.2.18->6.2.20 Nexus7009(SUP1) + two FEX (101:N2K-C2232PP-10GE, 103:N2K-C2248TP-E-1GE)
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.