Guest

Preview Tool

Cisco Bug: CSCvs57973 - adding or reinserting a linecard N9K-X9464PX in a Nexus 9500 running 9.2.2 will not be detected

Last Modified

Jan 23, 2020

Products (1)

  • Cisco Nexus 9000 Series Switches

Known Affected Releases

9.2(2)

Description (partial)

Symptom:
After adding or reinserting a linecard N9K-X9464PX is being detected in the command show module or generates a log in nvram.
We can rlogin into the module 4 and check the logs of the linecard with bash even when the Nexus is not showing it. We can also see one-wire errors for that module with the command show system internal platform internal event-history errors.
+Inserted the linecard in mod 4

switch# sh clock
00:32:55.328 UTC Thu Dec 19 2019<<<<<<<<<<<<Time I inserted the linecard
Time source is NTP
switch# sh clock
00:33:00.118 UTC Thu Dec 19 2019

switch#  show system internal platform internal event-history errors

1) Event:E_DEBUG, length:50, at 489118 usecs after Thu Dec 19 00:33:50 2019
    [103] one-wire error code 0xe9(233) rcvd for mod 4
<snip>


+Attached to the linecard 4 when it is not being recognized and gathered the logs in it

switch(config)# run bash sudo rlogin lc4
root@lc4:~# cd /var/volatile/log
root@lc4:/var/volatile/log# ls          
boot.log  date  dmesg  dmesg.log  external  install_klm.log  isan.log  lastlog  time  wtmp
root@lc4:/var/volatile/log# cat boot.log
mount: mounting sysfs on /sys failed: Device or resource busy
5.61: Mounting isan ...
Rename eth0 to eobc
mknod: `/dev/zram0': File exists
mke2fs 1.42.1 (17-Feb-2012)
Discarding device blocks: done                            
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
45408 inodes, 181378 blocks
9068 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=188743680
6 block groups
32768 blocks per group, 32768 fragments per group
7568 inodes per group
Superblock backups stored on blocks: 
        32768, 98304, 163840

Allocating group tables: done                            
Writing inode tables: done                            
Writing superblocks and filesystem accounting information: done

16.23: Installing klm_gpl ...
16.31: Installing klm_isan_kthread ...
16.37: Installing klm_sdwrap ...
16.46: Installing klm_sse ...
17.30: Inserting mtdphysmap module
17.36: MTD Device found...
17.49: Checking plog ...
17.57: LC1 0
17.82: LC1 0
17.91: LC1 0
29.80: LC1 0
36.19: Partition /mnt/plog looks good.
36.23: Checking obfl mtdrr/mtdoops ...
36.27: mounting pstore...
36.30: Before mounting pstore
36.34: After mounting pstore
36.36: check ftrace partition...
39.56: after check ftrace partition...
39.64: sent ow err code...
40.28: Installing klm_i2c_stub ...
40.35: Installing klm_cctrl ...
40.41: Card type determine = 8
40.72: Applying quirks
41.40: Setting up Network
41.42: Setting up lo:
41.46: Setting up eobc:
42.28: Setting hostname lc4
47.80: Installing klm_obfl ...
47.83: Check if card is of type mmc
47.99: Installing sprom ...
48.05: Installing sprom ...
48.76: Installing klm_pfmsvcs ...
49.40: Installing aipc ...
50.24: Installing mts ...
54.95: SUP_IP is 127.1.1.27
55.04: Setting active SUP 27
55.55: 2019-12-19
55.73: stat /etc/localtime : File: "/etc/localtime" Size: 118 Blocks: 8 IO Block: 4096 Regular File Device: 1h/1d Inode: 6984 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: Thu Dec 19 00:33:45 2019 Modify: Thu Dec 19 00:26:07 2019 Change: Thu Dec 19 00:33:45 2019
55.76: /etc/localtime :
55.78:
55.95: stat /etc/isan.timezone : File: "/etc/isan.timezone" Size: 0 Blocks: 0 IO Block: 4096 Regular File Device: 1h/1d Inode: 884 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: Thu Dec 19 00:33:45 2019 Modify: Tue Mar 5 21:21:37 2019 Change: Thu Dec 19 00:33:45 2019
55.99: copy time: 19-12-19 00:33:45
56.94: SUP_IP is 127.1.1.27
57.04: SUP_IP is 127.1.1.27
57.19: downloaded patchrpm list
58.10: Installing KLMs
58.13: Installing klm_utaker ...
58.15: Installing utaker ...
58.18: Installing klm_vdc_mgr ...
58.28: Installing pss ...
58.39: Installing kfsmutils ...
58.46: Installing mts_trace ...
58.52: Installing kadb ...
58.62: Installing klm_tlv ...
58.68: Installing klm_cctrl_bg ...
58.76: Installing klm_lc_diag_stat ...
58.83: Installing klm_if_index ...
58.91: Installing klm_usd ...
58.98: Installing klm_mvdxn ...
59.08: Installing klm_emon ...
BOOT LOG END :: Thu Dec 19 00:33:51 UTC 2019

We can see additional logs when the linecard gets detected:


+The following lines were not showing in the command when it was not being detected.

switch(config)# run bash sudo rlogin lc6
root@lc6:~# cd /var/volatile/log
root@lc6:/var/volatile/log# cat boot.log

<snip>
BOOT LOG END :: Thu Dec 19 00:49:59 UTC 2019
233.34: SUP_IP is 127.1.1.27
233.68: 2019-12-19
233.88: stat /etc/localtime : File: "/etc/localtime" Size: 118 Blocks: 8 IO Block: 4096 Regular File Device: 1h/1d Inode: 7579 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: Thu Dec 19 00:49:53 2019 Modify: Thu Dec 19 00:49:53 2019 Change: Thu Dec 19 00:49:53 2019
233.92: /etc/localtime :
233.96:
234.15: stat /etc/isan.timezone : File: "/etc/isan.timezone" Size: 0 Blocks: 0 IO Block: 4096 Regular File Device: 1h/1d Inode: 7588 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: Thu Dec 19 00:49:53 2019 Modify: Thu Dec 19 00:49:53 2019 Change: Thu Dec 19 00:49:53 2019
234.20: copy time 19-12-19 00:49:53
root@lc6:/var/volatile/log#

Conditions:
Adding or reinserting a line card after the boot up of the Nexus
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.