Guest

Preview Tool

Cisco Bug: CSCvt29149 - VIC Adapter errors "vnicXY: hang_notify" after ESXi VNIC failover

Last Modified

Oct 14, 2020

Products (1)

  • Cisco Unified Computing System

Known Affected Releases

4.1(1c)B

Description (partial)

Symptom:
HX node loosing connectivity via eth1/vmk1(data traffic) when default active VNIC 5 set as active. 
Problem seems intermittent, wasn't reproducible everytime and on all nodes. 
Troubleshooting shown no upstream TX traffic leaving associated Veth. Due to this Fabric Interconnect not able to update MAC address table and associated VMs, VMK loosing network connectivityy.

Issue observed on below setup:
---------------------------------------
HX Stretch Cluster 3+3    3.5(2g)
HXAF240C-M5SX / UCS-CPU-I6248 (Gold 6248) / UCSC-MLOM-C40Q-03 (UCS VIC 1387) 
vSphere, ESXi   6.5U3(build-15256549)
nenic           1.0.29.0-1vmw.650.3.96.13932383
UCSM and Server fw    4.0(4e)

Conditions:
vnicXY: hang_notify observed in VIC adapter OBFL/Syslog logs

Example:
---------
200206-13:26:45.040670 mcp.vnic_dev vnic18 vnic_dev_enable
        200210-09:46:23.023330 mcp.hang_notify ERROR: vnic18: hang_notify
        200210-09:46:23.024175 mcp.hang_notify WQ[23] error_status 0x0 posted_index 0xe4 fetch_index 0x0 enable 1 master_enable 1 running 0 egress_port 1 vnic 18 l2_cos_sched 0x2 vnic_fetch_needed 0 wq_fetch_needed 1 lif->wq_disable_cnt 0 
        200210-09:46:23.024789 mcp.hang_notify RQ[19] error_status 0x0 posted_index 0x170 fetch_index 0x176 enable 1 master_enable 1 running 0
        200210-09:46:23.024832 mcp.hang_notify cfg_eg0_pfifo_ptr 00bf0000 048f00c0 085f0490 0c2f0860 0fff0c30 10001000 10001000 10001000
        200210-09:46:23.024865 mcp.hang_notify sta_eg0_pfifo_ptr 80118011 81288128 05220522 0a610a61 8ea48ea4 10001000 10001000 10001000
        200210-09:46:23.024881 mcp.hang_notify sta_eg0_db_dbg_info 62222165 17772166
        200210-09:46:23.024897 mcp.hang_notify sta_eg0_dbg_sop_eop_cnt c5c5aeae 00000000
        200210-09:46:23.024911 mcp.hang_notify sta_eg0_dbg_rfifo_ptr 01030103
        200210-09:46:23.024941 mcp.hang_notify cfg_eg1_pfifo_ptr 00bf0000 048f00c0 085f0490 0c2f0860 0fff0c30 10001000 10001000 10001000
        200210-09:46:23.024971 mcp.hang_notify sta_eg1_pfifo_ptr 00160016 80d801a7 88548854 08600860 0c300c30 10001000 10001000 10001000
        200210-09:46:23.024987 mcp.hang_notify sta_eg1_db_dbg_info 62222165 17772166
        200210-09:46:23.025004 mcp.hang_notify sta_eg1_dbg_sop_eop_cnt 4040d5d5 00000000
        200210-09:46:23.025018 mcp.hang_notify sta_eg1_dbg_rfifo_ptr 005d005d
        200210-09:46:23.025211 mcp.vnic_dev vnic18 vnic_dev_disable
        200210-09:46:23.025504 mcp.vnic_dev vnic18 vnic_dev_addr_del 00:25:b5:35:b4:02
        200210-09:46:23.025648 mcp.devcmd vnic18: notify pa 0x0 sz 40 intr 65535
        200210-09:46:23.027767 mcp.vnic_dev vnic18 vnic_dev_hangreset-
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.