Guest

Preview Tool

Cisco Bug: CSCvv69420 - FIB_MGR goes in MUTEX for long time with ABF/GRE Config on triggering core interface FLAP

Last Modified

Sep 25, 2020

Products (1)

  • Cisco Network Convergence System 5500 Series

Known Affected Releases

7.1.2.BASE

Description (partial)

Symptom:
FIB_MGR goes in MUTEX for long time with ABF/GRE Config on triggering core interface FLAP
Same issue seen on Router Reload time as well

Conditions:
FIB_MGR goes in MUTEX for long time with ABF/GRE Config on triggering core interface FLAP

Few Points 
 
•	Trigger ? CORE Bundle Interface SHUT [ On un-shut ? issue is not seen ]
o	Same Issue is seen on Router Reload too
•	Issue seen with Single PASS tunnels only
o	With 2 PASS tunnel ? don’t see this issue.
•	Issue is not dependent on MPLSoverSinglePASS ? removed the mpls static config still see the same issue.
•	NO background CLI / Script is running which is trying to collect any o/p - especially DPA related ones.

RP/0/RP0/CPU0:PF#sh processes blocked location 0/2/CPU0 
  Jid       Pid Tid          ProcessName        State   TimeInState    Blocked-on
 
  318      3492 4566              fib_mgr        Mutex 0000:02:57.0412 0x55fe709c9a60 4555 fib_mgr fib_proto_thread_mutex_lock:85
 
  152      3470 3470               qos_ea     ZMQ_POLL 0000:00:00.0003 ipc:///dev/shm/lo.0.0
 
  127      3498 3695              ipv6_ea        Reply 0000:01:34.0559    3492 fib_mgr
 
  131      3480 4451              ipv4_io        Reply 0000:00:58.0821    3492 fib_mgr
 
RP/0/RP0/CPU0:PF#

Thread 17 (LWP 4566)
#0  0x00007f9fe62441cc in __lll_lock_wait+0x1c from /lib64/libpthread-2.20.so
#1  0x00007f9fe623e785 in __pthread_mutex_lock+0x75 from /lib64/libpthread-2.20.so
#2  0x000055fe7049b734 in ?? () from /opt/cisco/XR/packages/ncs5500-iosxr-fwding-4.1.0.0-r712/all/bin/fib_mgr
#3  0x000055fe7049b7f3 in ?? () from /opt/cisco/XR/packages/ncs5500-iosxr-fwding-4.1.0.0-r712/all/bin/fib_mgr
#4  0x00007f9fe623c254 in start_thread+0xc4 from /lib64/libpthread-2.20.so
#5  0x00007f9fe653b53d in clone+0x6d from /lib64/libc-2.20.so
Thread 16 (LWP 4555)
#0  0x00007f9fe652ff2d in poll+0x2d from /lib64/libc-2.20.so
#1  0x00007f9fba738395 in _ZN3zmq15socket_poller_t4waitEPNS0_7event_tEil+0x125 from /opt/cisco/XR/packages/ncs5500-os-6.0.0.0-r712/all/lib/libzmq.so.5.1.5
#2  0x00007f9fba736ba6 in zmq_poll+0x126 from /opt/cisco/XR/packages/ncs5500-os-6.0.0.0-r712/all/lib/libzmq.so.5.1.5
#3  0x00007f9fbe706e37 in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libofa_xport.so
#4  0x00007f9fbe707519 in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libofa_xport.so
#5  0x00007f9fbe70804b in ofa_xport_send+0xee from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libofa_xport.so
#6  0x00007f9fc034699b in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libdpa_client_mono.so
#7  0x00007f9fc03493be in dpa_ipnhgroup_get_internal+0x45b from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libdpa_client_mono.so
#8  0x00007f9fc0349b09 in dpa_ipnhgroup_get+0x48 from /opt/cisco/XR/packages/ncs5500-dpa-3.0.0.0-r712/lc/lib/libdpa_client_mono.so
#9  0x00007f9fb2d3d5a1 in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-fwding-4.0.0.0-r712/lc/lib/libfib_hal_engine_hw_specific.so
#10 0x00007f9fb2d3f6ae in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-fwding-4.0.0.0-r712/lc/lib/libfib_hal_engine_hw_specific.so
#11 0x00007f9fb3585551 in ?? () from /opt/cisco/XR/packages/ncs5500-dpa-fwding-4.0.0.0-r712/lc/lib/libfib_hal_engine.so
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.