Guest

Preview Tool

Cisco Bug: CSCuq21409 - Cisco|KT|NETDEV WATCHDOG: eth8 (enic): transmit timed out

Last Modified

Mar 08, 2016

Products (1)

  • Cisco Videoscape Distribution Suite Transparent Caching

Known Affected Releases

5.1.1

Description (partial)

Symptom:
TIC#3 CE-4 was degraded.

Conditions:
23b | 07/28/2014 | 21:02:16 | Entity Presence #0x05 | Device Absent 
23c | 07/28/2014 | 21:02:35 | Entity Presence #0x01 | Device Absent 
23d | 07/28/2014 | 21:02:35 | Entity Presence #0x05 | Device Present 
23e | 07/28/2014 | 21:03:55 | System Event #0x83 | OEM System boot event | Asserted 
23f | 07/28/2014 | 21:03:57 | Entity Presence #0x01 | Device Present 
240 | 07/28/2014 | 21:04:01 | Entity Presence #0x01 | Device Absent 
241 | 07/28/2014 | 21:05:18 | System Event #0x83 | OEM System boot event | Asserted 
242 | 07/28/2014 | 21:05:20 | Entity Presence #0x01 | Device Present 


Jul 28 20:57:21 mg-1 snmpd[7170]: cluster has been degraded 
Jul 28 20:57:25 ce-7 pang[22824]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-7 pang[22824]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-7 pang[22824]: Reallocating resources ... 
Jul 28 20:57:25 ce-11 pang[23246]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-11 pang[23246]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-11 pang[23246]: Reallocating resources ... 
Jul 28 20:57:25 ce-12 pang[30358]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-12 pang[30358]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-12 pang[30358]: Reallocating resources ... 
Jul 28 20:57:25 ce-15 pang[23160]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-15 pang[23160]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-3 pang[30908]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-3 pang[30908]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-3 pang[30908]: Reallocating resources ... 
Jul 28 20:57:25 ce-13 pang[30367]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-13 pang[30367]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-13 pang[30367]: Reallocating resources ... 
Jul 28 20:57:25 ce-15 pang[23160]: Reallocating resources ... 
Jul 28 20:57:25 ce-1 pang[31489]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-1 pang[31489]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-1 pang[31489]: Reallocating resources ... 
Jul 28 20:57:25 ce-6 pang[31014]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-6 pang[31014]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-6 pang[31014]: Reallocating resources ... 
Jul 28 20:57:25 ce-10 pang[30603]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-10 pang[30603]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-10 pang[30603]: Reallocating resources ... 
Jul 28 20:57:25 ce-16 pang[23122]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-16 pang[23122]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-16 pang[23122]: Reallocating resources ... 
Jul 28 20:57:25 ce-5 pang[23151]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-5 pang[23151]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-5 pang[23151]: Reallocating resources ... 
Jul 28 20:57:25 ce-14 pang[23865]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-14 pang[23865]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-14 pang[23865]: Reallocating resources ... 
Jul 28 20:57:25 ce-9 pang[23135]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-9 pang[23135]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-9 pang[23135]: Reallocating resources ... 
Jul 28 20:57:25 ce-8 pang[30558]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-8 pang[30558]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-8 pang[30558]: Reallocating resources ... 
Jul 28 20:57:25 ce-2 pang[31268]: grace timeout wait_to restore indication is true 
Jul 28 20:57:25 ce-2 pang[31268]: time to say goodbye to blade 4 
Jul 28 20:57:25 ce-2 pang[31268]: Reallocating resources ... 

Jul 28 20:56:41 ce-4 kernel: ------------[ cut here ]------------ 
Jul 28 20:56:41 ce-4 kernel: WARNING: at net/sched/sch_generic.c:219 dev_watchdog+0x11c/0x1ad() 
Jul 28 20:56:41 ce-4 kernel: NETDEV WATCHDOG: eth8 (enic): transmit timed out 
Jul 28 20:56:41 ce-4 kernel: Modules linked in: xfs(N) llpf(N) msr(N) af_packet(N) crc32c(N) libcrc32c(N) ib_iser(N) rdma_cm(N) ib_cm(N) iw_cm(N) ib_sa(N) ib_mad(N) ib_core(N) ib_addr(N) binfmt_misc(N) iscsi_tcp(N) libiscsi(N) scsi_transport_iscsi(N) mppVhba mppUpper bonding(N) ipmi_watchdog(N) ipmi_si(N) ipmi_devintf(N) ipmi_msghandler(N) ioatdma(N) fuse(N) loop(N) dm_mod(N) rtc_cmos(N) igb(X) rtc_core(N) button(N) wmi(N) pcspkr(N) sg(N) rtc_lib(N) container(N) dca(N) enic(N) joydev(N) usbhid(N) hid(N) ff_memless(N) ehci_hcd(N) sd_mod(N) crc_t10dif(N) usbcore(N) edd(N) ext3(N) mbcache(N) jbd(N) fan(N) ide_pci_generic(N) ide_core(N) ata_generic(N) ata_piix(N) libata(N) dock(N) megaraid_sas(N) mptsas(N) mptscsih(N) mptbase(N) thermal(N) processor(N) thermal_sys(N) hwmon(N) mpt2sas(X) scsi_transport_sas(N) raid_class(N) scsi_mod(N) 
Jul 28 20:56:41 ce-4 kernel: Supported: No 
Jul 28 20:56:41 ce-4 kernel: Pid: 23942, comm: snmpd Tainted: G 2.6.27.19-llpf-5-default #4 
Jul 28 20:56:41 ce-4 kernel: 
Jul 28 20:56:41 ce-4 kernel: Call Trace: 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8020d9f9>] show_trace_log_lvl+0x41/0x58 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff80496ad4>] dump_stack+0x69/0x6f 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8023bf49>] warn_slowpath+0xa9/0xd1 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff80435ce3>] dev_watchdog+0x11c/0x1ad 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff802448f1>] run_timer_softirq+0x18d/0x204 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff80240ec4>] __do_softirq+0x7d/0x107 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8020d2ac>] call_softirq+0x1c/0x28 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8020e553>] do_softirq+0x2c/0x68 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff80240bf1>] irq_exit+0x3f/0x85 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8021b09c>] smp_apic_timer_interrupt+0x95/0xae 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8020cc86>] apic_timer_interrupt+0x66/0x70 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff804991d7>] lock_kernel+0x2b/0x41 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff802beb53>] __break_lease+0xab/0x390 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff802b6cf8>] may_open+0x105/0x222 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff802ba29e>] do_filp_open+0x3bc/0x7e1 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff802adc9d>] do_sys_open+0x48/0xc5 
Jul 28 20:56:41 ce-4 kernel: [<ffffffff8020bf8b>] system_call_fastpath+0x16/0x1b 
Jul 28 20:56:41 ce-4 kernel: [<00007f71907d123b>] 0x7f71907d123b 
Jul 28 20:56:41 ce-4 kernel: 
Jul 28 20:56:41 ce-4 kernel: ---[ end trace 7a601dd8bd4df059 ]--- 
Jul 28 20:56:47 ce-4 kernel: connection24:0: ping timeout of 5 secs expired, last rx 6407337481, last ping 6407338731, now 6407339981 
Jul 28 20:56:47 ce-4 kernel: connection24:0: detected conn error (1011) 
Jul 28 20:56:47 ce-4 iscsid: Kernel reported iSCSI connection 24:0 error (1011) state (3) 
Jul 28 21:01:44 ce-4 kernel: connection34:0: ping timeout of 5 secs expired, last rx 6407411764, last ping 6407413014, now 6407414264 
Jul 28 21:01:44 ce-4 kernel: connection34:0: detected conn error (1011)



Eran Amir (Inactive) added a comment - 29/Jul/14 10:45 AM

this is TIC#3 CE-4 degraded on : 07/28/2014
Mark Kogan added a comment - 29/Jul/14 10:58 AM

Looks like :
PeerApp-RCA-14710-SKB-HWWD-Yan-Pending.docx
Nadav Sharabi added a comment - 05/Aug/14 5:19 PM

Fixed llpf deadlock
Eran Amir [X] (Inactive) added a comment - 27/Oct/14 4:11 PM

Closed by Eran (Field).
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.