Guest

Preview Tool

Cisco Bug: CSCup86591 - CE Reloads Unexpectedly

Last Modified

Jan 07, 2016

Products (1)

  • Cisco Videoscape Distribution Suite Transparent Caching

Known Affected Releases

5.1.1

Description (partial)

Symptom:
CE-4 Reloads Unexpectedly, 07/08/2014

Please help identify root cause Problem Description: On Jun 18th around 5:29 PM the CE-4 restarted suddenly.

Furthermore, on June 26th the same Cache Engine was restarted suddenly around 1:15 PM.



External issue URL on PA:

http://10.1.1.245/bugzilla/show_bug.cgi?id=10602

Conditions:
2014-05-24 09:16:11.728  poll_health_status - pang is up but didn't answer to keep alive 0
2014-05-24 09:18:39.819  poll_health_status - Filemanager health is BAD (3455) , for 0 secs by now, 0 subsequient retries
2014-05-25 04:37:31.878  health 1907 not good (1907&3091=1043).. trying next time 
2014-05-25 04:40:35.568  health 2038 not good (2038&3091=1042).. trying next time 
2014-05-25 04:41:23.783  health 4086 not good (4086&3091=3090).. trying next time 
2014-05-25 05:02:11.757  health 3958 not good (3958&3091=3090).. trying next time 
2014-05-27 05:02:11.379  health 2038 not good (2038&3091=1042).. trying next time 
2014-05-27 09:15:23. 63  health 3954 not good (3954&3091=3090).. trying next time 
2014-05-27 09:17:23.316  Driver is stucked.Cpu counters did not changed!
2014-05-27 09:17:23.316  123987797 
2014-05-27 09:17:23.316  124404004 
2014-05-27 09:17:23.316  124459482 
2014-05-27 09:17:23.316  124465392 
2014-05-27 09:17:23.316  124467824 
2014-05-27 09:17:23.316  124479045 
2014-05-27 09:17:23.316  124532156 
2014-05-27 09:17:23.316  124539776 
2014-05-27 09:17:23.316  124537818 
2014-05-27 09:17:23.316  124633182 
2014-05-27 09:17:23.316  124555910 
2014-05-27 09:17:23.316  124602896 
2014-05-27 09:17:23.316  124619675 
2014-05-27 09:17:23.316  124542046 
2014-05-27 09:17:23.316  124646834 
2014-05-27 09:17:23.316  124629929 
2014-05-27 09:17:23.316  124634931 
2014-05-27 09:17:23.316  124702006 
2014-05-27 09:17:23.316  124704892 
2014-05-27 09:17:23.316  124677609 
2014-05-27 09:17:23.316  124705473 
2014-05-27 09:17:23.316  124716933 
2014-05-27 09:17:23.316  124717873 
2014-05-27 09:17:23.316  124719017 
2014-05-27 09:17:23.316  124713383 
2014-05-27 09:17:23.316  124722103 
2014-05-27 09:17:23.357  124731346 
2014-05-27 09:17:23.357  124741412 
2014-05-27 09:17:23.357  124751801 
2014-05-27 09:17:23.357  124716868 
2014-05-27 09:17:23.357  124764355 
2014-05-27 09:17:23.357  124775526 
2014-05-27 09:17:23.357  poll_health_status - pang is up but didn't answer to keep alive 0
could not open /proc/net/if_inet6

2014-05-27 20:23:14.337  Found 0 reboot events by ipmi watchdog; 0 ipmi reboots till now comparing to my memories; Overall reboots count 0
2014-05-27 20:23:14.337  first_start: 0
2014-05-27 20:23:14.337  watchdog_threshold_reboots_time=54000 , reboot_time_diff=0 , g_start_kernel_watchdog 1
2014-05-27 20:23:14.337  peerapp snmp agent has been restarted: 0 self-reboots till now , since 31-12-69 21:00:00

2014-05-27 20:23:14.405  Will start kernel watchdog update thread , max reboots permitted: 38 m_reboots_since_anchor_time: 0 (g_start_kernel_watchdog 1) 
2014-05-27 20:23:14.405  Starting kernel watchdog update thread
2014-05-27 20:23:16.894  (uptime 53.42 46.63 ) 
2014-05-27 20:23:16.894  will sleep 180 seconds because the machine is just restarted (uptime 53.419998 ) 
2014-05-27 20:26:23.319  connect_health_checker_socket going to connect again
2014-05-27 20:26:23.319  connect_health_checker_socket :sent hello data at 15890
2014-05-27 20:26:23.320  connect_health_checker_socket :received hello data at 15890
2014-05-27 20:41:15.670  health 1776 not good (1776&3091=1040).. trying next time 
2014-05-27 20:41:19.672  health 3071 not good (3071&3091=2067).. trying next time 
2014-05-29 12:47:35.871  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-05-29 12:47:39.874  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-05-30 15:19:43. 13  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-05-30 15:19:47. 28  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-05-30 15:19:51. 31  poll_health_status - Filemanager health is BAD (3455) , for 8 secs by now, 2 subsequient retries
2014-05-30 15:19:55.264  poll_health_status - Filemanager health is BAD (3583) , for 12 secs by now, 3 subsequient retries
2014-05-30 15:19:59.267  poll_health_status - Filemanager health is BAD (3583) , for 16 secs by now, 4 subsequient retries
2014-06-11 03:20:03.453  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-06-11 03:20:07.476  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-06-11 03:20:11.479  poll_health_status - Filemanager health is BAD (3583) , for 8 secs by now, 2 subsequient retries
2014-06-11 03:20:15.481  poll_health_status - Filemanager health is BAD (3455) , for 12 secs by now, 3 subsequient retries
2014-06-11 03:20:19.483  poll_health_status - Filemanager health is BAD (3583) , for 16 secs by now, 4 subsequient retries
2014-06-11 03:20:23.485  poll_health_status - Filemanager health is BAD (3583) , for 20 secs by now, 5 subsequient retries
2014-06-11 03:20:27.488  poll_health_status - Filemanager health is BAD (3583) , for 24 secs by now, 6 subsequient retries
2014-06-15 21:39:51.884  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-06-15 21:39:55.907  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-06-15 21:39:59.910  poll_health_status - Filemanager health is BAD (3583) , for 8 secs by now, 2 subsequient retries
2014-06-15 21:40:03.912  poll_health_status - Filemanager health is BAD (3583) , for 12 secs by now, 3 subsequient retries
2014-06-15 21:40:07.914  poll_health_status - Filemanager health is BAD (3583) , for 16 secs by now, 4 subsequient retries
2014-06-15 21:40:11.917  poll_health_status - Filemanager health is BAD (3583) , for 20 secs by now, 5 subsequient retries
2014-06-15 21:40:15.919  poll_health_status - Filemanager health is BAD (3583) , for 24 secs by now, 6 subsequient retries
2014-06-15 21:40:19.116  poll_health_status - Filemanager health is BAD (3455) , for 28 secs by now, 7 subsequient retries
2014-06-15 21:40:23.118  poll_health_status - Filemanager health is BAD (3583) , for 32 secs by now, 8 subsequient retries
2014-06-15 21:40:27.121  poll_health_status - Filemanager health is BAD (3583) , for 36 secs by now, 9 subsequient retries
2014-06-15 21:40:31.123  poll_health_status - Filemanager health is BAD (3583) , for 40 secs by now, 10 subsequient retries
2014-06-15 21:40:35.126  poll_health_status - Filemanager health is BAD (3583) , for 44 secs by now, 11 subsequient retries
2014-06-15 21:40:39.128  poll_health_status - Filemanager health is BAD (3583) , for 48 secs by now, 12 subsequient retries
2014-06-15 21:40:43.131  poll_health_status - Filemanager health is BAD (3583) , for 52 secs by now, 13 subsequient retries
2014-06-15 21:40:47.133  poll_health_status - Filemanager health is BAD (3583) , for 56 secs by now, 14 subsequient retries
2014-06-15 21:40:51.136  poll_health_status - Filemanager health is BAD (3583) , for 60 secs by now, 15 subsequient retries
2014-06-15 21:40:55.138  poll_health_status - Filemanager health is BAD (3583) , for 64 secs by now, 16 subsequient retries
2014-06-15 21:40:59.141  poll_health_status - Filemanager health is BAD (3583) , for 68 secs by now, 17 subsequient retries
2014-06-15 21:41:03.143  poll_health_status - Filemanager health is BAD (3583) , for 72 secs by now, 18 subsequient retries
2014-06-15 21:41:07.146  poll_health_status - Filemanager health is BAD (3583) , for 76 secs by now, 19 subsequient retries
2014-06-15 21:41:11.149  poll_health_status - Filemanager health is BAD (3583) , for 80 secs by now, 20 subsequient retries
2014-06-15 21:41:15.151  poll_health_status - Filemanager health is BAD (3583) , for 84 secs by now, 21 subsequient retries
2014-06-15 21:41:19.153  poll_health_status - Filemanager health is BAD (3583) , for 88 secs by now, 22 subsequient retries
2014-06-15 21:41:23.156  poll_health_status - Filemanager health is BAD (3583) , for 92 secs by now, 23 subsequient retries
2014-06-17 13:53:55.493  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-06-17 13:53:59.495  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-06-17 13:54:03.495  poll_health_status - Filemanager health is BAD (3583) , for 8 secs by now, 2 subsequient retries
2014-06-17 13:54:07.498  poll_health_status - Filemanager health is BAD (3583) , for 12 secs by now, 3 subsequient retries
2014-06-17 13:54:11.500  poll_health_status - Filemanager health is BAD (3583) , for 16 secs by now, 4 subsequient retries
2014-06-17 13:54:15.503  poll_health_status - Filemanager health is BAD (3583) , for 20 secs by now, 5 subsequient retries
2014-06-17 13:54:19.506  poll_health_status - Filemanager health is BAD (3583) , for 24 secs by now, 6 subsequient retries
2014-06-17 13:54:23.508  poll_health_status - Filemanager health is BAD (3583) , for 28 secs by now, 7 subsequient retries
2014-06-17 13:54:27.511  poll_health_status - Filemanager health is BAD (3583) , for 32 secs by now, 8 subsequient retries
2014-06-17 13:54:31.513  poll_health_status - Filemanager health is BAD (3583) , for 36 secs by now, 9 subsequient retries
2014-06-17 13:54:35.515  poll_health_status - Filemanager health is BAD (3583) , for 40 secs by now, 10 subsequient retries
2014-06-17 13:54:39.517  poll_health_status - Filemanager health is BAD (3583) , for 44 secs by now, 11 subsequient retries
2014-06-17 13:54:43.519  poll_health_status - Filemanager health is BAD (3583) , for 48 secs by now, 12 subsequient retries
2014-06-17 13:54:47.522  poll_health_status - Filemanager health is BAD (3583) , for 52 secs by now, 13 subsequient retries
2014-06-17 13:54:51.524  poll_health_status - Filemanager health is BAD (3583) , for 56 secs by now, 14 subsequient retries
2014-06-17 13:54:55.526  poll_health_status - Filemanager health is BAD (3583) , for 60 secs by now, 15 subsequient retries
2014-06-17 13:54:59.529  poll_health_status - Filemanager health is BAD (3583) , for 64 secs by now, 16 subsequient retries
2014-06-17 13:55:03.531  poll_health_status - Filemanager health is BAD (3583) , for 68 secs by now, 17 subsequient retries
2014-06-17 13:55:07.533  poll_health_status - Filemanager health is BAD (3583) , for 72 secs by now, 18 subsequient retries
2014-06-17 13:55:11.536  poll_health_status - Filemanager health is BAD (3583) , for 76 secs by now, 19 subsequient retries
2014-06-17 13:55:15.538  poll_health_status - Filemanager health is BAD (3583) , for 80 secs by now, 20 subsequient retries
2014-06-17 13:55:19.541  poll_health_status - Filemanager health is BAD (3583) , for 84 secs by now, 21 subsequient retries
could not open /proc/net/if_inet6

2014-06-18 17:40:11. 97  Found 0 reboot events by ipmi watchdog; 0 ipmi reboots till now comparing to my memories; Overall reboots count 0
2014-06-18 17:40:11. 97  first_start: 1
2014-06-18 17:40:11. 97  watchdog_threshold_reboots_time=54000 , reboot_time_diff=0 , g_start_kernel_watchdog 1
2014-06-18 17:40:11. 97  peerapp snmp agent has been restarted: 0 self-reboots till now , since 31-12-69 21:00:00

2014-06-18 17:40:11.178  Will start kernel watchdog update thread , max reboots permitted: 38 m_reboots_since_anchor_time: 0 (g_start_kernel_watchdog 1) 
2014-06-18 17:40:11.178  Starting kernel watchdog update thread
2014-06-18 17:40:13.547  (uptime 174.04 157.40 ) 
2014-06-18 17:40:13.547  will sleep 180 seconds because the machine is just restarted (uptime 174.039993 ) 
2014-06-18 17:43:19.348  connect_health_checker_socket going to connect again
2014-06-18 17:43:19.348  connect_health_checker_socket :sent hello data at 15890
2014-06-18 17:43:19.349  connect_health_checker_socket :received hello data at 15890
2014-06-18 17:56:47.636  health 3824 not good (3824&3091=3088).. trying next time 
2014-06-19 13:44:43.575  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-06-19 13:44:51.581  poll_health_status - Filemanager health is BAD (3583) , for 0 secs by now, 0 subsequient retries
2014-06-19 13:44:55.585  poll_health_status - Filemanager health is BAD (3583) , for 4 secs by now, 1 subsequient retries
2014-06-19 13:44:59.589  poll_health_status - Filemanager health is BAD (3583) , for 8 secs by now, 2 subsequent retries


18-06-14 17:20:58.130, 31105	[net:Warning]	virtual int connection_c::init(packet_c*)	Connection #60334740 ips 191.133.158.191 and 173.194.119.8 link is UNKNOWN - check that the ranges are configured correctly
18-06-14 17:20:58.154, 31105	[net:Warning]	virtual int connection_c::init(packet_c*)	Connection #60334810 ips 191.131.113.191 and 173.194.119.18 link is UNKNOWN - check that the ranges are configured correctly
18-06-14 17:20:58.162, 31105	[net:Warning]	virtual int connection_c::init(packet_c*)	Connection #60334837 ips 191.130.11.203 and 74.125.131.154 link is UNKNOWN - check that the ranges are configured correctly
18-06-14 17:20:58.165, 31105	[net:Warning]	virtual int connection_c::init(packet_c*)	Connection #60334845 ips 191.128.191.43 and 17.154.66.159 link is UNKNOWN - check that the ranges are configured correctly
18-06-14 17:20:58.169, 31105	[net:Warning]	virtual int connection_c::init(packet_c*)	Connection #60334863 ips 191.133.157.55 and 184.51.126.129 link is UNKNOWN - check that the ranges are configured correctly
 <BR>
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.