Guest

Preview Tool

Cisco Bug: CSCus44607 - QNS Servers Memory Leak

Last Modified

Dec 26, 2016

Products (1)

  • Cisco Mobility Services Engine

Known Affected Releases

7.0.1

Description (partial)

Symptom:
JAVA eating all the Memory


top - 19:01:34 up 72 days,  6:32,  1 user,  load average: 0.16, 0.11, 0.04
Tasks: 181 total,   1 running, 180 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.8%us,  0.4%sy,  0.0%ni, 98.5%id,  0.3%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:  16333656k total, 13466316k used,  2867340k free,   322412k buffers
Swap:  4063224k total,     8928k used,  4054296k free,  4967572k cached
 
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
4891 qns       20   0 13.6g 7.2g  20m S 11.0 46.0  15:02.87 java
  885 root      20   0     0    0    0 S  0.7  0.0  19:07.72 jbd2/dm-2-8
    9 root      20   0     0    0    0 S  0.3  0.0   2:05.86 ksoftirqd/1
8082 root      20   0 15028 1384 1000 R  0.3  0.0   0:00.01 top

Conditions:
tpclabqpsD-qns01  2015-01-08 17:59:05,898 [pool-2-thread-1] WARN  c.b.c.m.dao.impl.ShardInterface - Unexpected error
java.lang.OutOfMemoryError: Direct buffer memory
        at java.nio.Bits.reserveMemory(Bits.java:658) ~[na:1.8.0_11]
        at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) ~[na:1.8.0_11]
        at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) ~[na:1.8.0_11]
        at com.schooner.MemCached.SchoonerSockIO.<init>(Unknown Source) ~[na:na]
        at com.schooner.MemCached.SchoonerSockIOPool$TCPSockIO.<init>(Unknown Source) ~[na:na]
        at com.schooner.MemCached.SchoonerSockIOPool.createSocket(Unknown Source) ~[na:na]
        at com.schooner.MemCached.SchoonerSockIOPool.getConnection(Unknown Source) ~[na:na]
        at com.schooner.MemCached.SchoonerSockIOPool.getSock(Unknown Source) ~[na:na]
        at com.schooner.MemCached.AscIIClient.set(Unknown Source) ~[na:na]
        at com.schooner.MemCached.AscIIClient.add(Unknown Source) ~[na:na]
        at com.danga.MemCached.MemCachedClient.add(Unknown Source) ~[na:na]
        at com.broadhop.memcache.impl.MemcacheClient.add(MemcacheClient.java:137) ~[na:na]
        at com.broadhop.memcache.impl.SemaphoreManager.getSemaphore(SemaphoreManager.java:72) ~[na:na]
        at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source) ~[na:na]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11]
        at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.doInvoke(ServiceInvoker.java:58) ~[na:na]
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.invoke(ServiceInvoker.java:62) ~[na:na]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:71) ~[na:na]
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:54) ~[na:na]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.osgi.service.importer.support.LocalBundleContextAdvice.invoke(LocalBundleContextAdvice.java:59) ~[org.springframework.osgi.core_2.0.0.M1.jar:2.0.0.M1]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) ~[org.springframework.aop_3.0.5.RELEASE.jar:3.0.5.RELEASE]
        at com.sun.proxy.$Proxy61.getSemaphore(Unknown Source) ~[na:na]
        at com.broadhop.cache.mongodb.dao.impl.ShardInterface$MonitorFailover.run(ShardInterface.java:164) ~[com.broadhop.policy.mdb.cache_7.0.1.r068284.jar:na]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11]
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11]
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.