Guest

Preview Tool

Cisco Bug: CSCut06951 - qps processes not responding to jmx call and log halted in qns-1.log

Last Modified

Dec 25, 2016

Products (1)

  • Cisco Mobility Services Engine

Known Affected Releases

7.0.1.3

Description (partial)

Symptom:
as seen in the diagnostics.sh script won't move from qns06.


[root@rtpclabqps5g-cc01b ~]# date
Mon Feb 23 15:07:56 MST 2015
[root@rtpclabqps5g-cc01b ~]# diagnostics.sh QPS Diagnostics Multi-Node Environment
---------------------------
Checking basic ports (80, 7070, 27717-27720, 27749, 8080, 9091)...
Could not connect to port 27719 on sessionmgr02 (Reporting Database)...[FAIL] Corrective Action(s):
 1. On sessionmgr02, run /etc/init.d/sessionmgr-27719 start  2. If it doesn't stay started (ps -ef | grep -v grep | grep 27719), run /etc/init.d/sessionmgr-27719 repair  3. When the repair finishes (tail -f /var/log/mongodb-27719.log), run /etc/init.d/sessionmgr-27719 start

Checking qns passwordless logins for all VMs...[PASS] Checking disk space for all VMs...
Disk usage on pcrfclient01...[WARN]
Disk usage is above warning threshold (90%) on pcrfclient01.
Results of: ssh root@pcrfclient01 -x 'df -hP'
-----------------------------------
Filesystem                       Size  Used Avail Use% Mounted on
/dev/mapper/vg_shiprock-lv_root  7.9G  2.0G  5.5G  27% /
tmpfs                            7.8G     0  7.8G   0% /dev/shm
/dev/sda1                        485M   32M  428M   7% /boot
/dev/mapper/vg_shiprock-lv_home  2.0G   68M  1.9G   4% /home
/dev/mapper/vg_shiprock-lv_var    85G   73G  7.4G  91% /var
-----------------------------------

Disk usage on pcrfclient02...[FAIL]
Disk usage is above critical threshold (97%) on pcrfclient02.
Results of: ssh root@pcrfclient02 -x 'df -hP -x iso9660'
-----------------------------------
Filesystem                       Size  Used Avail Use% Mounted on
/dev/mapper/vg_shiprock-lv_root  7.9G  2.0G  5.6G  27% /
tmpfs                            7.8G     0  7.8G   0% /dev/shm
/dev/sda1                        485M   32M  428M   7% /boot
/dev/mapper/vg_shiprock-lv_home  2.0G   68M  1.9G   4% /home
/dev/mapper/vg_shiprock-lv_var    85G   77G  3.1G  97% /var
-----------------------------------

Checking swap space for all VMs...[PASS] Checking for clock skew...[PASS] Checking QPS diagnostics...
  Retrieving diagnostics from qns01:9045...[PASS]
  Retrieving diagnostics from qns02:9045...[PASS]
  Retrieving diagnostics from qns03:9045...[PASS]
  Retrieving diagnostics from qns04:9045...[PASS]
  Retrieving diagnostics from qns05:9045...[PASS]
  Retrieving diagnostics from qns06:9045...^C [root@rtpclabqps5g-cc01b ~]# date Mon Feb 23 15:14:05 MST 2015 [root@rtpclabqps5g-cc01b ~]# exit

Conditions:
Idle system for a week
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.