Guest

Preview Tool

Cisco Bug: CSCvv14550 - Large atop files causing /local partition to fill up and throw DiskUsageWarning on Service Status

Last Modified

Oct 22, 2020

Products (1)

  • Cisco Tetration Workload Security

Known Affected Releases

3.3(2.2) 3.3(2.28)

Description (partial)

Symptom:
DiskUsageWarning bosun alert raised for virtual machines within the cluster.

Sample metric : 
TSD metric sum:df{host=*,df_type_instance=used,df_instance=local,df_type=percent_bytes} with delimiter virtual-machine-instance with value:80. 5163269043 at time 1595373395 not in expected range 0:80 please check dependencies!

Conditions:
/local/logs/atop folder is consuming a high amount of disk space : 

[SiteName: tetinstall@virtual-machine-instance /]$ cd local
[SiteName: tetinstall@virtual-machine-instance local]$ du -Sh | sort -rh | head -5
46G     ./logs/atop   ----->>>atop log directory has 46G worth of logs
2.8G    ./logs/hadoop/hdfs
826M    ./adhoc/docker
603M    ./adhoc/conda/lib
346M    ./logs/yarn/yarn
 tetinstall@virtual-machine-instance local]$


tetinstall@datanodesmall-8 atop]$ ls -lh
total 46G
-rw-r--r--. 1 root root 23G Jul 24 19:18 atop_20191218.1    ---->23G log file
-rw-r--r--. 1 root root 20G Jul 24 19:18 atop_20200223.1    ---->20 log file
-rw-r--r--. 1 root root 71M Jun 13 23:59 atop_20200613.1
-rw-r--r--. 1 root root 72M Jun 14 23:59 atop_20200614.1
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.