Guest

Preview Tool

Cisco Bug: CSCvv79024 - [CFD] Unable to bring Postgres Services up on Cluster , Glusterfs not mounting on Node 2

Last Modified

Sep 22, 2020

Products (1)

  • Cisco DNA Center

Known Affected Releases

DNAC1.2.10

Description (partial)

Symptom:
Unable to bring up postgres services and also Glusterfs is not getting mounted on Node 2 (which is up for an RMA)


postgres-0                                               2/3       CrashLoopBackOff    11         1d        10.254.243.31    10.254.22.1
postgres-1                                               0/3       ContainerCreating   0          6m        <none>           10.254.22.2
postgres-2                                               3/3       Running             12         14d       10.254.247.93    10.254.22.3


OP  of repmgr cluster show on Node 3(containing postgres-2 which is in the Running state)

[Fri Sep 18 17:31:54 UTC] maglev@10.254.22.3 (maglev-master-10) ~
$  docker exec -it $(docker ps | awk '/postgres_postgres-[0-2]+_fusion/ {print $1}') su postgres -c 'repmgr cluster show'
INFO: connecting to database
ERROR: connection to database failed: could not connect to server: Connection refused
        Is the server running on host "postgres-2.postgres.fusion.svc.cluster.local" (10.254.247.93) and accepting
        TCP/IP connections on port 5433?


From logs we found that postgres-1 is master and on Node 2 (which is scheduled for an RMA) but we are not able to bring this up




Gluster not mounted on Node 2:

root@maglev-master-10:~# su maglev -c "df -h"
Filesystem      Size  Used Avail Use% Mounted on
udev            126G     0  126G   0% /dev
tmpfs            26G  2.5M   26G   1% /run
/dev/sda2        29G   18G  8.7G  68% /
tmpfs           126G  640K  126G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           126G     0  126G   0% /sys/fs/cgroup
/dev/sda3        29G   44M   27G   1% /install2
/dev/sda4       9.3G  1.5G  7.3G  18% /var
/dev/sda6       344G   35G  292G  11% /data
/dev/sdb1       420G   14G  385G   4% /data/maglev/srv/fusion
/dev/sdb2       1.4T  117G  1.2T  10% /data/maglev/srv/maglev-system
/dev/sdc1       3.5T   69M  3.3T   1% /data/maglev/srv/ndp

Conditions:
DNAC : 1.2.10
Bug details contain sensitive information and therefore require a Cisco.com account to be viewed.

Bug Details Include

  • Full Description (including symptoms, conditions and workarounds)
  • Status
  • Severity
  • Known Fixed Releases
  • Related Community Discussions
  • Number of Related Support Cases
Bug information is viewable for customers and partners who have a service contract. Registered users can view up to 200 bugs per month without a service contract.