[Pacemaker] pacemaker processes RSS growth
Vladislav Bogdanov
bubble at hoster-ok.com
Fri Sep 14 02:54:38 EDT 2012
13.09.2012 15:18, Vladislav Bogdanov wrote:
...
> and now it runs on my testing cluster.
>
> Ipc-related memory problems seem to be completely fixed now, processes
> own memory (RES-SHR in terms of htop) does not grow any longer (after 40
> minutes). Although I see that both RES and SHR counters sometimes
> increase synchronously. lrmd does not grow at all. Will look again after
> few hours.
So, lrmd is ok. I see only 4kb growth in RES-SHR on one node (current
DC). Other instances are of the constant size for almost a day.
I see RES-SHR growth in pacemakerd (>100kb per day). So I expect some
leakage here. Should I run it under valgrind?
And I see that both RES and SHR synchronously grow in crmd (600-700kb
per day on member nodes, 6Mb on DC), while RES-SHR is reduced by 24kb on
DC.
And I see cib growth in both RES and SHR in range 12-340 kb, and 4kb
growth in RES-SHR on nodes except DC.
I can't say for sure what causes growth of shared pages.
May be it is /dev/shm. Lot of files are there. I'll look if it grows.
# ls -l /dev/shm
total 75492
-rw------- 1 hacluster root 24 Sep 13 10:49
qb-attrd-control-1732-1734-6
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cfg-event-1634-1727-29-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cfg-event-1634-1727-29-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-event-1634-1734-37-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-event-1634-1734-37-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-event-1634-1734-38-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-event-1634-1734-38-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-event-1634-1734-39-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-event-1634-1734-39-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cfg-event-1634-2440-36-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cfg-event-1634-2440-36-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cfg-request-1634-1727-29-data
-rw------- 1 root root 8252 Sep 13 10:49
qb-cfg-request-1634-1727-29-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-request-1634-1734-37-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cfg-request-1634-1734-37-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-request-1634-1734-38-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cfg-request-1634-1734-38-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-request-1634-1734-39-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cfg-request-1634-1734-39-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cfg-request-1634-2440-36-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-cfg-request-1634-2440-36-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cfg-response-1634-1727-29-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cfg-response-1634-1727-29-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-response-1634-1734-37-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-response-1634-1734-37-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-response-1634-1734-38-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-response-1634-1734-38-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cfg-response-1634-1734-39-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cfg-response-1634-1734-39-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cfg-response-1634-2440-36-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cfg-response-1634-2440-36-header
-rw------- 1 hacluster root 24 Sep 13 10:49
qb-cib_rw-control-1729-1730-10
-rw------- 1 hacluster root 24 Sep 13 10:49
qb-cib_rw-control-1729-1732-12
-rw------- 1 hacluster root 524288 Sep 13 11:11
qb-cib_shm-event-1729-1734-8-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cib_shm-event-1729-1734-8-header
-rw------- 1 hacluster root 524288 Sep 13 21:55
qb-cib_shm-request-1729-1734-8-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cib_shm-request-1729-1734-8-header
-rw------- 1 hacluster root 524288 Sep 13 10:49
qb-cib_shm-response-1729-1734-8-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cib_shm-response-1729-1734-8-header
-rw------- 1 root root 8388608 Sep 14 06:34 qb-corosync-blackbox-data
-rw------- 1 root root 8248 Sep 13 10:49 qb-corosync-blackbox-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cpg-event-1634-1727-30-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cpg-event-1634-1727-30-header
-rw------- 1 hacluster root 1048576 Sep 13 11:11
qb-cpg-event-1634-1729-33-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-event-1634-1729-33-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cpg-event-1634-1730-32-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cpg-event-1634-1730-32-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cpg-event-1634-1732-31-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-event-1634-1732-31-header
-rw------- 1 hacluster root 1048576 Sep 13 11:35
qb-cpg-event-1634-1734-34-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-event-1634-1734-34-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-event-1634-2440-41-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-event-1634-2440-41-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-event-1634-2440-44-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-event-1634-2440-44-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-event-1634-3140-42-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-event-1634-3140-42-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cpg-request-1634-1727-30-data
-rw------- 1 root root 8252 Sep 13 10:49
qb-cpg-request-1634-1727-30-header
-rw------- 1 hacluster root 1048576 Sep 13 17:58
qb-cpg-request-1634-1729-33-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cpg-request-1634-1729-33-header
-rw------- 1 root root 1048576 Sep 13 11:35
qb-cpg-request-1634-1730-32-data
-rw------- 1 root root 8252 Sep 13 10:49
qb-cpg-request-1634-1730-32-header
-rw------- 1 hacluster root 1048576 Sep 13 17:58
qb-cpg-request-1634-1732-31-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cpg-request-1634-1732-31-header
-rw------- 1 hacluster root 1048576 Sep 13 17:58
qb-cpg-request-1634-1734-34-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-cpg-request-1634-1734-34-header
-rw------- 1 root root 1048576 Sep 13 11:35
qb-cpg-request-1634-2440-41-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-cpg-request-1634-2440-41-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-request-1634-2440-44-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-cpg-request-1634-2440-44-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-request-1634-3140-42-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-cpg-request-1634-3140-42-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cpg-response-1634-1727-30-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cpg-response-1634-1727-30-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cpg-response-1634-1729-33-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-response-1634-1729-33-header
-rw------- 1 root root 1048576 Sep 13 10:49
qb-cpg-response-1634-1730-32-data
-rw------- 1 root root 8248 Sep 13 10:49
qb-cpg-response-1634-1730-32-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cpg-response-1634-1732-31-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-response-1634-1732-31-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-cpg-response-1634-1734-34-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-cpg-response-1634-1734-34-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-response-1634-2440-41-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-response-1634-2440-41-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-response-1634-2440-44-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-response-1634-2440-44-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-cpg-response-1634-3140-42-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-cpg-response-1634-3140-42-header
-rw------- 1 hacluster root 20480 Sep 13 10:49
qb-lrmd-event-1731-1734-5-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-lrmd-event-1731-1734-5-header
-rw------- 1 hacluster root 20480 Sep 13 10:50
qb-lrmd-request-1731-1734-5-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-lrmd-request-1731-1734-5-header
-rw------- 1 hacluster root 20480 Sep 13 10:49
qb-lrmd-response-1731-1734-5-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-lrmd-response-1731-1734-5-header
-rw------- 1 hacluster root 5242880 Sep 13 11:29
qb-pengine-event-1733-1734-4-data
-rw------- 1 hacluster root 8248 Sep 13 11:29
qb-pengine-event-1733-1734-4-header
-rw------- 1 hacluster root 5242880 Sep 13 23:50
qb-pengine-request-1733-1734-4-data
-rw------- 1 hacluster root 8252 Sep 13 11:29
qb-pengine-request-1733-1734-4-header
-rw------- 1 hacluster root 5242880 Sep 13 11:29
qb-pengine-response-1733-1734-4-data
-rw------- 1 hacluster root 8248 Sep 13 11:29
qb-pengine-response-1733-1734-4-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-quorum-event-1634-1734-35-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-quorum-event-1634-1734-35-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-event-1634-2440-40-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-quorum-event-1634-2440-40-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-event-1634-3140-43-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-quorum-event-1634-3140-43-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-quorum-request-1634-1734-35-data
-rw------- 1 hacluster root 8252 Sep 13 10:49
qb-quorum-request-1634-1734-35-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-request-1634-2440-40-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-quorum-request-1634-2440-40-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-request-1634-3140-43-data
-rw------- 1 root root 8252 Sep 13 10:50
qb-quorum-request-1634-3140-43-header
-rw------- 1 hacluster root 1048576 Sep 13 10:49
qb-quorum-response-1634-1734-35-data
-rw------- 1 hacluster root 8248 Sep 13 10:49
qb-quorum-response-1634-1734-35-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-response-1634-2440-40-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-quorum-response-1634-2440-40-header
-rw------- 1 root root 1048576 Sep 13 10:50
qb-quorum-response-1634-3140-43-data
-rw------- 1 root root 8248 Sep 13 10:50
qb-quorum-response-1634-3140-43-header
-rw------- 1 root root 24 Sep 13 10:50
qb-stonith-ng-control-1730-1731-11
-rw------- 1 hacluster root 24 Sep 13 10:49
qb-stonith-ng-control-1730-1734-8
Vladislav
More information about the Pacemaker
mailing list