Comments on: Using Process Memory Matrix script for calculating Oracle process memory usage on Solaris

By: MikeD

MikeD — Wed, 28 Dec 2011 20:48:22 +0000

@Max, the pmap man page seems to contradict itself. In one of the examples it states that for an Anon value of 56, “each additional bourne shell uses approximately 56Kbytes of additional physical memory.” Also the totals row is labelled total Kb, so that suggests the Anon is really in Kb.

@Tanel, good work on this. My question is this (hopefully not a stupid one). Are the virtual addresses unique to each process or do they represent all of the system’s virtual memory? When using the -t option with multiple pids, I have seen that the segment “type” can vary for the same address across different pids (one may be anon, one may be a lib, etc) and they can also have different allocations for the same segment. It looks like the join of the -x and the -S files will wipe out duplicate rows with the same virtual address. I’m wondering if that is an accurate way to deal with the duplicates or not.

By: Roberts

Roberts — Wed, 13 Jul 2011 08:57:39 +0000

Hi,
I tried to use script on Solaris, but did not succeded with -t option. As it does not show summary for me. Without -t option script seems to be working.
Roberts

uname -a
SunOS 5.10 Generic_142900-08 sun4v sparc SUNW,Sun-Blade-T6320

bash-3.00$ sudo -u oraclet1 ./procmm.sh -t `pgrep -f ora`

– procmm.sh: Process Memory Matrix v1.03 by Tanel Poder ( http://tech.e2sn.com )
– All numbers are shown in kilobytes

Total PIDs 19, working: ……………….

PID SEGMENT_TYPE VIRTUAL RSS ANON LOCKED SWAP_RSVD
—— ——————– ———— ———— ———— ———— ————
0 stack 1984 1984 1984 0 1984
0 tnslsnr 1688 1296 0 0 96
0 anon 256 224 96 0 248
0 lib 15544 12800 40 0 1096
0 heap 1584 1520 600 0 1584
—— ——————– ———— ———— ———— ———— ————
0 TOTAL(kB) 21056 17824 2720 0 5008

– Note that in Total (-t) calculation mode it makes sense to look into ANON and SWAP_RSVD
– totals only as other numbers may be heavily “doublecounted” due to overlaps of shared mappings

By: Max

Max — Mon, 02 Aug 2010 00:22:01 +0000

Also when man pmap, it says:

Anonymous Memory (Anon)

The number of pages, counted by using the system page
size, of anonymous memory associated with the specified
mapping. Anonymous memory shared with other address
spaces is not included, unless the -a option is speci-
fied.

Anonymous memory is reported for the process heap,
stack, for ‘copy on write’ pages with mappings mapped
with MAP_PRIVATE (see mmap(2)).

So “Anon” in pmap seems showing the number of pages, not in kb.

By: Max

Max — Mon, 02 Aug 2010 00:13:53 +0000

Hi Tanel,

The original process has logged out. Here is another example when both commands ran immediately one after another:

>pmap -x 18918
18918: oraclelpiweb (LOCAL=NO)
Address Kbytes 0000000100000000 103696 0000000106642000 832 0000000106712000 1960 0000000380000000 188416 00000003C0000000 172032 0000000400000000 180224 0000000440000000 176128 0000000480000000 16 FFFFFFFF7BA60000 64 FFFFFFFF7BAC0000 64 FFFFFFFF7BAD0000 64 FFFFFFFF7BAE0000 64 FFFFFFFF7BB00000 16 FFFFFFFF7BC04000 8 FFFFFFFF7BD00000 56 FFFFFFFF7BE0E000 8 FFFFFFFF7BF00000 640 FFFFFFFF7C09E000 40 FFFFFFFF7C100000 32 FFFFFFFF7C208000 8 FFFFFFFF7C300000 32 FFFFFFFF7C408000 8 FFFFFFFF7C500000 1264 FFFFFFFF7C700000 64 FFFFFFFF7C73C000 72 FFFFFFFF7C74E000 8 FFFFFFFF7C800000 8 FFFFFFFF7C902000 8 FFFFFFFF7CA00000 32 FFFFFFFF7CB08000 8 FFFFFFFF7CC00000 56 FFFFFFFF7CD00000 8 FFFFFFFF7CD0E000 16 FFFFFFFF7CE00000 688 FFFFFFFF7CF00000 64 FFFFFFFF7CF10000 64 FFFFFFFF7CF20000 64 FFFFFFFF7CF30000 64 FFFFFFFF7CF40000 64 FFFFFFFF7CF50000 64 FFFFFFFF7CF60000 64 FFFFFFFF7CF70000 64 FFFFFFFF7CFAC000 64 FFFFFFFF7CFBC000 32 FFFFFFFF7D000000 8 FFFFFFFF7D102000 8 FFFFFFFF7D200000 2184 FFFFFFFF7D500000 64 FFFFFFFF7D520000 240 FFFFFFFF7D55C000 8 FFFFFFFF7D600000 72 FFFFFFFF7D700000 24 FFFFFFFF7D710000 8 FFFFFFFF7D770000 64 FFFFFFFF7D780000 64 FFFFFFFF7D790000 64 FFFFFFFF7D7A0000 64 FFFFFFFF7D7B0000 64 FFFFFFFF7D7C0000 64 FFFFFFFF7D7D0000 64 FFFFFFFF7D7E0000 64 FFFFFFFF7D800000 9272 FFFFFFFF7E200000 8 FFFFFFFF7E20C000 560 FFFFFFFF7E300000 1072 FFFFFFFF7E500000 8 FFFFFFFF7E50A000 56 FFFFFFFF7E518000 8 FFFFFFFF7E600000 1072 FFFFFFFF7E800000 8 FFFFFFFF7E80A000 56 FFFFFFFF7E818000 8 FFFFFFFF7E900000 1376 FFFFFFFF7EB00000 8 FFFFFFFF7EB56000 64 FFFFFFFF7EB66000 8 FFFFFFFF7EC00000 1536 FFFFFFFF7EE00000 8 FFFFFFFF7EE7E000 64 FFFFFFFF7EE8E000 8 FFFFFFFF7EF00000 8 FFFFFFFF7F000000 8 FFFFFFFF7F100000 1752 FFFFFFFF7F300000 8 FFFFFFFF7F3B4000 72 FFFFFFFF7F3C6000 16 FFFFFFFF7F400000 144 FFFFFFFF7F500000 8 FFFFFFFF7F522000 16 FFFFFFFF7F600000 216 FFFFFFFF7F700000 8 FFFFFFFF7F736000 16 FFFFFFFF7F73A000 8 FFFFFFFF7F7B8000 8 FFFFFFFF7FFDE000 136 —————- total Kb 848000 >./procmm.sh 18918 RSS Anon Locked Mode Mapped File
103624 – – r-x– oracle
656 208 – rwx– oracle
912 888 – rwx– [ heap ]
188416 – 188416 rwxsR [ ism shmid=0x6a00002c ]
172032 – 172032 rwxsR [ ism shmid=0x50000032 ]
180224 – 180224 rwxsR [ ism shmid=0x6c000038 ]
176128 – 176128 rwxsR [ ism shmid=0xf000042 ]
16 – 16 rwxsR [ ism shmid=0x7b000043 ]
64 64 – rw— [ anon ]
40 40 – rw— [ anon ]
64 64 – rw— [ anon ]
40 40 – rw— [ anon ]
16 – – r-x– liblgrp.so.1
8 8 – rwx– liblgrp.so.1
56 – – r-x– libmd.so.1
8 8 – rwx– libmd.so.1
472 – – r-x– libm.so.2
32 24 – rwx– libm.so.2
32 – – r-x– librt.so.1
8 8 – rwx– librt.so.1
32 – – r-x– libaio.so.1
8 8 – rwx– libaio.so.1
896 – – r-x– libc.so.1
32 32 – rwx– [ anon ]
72 72 – rwx– libc.so.1
– – – rwx– libc.so.1
8 – – r-x– libdl.so.1
8 8 – rwx– libdl.so.1
32 – – r-x– libgen.so.1
8 8 – rwx– libgen.so.1
56 – – r-x– libsocket.so.1
8 8 – rwx– [ anon ]
16 16 – rwx– libsocket.so.1
448 – – r-x– libnsl.so.1
16 16 – rw— [ anon ]
64 64 – rw— [ anon ]
64 56 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rwx– libnsl.so.1
32 24 – rwx– libnsl.so.1
8 – – r-x– libkstat.so.1
8 8 – rwx– libkstat.so.1
408 – – r-x– libnnz10.so
64 64 – rwx– [ anon ]
216 200 – rwx– libnnz10.so
– – – rwx– libnnz10.so
72 – – r-x– libdbcfg10.so
16 16 – rwx– [ anon ]
8 8 – rwx– libdbcfg10.so
64 56 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
64 64 – rw— [ anon ]
32 32 – rw— [ anon ]
8208 – – r-x– libjox10.so
8 8 – rwx– [ anon ]
560 448 – rwx– libjox10.so
112 – – r-x– libclsra10.so
8 8 – rwx– [ anon ]
40 40 – rwx– libclsra10.so
– – – rwx– libclsra10.so
192 – – r-x– libocrutl10.so
8 – – r-x– libc_psr.so.1
48 48 – rwx– libocrutl10.so
– – – rwx– libocrutl10.so
192 – – r-x– libocrb10.so
8 8 – rwx– [ anon ]
56 56 – rwx– libocrb10.so
– – – rwx– libocrb10.so
256 – – r-x– libocr10.so
8 8 – rwx– [ anon ]
56 56 – rwx– libocr10.so
– – – rwx– libocr10.so
8 – – r-x– libskgxn2.so
8 8 – rwx– libskgxn2.so
792 – – r-x– libhasgen10.so
8 8 – rwx– [ anon ]
64 64 – rwx– libhasgen10.so
8 8 – rwx– libhasgen10.so
96 – – r-x– libskgxp10.so
8 8 – rwx– [ anon ]
16 16 – rwx– libskgxp10.so
216 – – r-x– ld.so.1
8 – – r-x– libsched.so.1
16 16 – rwx– ld.so.1
8 8 – rwx– ld.so.1
8 – – rwxs- [ anon ]
136 136 – rw— [ stack ]
———- ———- ———- ———-
837472 3768 716816

– procmm.sh: Process Memory Matrix v1.02 by Tanel Poder ( http://tech.e2sn.com )
– All numbers are shown in kilobytes

PID SEGMENT_TYPE VIRTUAL RSS ANON LOCKED SWAP_RSVD
—— ——————– ———— ———— ———— ———— ————
18918 stack 136 136 136 0 136
18918 anon 1496 1328 1304 0 1488
18918 lib 23064 14000 1232 0 1512
—— ——————– ———— ———— ———— ———— ————
18918 TOTAL(kB) 24696 15464 2672 0 3136

Thanks,
Max

By: Tanel Poder

Tanel Poder — Fri, 30 Jul 2010 06:07:35 +0000

@Max
Can you send me the full output of both commands?

As which user are you running this command? (is the oracle user or a member of dba group)?

procmm should report more output than the current (for example the shared mem segments etc).

By: Max

Max — Fri, 30 Jul 2010 02:36:49 +0000

Can anyone please explain the following output from “pmap” and “procmm.sh”, where the number for “Anon” from “pmap” is more likely “SWAP_RSVD” from “procmm.sh”?

# pmap -x 20211
20211: oraclelpiweb (LOCAL=NO)
Address Kbytes RSS Anon Locked Mode Mapped File
0000000100000000 103696 103392 – – r-x– oracle
0000000106642000 832 560 208 – rwx– oracle
…
FFFFFFFF7FFE8000 96 96 96 – rw— [ stack ]
—————- ———- ———- ———- ———-
total Kb 847512 837128 2736 716816

# ./procmm.sh 20211

– procmm.sh: Process Memory Matrix v1.02 by Tanel Poder ( http://tech.e2sn.com )
– All numbers are shown in kilobytes

PID SEGMENT_TYPE VIRTUAL RSS ANON LOCKED SWAP_RSVD
—— ——————– ———— ———— ———— ———— ————
20211 stack 96 96 96 0 96
20211 anon 1048 960 816 0 1040
20211 lib 23064 14392 944 0 1512
—— ——————– ———— ———— ———— ———— ————
20211 TOTAL(kB) 24208 15448 1856 0 2648

By: Tanel Poder

Tanel Poder — Mon, 19 Jul 2010 11:25:26 +0000

@maclean Thanks, do you have an example output of svmon -P? (believe it or not, but I don't have an AIX box in my garage ;-) By the way, I've updated the script and fixed the earlier problems with it (which caused AWK to fail)

By: maclean

maclean — Mon, 19 Jul 2010 10:42:51 +0000

till aix 6.1 , procmap command do not show anon segment and stack detail,
Maybe workaround way is utilizing “svmon -P” , but it reports in another style format.

By: Tanel Poder

Tanel Poder — Thu, 15 Apr 2010 09:32:43 +0000

I’ve fixed the AWK problem in the script (by replacing awk with nawk), so it should work now…

By: carey holman

carey holman — Sun, 04 Apr 2010 01:16:14 +0000

@Taral I had the same problem. Try nawk instead of awk.