Memory Leak with V2.7.4
by Rungta, Vandana
Readdir of a directory tree with millions of files causes the cache entries used to continue to grow beyond the Hi Watermark and never comes back down even after stopping the readdir and unmounting the share.
Nfs Ganesha V2.7.4
File share with 5 million files - 2000 directories with 2500 files in each
Hi Watermark configured for 500,000
Linux client mounting the share with NFS version 4.1
Start a readdir
(gdb) print lru_state
$1 = {entries_hiwat = 500000, entries_used = 1989506, chunks_hiwat = 100000, chunks_used = 797, fds_system_imposed = 400000, fds_hard_limit = 396000,
fds_hiwat = 360000, fds_lowat = 200000, futility = 0, per_lane_work = 50, biggest_window = 160000, prev_fd_count = 0, prev_time = 1560376713, fd_state = 0}
(gdb)
After some time:
(gdb) print lru_state
$1 = {entries_hiwat = 500000, entries_used = 2219506, chunks_hiwat = 100000, chunks_used = 889, fds_system_imposed = 400000, fds_hard_limit = 396000,
fds_hiwat = 360000, fds_lowat = 200000, futility = 0, per_lane_work = 50, biggest_window = 160000, prev_fd_count = 0, prev_time = 1560377613, fd_state = 0}
(gdb)
Continues to grow: (Matches the number of entries readdir has returned)
(gdb) print lru_state
$1 = {entries_hiwat = 500000, entries_used = 2312006, chunks_hiwat = 100000, chunks_used = 926, fds_system_imposed = 400000, fds_hard_limit = 396000,
fds_hiwat = 360000, fds_lowat = 200000, futility = 0, per_lane_work = 50, biggest_window = 160000, prev_fd_count = 0, prev_time = 1560377973, fd_state = 0}
(gdb)
Test ( Readdir ) stopped and share unmounted
(gdb) print lru_state
$1 = {entries_hiwat = 500000, entries_used = 2332006, chunks_hiwat = 100000, chunks_used = 934, fds_system_imposed = 400000, fds_hard_limit = 396000,
fds_hiwat = 360000, fds_lowat = 200000, futility = 0, per_lane_work = 50, biggest_window = 160000, prev_fd_count = 0, prev_time = 1560378063, fd_state = 0}
(gdb)
2 hours after the test is stopped – entries_used is unchanged:
(gdb) print lru_state
$1 = {entries_hiwat = 500000, entries_used = 2332006, chunks_hiwat = 100000, chunks_used = 934, fds_system_imposed = 400000, fds_hard_limit = 396000,
fds_hiwat = 360000, fds_lowat = 200000, futility = 0, per_lane_work = 50, biggest_window = 160000, prev_fd_count = 0, prev_time = 1560382845, fd_state = 0}
(gdb)
“top” shows continuously increasing memory usage by ganesha
3516 root 20 0 1908m 1.7g 7648 S 19.0 11.1 4:02.14 ganesha.nfsd
3516 root 20 0 3337m 3.1g 7648 S 2.0 20.3 7:25.74 ganesha.nfsd
3516 root 20 0 3710m 3.4g 7652 S 12.0 22.7 8:19.03 ganesha.nfsd
The issue is reproducible and I am happy to provide on any additional debug info or re-run with debug flags turned on.
Thanks,
Vandana
5 years, 6 months
Change in ...nfs-ganesha[next]: MDCACHE - whence search can have NULL prev_chunk
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/458125
Change subject: MDCACHE - whence search can have NULL prev_chunk
......................................................................
MDCACHE - whence search can have NULL prev_chunk
A whence search can have a NULL prev_chunk, in the case where we're
iterating to catch up, and ran into a hole in the chunks.
Change-Id: I25ff746a2806f92a4342eb5788473b1fc706f0a0
Signed-off-by: Daniel Gryniewicz <dang(a)redhat.com>
---
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c
1 file changed, 1 insertion(+), 2 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/25/458125/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/458125
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I25ff746a2806f92a4342eb5788473b1fc706f0a0
Gerrit-Change-Number: 458125
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
5 years, 6 months
Change in ...nfs-ganesha[next]: MDCACHE - Swapped dirents may already have a ref
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/458124
Change subject: MDCACHE - Swapped dirents may already have a ref
......................................................................
MDCACHE - Swapped dirents may already have a ref
If a dirent already exists, and creating one swaps to the existing one,
it's fine for that dirent to already have an entry refcounted.
Change-Id: I0c7b4d821122189b122dae78fbc33e76f72c38dc
Signed-off-by: Daniel Gryniewicz <dang(a)redhat.com>
---
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c
1 file changed, 10 insertions(+), 4 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/24/458124/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/458124
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I0c7b4d821122189b122dae78fbc33e76f72c38dc
Gerrit-Change-Number: 458124
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
5 years, 6 months
Change in ...nfs-ganesha[next]: MDCACHE - Fix chunk refcounting in readdir
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457970
Change subject: MDCACHE - Fix chunk refcounting in readdir
......................................................................
MDCACHE - Fix chunk refcounting in readdir
Chunk refcounting was a bit loose, and there was a case where a chunk
could get reaped while in use, when the write lock was held.
Clean up the chunk refcounting, so that all the pointers to chunks that
we keep during readdir have a refcount, and that we drop all the refs
appropriately.
Change-Id: Ic3acfc71d15cde1cdf68a46864f5e60445c4ff71
Signed-off-by: Daniel Gryniewicz <dang(a)redhat.com>
---
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.h
3 files changed, 155 insertions(+), 84 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/70/457970/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457970
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: Ic3acfc71d15cde1cdf68a46864f5e60445c4ff71
Gerrit-Change-Number: 457970
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
5 years, 6 months
Change in ...nfs-ganesha[next]: Document Chunks_HWMark
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457969
Change subject: Document Chunks_HWMark
......................................................................
Document Chunks_HWMark
Change-Id: I7659e4aaef6227bc3b2869b4547ac63aace85ccd
Signed-off-by: Daniel Gryniewicz <dang(a)redhat.com>
---
M src/doc/man/ganesha-cache-config.rst
1 file changed, 3 insertions(+), 0 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/69/457969/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457969
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I7659e4aaef6227bc3b2869b4547ac63aace85ccd
Gerrit-Change-Number: 457969
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
5 years, 6 months
Change in ...nfs-ganesha[next]: Store DRC in xprt for UDP
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457624
Change subject: Store DRC in xprt for UDP
......................................................................
Store DRC in xprt for UDP
The drc entry was moved to be stored in the xprt, but it was only stored
in the TCP case, resulting in a crash for UDP. Store it for UDP as
well.
Change-Id: Ie02367998e5574cc5f20775908d507ce1e145a0d
Signed-off-by: Daniel Gryniewicz <dang(a)redhat.com>
---
M src/RPCAL/nfs_dupreq.c
1 file changed, 1 insertion(+), 0 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/24/457624/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/457624
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: Ie02367998e5574cc5f20775908d507ce1e145a0d
Gerrit-Change-Number: 457624
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
5 years, 6 months
回复:[NFS-Ganesha-Devel]_Re:_[NFS-Ganesha-Devel]回复:Re:_Cannot_close_Error_with_gluster_FSAL
by QR
The issue disappears after upgrading glusterfs-api-devel from 4.1.5 to 6.1. So there is sth wrong with glusterfs-api-devel-4.1.5.
Thanks Soumya.
--------------------------------
----- 原始邮件 -----
发件人:Soumya Koduri <skoduri(a)redhat.com>
收件人:zhbingyin(a)sina.com, ganesha-devel <devel(a)lists.nfs-ganesha.org>, Frank Filz <ffilz(a)redhat.com>
主题:[NFS-Ganesha-Devel]_Re:_[NFS-Ganesha-Devel]回复:Re:_Cannot_close_Error_with_gluster_FSAL
日期:2019年06月03日 19点46分
Hi,
I retried the tests on RHEL-7.7 systems but still couldn't reproduce the
issue. Could you try using latest gluster release (gluster-6)?
Meanwhile one optimization we can work on is to make FSAL_GLUSTER open
atomic. Currently we invoke two calls via gfapi - create (to get handle)
followed by open (to get fd). By clubbing these two operations into one
call, we could fix this perm issue to an extent if not fully.
Thanks,
Soumya
On 6/1/19 4:56 AM, QR wrote:
> Hi Soumya, thanks for your help.
>
> The ganesha process is started by root, but the tar is executed by a
> non-root(I use qr here) user.
> The mount point is /home/glusterfs.
> Reproduce steps
> 1. Prepare the tar file and mount point with root user
> cd /tmp/perm
> echo 444 > big1.hdr
> chown qr:qr big1.hdr
> tar czf 444.tgz big1.hdr
> chown qr:qr 444.tgz
> mkdir /home/glusterfs/perm && chown qr:qr /home/glusterfs/perm
> 2. switch to non-root user: su qr
> 3. cd /home/glusterfs/perm
> 4. tar xzf /tmp/perm/444.tgz
>
> The ganesha and nfs client are on the same host.
> os version : CentOS Linux release 7.5.1804 (Core)
> kernel version: 3.10.0-693.17.1.el7.x86_64
> glusterfs api : glusterfs-api-devel-4.1.5-1.el7.x86_64
>
> ERROR LOGS - ganesha.log
> 01/06/2019 06:59:48 : ganesha.nfsd-7236[svc_2] glusterfs_close_my_fd
> :FSAL :CRIT :Error : close returns with Permission denied
> ERROR LOGS - ganesha-gfapi.log
> [2019-05-31 22:59:48.613207] E [MSGID: 114031]
> [client-rpc-fops_v2.c:272:client4_0_open_cbk] 0-gv0-client-0: remote
> operation failed. Path: /perm/big1.hdr
> (c591c1bf-9494-4222-8aa1-deaaf0b44c7f) [Permission denied]
> ERROR LOGS - export-sdb1-brick.log
> [2019-05-31 22:59:48.388169] W [MSGID: 113117]
> [posix-metadata.c:569:posix_update_utime_in_mdata] 0-gv0-posix: posix
> utime set mdata failed on file
> [2019-05-31 22:59:48.399813] W [MSGID: 113117]
> [posix-metadata.c:569:posix_update_utime_in_mdata] 0-gv0-posix: posix
> utime set mdata failed on file [函数未实现]
> [2019-05-31 22:59:48.403448] I [MSGID: 139001]
> [posix-acl.c:269:posix_acl_log_permit_denied] 0-gv0-access-control:
> client:
> CTX_ID:51affcdc-77ef-497d-aece-36a568671907-GRAPH_ID:0-PID:7236-HOST:nfs-ganesha-PC_NAME:gv0-client-0-RECON_NO:-0,
> gfid: c591c1bf-9494-4222-8aa1-deaaf0b44c7f,
> req(uid:1000,gid:1000,perm:2,ngrps:1),
> ctx(uid:1000,gid:1000,in-groups:1,perm:444,updated-fop:SETATTR, acl:-)
> [Permission denied]
> [2019-05-31 22:59:48.403499] E [MSGID: 115070]
> [server-rpc-fops_v2.c:1442:server4_open_cbk] 0-gv0-server: 124: OPEN
> /perm/big1.hdr (c591c1bf-9494-4222-8aa1-deaaf0b44c7f), client:
> CTX_ID:51affcdc-77ef-497d-aece-36a568671907-GRAPH_ID:0-PID:7236-HOST:nfs-ganesha-PC_NAME:gv0-client-0-RECON_NO:-0,
> error-xlator: gv0-access-control [Permission denied]
>
>
> --------------------------------
>
>
> ----- 原始邮件 -----
> 发件人:Soumya Koduri <skoduri(a)redhat.com>
> 收件人:zhbingyin(a)sina.com, ganesha-devel <devel(a)lists.nfs-ganesha.org>,
> Frank Filz <ffilz(a)redhat.com>
> 主题:[NFS-Ganesha-Devel] Re: Cannot close Error with gluster FSAL
> 日期:2019年06月01日 01点35分
>
>
> On 5/31/19 1:55 PM, Soumya Koduri wrote:
> >
> >
> > On 5/31/19 4:30 AM, QR wrote:
> >> We cannot decompress this file with gluster FSAL, but vfs FSAL and
> >> kernel nfs can.
> >> Is anyone know about this?
> >> Thanks in advance.
> >>
> >> [qr@nfs-ganesha perm]$ tar xzf /tmp/perm/444.tgz
> >> tar: big1.hdr: Cannot close: Permission denied
> >> tar: Exiting with failure status due to previous errors
> >> [qr@nfs-ganesha perm]$ tar tvf /tmp/perm/444.tgz
> >> -r--r--r-- qr/qr 4 2019-05-30 11:25 big1.hdr
> >>
> >
> > It could be similar to the issue mentioned in [1]. Will check and
> confirm.
> I couldn't reproduce this issue. What is the OS version of the server
> and client machines? Also please check if there are any errors in
> ganesha.log, ganesha-gfapi.log and brick logs. Most probably you are
> hitting the issues discussed in [1].
> The problem is that unlike most of the other FSALs in FSAL_GLUSTER we
> switch to user credentials before performing any operations on the
> backend file system [these changes were done to be able to run
> nfs-ganesha by a non-root user]
> The side-effect is that though first time the fd is opened as part of
> NFSv4.x client OPEN call, NFS-ganesha server may need to re-open the
> file to get additional fds to perform certain other operations like
> COMMIT, LOCK/LEASE and glusterfs doesn't grant RW access to those fds
> (as expected).
> Not sure if there is a clean way of fixing it. In [1], the author tried
> to workaround the problem by switching to root user if the ganesha
> process ID is also root. That means this issue will still remain if the
> ganesha process is started by a non-root user.
> @Frank,
> any thoughts?
> Thanks,
> Soumya
> >
> > Thanks,
> > Soumya
> >
> > [1] https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/447012
> >
> >> Ganesha server info
> >> ganesha version: a3c6fa39ce72682049391b7e094885a8c151b0c8(V2.8-rc1)
> >> FSAL : gluster
> >> nfs client info
> >> nfs version : nfs4.0
> >> mount options :
> >>
> rw,relatime,vers=4.0,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=XXX,local_lock=none,addr=YYY
>
> >>
> >>
> >> _______________________________________________
> >> Devel mailing list -- devel(a)lists.nfs-ganesha.org
> >> To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
> >>
> > _______________________________________________
> > Devel mailing list -- devel(a)lists.nfs-ganesha.org
> > To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
> _______________________________________________
> Devel mailing list -- devel(a)lists.nfs-ganesha.org
> To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
>
> _______________________________________________
> Devel mailing list -- devel(a)lists.nfs-ganesha.org
> To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
>
_______________________________________________
Devel mailing list -- devel(a)lists.nfs-ganesha.org
To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
5 years, 6 months
Announce Push of V2.8.0.1
by Frank Filz
Branch next
Tag:V2.8.0.1
Release Highlights
* MDCACHE - Release refs on dirents when chunk not consumed
* Don't call mdcache_locate_host in mdc_lookup if mdc_get_parent fails
* FSAL_CEPH : Fix inode reference leak
* Handle errors for in config blocks parsing.
* rpm: require nfs-ganesha-selinux
Signed-off-by: Frank S. Filz <ffilzlnx(a)mindspring.com>
Contents:
3973921 Frank S. Filz V2.8.0.1
0ac3137 Ken Dreyer rpm: require nfs-ganesha-selinux
ec41098 Gaurav Gangalwar Handle errors for in config blocks parsing.
1a9ed7f Prashant D FSAL_CEPH : Fix inode reference leak
c98ad1e Madhu Thorat Don't call mdcache_locate_host in mdc_lookup if
mdc_get_parent fails
136df4f Daniel Gryniewicz MDCACHE - Release refs on dirents when chunk not
consumed
5 years, 6 months
Ganesha 2.7.4 / ntirpc 1.7.4
by Daniel Gryniewicz
We're pleased to announce the release of ntirpc 1.7.4 and Ganesha
2.7.4. These are the last releases in the 1.7/2.7 series, and contain
many fixes to those branches.
ntirpc changes:
50eadf8d (HEAD -> v1.7, tag: v1.7.4, upstream/v1.7, origin/v1.7) 1.7.4
3dc65f44 SVC - Don't double release xprt on write error
cf01e379 _svcauth_gss - Clean up gss_data handling
f6e89b1f Don't attempt to destroy XPRT if CLNT create was unsuccessful
ccf92178 Mark ANYFD clients as local clients
c99acef0 Do not use macro "svcauth_gss_return"
f0d7a08e getclnthandle(): Fix assert(client == NULL) and destroy client
handle.
e42d079a Fix memory leak for RPCSEC_GSS
51d5406d Use "gss_get_mic" instead of "gss_sign"
07c33bca Close fd if makefd_xprt fails. We are doing accept and
returning XPRT_DIED without closing fd, which will be unmonitored and
cause fd leak. Client will see connection succeded but IO will hang on it.
68584411 Free 'ret' when returning NULL in __rpc_taddr2uaddr_af()
b3fc0c3d Make a header for strl*()
00f98844 Convert unsafe strncpy to strlcpy
Ganesha changes:
2aa33309d (HEAD -> V2.7-stable, upstream/V2.7-stable) Pullup ntirpc v1.7.4
f6c0e0256 rpc_callback: don't issue CB_NULL on new v4.1 channels
2bdd0a09a doc: add section about flags to ganesha-rados-grace manpage
f5d73f13b SAL - Remove state_obj as the last operation
6b33eccf8 SAL: Check for state type before reading lock.openstate
a5db2bed7 Handle close race in FSAL_MEM and FSAL_RGW
4a1edc863 spec file changes for RHEL8 python3
18840591c fsal_open2 - check for non-regular file when open by name
bc2a5fe34 FSAL fix race in FSAL close method
a0443381c MDCACHE - Restart readdir if directory is invalidated
482c3bafe [9P] _9p_lock doesn't process conflicts
99a0b7e96 Fix gobject for python3
f0639bf35 Don't mix tabs and spaces in python code
35aa16dbb MDCACHE - Update chunk pointers when splitting a chunk
183c0384f MEM - Set the parent pointer for a directory
153c40813 FSAL_CEPH: fix length calculation in reclaim_reset
6e140af4a NFS4 - Allow locking past the FSAL's maxfilesize
48aba24dc MDCACHE: Don't deref the mdcache_entry pointer once the ref is
dropped.
93df18c6c FSAL_GLUSTER: Enable readdir_plus option
f8fe93b3c FSAL_GLUSTER/lock_op: Unlock state's fdlock incase of error
66ea17295 MDCACHE - Fix race between lru functions for the chunk and the
parent of the chunk getting freed and reused.
d2099849b Add 'expire_time_parent' parameter and refill parent handle if
expired
b78896590 Fix memory leak in nlm4_Lock()
39cfa108d Fix NLM owner refcount leak in state_lock()
dbbb952d1 Fix memory leak for RPCSEC_GSS
d479cea6c Revert idmapper changes that accidentally got included in a patch
b466ee545 Free NLM block data when not used
fdf0c0af0 FSAL_CEPH: use a unique uuid string per export
2ec89031f Convert strncpy calls to a safer strlcpy
ec002cc34 Modify strmaxcpy definition to be more graceful!
dc246c5a4 [GPFS] Don't fail getattrs() if getting fs_locations fails
7a47aa917 Return ERR_FSAL_SYMLINK when trying to OPEN a SYMLINK
28762badd Call _9p_worker_shutdown when CORE_OPTION_9P is set
376f75377 Invalidate parent handle of a directory for invalidate UP call
2982625e5 Remove drc field from dupreq and avoid memory leak
0b85d48bf Release dupreq's ref on drc just before freeing the dupreq.
ae129e614 Handle dupreq hash deletion race
744423a52 Fix syntax error in ganesha_stats script
800985ebc Do not store transient open flags with fd
a8b9ed9ad Remove unused openflags
274a53c2b Don't log fields of file handle in nfs4_Is_Fh_Invalid and
nfs4_FSALToFhandle
cf3f6cdb4 [GPFS] Sanity checks for max no. of V4 ACE's supported
15515ebd2 locktest does not handle EACCES error for fcntl() F_SETLK
operation
f4d3f24f7 Status of "v4_full" is missing
ccc0500f2 Convert gsh_malloc and friends to macros
4a93c8e4c NFSv4 detailed statistics via ganesha_stats
5313a07fc NFSv3 detailed statistics via ganesha_stats
6db16635d Replaced a LogCrit() with LogEvent() in commonlib.c
46be167f7 [GPFS] Implement ignore_mode_change config option
04454aaa8 Replaced a LogMajor() with LogEvent() in nlm_util.c
5 years, 6 months