5:08 a.m.
Hi,
We have a 2-node NFS ganesha cluster (using CTDB), that I recently inherited
administration for.
Most of our internal users are satisfied with the performance, but one particular user has
had all sorts of performance related issues affecting their adoption and usage of the NFS
shares. From initial analysis, this seems to be a problem of loading (because it occurs
during intensive reads/writes of large datasets, such as during rsync transfers or backup
reads).
So far, I have not yet been able to establish whether the problem is due to the number of
files or the volume of data, and I am now setting up test client nodes to try and
reproduce the client's issues.
I googled around seeking information on tuning (kernel, NFS, OS, etc), but cannot seem to
find any at all. Please, can someone share some insight into how to go about trying to
optimize the performance of ganesha. Also, would appreciate any insight /suggestion on
how best to benchmark the performance.
Thanks in advance
11:26 a.m.
New subject: New to NFS Ganesha - seeking general info on tuning and benchmarking
I also run ganesha active/active with ctdb, my versions are quite outdated
now, haven't done much tuning but I'll share some thoughts
I'm assuming you're using the ceph FSAL with Ganesha rather than exporting
a cephfs kernel mount.
Increasing the ceph client cache size made the biggest difference for me,
that's the client_oc_size parameter, you set that in the [client] section
of your ceph.conf on the Ganesha servers. I have all the Ganesha caching
turned off in my Ganesha.conf (don't have access currently to post
parameters)
If you have any reasonably fast local storage on one of the Ganesha
servers, I would export a dir using the VFS FSAL and mount that on your
user's terminal and test their workload. If there's no improvement, that
would suggest the bottleneck is the nfs implementation rather than ceph.
Or try and reproduce the workload on a ceph kernel mount, if performance is
still poor that would suggest the issue is with your cluster.
In terms of benchmarking I typically use good old fio
Let me know how you get on
On Fri, 1 Oct 2021, 11:09 , <zlaymonk(a)gmail.com> wrote:
Hi,
We have a 2-node NFS ganesha cluster (using CTDB), that I recently
inherited administration for.
Most of our internal users are satisfied with the performance, but one
particular user has had all sorts of performance related issues affecting
their adoption and usage of the NFS shares. From initial analysis, this
seems to be a problem of loading (because it occurs during intensive
reads/writes of large datasets, such as during rsync transfers or backup
reads).
So far, I have not yet been able to establish whether the problem is due
to the number of files or the volume of data, and I am now setting up test
client nodes to try and reproduce the client's issues.
I googled around seeking information on tuning (kernel, NFS, OS, etc), but
cannot seem to find any at all. Please, can someone share some insight
into how to go about trying to optimize the performance of ganesha. Also,
would appreciate any insight /suggestion on how best to benchmark the
performance.
Thanks in advance
_______________________________________________
Support mailing list -- support(a)lists.nfs-ganesha.org
To unsubscribe send an email to support-leave(a)lists.nfs-ganesha.org
940
days inactive
946
days old
1 comments
2 participants
participants (2)
-
David C -
zlaymonk＠gmail.com