August 2019 - Support - NFS Ganesha List Archives

Using nfsidmap with NFS Ganesha on CentOS 7
by Alexander Bauer 16 Aug '19

16 Aug '19

Hello all, I'm attempting to configure my NFS Ganesha installation with nfsidmap, using local usernames. This is a home environment using trusted hosts and no central authentication yet, so I'm finding a lot of documentation on NFS Ganesha in enterprise environments, or in environments which accommodate self-compiling it with different configure flags. Right now, I have nfsidmap configured on my Ganesha server and on my NFS client, with matching domains, and users with matching names, but different UIDs on each. I have set the option nfs4_disable_idmapping=N (which disables idmapping when sec=sys) for nfsd and nfs on the server and client respectively. But files created from the client maintain the client user's UID when inspected on CephFS, rather than being translated to the server user's UID. I can't seem to figure out what configure flags the version in the CentOS SIG repo has, nor what the requirements are to allow Ganesha to use nfsidmap, nor what logging to enable to debug the process. Is there current documentation or a guide on interactions between the two, so that I can narrow down my issue? Thanks in advance, and warm wishes, Sasha

4 3

CentOS 7 Dependency Issues surrounding userspace-rcu
by Alexander Bauer 13 Aug '19

13 Aug '19

Hello all, I am encountering dependency issues in installing nfs-ganesha, and I’m hoping someone here may be able to help. I have a dedicated CentOS 7 VM for the purpose of running nfs-ganesha with the CephFS FSAL, pointed towards my existing Ceph cluster. I have installed the centos-nfs-ganesha28 release RPM, and have that repository enabled. I also have the Ceph Nautilus release RPM for el7 installed, which provides repositories of that release. I have these repositories enabled: [root@nfs ~]# yum repolist Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirror.umd.edu * centos-nfs-ganesha28: mirror.net.cen.ct.gov * epel: epel.mirror.constant.com * extras: repos.dfw.quadranet.com * updates: mirror.wdc1.us.leaseweb.net repo id repo name status Ceph/x86_64 Ceph packages for x86_64 210 Ceph-noarch Ceph noarch packages 45 base/7/x86_64 CentOS-7 - Base 10,019 centos-nfs-ganesha28/7/x86_64 CentOS-7 - NFS Ganesha 2.8 54 ceph-source Ceph source packages 0 epel/x86_64 Extra Packages for Enterprise Linux 7 - x86_64 13,338 extras/7/x86_64 CentOS-7 - Extras 435 updates/7/x86_64 CentOS-7 - Updates 2,500 repolist: 26,601 When I try to yum install nfs-ganesha, I get this dependency error: [root@nfs ~]# yum install nfs-ganesha Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirror.umd.edu * centos-nfs-ganesha28: mirror.net.cen.ct.gov * epel: ewr.edge.kernel.org * extras: repos.dfw.quadranet.com * updates: mirror.wdc1.us.leaseweb.net Resolving Dependencies --> Running transaction check ---> Package nfs-ganesha.x86_64 0:2.8.2-1.el7 will be installed --> Processing Dependency: psmisc for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libwbclient.so.0(WBCLIENT_0.9)(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libntirpc.so.1.8(NTIRPC_1.8.0)(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libwbclient.so.0()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: liburcu-bp.so.6()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: librados.so.2()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libntirpc.so.1.8()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Running transaction check ---> Package libntirpc.x86_64 0:1.8.0-1.el7 will be installed ---> Package librados2.x86_64 2:14.2.2-0.el7 will be installed --> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.2-0.el7.x86_64 ---> Package libwbclient.x86_64 0:4.8.3-6.el7_6 will be installed --> Processing Dependency: samba-client-libs = 4.8.3-6.el7_6 for package: libwbclient-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libreplace-samba4.so(SAMBA_4.8.3)(64bit) for package: libwbclient-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libreplace-samba4.so()(64bit) for package: libwbclient-4.8.3-6.el7_6.x86_64 ---> Package psmisc.x86_64 0:22.20-15.el7 will be installed ---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be updated --> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 ---> Package userspace-rcu.x86_64 0:0.10.0-3.el7 will be an update --> Running transaction check ---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed --> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 ---> Package samba-client-libs.x86_64 0:4.8.3-6.el7_6 will be installed --> Processing Dependency: samba-common = 4.8.3-6.el7_6 for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: samba-common = 4.8.3-6.el7_6 for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.9)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.31)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.30)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.21)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.20)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.16)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.14)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.13)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.12)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.3.11)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.3.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.5)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.2)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.1)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2(TALLOC_2.1.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2(TALLOC_2.0.2)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.3.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.30)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.19)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.1)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.23)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.15)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.10)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libaesni-intel-samba4.so(SAMBA_4.8.3)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libcups.so.2()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libavahi-common.so.3()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libavahi-client.so.3()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libaesni-intel-samba4.so()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 ---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be updated --> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Running transaction check ---> Package avahi-libs.x86_64 0:0.6.31-19.el7 will be installed ---> Package cups-libs.x86_64 1:1.6.3-35.el7 will be installed ---> Package libldb.x86_64 0:1.3.4-1.el7 will be installed ---> Package libtalloc.x86_64 0:2.1.13-1.el7 will be installed ---> Package libtdb.x86_64 0:1.3.15-1.el7 will be installed ---> Package libtevent.x86_64 0:0.9.36-1.el7 will be installed ---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed --> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 ---> Package samba-common.noarch 0:4.8.3-6.el7_6 will be installed ---> Package samba-common-libs.x86_64 0:4.8.3-6.el7_6 will be installed ---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be updated --> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 --> Finished Dependency Resolution Error: Package: lttng-ust-2.4.1-4.el7.x86_64 (epel) Requires: liburcu-cds.so.1()(64bit) Removing: userspace-rcu-0.7.16-1.el7.x86_64 (@epel) liburcu-cds.so.1()(64bit) Updated By: userspace-rcu-0.10.0-3.el7.x86_64 (centos-nfs-ganesha28) ~liburcu-cds.so.6()(64bit) Error: Package: lttng-ust-2.4.1-4.el7.x86_64 (epel) Requires: liburcu-bp.so.1()(64bit) Removing: userspace-rcu-0.7.16-1.el7.x86_64 (@epel) liburcu-bp.so.1()(64bit) Updated By: userspace-rcu-0.10.0-3.el7.x86_64 (centos-nfs-ganesha28) ~liburcu-bp.so.6()(64bit) You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest If I remove the EPEL repository, then I instead reach the following issue: librados2 cannot install correctly. [root@nfs ~]# yum remove epel-release Loaded plugins: fastestmirror Resolving Dependencies --> Running transaction check ---> Package epel-release.noarch 0:7-11 will be erased --> Finished Dependency Resolution Dependencies Resolved =================================================================================================================================================================================================================== Package Arch Version Repository Size =================================================================================================================================================================================================================== Removing: epel-release noarch 7-11 @extras 24 k Transaction Summary =================================================================================================================================================================================================================== Remove 1 Package Installed size: 24 k Is this ok [y/N]: y Downloading packages: Running transaction check Running transaction test Transaction test succeeded Running transaction Erasing : epel-release-7-11.noarch 1/1 Verifying : epel-release-7-11.noarch 1/1 Removed: epel-release.noarch 0:7-11 Complete! [root@nfs ~]# yum -y install nfs-ganesha Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile [52/1824] * base: mirror.umd.edu * centos-nfs-ganesha28: mirror.net.cen.ct.gov * extras: repos.dfw.quadranet.com * updates: mirror.wdc1.us.leaseweb.net Resolving Dependencies --> Running transaction check ---> Package nfs-ganesha.x86_64 0:2.8.2-1.el7 will be installed --> Processing Dependency: psmisc for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libwbclient.so.0(WBCLIENT_0.9)(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libntirpc.so.1.8(NTIRPC_1.8.0)(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libwbclient.so.0()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: liburcu-bp.so.6()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: librados.so.2()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Processing Dependency: libntirpc.so.1.8()(64bit) for package: nfs-ganesha-2.8.2-1.el7.x86_64 --> Running transaction check ---> Package libntirpc.x86_64 0:1.8.0-1.el7 will be installed ---> Package librados2.x86_64 2:14.2.2-0.el7 will be installed --> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.2-0.el7.x86_64 ---> Package libwbclient.x86_64 0:4.8.3-6.el7_6 will be installed --> Processing Dependency: samba-client-libs = 4.8.3-6.el7_6 for package: libwbclient-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libreplace-samba4.so(SAMBA_4.8.3)(64bit) for package: libwbclient-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libreplace-samba4.so()(64bit) for package: libwbclient-4.8.3-6.el7_6.x86_64 ---> Package psmisc.x86_64 0:22.20-15.el7 will be installed ---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be updated ---> Package userspace-rcu.x86_64 0:0.10.0-3.el7 will be an update --> Running transaction check ---> Package librados2.x86_64 2:14.2.2-0.el7 will be installed --> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.2-0.el7.x86_64 ---> Package samba-client-libs.x86_64 0:4.8.3-6.el7_6 will be installed --> Processing Dependency: samba-common = 4.8.3-6.el7_6 for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: samba-common = 4.8.3-6.el7_6 for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.9)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.31)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.30)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.21)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.20)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.16)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.14)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.13)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0(TEVENT_0.9.12)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.3.11)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 [11/1824] --> Processing Dependency: libtdb.so.1(TDB_1.3.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.5)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.2)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1(TDB_1.2.1)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2(TALLOC_2.1.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2(TALLOC_2.0.2)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.3.0)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.30)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.19)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_1.1.1)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.23)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.15)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1(LDB_0.9.10)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libaesni-intel-samba4.so(SAMBA_4.8.3)(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtevent.so.0()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtdb.so.1()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libtalloc.so.2()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libldb.so.1()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libcups.so.2()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libavahi-common.so.3()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libavahi-client.so.3()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Processing Dependency: libaesni-intel-samba4.so()(64bit) for package: samba-client-libs-4.8.3-6.el7_6.x86_64 --> Running transaction check ---> Package avahi-libs.x86_64 0:0.6.31-19.el7 will be installed ---> Package cups-libs.x86_64 1:1.6.3-35.el7 will be installed ---> Package libldb.x86_64 0:1.3.4-1.el7 will be installed ---> Package librados2.x86_64 2:14.2.2-0.el7 will be installed --> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-14.2.2-0.el7.x86_64 ---> Package libtalloc.x86_64 0:2.1.13-1.el7 will be installed ---> Package libtdb.x86_64 0:1.3.15-1.el7 will be installed ---> Package libtevent.x86_64 0:0.9.36-1.el7 will be installed ---> Package samba-common.noarch 0:4.8.3-6.el7_6 will be installed ---> Package samba-common-libs.x86_64 0:4.8.3-6.el7_6 will be installed --> Finished Dependency Resolution Error: Package: 2:librados2-14.2.2-0.el7.x86_64 (Ceph) Requires: liblttng-ust.so.0()(64bit) You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest I’m not certain quite what to make of this, other than hoping it’s user error on my part.

5 5

Extremely unstable export
by Valerio Luccio 12 Aug '19

12 Aug '19

Hi. I recently did an update of our system and my NFS export has become extremely unstable. It will work for a few minutes, but then stopsThe ganesha.log file shows the following messages: ganesha.nfsd-43423[dbus_heartbeat] nfs_health :DBUS :WARN :Health status is unhealthy. enq new: 116158, old: 116157; deq new: 116148, old: 116148 When I do a systemctl status -l I see: rpc-clnt-ping.c:162:rpc_clnt_ping_timer_expired For each of the servers in the set, but a ping of the server responds right away. I haven't been able to find online an explanation of the problem. Could anyone help ? Here are the current software version numbers: O/S: CentOS Linux release 7.6.1810 glusterfs: 5.8-1.el7 nfs-ganesha: 2.7.6-1.el7 Thanks, -- Valerio Luccio (212) 998-8736 Center for Brain Imaging 4 Washington Place, Room 157 New York University New York, NY 10003 "In an open world, who needs windows or gates ?"

2 1