[Nfs-ganesha-support] Re: Nfs-ganesha rgw config for multi tenancy rgw users

I stopped the rgw3 instance that is running on the same server (I am not sure anymore if I can run radosgw and nfs-ganesha with the same client.rgw3), started ganesha with this config. I am correct to understand that the ganesha-rgw is not using the http(s) interface and directly connects to ceph with librados (because that is why we have the RGW config section)? RGW { cluster = "ceph"; name = "client.rgw3"; ceph_conf = "/etc/ceph/ceph.conf"; } EXPORT { Export_ID=301; Path = "test:test3"; Pseudo = "/rgwtester"; FSAL { Name = RGW; User_Id = "test$tester1"; Access_Key_Id ="xxxxxx"; Secret_Access_Key = "xxxxxx"; } Disable_ACL = TRUE; CLIENT { Clients = 192.168.10.0/24; access_type = "RO"; } } Logs of ganesha related to test3 bucket [@]# tail -1000 /var/log/messages | grep ganesh | grep test3 Apr 30 22:24:55 c01 nfs-ganesha[604956]: [Admin] mdcache_exp_release :FSAL :INFO :Releasing RGW export for test:test3 Apr 30 22:24:55 c01 nfs-ganesha[604956]: [Admin] mdcache_exp_release :FSAL :INFO :Releasing RGW export for test:test3 Apr 30 22:27:07 c01 nfs-ganesha[644097]: [main] export_commit_common :CONFIG :INFO :Export 301 created at pseudo (/rgwtester) with path (test:test3) and tag ((null)) perms (options=03303002 , , , , , , , ) Apr 30 22:27:07 c01 nfs-ganesha[644097]: [main] export_commit_common :CONFIG :INFO :Export 301 created at pseudo (/rgwtester) with path (test:test3) and tag ((null)) perms (options=03303002 , , , , , , , ) [@]# showmount -e nfs Export list for nfs: /ram 192.168.x.0 /test 192.168.x.0 /rgwtester 192.168.x.0 [@ mnt]# mount nfs:/rgwtester /mnt/nfstest [@ mnt]# mount proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) ... nfs:/test on /home/users/robbert/nfs-test type nfs4 (rw,nodev,relatime,vers=4,intr,timeo=600,nolock,retrans=2,proto=tcp,naml en=255,hard,addr= nfs:/rgwtester on /mnt/nfstest type nfs (rw,vers=4,addr=192.168.x.x,clientaddr=192.168.x.x) [@ mnt]# ls -l /mnt/nfstest/ ls: reading directory /mnt/nfstest/: Remote I/O error total 0 -----Original Message----- From: Daniel Gryniewicz [mailto:dang@redhat.com] Sent: maandag 30 april 2018 20:06 To: Marc Roos; support Cc: Matt Benjamin Subject: Re: [Nfs-ganesha-support] Re: Nfs-ganesha rgw config for multi tenancy rgw users Okay, so on consultation, we think that maybe you should be mounting test:test3 (ie, <tenant:bucket>) with no '/'. I can't tell from the mail thread if you tried that; can you confirm? (I have no personal experience with multi-tenant, so I didn't recognize it as such). In the mean time, we'll try to reproduce here and see what we can see. Daniel On 04/30/2018 09:28 AM, Daniel Gryniewicz wrote: output: nfs-ganesha[3981596]: