Okay. Could you try steps mentioned below -
https://www.thelinuxfaq.com/101-linux-su-cannot-set-groups-operation-not-...
Also found that a new option has been added to overlayfs to honour
disabling ACLs -
https://lkml.org/lkml/2019/5/2/7
Not sure if the kernel version you are using has this change. Maybe you
can give a try adding that mount option and use NFSv3.
Thanks,
Soumya
On 8/15/19 2:46 AM, Erik Jacobson wrote:
> Thank you - responses below:
>
>> Checked the tcpdump in more detail. "Execute" permission seem to have
got
>> denied for following paths even for root user -
>>
>> /cm_shared/image/images_ro_nfs/rhel76-aarch64-newkernel/etc/group
>>
>>
/cm_shared/image/images_ro_nfs/rhel76-aarch64-newkernel/usr/share/zoneinfo/America/Chicago
>>
>> Whereas in case of gNFS pkt trace, root user had Execute access.
>>
>> I am not sure why there is a difference here anf if this caused issue. Could
>> you cross check the perms on both mount point and at the backend bricks
>> path?
>
>
> leader1 (ganesha in question) has that gluster mounted under
> /opt/clmgr/shared_storage,so:
>
>
> [root@leader1 ~]# ls -l
/opt/clmgr/shared_storage/image/images_ro_nfs/rhel76-aarch64-newkernel/etc/group
/opt/clmgr/shared_storage/image/images_ro_nfs/rhel76-aarch64-newkernel//usr/share/zoneinfo/America/Chicago
> -rw-r--r-- 1 root root 718 Aug 11 12:19
/opt/clmgr/shared_storage/image/images_ro_nfs/rhel76-aarch64-newkernel/etc/group
> -rw-r--r-- 2 root root 3559 May 7 2018
/opt/clmgr/shared_storage/image/images_ro_nfs/rhel76-aarch64-newkernel//usr/share/zoneinfo/America/Chicago
>
>
>
> Here is the path on the 9 leaders (gluster 3x3):
> These two files are on subvolume 1, so they appear on three of the 9
> bricks and leaders (see end).
>
>
>
> [root@indeed ~]# pdsh -w leader[1-9] ls -l
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago|dshbak
> leader8: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader5: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader5: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> leader8: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> pdsh@indeed: leader5: ssh exited with exit code 2
> pdsh@indeed: leader8: ssh exited with exit code 2
> leader6: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader6: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> pdsh@indeed: leader6: ssh exited with exit code 2
> leader4: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader4: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> pdsh@indeed: leader4: ssh exited with exit code 2
> leader9: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader9: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> leader7: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group: No such file or
directory
> leader7: ls: cannot access
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago:
No such file or directory
> pdsh@indeed: leader9: ssh exited with exit code 2
> pdsh@indeed: leader7: ssh exited with exit code 2
> ----------------
> leader1
> ----------------
> -rw-r--r-- 2 root root 718 Aug 11 12:19
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group
> -rw-r--r-- 3 root root 3559 May 7 2018
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago
> ----------------
> leader2
> ----------------
> -rw-r--r-- 2 root root 718 Aug 11 12:19
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group
> -rw-r--r-- 3 root root 3559 May 7 2018
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago
> ----------------
> leader3
> ----------------
> -rw-r--r-- 2 root root 718 Aug 11 12:19
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64/etc/group
> -rw-r--r-- 3 root root 3559 May 7 2018
/data/brick_cm_shared/image/images_ro_nfs/rhel76-aarch64//usr/share/zoneinfo/America/Chicago
> _______________________________________________
> Devel mailing list -- devel(a)lists.nfs-ganesha.org
> To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
>