Okay, so the boot system just runs mount, and then stops. What commands to you run inside the chroot to reproduce the problem? And what are the expected and actual results of these commands?
I'm literally just running 'su - erikj' at this point and watching it not work. I have a script in our "fat initrd" miniroot that resets the test case so I can start over quickly without rebooting. It also shows exactly what its doing: So the full text is: bash-4.2# bash reset.sh + umount /a + umount /root_ro_nfs + umount /rootfs.rw + mount -o ro,noatime,nocto,actimeo=3600,lookupcache=all,nolock,tcp,vers=3 172.23.255.249:/cm_shared/image/images_ro_nfs/rhel76-aarch64-newkernel /root_ro_nfs + mount -t tmpfs -o mpol=interleave tmpfs /rootfs.rw + mkdir /rootfs.rw/upperdir + mkdir /rootfs.rw/work + mount -t overlay overlay -o lowerdir=/root_ro_nfs,upperdir=/rootfs.rw/upperdir,workdir=/rootfs.rw/work /a bash-4.2# chroot /a sh: no job control in this shell sh-4.2# su - erikj su: warning: cannot change directory to /home/erikj: Operation not supported su: failed to execute /bin/bash: Operation not supported sh-4.2# exit exit
Okay, this is very interesting. If Ganesha is running on x86_64, then it's less likely to be an architecture issue, and more likely to be an NFS client version issue. What kernel version are you using on the aarch64 clients?
bash-4.2# uname -a Linux (none) 4.14.0-115.10.1.el7a.aarch64 #1 SMP Tue Jul 30 14:50:37 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux The above is technically a centos kernel (turns out our internal aarch64 rhel76 mirror isn't working) but I had the same results with true rhel76 GA kernel: 4.14.0-115.el7a.aarch64 I upgraded the kernel in the hopes the problem would disappear and I could move on :) hahah Erik