Good morning. Since the problem didn't happen for me any more in the lab, I tried it on the ARM supercomputer during what may be my last slot before it moves to a place I can't get to any more network-wise.
I am not allowed to send logs directly without them clearing them for release. However, when using overlay with nfs v4 and the ganesha config file below... While booting 2592 nodes spread across 9 Gluster/Ganesha servers, the ganesha daemons all died on all 9 servers.
This run was full debug with the config below.
I'm going to archive these logs so that I can get them blessed for release later.
I'll mention that the logs seem to have this at the end:
<snip> :NFS4 :F_DBG :Maximum allowed attr index = 76
That's the max for NFS v4.1, so nothing special there, however, it does indicate a GETATTR was the last thing processed.
I am going back in the thread to find the other log setup you wanted for one more run. Then I will switch away from overlayfs and use TMPFS overmounts for the writable areas instead, which seemed to be more reliable in the lab.
If you happen to be reading this now and need me to collect anything in a different way, let me know. After my time slot I may never get access again to this specific system. The next large systems I'll have access to months from now will be x86_64 based clusters.
NFS_CORE_PARAM { Clustered = TRUE; RPC_Max_Connections = 2048; }
NFSv4 { Graceless = True; Allow_Numeric_Owners = True; Only_Numeric_Owners = True; }
EXPORT_DEFAULTS { Squash = none; }
Disable_ACL = TRUE;
EXPORT { # Export Id (mandatory, each EXPORT must have a unique Export_Id) Export_Id = 10; Disable_ACL = TRUE;
# Exported path (mandatory) Path = "/cm_shared"; # assuming 'testvol' is the Gluster volume name
# Pseudo Path (required for NFS v4) Pseudo = "/cm_shared";
# Required for access (default is None) # Could use CLIENT blocks instead Access_Type = RW;
Squash = none;
# Security flavor supported SecType = "sys";
# Exporting FSAL FSAL { Name = "GLUSTER"; Hostname = "127.0.0.1"; # IP of one of the nodes in the trusted pool Volume = "cm_shared"; }
}
LOG { Components { ALL = FULL_DEBUG; } } _______________________________________________ Devel mailing list -- devel@lists.nfs-ganesha.org To unsubscribe send an email to devel-leave@lists.nfs-ganesha.org