I'm not sure I'm understanding the problem here. Is it that you can list a file but not see it's contents? Or is it that you cannot list a file, but can still open the file if you use a full path to it? Is it files, or directories, or both? What version of Ganesha are you using? What FSAL are you using? Daniel On 11/10/20 6:43 PM, David Hansen wrote: > Hi Ganesha support, > > There are more general questions. I have a client reporting that mounted > via linux hosts he sometimes is not able to see the contents. Logging on > to the Ganesha server on the local dir does show them however. I was > wondering if someone could point me in the right direction for possible > caching options to throw in the mount to make sure the client cach is up > to date? Some things we've tried: > > * We tried umounting /dataBA on the VM and mounting again, didn't help > * We rebooted the VM, didn't help > * We checked VAS info for user on nfs server and VM, looked ok. > > > Here we see we can cd into a directory (redacted6) that doesn't show up > in ls. > We thought maybe touching a file would force a cache update or something. > > [user6@b5c06 redacted4]$ cd redacted5/ > [user6@b5c06 redacted5]$ ls > afile > [user6@b5c06 redacted5]$ ls -lh > total 0 > -rw-------. 1 user67 hpc.default 0 Nov 2 23:10 afile > [user6@b5c06 redacted5]$ rm afile > [user6@b5c06 redacted5]$ ls > [user6@b5c06 redacted5]$ cd redacted6 > [user6@b5c06 redacted6]$ ls > 0-15ft 10ft 15ft 17-30ft 25ft 5ft > [user6@b5c06 redacted6]$ cd .. > [user6@b5c06 redacted5]$ ls > > Any pointers or insight would be fantastic. > > Thanks > > -- > David Hansen > WekaIO > davidh(a)weka.io <mailto:davidh@weka.io> *•* https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/&g=N... > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/%3Futm_s... > > The World's Fastest File System > > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/promo/20... > > > > _______________________________________________ > Support mailing list -- support(a)lists.nfs-ganesha.org > To unsubscribe send an email to support-leave(a)lists.nfs-ganesha.org >

What underlying filesystem? We may need some debug logs and/or tcpdump traces to figure out what’s going wrong. Frank *From:* David Hansen [mailto:davidh@weka.io] *Sent:* Wednesday, November 11, 2020 7:20 AM *To:* Daniel Gryniewicz <dang(a)redhat.com&gt; *Cc:* support(a)lists.nfs-ganesha.org *Subject:* [NFS-Ganesha-Support] Re: Invisible files Thank you Daniel for your reply, If you have 2 folders, one nested, /dir1/dir2 and you issue an ls command in dir1. It won't show dir2 however you can cd into that directory directly. The ganesha config is as follows: ################################################### NFSV4 { DomainName = lmco.com <https://avanan.url-protection.com/v1/url?o=http%3A//lmco.com&g=NTg3Zj... ; } NFS_CORE_PARAM { NFS_Port = 2049; MNT_Port = 20048; Rquota_Port = 875; NLM_Port = 32803; NFS_Protocols = 3,4; } EXPORT_DEFAULTS { Access_Type = RW; Manage_Gids = true; Protocols = 3,4; Transports = TCP; } EXPORT { # Export Id (mandatory, each EXPORT must have a unique Export_Id) Export_Id = 4; # Exported path (mandatory) Path = /scratch; # Pseudo Path (required for NFS v4) Pseudo = /scratch; # Required for access (default is None) # Could use CLIENT blocks instead # Exporting FSAL FSAL { Name = VFS; } } Thank you David On Wed, Nov 11, 2020 at 6:47 AM Daniel Gryniewicz <dang(a)redhat.com&gt; wrote: I'm not sure I'm understanding the problem here. Is it that you can list a file but not see it's contents? Or is it that you cannot list a file, but can still open the file if you use a full path to it? Is it files, or directories, or both? What version of Ganesha are you using? What FSAL are you using? Daniel On 11/10/20 6:43 PM, David Hansen wrote: > Hi Ganesha support, > > There are more general questions. I have a client reporting that mounted > via linux hosts he sometimes is not able to see the contents. Logging on > to the Ganesha server on the local dir does show them however. I was > wondering if someone could point me in the right direction for possible > caching options to throw in the mount to make sure the client cach is up > to date? Some things we've tried: > > * We tried umounting /dataBA on the VM and mounting again, didn't help > * We rebooted the VM, didn't help > * We checked VAS info for user on nfs server and VM, looked ok. > > > Here we see we can cd into a directory (redacted6) that doesn't show up > in ls. > We thought maybe touching a file would force a cache update or something. > > [user6@b5c06 redacted4]$ cd redacted5/ > [user6@b5c06 redacted5]$ ls > afile > [user6@b5c06 redacted5]$ ls -lh > total 0 > -rw-------. 1 user67 hpc.default 0 Nov 2 23:10 afile > [user6@b5c06 redacted5]$ rm afile > [user6@b5c06 redacted5]$ ls > [user6@b5c06 redacted5]$ cd redacted6 > [user6@b5c06 redacted6]$ ls > 0-15ft 10ft 15ft 17-30ft 25ft 5ft > [user6@b5c06 redacted6]$ cd .. > [user6@b5c06 redacted5]$ ls > > Any pointers or insight would be fantastic. > > Thanks > > -- > David Hansen > WekaIO > davidh(a)weka.io <mailto:davidh@weka.io> *•* https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/&g=N... > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/%3Futm_s... > > The World's Fastest File System > > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/promo/20... > > > > _______________________________________________ > Support mailing list -- support(a)lists.nfs-ganesha.org > To unsubscribe send an email to support-leave(a)lists.nfs-ganesha.org > -- [image: Image removed by sender.] *David Hansen* *WekaIO* davidh(a)weka.io *•* https://www.weka.io/ <https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/%3Futm_s... The World's Fastest File System [image: Image removed by sender.] <https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/promo/20...

If it’s V2.8.3 you might want to try V2.8.4, that includes readdir fixes. So the issue is the directory never shows up in a directory listing, but you can navigate into it (LOOKUP)? If you can run with the following debug config: LOG { COMPONENTS { CACHE_INODE = FULL_DEBUG; } } And show us an attempt to list a directory with sub-directories, and then a successful cd into the directory, that might help. Daniel, any other thoughts? Frank *From:* David Hansen [mailto:davidh@weka.io] *Sent:* Wednesday, November 11, 2020 8:09 AM *To:* Frank Filz <ffilzlnx(a)mindspring.com&gt; *Cc:* Daniel Gryniewicz <dang(a)redhat.com>; support(a)lists.nfs-ganesha.org *Subject:* [NFS-Ganesha-Support] Re: Invisible files Thank you Frank, Weka (my company) has had a few issues with the NFS 16 group limitation as well as file locking. We utilize an "Native" NFS solution which we are transitioning from to a Ganesha implementation actually in a later Weka version. For this customer they couldn't wait for that feature. In this case Wekafs is mounted on a customer host which in turn is presenting a stand-alone Ganesha instance. When logging on to the ganesha server file/dir operations have no issue and files/dirs are accessible and visible on the ganesha server where weka is mounted. I also believe this is ganesha version 2.8.3 as far as I know. I'm working on trying to recreate this in AWS. Frank, I think I emailed before and you responded to an earlier issue where we couldn't reproduce but the files eventually became available whereas this instance it seems they don't. While the reproduction is still underway are there any settings related to this type of situation? David On Wed, Nov 11, 2020 at 8:45 AM Frank Filz <ffilzlnx(a)mindspring.com&gt; wrote: What underlying filesystem? We may need some debug logs and/or tcpdump traces to figure out what’s going wrong. Frank *From:* David Hansen [mailto:davidh@weka.io] *Sent:* Wednesday, November 11, 2020 7:20 AM *To:* Daniel Gryniewicz <dang(a)redhat.com&gt; *Cc:* support(a)lists.nfs-ganesha.org *Subject:* [NFS-Ganesha-Support] Re: Invisible files Thank you Daniel for your reply, If you have 2 folders, one nested, /dir1/dir2 and you issue an ls command in dir1. It won't show dir2 however you can cd into that directory directly. The ganesha config is as follows: ################################################### NFSV4 { DomainName = lmco.com <https://avanan.url-protection.com/v1/url?o=http%3A//lmco.com&g=NTg3Zj... ; } NFS_CORE_PARAM { NFS_Port = 2049; MNT_Port = 20048; Rquota_Port = 875; NLM_Port = 32803; NFS_Protocols = 3,4; } EXPORT_DEFAULTS { Access_Type = RW; Manage_Gids = true; Protocols = 3,4; Transports = TCP; } EXPORT { # Export Id (mandatory, each EXPORT must have a unique Export_Id) Export_Id = 4; # Exported path (mandatory) Path = /scratch; # Pseudo Path (required for NFS v4) Pseudo = /scratch; # Required for access (default is None) # Could use CLIENT blocks instead # Exporting FSAL FSAL { Name = VFS; } } Thank you David On Wed, Nov 11, 2020 at 6:47 AM Daniel Gryniewicz <dang(a)redhat.com&gt; wrote: I'm not sure I'm understanding the problem here. Is it that you can list a file but not see it's contents? Or is it that you cannot list a file, but can still open the file if you use a full path to it? Is it files, or directories, or both? What version of Ganesha are you using? What FSAL are you using? Daniel On 11/10/20 6:43 PM, David Hansen wrote: > Hi Ganesha support, > > There are more general questions. I have a client reporting that mounted > via linux hosts he sometimes is not able to see the contents. Logging on > to the Ganesha server on the local dir does show them however. I was > wondering if someone could point me in the right direction for possible > caching options to throw in the mount to make sure the client cach is up > to date? Some things we've tried: > > * We tried umounting /dataBA on the VM and mounting again, didn't help > * We rebooted the VM, didn't help > * We checked VAS info for user on nfs server and VM, looked ok. > > > Here we see we can cd into a directory (redacted6) that doesn't show up > in ls. > We thought maybe touching a file would force a cache update or something. > > [user6@b5c06 redacted4]$ cd redacted5/ > [user6@b5c06 redacted5]$ ls > afile > [user6@b5c06 redacted5]$ ls -lh > total 0 > -rw-------. 1 user67 hpc.default 0 Nov 2 23:10 afile > [user6@b5c06 redacted5]$ rm afile > [user6@b5c06 redacted5]$ ls > [user6@b5c06 redacted5]$ cd redacted6 > [user6@b5c06 redacted6]$ ls > 0-15ft 10ft 15ft 17-30ft 25ft 5ft > [user6@b5c06 redacted6]$ cd .. > [user6@b5c06 redacted5]$ ls > > Any pointers or insight would be fantastic. > > Thanks > > -- > David Hansen > WekaIO > davidh(a)weka.io <mailto:davidh@weka.io> *•* https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/&g=N... > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/%3Futm_s... > > The World's Fastest File System > > < https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/promo/20... > > > > _______________________________________________ > Support mailing list -- support(a)lists.nfs-ganesha.org > To unsubscribe send an email to support-leave(a)lists.nfs-ganesha.org > -- [image: Image removed by sender.] *David Hansen* *WekaIO* davidh(a)weka.io *•* https://www.weka.io/ <https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/%3Futm_s... The World's Fastest File System [image: Image removed by sender.] <https://avanan.url-protection.com/v1/url?o=https%3A//www.weka.io/promo/20... -- [image: Image removed by sender.] *David Hansen* *WekaIO* davidh(a)weka.io *•* https://www.weka.io/ <https://www.weka.io/?utm_source=WiseStamp&utm_medium=email&utm_te... The World's Fastest File System [image: Image removed by sender.] <https://www.weka.io/promo/2020-10-esg-validation-paper/?utm_source=WiseSt...