September 2019 - Devel - NFS Ganesha List Archives

Change in ...nfs-ganesha[next]: MDCACHE - Add MDCACHE {} config block
by Daniel Gryniewicz (GerritHub) 05 Nov '20

05 Nov '20

Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/454929 Change subject: MDCACHE - Add MDCACHE {} config block ...................................................................... MDCACHE - Add MDCACHE {} config block Add a config block name MDCACHE that is a copy of CACHEINODE. Both can be configured, but MDCACHE will override CACHEINODE. This allows us to deprecate CACHEINODE. Change-Id: I49012723132ae6105b904a60d1a96bb2bf78d51b Signed-off-by: Daniel Gryniewicz <dang(a)fprintf.net> --- M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_read_conf.c M src/config_samples/ceph.conf M src/config_samples/config.txt M src/config_samples/ganesha.conf.example M src/doc/man/ganesha-cache-config.rst M src/doc/man/ganesha-config.rst 6 files changed, 31 insertions(+), 7 deletions(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/29/454929/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/454929 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: I49012723132ae6105b904a60d1a96bb2bf78d51b Gerrit-Change-Number: 454929 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com> Gerrit-MessageType: newchange

3 2

lseek gets bad offset from nfs client with ganesha/gluster which supports SEEK
by Kinglong Mee 14 Sep '20

14 Sep '20

The latest ganesha/gluster supports seek according to, https://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-41#section-15.11 From the given sa_offset, find the next data_content4 of type sa_what in the file. If the server can not find a corresponding sa_what, then the status will still be NFS4_OK, but sr_eof would be TRUE. If the server can find the sa_what, then the sr_offset is the start of that content. If the sa_offset is beyond the end of the file, then SEEK MUST return NFS4ERR_NXIO. For a file's filemap as, Part 1: HOLE 0x0000000000000000 ---> 0x0000000000600000 Part 2: DATA 0x0000000000600000 ---> 0x0000000000700000 Part 3: HOLE 0x0000000000700000 ---> 0x0000000001000000 SEEK(0x700000, SEEK_DATA) gets result (sr_eof:1, sr_offset:0x70000) from ganesha/gluster; SEEK(0x700000, SEEK_HOLE) gets result (sr_eof:0, sr_offset:0x70000) from ganesha/gluster. If an application depends the lseek result for data searching, it may enter infinite loop. while (1) { next_pos = lseek(fd, cur_pos, seek_type); if (seek_type == SEEK_DATA) { seek_type = SEEK_HOLE; } else { seek_type = SEEK_DATA; } if (next_pos == -1) { return ; cur_pos = next_pos; } The lseek syscall always gets 0x70000 from nfs client for those two cases, but, if underlying filesystem is ext4/f2fs, or the nfs server is knfsd, the lseek(0x700000, SEEK_DATA) gets ENXIO. I wanna to know, should I fix the ganesha/gluster as knfsd return ENXIO for the first case? or should I fix the nfs client to return ENXIO for the first case? thanks, Kinglong Mee

4 8

Re: [Nfs-ganesha-devel] 2.7.3 with CEPH_FSAL Crashing
by Daniel Gryniewicz 10 Oct '19

10 Oct '19

This is not one I've seen before, and a quick look at the code looks strange. The only assert in that bit is asserting the parent is a directory, but the parent directory is not something that was passed in by Ganesha, but rather something that was looked up internally in libcephfs. This is beyond my expertise, at this point. Maybe some ceph logs would help? Daniel On 7/15/19 10:54 AM, David C wrote: > This list has been deprecated. Please subscribe to the new devel list at lists.nfs-ganesha.org. > > > Hi All > > I'm running 2.7.3 using the CEPH FSAL to export CephFS (Luminous), it > ran well for a few days and crashed. I have a coredump, could someone > assist me in debugging this please? > > (gdb) bt > #0 0x00007f04dcab6207 in raise () from /lib64/libc.so.6 > #1 0x00007f04dcab78f8 in abort () from /lib64/libc.so.6 > #2 0x00007f04d2a9d6c5 in ceph::__ceph_assert_fail(char const*, char > const*, int, char const*) () from /usr/lib64/ceph/libceph-common.so.0 > #3 0x00007f04d2a9d844 in ceph::__ceph_assert_fail(ceph::assert_data > const&) () from /usr/lib64/ceph/libceph-common.so.0 > #4 0x00007f04cc807f04 in Client::_lookup_name(Inode*, Inode*, UserPerm > const&) () from /lib64/libcephfs.so.2 > #5 0x00007f04cc81c41f in Client::ll_lookup_inode(inodeno_t, UserPerm > const&, Inode**) () from /lib64/libcephfs.so.2 > #6 0x00007f04ccadbf0e in create_handle (export_pub=0x1baff10, > desc=<optimized out>, pub_handle=0x7f0470fd4718, > attrs_out=0x7f0470fd4740) at > /usr/src/debug/nfs-ganesha-2.7.3/FSAL/FSAL_CEPH/export.c:256 > #7 0x0000000000523895 in mdcache_locate_host (fh_desc=0x7f0470fd4920, > export=export@entry=0x1bafbf0, entry=entry@entry=0x7f0470fd48b8, > attrs_out=attrs_out@entry=0x0) > at > /usr/src/debug/nfs-ganesha-2.7.3/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1011 > #8 0x000000000051d278 in mdcache_create_handle (exp_hdl=0x1bafbf0, > fh_desc=<optimized out>, handle=0x7f0470fd4900, attrs_out=0x0) at > /usr/src/debug/nfs-ganesha-2.7.3/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:1578 > #9 0x000000000046d404 in nfs4_mds_putfh > (data=data@entry=0x7f0470fd4ea0) at > /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_op_putfh.c:211 > #10 0x000000000046d8e8 in nfs4_op_putfh (op=0x7f03effaf1d0, > data=0x7f0470fd4ea0, resp=0x7f03ec1de1f0) at > /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_op_putfh.c:281 > #11 0x000000000045d120 in nfs4_Compound (arg=<optimized out>, > req=<optimized out>, res=0x7f03ec1de9d0) at > /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_Compound.c:942 > #12 0x00000000004512cd in nfs_rpc_process_request > (reqdata=0x7f03ee5ed4b0) at > /usr/src/debug/nfs-ganesha-2.7.3/MainNFSD/nfs_worker_thread.c:1328 > #13 0x0000000000450766 in nfs_rpc_decode_request (xprt=0x7f02180c2320, > xdrs=0x7f03ec568ab0) at > /usr/src/debug/nfs-ganesha-2.7.3/MainNFSD/nfs_rpc_dispatcher_thread.c:1345 > #14 0x00007f04df45d07d in svc_rqst_xprt_task (wpe=0x7f02180c2538) at > /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:769 > #15 0x00007f04df45d59a in svc_rqst_epoll_events (n_events=<optimized > out>, sr_rec=0x4bb53e0) at > /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:941 > #16 svc_rqst_epoll_loop (sr_rec=<optimized out>) at > /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:1014 > #17 svc_rqst_run_task (wpe=0x4bb53e0) at > /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:1050 > #18 0x00007f04df465123 in work_pool_thread (arg=0x7f044c0008c0) at > /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/work_pool.c:181 > #19 0x00007f04dda05dd5 in start_thread () from /lib64/libpthread.so.0 > #20 0x00007f04dcb7dead in clone () from /lib64/libc.so.6 > > Package versions: > > nfs-ganesha-2.7.3-0.1.el7.x86_64 > nfs-ganesha-ceph-2.7.3-0.1.el7.x86_64 > libcephfs2-14.2.1-0.el7.x86_64 > librados2-14.2.1-0.el7.x86_64 > > I notice in my Ceph log I have a bunch of slow requests around the time > it went down, I'm not sure if it's a symptom of Ganesha segfaulting or > if it was a contributing factor. > > Thanks, > David > > > _______________________________________________ > Nfs-ganesha-devel mailing list > Nfs-ganesha-devel(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel >

4 9

回复：Re: rsize and wsize on centos7.2 not working
by QR 04 Oct '19

04 Oct '19

Hi malahal, thanks for your reply.CentOS7.5 doesn't has this issue, so this seems a bug in kNFS.I need to find a solution for CentOS7.2, so I search the release notes for 7.3~7.6, and fail to find anything about this.Then I find bug https://bugzilla.redhat.com/show_bug.cgi?id=1519701, but the bug is not confirmed yet. So could anyone tell me how to find the link for this issue? Thanks in advance. -------------------------------- ----- 原始邮件 ----- 发件人：Malahal Naineni <malahal(a)gmail.com> 收件人：zhbingyin(a)sina.com 抄送人：ganesha-devel <devel(a)lists.nfs-ganesha.org> 主题：[NFS-Ganesha-Devel] Re: rsize and wsize on centos7.2 not working 日期：2019年09月25日 13点28分 I remember an issue like this with early shipments of RHEL7. I recall it as a defect in kNFS, My memory could be wrong though. These are exchanged very early on, so I imagine this is due to NFS client (Centos 7.2). Try with Centos 7.6, if you don't see this issue then it is clear where the issue is. On Wed, Sep 25, 2019 at 9:03 AM QR <zhbingyin(a)sina.com> wrote: In CentOS7.2 under v4.0, the wsize is 1048576, but when writing 1048576 bytes on a file, ganesha receives 4 requests.The problem is who splits the 1MB request to 4 requests(256KB)?Is anyone know about this? Thanks in advance. Ganesha server info ganesha version: V2.7.6 FSAL : glusternfs client info nfs version : nfs v4.0 client info : CentOS Linux release 7.2.1511(3.10.0-327.el7.x86_64)_______________________________________________ Devel mailing list -- devel(a)lists.nfs-ganesha.org To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org _______________________________________________ Devel mailing list -- devel(a)lists.nfs-ganesha.org To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org

2 1

Change in ...nfs-ganesha[next]: Add get options to ganesha_conf tool
by xijinyu (GerritHub) 29 Sep '19

29 Sep '19

xijinyu has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469796 ) Change subject: Add get options to ganesha_conf tool ...................................................................... Add get options to ganesha_conf tool Signed-off-by: Xi Jinyu <xijinyu(a)cmss.chinamobile.com> Change-Id: I8ef124b9fc81fcd5d7454770d95019d1770b5bb9 --- M src/scripts/ganeshactl/Ganesha/config_editor.py M src/scripts/ganeshactl/ganesha_conf.py 2 files changed, 45 insertions(+), 1 deletion(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/96/469796/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469796 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: I8ef124b9fc81fcd5d7454770d95019d1770b5bb9 Gerrit-Change-Number: 469796 Gerrit-PatchSet: 1 Gerrit-Owner: xijinyu <xijinyu(a)cmss.chinamobile.com> Gerrit-MessageType: newchange

1 0

Change in ...nfs-ganesha[next]: Updating component_log_level not getting reflected in FSALs. Compile ...
by Ashish Sangwan (GerritHub) 29 Sep '19

29 Sep '19

Ashish Sangwan has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469779 ) Change subject: Updating component_log_level not getting reflected in FSALs. Compile ganesha.nfsd binary with fPIC ...................................................................... Updating component_log_level not getting reflected in FSALs. Compile ganesha.nfsd binary with fPIC After creating libganesha_nfsd.so, the component_log_level is moved there. Doing a readelf on the ganesha.nfsd binary tells that we are doing copy of component_log_level: 0000006041f0 003800000005 R_X86_64_COPY 00000000006041f0 component_log_level + 0 When we update component_log_level, its only updating the one inside libganesha_nfsd.so All the FSALs which are dlopened with RTLD_DEEPBIND end up using the component_log_level that is defined in the ganesha.nfsd There are also other variables which have copies like nfs_ServerBootTime, nfs_config_path To avoid this, compile the executale with fPIC Signed-off-by: ashish.sangwan <ashishsangwan2(a)gmail.com> Change-Id: I249cf196f78c43e6162f86d04880f2b8b418e262 --- M src/CMakeLists.txt 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/79/469779/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469779 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: I249cf196f78c43e6162f86d04880f2b8b418e262 Gerrit-Change-Number: 469779 Gerrit-PatchSet: 1 Gerrit-Owner: Ashish Sangwan <ashishsangwan2(a)gmail.com> Gerrit-MessageType: newchange

1 0

Announce Push of V2.9-dev.10
by Frank Filz 27 Sep '19

27 Sep '19

Branch next Tag:V2.9-dev.10 Release Highlights * MDCACHE - Put ref on root * RQUOTA: Get credentials for GETQUOTA/SETQUOTA requests * Reopen the file only if openflags change * python: run setup.py for gpfs-epoch(.py) to fix its shebang * build: PyQt4 is EOL soon, switch to PyQt5 Signed-off-by: Frank S. Filz <ffilzlnx(a)mindspring.com> Contents: 5660fb6 Frank S. Filz V2.9-dev.10 904d642 Kaleb S. KEITHLEY build: PyQt4 is EOL soon, switch to PyQt5 3a18699 Kaleb S. KEITHLEY python: run setup.py for gpfs-epoch(.py) to fix its shebang a29858c Soumya Koduri Reopen the file only if openflags change 80dc5cf Madhu Thorat RQUOTA: Get credentials for GETQUOTA/SETQUOTA requests a8b6b40 Daniel Gryniewicz MDCACHE - Put ref on root

1 0

Change in ...nfs-ganesha[next]: use tmp char* due to &array == array
by Yang Ruifeng (GerritHub) 26 Sep '19

26 Sep '19

Yang Ruifeng has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469647 ) Change subject: use tmp char* due to &array == array ...................................................................... use tmp char* due to &array == array Change-Id: Ic95517cb0166e2c951dd0ee91b3110e86cff54f6 Signed-off-by: Yang Ruifeng <ruifeng(a)xsky.com> --- M src/support/client_mgr.c 1 file changed, 2 insertions(+), 1 deletion(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/47/469647/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469647 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: Ic95517cb0166e2c951dd0ee91b3110e86cff54f6 Gerrit-Change-Number: 469647 Gerrit-PatchSet: 1 Gerrit-Owner: Yang Ruifeng <149233652(a)qq.com> Gerrit-MessageType: newchange

1 0

Change in ...nfs-ganesha[next]: experimental: revert all patches since dev7, cthon04
by Kaleb KEITHLEY (GerritHub) 25 Sep '19

25 Sep '19

Kaleb KEITHLEY has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469404 ) Change subject: experimental: revert all patches since dev7, cthon04 ...................................................................... experimental: revert all patches since dev7, cthon04 DO NOT MERGE Signed-off-by: Kaleb S. KEITHLEY <kkeithle(a)redhat.com> Change-Id: I4a8535e272a7d1e7a64eadb7ff79a12fa9f992a1 --- M src/CMakeLists.txt M src/FSAL/FSAL_GLUSTER/handle.c M src/FSAL/FSAL_PROXY/handle.c M src/FSAL/FSAL_RGW/handle.c M src/FSAL/commonlib.c M src/FSAL/fsal_convert.c M src/MainNFSD/libganesha_nfsd.ver M src/MainNFSD/nfs_admin_thread.c M src/MainNFSD/nfs_rpc_callback_simulator.c M src/MainNFSD/nfs_rpc_dispatcher_thread.c M src/MainNFSD/nfs_worker_thread.c M src/Protocols/NFS/nfs3_read.c M src/Protocols/NFS/nfs4_op_read.c M src/Protocols/XDR/xdr_nfs23.c M src/SAL/nfs4_recovery.c M src/SAL/nfs4_state.c M src/dbus/dbus_server.c M src/idmapper/idmapper.c M src/idmapper/idmapper_cache.c M src/include/gsh_dbus.h M src/include/gsh_lttng/nfs_rpc.h M src/include/gsh_rpc.h M src/include/log.h M src/include/nfsv41.h M src/log/log_functions.c M src/scripts/nfs-ganesha-config.sh M src/scripts/systemd/nfs-ganesha.service.debian8 M src/scripts/systemd/nfs-ganesha.service.el7 M src/support/client_mgr.c M src/support/export_mgr.c M src/support/server_stats.c 31 files changed, 188 insertions(+), 515 deletions(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/04/469404/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469404 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: I4a8535e272a7d1e7a64eadb7ff79a12fa9f992a1 Gerrit-Change-Number: 469404 Gerrit-PatchSet: 1 Gerrit-Owner: Kaleb KEITHLEY <kaleb(a)redhat.com> Gerrit-MessageType: newchange

1 0

Change in ...nfs-ganesha[next]: build: PyQt4 is EOL soon, switch to PyQt5
by Kaleb KEITHLEY (GerritHub) 25 Sep '19

25 Sep '19

Kaleb KEITHLEY has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469402 ) Change subject: build: PyQt4 is EOL soon, switch to PyQt5 ...................................................................... build: PyQt4 is EOL soon, switch to PyQt5 Debian bullseye/sid is said to be dropping PyQt4 soon. RHEL/CentOS 8 has already dropped it. Fedora up to F32/Rawhide still has both, so do Debian buster and Ubuntu disco and eoan; to name a few. Signed-off-by: Kaleb S. KEITHLEY <kkeithle(a)redhat.com> Change-Id: I86c1b27abeed97190ebae0774cd355811bd5b574 --- M src/CMakeLists.txt M src/nfs-ganesha.spec-in.cmake 2 files changed, 9 insertions(+), 2 deletions(-) git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/02/469402/1 -- To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469402 To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings Gerrit-Project: ffilz/nfs-ganesha Gerrit-Branch: next Gerrit-Change-Id: I86c1b27abeed97190ebae0774cd355811bd5b574 Gerrit-Change-Number: 469402 Gerrit-PatchSet: 1 Gerrit-Owner: Kaleb KEITHLEY <kaleb(a)redhat.com> Gerrit-MessageType: newchange

1 0