Change in ...nfs-ganesha[next]: MDCACHE - Add MDCACHE {} config block
by Daniel Gryniewicz (GerritHub)
Daniel Gryniewicz has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/454929
Change subject: MDCACHE - Add MDCACHE {} config block
......................................................................
MDCACHE - Add MDCACHE {} config block
Add a config block name MDCACHE that is a copy of CACHEINODE. Both can
be configured, but MDCACHE will override CACHEINODE. This allows us to
deprecate CACHEINODE.
Change-Id: I49012723132ae6105b904a60d1a96bb2bf78d51b
Signed-off-by: Daniel Gryniewicz <dang(a)fprintf.net>
---
M src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_read_conf.c
M src/config_samples/ceph.conf
M src/config_samples/config.txt
M src/config_samples/ganesha.conf.example
M src/doc/man/ganesha-cache-config.rst
M src/doc/man/ganesha-config.rst
6 files changed, 31 insertions(+), 7 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/29/454929/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/454929
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I49012723132ae6105b904a60d1a96bb2bf78d51b
Gerrit-Change-Number: 454929
Gerrit-PatchSet: 1
Gerrit-Owner: Daniel Gryniewicz <dang(a)redhat.com>
Gerrit-MessageType: newchange
3 years, 11 months
lseek gets bad offset from nfs client with ganesha/gluster which supports SEEK
by Kinglong Mee
The latest ganesha/gluster supports seek according to,
https://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-41#section-15.11
From the given sa_offset, find the next data_content4 of type sa_what
in the file. If the server can not find a corresponding sa_what,
then the status will still be NFS4_OK, but sr_eof would be TRUE. If
the server can find the sa_what, then the sr_offset is the start of
that content. If the sa_offset is beyond the end of the file, then
SEEK MUST return NFS4ERR_NXIO.
For a file's filemap as,
Part 1: HOLE 0x0000000000000000 ---> 0x0000000000600000
Part 2: DATA 0x0000000000600000 ---> 0x0000000000700000
Part 3: HOLE 0x0000000000700000 ---> 0x0000000001000000
SEEK(0x700000, SEEK_DATA) gets result (sr_eof:1, sr_offset:0x70000) from ganesha/gluster;
SEEK(0x700000, SEEK_HOLE) gets result (sr_eof:0, sr_offset:0x70000) from ganesha/gluster.
If an application depends the lseek result for data searching, it may enter infinite loop.
while (1) {
next_pos = lseek(fd, cur_pos, seek_type);
if (seek_type == SEEK_DATA) {
seek_type = SEEK_HOLE;
} else {
seek_type = SEEK_DATA;
}
if (next_pos == -1) {
return ;
cur_pos = next_pos;
}
The lseek syscall always gets 0x70000 from nfs client for those two cases,
but, if underlying filesystem is ext4/f2fs, or the nfs server is knfsd,
the lseek(0x700000, SEEK_DATA) gets ENXIO.
I wanna to know,
should I fix the ganesha/gluster as knfsd return ENXIO for the first case?
or should I fix the nfs client to return ENXIO for the first case?
thanks,
Kinglong Mee
4 years, 1 month
Re: [Nfs-ganesha-devel] 2.7.3 with CEPH_FSAL Crashing
by Daniel Gryniewicz
This is not one I've seen before, and a quick look at the code looks
strange. The only assert in that bit is asserting the parent is a
directory, but the parent directory is not something that was passed in
by Ganesha, but rather something that was looked up internally in
libcephfs. This is beyond my expertise, at this point. Maybe some ceph
logs would help?
Daniel
On 7/15/19 10:54 AM, David C wrote:
> This list has been deprecated. Please subscribe to the new devel list at lists.nfs-ganesha.org.
>
>
> Hi All
>
> I'm running 2.7.3 using the CEPH FSAL to export CephFS (Luminous), it
> ran well for a few days and crashed. I have a coredump, could someone
> assist me in debugging this please?
>
> (gdb) bt
> #0 0x00007f04dcab6207 in raise () from /lib64/libc.so.6
> #1 0x00007f04dcab78f8 in abort () from /lib64/libc.so.6
> #2 0x00007f04d2a9d6c5 in ceph::__ceph_assert_fail(char const*, char
> const*, int, char const*) () from /usr/lib64/ceph/libceph-common.so.0
> #3 0x00007f04d2a9d844 in ceph::__ceph_assert_fail(ceph::assert_data
> const&) () from /usr/lib64/ceph/libceph-common.so.0
> #4 0x00007f04cc807f04 in Client::_lookup_name(Inode*, Inode*, UserPerm
> const&) () from /lib64/libcephfs.so.2
> #5 0x00007f04cc81c41f in Client::ll_lookup_inode(inodeno_t, UserPerm
> const&, Inode**) () from /lib64/libcephfs.so.2
> #6 0x00007f04ccadbf0e in create_handle (export_pub=0x1baff10,
> desc=<optimized out>, pub_handle=0x7f0470fd4718,
> attrs_out=0x7f0470fd4740) at
> /usr/src/debug/nfs-ganesha-2.7.3/FSAL/FSAL_CEPH/export.c:256
> #7 0x0000000000523895 in mdcache_locate_host (fh_desc=0x7f0470fd4920,
> export=export@entry=0x1bafbf0, entry=entry@entry=0x7f0470fd48b8,
> attrs_out=attrs_out@entry=0x0)
> at
> /usr/src/debug/nfs-ganesha-2.7.3/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1011
> #8 0x000000000051d278 in mdcache_create_handle (exp_hdl=0x1bafbf0,
> fh_desc=<optimized out>, handle=0x7f0470fd4900, attrs_out=0x0) at
> /usr/src/debug/nfs-ganesha-2.7.3/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:1578
> #9 0x000000000046d404 in nfs4_mds_putfh
> (data=data@entry=0x7f0470fd4ea0) at
> /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_op_putfh.c:211
> #10 0x000000000046d8e8 in nfs4_op_putfh (op=0x7f03effaf1d0,
> data=0x7f0470fd4ea0, resp=0x7f03ec1de1f0) at
> /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_op_putfh.c:281
> #11 0x000000000045d120 in nfs4_Compound (arg=<optimized out>,
> req=<optimized out>, res=0x7f03ec1de9d0) at
> /usr/src/debug/nfs-ganesha-2.7.3/Protocols/NFS/nfs4_Compound.c:942
> #12 0x00000000004512cd in nfs_rpc_process_request
> (reqdata=0x7f03ee5ed4b0) at
> /usr/src/debug/nfs-ganesha-2.7.3/MainNFSD/nfs_worker_thread.c:1328
> #13 0x0000000000450766 in nfs_rpc_decode_request (xprt=0x7f02180c2320,
> xdrs=0x7f03ec568ab0) at
> /usr/src/debug/nfs-ganesha-2.7.3/MainNFSD/nfs_rpc_dispatcher_thread.c:1345
> #14 0x00007f04df45d07d in svc_rqst_xprt_task (wpe=0x7f02180c2538) at
> /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:769
> #15 0x00007f04df45d59a in svc_rqst_epoll_events (n_events=<optimized
> out>, sr_rec=0x4bb53e0) at
> /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:941
> #16 svc_rqst_epoll_loop (sr_rec=<optimized out>) at
> /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:1014
> #17 svc_rqst_run_task (wpe=0x4bb53e0) at
> /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/svc_rqst.c:1050
> #18 0x00007f04df465123 in work_pool_thread (arg=0x7f044c0008c0) at
> /usr/src/debug/nfs-ganesha-2.7.3/libntirpc/src/work_pool.c:181
> #19 0x00007f04dda05dd5 in start_thread () from /lib64/libpthread.so.0
> #20 0x00007f04dcb7dead in clone () from /lib64/libc.so.6
>
> Package versions:
>
> nfs-ganesha-2.7.3-0.1.el7.x86_64
> nfs-ganesha-ceph-2.7.3-0.1.el7.x86_64
> libcephfs2-14.2.1-0.el7.x86_64
> librados2-14.2.1-0.el7.x86_64
>
> I notice in my Ceph log I have a bunch of slow requests around the time
> it went down, I'm not sure if it's a symptom of Ganesha segfaulting or
> if it was a contributing factor.
>
> Thanks,
> David
>
>
> _______________________________________________
> Nfs-ganesha-devel mailing list
> Nfs-ganesha-devel(a)lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel
>
5 years
回复：Re: rsize and wsize on centos7.2 not working
by QR
Hi malahal, thanks for your reply.CentOS7.5 doesn't has this issue, so this seems a bug in kNFS.I need to find a solution for CentOS7.2, so I search the release notes for 7.3~7.6, and fail to find anything about this.Then I find bug https://bugzilla.redhat.com/show_bug.cgi?id=1519701, but the bug is not confirmed yet.
So could anyone tell me how to find the link for this issue? Thanks in advance.
--------------------------------
----- 原始邮件 -----
发件人：Malahal Naineni <malahal(a)gmail.com>
收件人：zhbingyin(a)sina.com
抄送人：ganesha-devel <devel(a)lists.nfs-ganesha.org>
主题：[NFS-Ganesha-Devel] Re: rsize and wsize on centos7.2 not working
日期：2019年09月25日 13点28分
I remember an issue like this with early shipments of RHEL7. I recall it as a defect in kNFS, My memory could be wrong though. These are exchanged very early on, so I imagine this is due to NFS client (Centos 7.2). Try with Centos 7.6, if you don't see this issue then it is clear where the issue is.
On Wed, Sep 25, 2019 at 9:03 AM QR <zhbingyin(a)sina.com> wrote:
In CentOS7.2 under v4.0, the wsize is 1048576, but when writing 1048576 bytes on a file, ganesha receives 4 requests.The problem is who splits the 1MB request to 4 requests(256KB)?Is anyone know about this? Thanks in advance.
Ganesha server info ganesha version: V2.7.6 FSAL : glusternfs client info nfs version : nfs v4.0 client info : CentOS Linux release 7.2.1511(3.10.0-327.el7.x86_64)_______________________________________________
Devel mailing list -- devel(a)lists.nfs-ganesha.org
To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
_______________________________________________
Devel mailing list -- devel(a)lists.nfs-ganesha.org
To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
5 years
Change in ...nfs-ganesha[next]: Add get options to ganesha_conf tool
by xijinyu (GerritHub)
xijinyu has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469796 )
Change subject: Add get options to ganesha_conf tool
......................................................................
Add get options to ganesha_conf tool
Signed-off-by: Xi Jinyu <xijinyu(a)cmss.chinamobile.com>
Change-Id: I8ef124b9fc81fcd5d7454770d95019d1770b5bb9
---
M src/scripts/ganeshactl/Ganesha/config_editor.py
M src/scripts/ganeshactl/ganesha_conf.py
2 files changed, 45 insertions(+), 1 deletion(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/96/469796/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469796
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I8ef124b9fc81fcd5d7454770d95019d1770b5bb9
Gerrit-Change-Number: 469796
Gerrit-PatchSet: 1
Gerrit-Owner: xijinyu <xijinyu(a)cmss.chinamobile.com>
Gerrit-MessageType: newchange
5 years
Change in ...nfs-ganesha[next]: Updating component_log_level not getting reflected in FSALs. Compile ...
by Ashish Sangwan (GerritHub)
Ashish Sangwan has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469779 )
Change subject: Updating component_log_level not getting reflected in FSALs. Compile ganesha.nfsd binary with fPIC
......................................................................
Updating component_log_level not getting reflected in FSALs.
Compile ganesha.nfsd binary with fPIC
After creating libganesha_nfsd.so, the component_log_level is moved there.
Doing a readelf on the ganesha.nfsd binary tells that we are doing copy of
component_log_level:
0000006041f0 003800000005 R_X86_64_COPY 00000000006041f0 component_log_level + 0
When we update component_log_level, its only updating the one inside libganesha_nfsd.so
All the FSALs which are dlopened with RTLD_DEEPBIND end up using the component_log_level
that is defined in the ganesha.nfsd
There are also other variables which have copies like nfs_ServerBootTime, nfs_config_path
To avoid this, compile the executale with fPIC
Signed-off-by: ashish.sangwan <ashishsangwan2(a)gmail.com>
Change-Id: I249cf196f78c43e6162f86d04880f2b8b418e262
---
M src/CMakeLists.txt
1 file changed, 1 insertion(+), 1 deletion(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/79/469779/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469779
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I249cf196f78c43e6162f86d04880f2b8b418e262
Gerrit-Change-Number: 469779
Gerrit-PatchSet: 1
Gerrit-Owner: Ashish Sangwan <ashishsangwan2(a)gmail.com>
Gerrit-MessageType: newchange
5 years
Announce Push of V2.9-dev.10
by Frank Filz
Branch next
Tag:V2.9-dev.10
Release Highlights
* MDCACHE - Put ref on root
* RQUOTA: Get credentials for GETQUOTA/SETQUOTA requests
* Reopen the file only if openflags change
* python: run setup.py for gpfs-epoch(.py) to fix its shebang
* build: PyQt4 is EOL soon, switch to PyQt5
Signed-off-by: Frank S. Filz <ffilzlnx(a)mindspring.com>
Contents:
5660fb6 Frank S. Filz V2.9-dev.10
904d642 Kaleb S. KEITHLEY build: PyQt4 is EOL soon, switch to PyQt5
3a18699 Kaleb S. KEITHLEY python: run setup.py for gpfs-epoch(.py) to fix
its shebang
a29858c Soumya Koduri Reopen the file only if openflags change
80dc5cf Madhu Thorat RQUOTA: Get credentials for GETQUOTA/SETQUOTA requests
a8b6b40 Daniel Gryniewicz MDCACHE - Put ref on root
5 years
Change in ...nfs-ganesha[next]: experimental: revert all patches since dev7, cthon04
by Kaleb KEITHLEY (GerritHub)
Kaleb KEITHLEY has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469404 )
Change subject: experimental: revert all patches since dev7, cthon04
......................................................................
experimental: revert all patches since dev7, cthon04
DO NOT MERGE
Signed-off-by: Kaleb S. KEITHLEY <kkeithle(a)redhat.com>
Change-Id: I4a8535e272a7d1e7a64eadb7ff79a12fa9f992a1
---
M src/CMakeLists.txt
M src/FSAL/FSAL_GLUSTER/handle.c
M src/FSAL/FSAL_PROXY/handle.c
M src/FSAL/FSAL_RGW/handle.c
M src/FSAL/commonlib.c
M src/FSAL/fsal_convert.c
M src/MainNFSD/libganesha_nfsd.ver
M src/MainNFSD/nfs_admin_thread.c
M src/MainNFSD/nfs_rpc_callback_simulator.c
M src/MainNFSD/nfs_rpc_dispatcher_thread.c
M src/MainNFSD/nfs_worker_thread.c
M src/Protocols/NFS/nfs3_read.c
M src/Protocols/NFS/nfs4_op_read.c
M src/Protocols/XDR/xdr_nfs23.c
M src/SAL/nfs4_recovery.c
M src/SAL/nfs4_state.c
M src/dbus/dbus_server.c
M src/idmapper/idmapper.c
M src/idmapper/idmapper_cache.c
M src/include/gsh_dbus.h
M src/include/gsh_lttng/nfs_rpc.h
M src/include/gsh_rpc.h
M src/include/log.h
M src/include/nfsv41.h
M src/log/log_functions.c
M src/scripts/nfs-ganesha-config.sh
M src/scripts/systemd/nfs-ganesha.service.debian8
M src/scripts/systemd/nfs-ganesha.service.el7
M src/support/client_mgr.c
M src/support/export_mgr.c
M src/support/server_stats.c
31 files changed, 188 insertions(+), 515 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/04/469404/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469404
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I4a8535e272a7d1e7a64eadb7ff79a12fa9f992a1
Gerrit-Change-Number: 469404
Gerrit-PatchSet: 1
Gerrit-Owner: Kaleb KEITHLEY <kaleb(a)redhat.com>
Gerrit-MessageType: newchange
5 years
Change in ...nfs-ganesha[next]: build: PyQt4 is EOL soon, switch to PyQt5
by Kaleb KEITHLEY (GerritHub)
Kaleb KEITHLEY has uploaded this change for review. ( https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469402 )
Change subject: build: PyQt4 is EOL soon, switch to PyQt5
......................................................................
build: PyQt4 is EOL soon, switch to PyQt5
Debian bullseye/sid is said to be dropping PyQt4 soon. RHEL/CentOS 8
has already dropped it.
Fedora up to F32/Rawhide still has both, so do Debian buster and Ubuntu
disco and eoan; to name a few.
Signed-off-by: Kaleb S. KEITHLEY <kkeithle(a)redhat.com>
Change-Id: I86c1b27abeed97190ebae0774cd355811bd5b574
---
M src/CMakeLists.txt
M src/nfs-ganesha.spec-in.cmake
2 files changed, 9 insertions(+), 2 deletions(-)
git pull ssh://review.gerrithub.io:29418/ffilz/nfs-ganesha refs/changes/02/469402/1
--
To view, visit https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/469402
To unsubscribe, or for help writing mail filters, visit https://review.gerrithub.io/settings
Gerrit-Project: ffilz/nfs-ganesha
Gerrit-Branch: next
Gerrit-Change-Id: I86c1b27abeed97190ebae0774cd355811bd5b574
Gerrit-Change-Number: 469402
Gerrit-PatchSet: 1
Gerrit-Owner: Kaleb KEITHLEY <kaleb(a)redhat.com>
Gerrit-MessageType: newchange
5 years
