Thanks, we need to upgrade dbus.
I found one issue, but not sure if that's the root cause as we don't have
reproducer now.
But I think this is how we want full stats, we have defined type as array
but not using it, just dumping all ops in struct.
https://review.gerrithub.io/#/c/ffilz/nfs-ganesha/+/452651/
-Gaurav
On Mon, Apr 29, 2019 at 7:45 PM Daniel Gryniewicz <dang(a)redhat.com> wrote:
Thanks for this. Everything on the Ganesha side looks fine. Can
you
upgrade your dbus? 1.10 is *very* old. Even my oldest test systems
(Fedora 24, so quite old) have 1.11 on them.
Daniel
On 4/26/19 1:09 PM, gaurav gangalwar wrote:
> More details
>
> (gdb) f 16
>
> #16 0x0000000000514d88 in server_dbus_v4_full_stats
> (iter=0x7fc1987bf130) at
> /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287
>
> 2287 dbus_message_iter_append_basic(iter, DBUS_TYPE_STRING,
> &message);
>
> (gdb) p message
>
> $1 = 0x5a3f72 "OK"
>
> (gdb) p iter
>
> $2 = (DBusMessageIter *) 0x7fc1987bf130
>
> (gdb) p *iter
>
> $3 = {dummy1 = 0x7fc1ad031140, dummy2 = 0x7fc100e00000, dummy3 =
> 2558132332, dummy4 = 32705, dummy5 = 0, dummy6 = 0, dummy7 = -1,
>
> dummy8 = 32705, dummy9 = -1392307824, dummy10 = 32705, dummy11 =
> 2384, pad1 = 32705, pad2 = 0xe19325a9afe4c600, pad3 = 0x0}
>
> (gdb) p op_counter
>
> $4 = 718029857
>
> (gdb) p op
>
> $5 = 72
>
> (gdb)
>
>
>
> -Gaurav
>
> On Fri, Apr 26, 2019 at 7:12 PM Daniel Gryniewicz <dang(a)redhat.com
> <mailto:dang@redhat.com>> wrote:
>
> This is clearly a modified version of 2.7.1, since that function
isn't
> in 2.7 at all. Can you figure out which line in
> server_dbus_v4_full_stats() is being run, and post that? That would
> help, I think.
>
> Daniel
>
> On Fri, Apr 26, 2019 at 1:23 AM gaurav gangalwar
> <gaurav.gangalwar(a)gmail.com <mailto:gaurav.gangalwar@gmail.com>>
wrote:
> >
> > Hi,
> > We are getting this crash on loaded system, we are using
> dbus-1.10.24-13, looks like issue with dbus lib.
> > Anyone aware of this issue?
> >
> > (gdb) bt
> >
> > #0 0x00007f4e468e159b in raise () from /lib64/libpthread.so.0
> >
> > #1 0x0000000000448db4 in crash_handler (signo=11,
> info=0x7f4e2c1db870, ctx=0x7f4e2c1db740) at
> /usr/src/debug/nfs-ganesha-2.7.1/MainNFSD/nfs_init.c:246
> >
> > #2 <signal handler called>
> >
> > #3 0x00007f4e47f0b269 in _dbus_marshal_read_uint32 () from
> /lib64/libdbus-1.so.3
> >
> > #4 0x00007f4e47f0bb6a in _dbus_marshal_skip_basic () from
> /lib64/libdbus-1.so.3
> >
> > #5 0x00007f4e47ef71f2 in base_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #6 0x00007f4e47ef70cb in _dbus_type_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #7 0x00007f4e47ef71b8 in base_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #8 0x00007f4e47ef7239 in struct_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #9 0x00007f4e47ef70cb in _dbus_type_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #10 0x00007f4e47ef7368 in array_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #11 0x00007f4e47ef70cb in _dbus_type_reader_next () from
> /lib64/libdbus-1.so.3
> >
> > #12 0x00007f4e47ef5348 in _dbus_header_cache_revalidate () from
> /lib64/libdbus-1.so.3
> >
> > #13 0x00007f4e47ef5c8e in _dbus_header_get_field_raw () from
> /lib64/libdbus-1.so.3
> >
> > #14 0x00007f4e47efa222 in
> _dbus_message_iter_open_signature.part.4 () from
/lib64/libdbus-1.so.3
> >
> > #15 0x00007f4e47efc0f4 in dbus_message_iter_append_basic () from
> /lib64/libdbus-1.so.3
> >
> > #16 0x0000000000514be1 in server_dbus_v4_full_stats
> (iter=0x7f4e2c1dc130) at
> /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287
> >
> > #17 0x000000000051b319 in stats_v4_full (args=0x0,
> reply=0x7f4e2441f080, error=0x7f4e2c1dc230) at
> /usr/src/debug/nfs-ganesha-2.7.1/support/export_mgr.c:2102
> >
> > #18 0x0000000000554e10 in dbus_message_entrypoint
> (conn=0x7f4e42c67400, msg=0x7f4e42c31200, user_data=0x7e7cd0
> <export_interfaces>) at
> /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:562
> >
> > #19 0x00007f4e47f00276 in _dbus_object_tree_dispatch_and_unlock
> () from /lib64/libdbus-1.so.3
> >
> > #20 0x00007f4e47ef1b29 in dbus_connection_dispatch () from
> /lib64/libdbus-1.so.3
> >
> > #21 0x00007f4e47ef1e42 in _dbus_connection_read_write_dispatch ()
> from /lib64/libdbus-1.so.3
> >
> > #22 0x00000000005559e8 in gsh_dbus_thread (arg=0x0) at
> /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:795
> >
> > #23 0x00007f4e468d9e25 in start_thread () from
/lib64/libpthread.so.0
> >
> > #24 0x00007f4e461e1bad in clone () from /lib64/libc.so.6
> >
> > (gdb)
> >
> >
> > Thanks.
> >
> > Gaurav
> >
> > _______________________________________________
> > Devel mailing list -- devel(a)lists.nfs-ganesha.org
> <mailto:devel@lists.nfs-ganesha.org>
> > To unsubscribe send an email to devel-leave(a)lists.nfs-ganesha.org
> <mailto:devel-leave@lists.nfs-ganesha.org>
>