Thanks, we need to upgrade dbus. I found one issue, but not sure if that's the root cause as we don't have reproducer now. But I think this is how we want full stats, we have defined type as array but not using it, just dumping all ops in struct. https://review.gerrithub.io/#/c/ffilz/nfs-ganesha/+/452651/ -Gaurav On Mon, Apr 29, 2019 at 7:45 PM Daniel Gryniewicz <dang@redhat.com> wrote:
Thanks for this. Everything on the Ganesha side looks fine. Can you upgrade your dbus? 1.10 is *very* old. Even my oldest test systems (Fedora 24, so quite old) have 1.11 on them.
Daniel
On 4/26/19 1:09 PM, gaurav gangalwar wrote:
More details
(gdb) f 16
#16 0x0000000000514d88 in server_dbus_v4_full_stats (iter=0x7fc1987bf130) at /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287
2287 dbus_message_iter_append_basic(iter, DBUS_TYPE_STRING, &message);
(gdb) p message
$1 = 0x5a3f72 "OK"
(gdb) p iter
$2 = (DBusMessageIter *) 0x7fc1987bf130
(gdb) p *iter
$3 = {dummy1 = 0x7fc1ad031140, dummy2 = 0x7fc100e00000, dummy3 = 2558132332, dummy4 = 32705, dummy5 = 0, dummy6 = 0, dummy7 = -1,
dummy8 = 32705, dummy9 = -1392307824, dummy10 = 32705, dummy11 = 2384, pad1 = 32705, pad2 = 0xe19325a9afe4c600, pad3 = 0x0}
(gdb) p op_counter
$4 = 718029857
(gdb) p op
$5 = 72
(gdb)
-Gaurav
On Fri, Apr 26, 2019 at 7:12 PM Daniel Gryniewicz <dang@redhat.com <mailto:dang@redhat.com>> wrote:
This is clearly a modified version of 2.7.1, since that function isn't in 2.7 at all. Can you figure out which line in server_dbus_v4_full_stats() is being run, and post that? That would help, I think.
Daniel
On Fri, Apr 26, 2019 at 1:23 AM gaurav gangalwar <gaurav.gangalwar@gmail.com <mailto:gaurav.gangalwar@gmail.com>> wrote: > > Hi, > We are getting this crash on loaded system, we are using dbus-1.10.24-13, looks like issue with dbus lib. > Anyone aware of this issue? > > (gdb) bt > > #0 0x00007f4e468e159b in raise () from /lib64/libpthread.so.0 > > #1 0x0000000000448db4 in crash_handler (signo=11, info=0x7f4e2c1db870, ctx=0x7f4e2c1db740) at /usr/src/debug/nfs-ganesha-2.7.1/MainNFSD/nfs_init.c:246 > > #2 <signal handler called> > > #3 0x00007f4e47f0b269 in _dbus_marshal_read_uint32 () from /lib64/libdbus-1.so.3 > > #4 0x00007f4e47f0bb6a in _dbus_marshal_skip_basic () from /lib64/libdbus-1.so.3 > > #5 0x00007f4e47ef71f2 in base_reader_next () from /lib64/libdbus-1.so.3 > > #6 0x00007f4e47ef70cb in _dbus_type_reader_next () from /lib64/libdbus-1.so.3 > > #7 0x00007f4e47ef71b8 in base_reader_next () from /lib64/libdbus-1.so.3 > > #8 0x00007f4e47ef7239 in struct_reader_next () from /lib64/libdbus-1.so.3 > > #9 0x00007f4e47ef70cb in _dbus_type_reader_next () from /lib64/libdbus-1.so.3 > > #10 0x00007f4e47ef7368 in array_reader_next () from /lib64/libdbus-1.so.3 > > #11 0x00007f4e47ef70cb in _dbus_type_reader_next () from /lib64/libdbus-1.so.3 > > #12 0x00007f4e47ef5348 in _dbus_header_cache_revalidate () from /lib64/libdbus-1.so.3 > > #13 0x00007f4e47ef5c8e in _dbus_header_get_field_raw () from /lib64/libdbus-1.so.3 > > #14 0x00007f4e47efa222 in _dbus_message_iter_open_signature.part.4 () from /lib64/libdbus-1.so.3 > > #15 0x00007f4e47efc0f4 in dbus_message_iter_append_basic () from /lib64/libdbus-1.so.3 > > #16 0x0000000000514be1 in server_dbus_v4_full_stats (iter=0x7f4e2c1dc130) at /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287 > > #17 0x000000000051b319 in stats_v4_full (args=0x0, reply=0x7f4e2441f080, error=0x7f4e2c1dc230) at /usr/src/debug/nfs-ganesha-2.7.1/support/export_mgr.c:2102 > > #18 0x0000000000554e10 in dbus_message_entrypoint (conn=0x7f4e42c67400, msg=0x7f4e42c31200, user_data=0x7e7cd0 <export_interfaces>) at /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:562 > > #19 0x00007f4e47f00276 in _dbus_object_tree_dispatch_and_unlock () from /lib64/libdbus-1.so.3 > > #20 0x00007f4e47ef1b29 in dbus_connection_dispatch () from /lib64/libdbus-1.so.3 > > #21 0x00007f4e47ef1e42 in _dbus_connection_read_write_dispatch () from /lib64/libdbus-1.so.3 > > #22 0x00000000005559e8 in gsh_dbus_thread (arg=0x0) at /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:795 > > #23 0x00007f4e468d9e25 in start_thread () from /lib64/libpthread.so.0 > > #24 0x00007f4e461e1bad in clone () from /lib64/libc.so.6 > > (gdb) > > > Thanks. > > Gaurav > > _______________________________________________ > Devel mailing list -- devel@lists.nfs-ganesha.org <mailto:devel@lists.nfs-ganesha.org> > To unsubscribe send an email to devel-leave@lists.nfs-ganesha.org <mailto:devel-leave@lists.nfs-ganesha.org>