Thanks, we need to upgrade dbus.
I found one issue, but not sure if that's the root cause as we don't have reproducer now.
But I think this is how we want full stats, we have defined type as array but not using it, just dumping all ops in struct.
-Gaurav

On Mon, Apr 29, 2019 at 7:45 PM Daniel Gryniewicz <dang@redhat.com> wrote:
Thanks for this.  Everything on the Ganesha side looks fine.  Can you
upgrade your dbus?  1.10 is *very* old.  Even my oldest test systems
(Fedora 24, so quite old) have 1.11 on them.

Daniel

On 4/26/19 1:09 PM, gaurav gangalwar wrote:
> More details
>
> (gdb) f 16
>
> #16 0x0000000000514d88 in server_dbus_v4_full_stats
> (iter=0x7fc1987bf130) at
> /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287
>
> 2287            dbus_message_iter_append_basic(iter, DBUS_TYPE_STRING,
> &message);
>
> (gdb) p message
>
> $1 = 0x5a3f72 "OK"
>
> (gdb) p iter
>
> $2 = (DBusMessageIter *) 0x7fc1987bf130
>
> (gdb) p *iter
>
> $3 = {dummy1 = 0x7fc1ad031140, dummy2 = 0x7fc100e00000, dummy3 =
> 2558132332, dummy4 = 32705, dummy5 = 0, dummy6 = 0, dummy7 = -1,
>
>    dummy8 = 32705, dummy9 = -1392307824, dummy10 = 32705, dummy11 =
> 2384, pad1 = 32705, pad2 = 0xe19325a9afe4c600, pad3 = 0x0}
>
> (gdb) p op_counter
>
> $4 = 718029857
>
> (gdb) p op
>
> $5 = 72
>
> (gdb)
>
>
>
> -Gaurav
>
> On Fri, Apr 26, 2019 at 7:12 PM Daniel Gryniewicz <dang@redhat.com
> <mailto:dang@redhat.com>> wrote:
>
>     This is clearly a modified version of 2.7.1, since that function isn't
>     in 2.7 at all.  Can you figure out which line in
>     server_dbus_v4_full_stats() is being run, and post that?   That would
>     help, I think.
>
>     Daniel
>
>     On Fri, Apr 26, 2019 at 1:23 AM gaurav gangalwar
>     <gaurav.gangalwar@gmail.com <mailto:gaurav.gangalwar@gmail.com>> wrote:
>      >
>      > Hi,
>      > We are getting this crash on loaded system, we are using
>     dbus-1.10.24-13, looks like issue with dbus lib.
>      > Anyone aware of this issue?
>      >
>      > (gdb) bt
>      >
>      > #0  0x00007f4e468e159b in raise () from /lib64/libpthread.so.0
>      >
>      > #1  0x0000000000448db4 in crash_handler (signo=11,
>     info=0x7f4e2c1db870, ctx=0x7f4e2c1db740) at
>     /usr/src/debug/nfs-ganesha-2.7.1/MainNFSD/nfs_init.c:246
>      >
>      > #2  <signal handler called>
>      >
>      > #3  0x00007f4e47f0b269 in _dbus_marshal_read_uint32 () from
>     /lib64/libdbus-1.so.3
>      >
>      > #4  0x00007f4e47f0bb6a in _dbus_marshal_skip_basic () from
>     /lib64/libdbus-1.so.3
>      >
>      > #5  0x00007f4e47ef71f2 in base_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #6  0x00007f4e47ef70cb in _dbus_type_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #7  0x00007f4e47ef71b8 in base_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #8  0x00007f4e47ef7239 in struct_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #9  0x00007f4e47ef70cb in _dbus_type_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #10 0x00007f4e47ef7368 in array_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #11 0x00007f4e47ef70cb in _dbus_type_reader_next () from
>     /lib64/libdbus-1.so.3
>      >
>      > #12 0x00007f4e47ef5348 in _dbus_header_cache_revalidate () from
>     /lib64/libdbus-1.so.3
>      >
>      > #13 0x00007f4e47ef5c8e in _dbus_header_get_field_raw () from
>     /lib64/libdbus-1.so.3
>      >
>      > #14 0x00007f4e47efa222 in
>     _dbus_message_iter_open_signature.part.4 () from /lib64/libdbus-1.so.3
>      >
>      > #15 0x00007f4e47efc0f4 in dbus_message_iter_append_basic () from
>     /lib64/libdbus-1.so.3
>      >
>      > #16 0x0000000000514be1 in server_dbus_v4_full_stats
>     (iter=0x7f4e2c1dc130) at
>     /usr/src/debug/nfs-ganesha-2.7.1/support/server_stats.c:2287
>      >
>      > #17 0x000000000051b319 in stats_v4_full (args=0x0,
>     reply=0x7f4e2441f080, error=0x7f4e2c1dc230) at
>     /usr/src/debug/nfs-ganesha-2.7.1/support/export_mgr.c:2102
>      >
>      > #18 0x0000000000554e10 in dbus_message_entrypoint
>     (conn=0x7f4e42c67400, msg=0x7f4e42c31200, user_data=0x7e7cd0
>     <export_interfaces>) at
>     /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:562
>      >
>      > #19 0x00007f4e47f00276 in _dbus_object_tree_dispatch_and_unlock
>     () from /lib64/libdbus-1.so.3
>      >
>      > #20 0x00007f4e47ef1b29 in dbus_connection_dispatch () from
>     /lib64/libdbus-1.so.3
>      >
>      > #21 0x00007f4e47ef1e42 in _dbus_connection_read_write_dispatch ()
>     from /lib64/libdbus-1.so.3
>      >
>      > #22 0x00000000005559e8 in gsh_dbus_thread (arg=0x0) at
>     /usr/src/debug/nfs-ganesha-2.7.1/dbus/dbus_server.c:795
>      >
>      > #23 0x00007f4e468d9e25 in start_thread () from /lib64/libpthread.so.0
>      >
>      > #24 0x00007f4e461e1bad in clone () from /lib64/libc.so.6
>      >
>      > (gdb)
>      >
>      >
>      > Thanks.
>      >
>      > Gaurav
>      >
>      > _______________________________________________
>      > Devel mailing list -- devel@lists.nfs-ganesha.org
>     <mailto:devel@lists.nfs-ganesha.org>
>      > To unsubscribe send an email to devel-leave@lists.nfs-ganesha.org
>     <mailto:devel-leave@lists.nfs-ganesha.org>
>