On Wed, 2019-05-29 at 13:49 +0000, Stolte, Felix wrote: Note that there are significant problems with the rados_kv recovery backend. In particular, it does not properly handle the case where the server crashes during the grace period. The rados_ng and rados_cluster backends do handle those situations properly. If I had to guess, the hanging is probably due to state that is being held by the other node's MDS session that hasn't expired yet. Ceph v12 doesn't have the client reclaim interfaces that make more instantaneous failover possible. That's new in v14 (Nautilus). See pages 12 and 13 here: https://static.sched.com/hosted_files/cephalocon2019/86/Rook-Deployed%20N... Yikes! That's _way_ too short a grace period and lease lifetime. Ganesha will probably exit the grace period before the clients ever realize the server has restarted, and they will fail to reclaim their state. I consider ganesha's dbus-based takeover mechanism to be broken by design, as it requires the recovery backend to do things that can't be done atomically. If a crash occurs at the wrong time, the recovery database can end up trashed and no one can reclaim anything. If you really want an active/passive setup then I'd move away from that and just have whatever clustering software you're using start up the daemon on the active node after ensuring that it's shut down on the passive one. With that, you can also use the rados_ng recovery backend, which is more resilient in the face of multiple crashes. In that configuration you would want to have the same config file on both nodes, including the same nodeid so that you can potentially take advantage of the RECLAIM_RESET interface to kill off the old session quickly after the server restarts. You also need a much longer grace period. Cheers, -- Jeff Layton <jlayton(a)redhat.com&gt;