Many ceph clusters from one ganesha server (rgw)
Hello, Is it possible to connect ganesha and serve to clients more than one ceph cluster with fsal_rgw? I can see that there is a global rgw config part with one ceph.conf in ganesha.conf, so I guess it's not as simple as adding another fsal to the config, but I'm wondering if it's at all possible - maybe with some changes to the code. Is there maybe any other way to serve many rgw's so that they are visible as mountpoint to the clients? Aleksander Smolik
On 2/28/19 1:10 PM, asmolik@cloudferro.com wrote:
Hello,
Is it possible to connect ganesha and serve to clients more than one ceph cluster with fsal_rgw? I can see that there is a global rgw config part with one ceph.conf in ganesha.conf, so I guess it's not as simple as adding another fsal to the config, but I'm wondering if it's at all possible - maybe with some changes to the code. Is there maybe any other way to serve many rgw's so that they are visible as mountpoint to the clients?
Hi, Aleksander. Currently, no, it's not possible. As you noticed, Ganesha has a single global config option for a ceph.conf, which means it can only connect to a single cluster. In addition, FSAL_RGW currently has a singleton instance of it's librgw connection. This is shared by all exports. Finally, it looks like librgw (provided by Ceph) has the same issue: it uses a singleton global context instance to connect to the cluster. So, it looks like it would require quite a few code changes to both Ceph and to Ganesha to be able to do this. That said, it's fairly common to run a Ganesha instance on the same machine as an RGW instance, so you can just run multiple Ganeshas. It won't provide a single global namespace access to all the clusters, but it will provide access. Daniel
Hello,
Is it possible to connect ganesha and serve to clients more than one ceph cluster with fsal_rgw? I can see that there is a global rgw config
Would be nice if this librgw multi tenant, could be back ported into luminous -----Original Message----- From: Daniel Gryniewicz [mailto:dang@redhat.com] Sent: 01 March 2019 14:33 To: support@lists.nfs-ganesha.org Subject: [NFS-Ganesha-Support] Re: Many ceph clusters from one ganesha server (rgw) On 2/28/19 1:10 PM, asmolik@cloudferro.com wrote: part with one ceph.conf in ganesha.conf, so I guess it's not as simple as adding another fsal to the config, but I'm wondering if it's at all possible - maybe with some changes to the code.
Is there maybe any other way to serve many rgw's so that they are visible as mountpoint to the clients?
Hi, Aleksander. Currently, no, it's not possible. As you noticed, Ganesha has a single global config option for a ceph.conf, which means it can only connect to a single cluster. In addition, FSAL_RGW currently has a singleton instance of it's librgw connection. This is shared by all exports. Finally, it looks like librgw (provided by Ceph) has the same issue: it uses a singleton global context instance to connect to the cluster. So, it looks like it would require quite a few code changes to both Ceph and to Ganesha to be able to do this. That said, it's fairly common to run a Ganesha instance on the same machine as an RGW instance, so you can just run multiple Ganeshas. It won't provide a single global namespace access to all the clusters, but it will provide access. Daniel _______________________________________________ Support mailing list -- support@lists.nfs-ganesha.org To unsubscribe send an email to support-leave@lists.nfs-ganesha.org
I'm not the librgw expert, but looking at the code (I'm looking at Master), I don't see any multi-tenant for librgw. It looks like it can only connect to a single cluster. Daniel On 3/1/19 8:39 AM, Marc Roos wrote:
Would be nice if this librgw multi tenant, could be back ported into luminous
-----Original Message----- From: Daniel Gryniewicz [mailto:dang@redhat.com] Sent: 01 March 2019 14:33 To: support@lists.nfs-ganesha.org Subject: [NFS-Ganesha-Support] Re: Many ceph clusters from one ganesha server (rgw)
Hello,
Is it possible to connect ganesha and serve to clients more than one ceph cluster with fsal_rgw? I can see that there is a global rgw config
On 2/28/19 1:10 PM, asmolik@cloudferro.com wrote: part with one ceph.conf in ganesha.conf, so I guess it's not as simple as adding another fsal to the config, but I'm wondering if it's at all possible - maybe with some changes to the code.
Is there maybe any other way to serve many rgw's so that they are visible as mountpoint to the clients?
Hi, Aleksander.
Currently, no, it's not possible. As you noticed, Ganesha has a single global config option for a ceph.conf, which means it can only connect to a single cluster. In addition, FSAL_RGW currently has a singleton instance of it's librgw connection. This is shared by all exports. Finally, it looks like librgw (provided by Ceph) has the same issue: it uses a singleton global context instance to connect to the cluster. So, it looks like it would require quite a few code changes to both Ceph and to Ganesha to be able to do this.
That said, it's fairly common to run a Ganesha instance on the same machine as an RGW instance, so you can just run multiple Ganeshas. It won't provide a single global namespace access to all the clusters, but it will provide access.
Daniel _______________________________________________ Support mailing list -- support@lists.nfs-ganesha.org To unsubscribe send an email to support-leave@lists.nfs-ganesha.org
participants (3)
-
asmolik＠cloudferro.com -
Daniel Gryniewicz -
Marc Roos