Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1415484 > unrolled thread

NVMe over Fabrics RDMA transport drivers

Started byChristoph Hellwig <hch@lst.de>
First post2016-06-06 23:30 +0200
Last post2016-06-07 17:20 +0200
Articles 8 — 6 participants

Back to article view | Back to linux.kernel

Contents

  NVMe over Fabrics RDMA transport drivers Christoph Hellwig <hch@lst.de> - 2016-06-06 23:30 +0200
    Re: NVMe over Fabrics RDMA transport drivers Sagi Grimberg <sagi@grimberg.me> - 2016-06-07 14:00 +0200
      Re: NVMe over Fabrics RDMA transport drivers Christoph Hellwig <hch@lst.de> - 2016-06-07 14:10 +0200
      RE: NVMe over Fabrics RDMA transport drivers "Woodruff, Robert J" <robert.j.woodruff@intel.com> - 2016-06-07 17:00 +0200
        Re: NVMe over Fabrics RDMA transport drivers Steve Wise <swise@opengridcomputing.com> - 2016-06-07 22:20 +0200
          Re: NVMe over Fabrics RDMA transport drivers Christoph Hellwig <hch@lst.de> - 2016-06-07 22:30 +0200
    Re: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver Keith Busch <keith.busch@intel.com> - 2016-06-07 16:50 +0200
      Re: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver "Freyensee, James P" <james.p.freyensee@intel.com> - 2016-06-07 17:20 +0200

#1415484 — NVMe over Fabrics RDMA transport drivers

FromChristoph Hellwig <hch@lst.de>
Date2016-06-06 23:30 +0200
SubjectNVMe over Fabrics RDMA transport drivers
Message-ID<rHafU-1OH-31@gated-at.bofh.it>
This patch set implements the NVMe over Fabrics RDMA host and the target
drivers.

The host driver is tied into the NVMe host stack and implements the RDMA
transport under the NVMe core and Fabrics modules. The NVMe over Fabrics
RDMA host module is responsible for establishing a connection against a
given target/controller, RDMA event handling and data-plane command
processing.

The target driver hooks into the NVMe target core stack and implements
the RDMA transport. The module is responsible for RDMA connection
establishment, RDMA event handling and data-plane RDMA commands
processing.

RDMA connection establishment is done using RDMA/CM and IP resolution.
The data-plane command sequence follows the classic storage model where
the target pushes/pulls the data.

[toc] | [next] | [standalone]

#1416084

FromSagi Grimberg <sagi@grimberg.me>
Date2016-06-07 14:00 +0200
Message-ID<rHnPQ-2e7-37@gated-at.bofh.it>
In reply to#1415484
We forgot to CC Linux-rdma, CC'ing...

On 07/06/16 00:23, Christoph Hellwig wrote:
> This patch set implements the NVMe over Fabrics RDMA host and the target
> drivers.
>
> The host driver is tied into the NVMe host stack and implements the RDMA
> transport under the NVMe core and Fabrics modules. The NVMe over Fabrics
> RDMA host module is responsible for establishing a connection against a
> given target/controller, RDMA event handling and data-plane command
> processing.
>
> The target driver hooks into the NVMe target core stack and implements
> the RDMA transport. The module is responsible for RDMA connection
> establishment, RDMA event handling and data-plane RDMA commands
> processing.
>
> RDMA connection establishment is done using RDMA/CM and IP resolution.
> The data-plane command sequence follows the classic storage model where
> the target pushes/pulls the data.
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-block" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

[toc] | [prev] | [next] | [standalone]

#1416101

FromChristoph Hellwig <hch@lst.de>
Date2016-06-07 14:10 +0200
Message-ID<rHnZw-2wN-41@gated-at.bofh.it>
In reply to#1416084
On Tue, Jun 07, 2016 at 02:57:09PM +0300, Sagi Grimberg wrote:
> We forgot to CC Linux-rdma, CC'ing...

D'oh - thanks for catching this.

[toc] | [prev] | [next] | [standalone]

#1416276

From"Woodruff, Robert J" <robert.j.woodruff@intel.com>
Date2016-06-07 17:00 +0200
Message-ID<rHqE2-3Zy-9@gated-at.bofh.it>
In reply to#1416084
Sagi Grimberg wrote,

>We forgot to CC Linux-rdma, CC'ing...

Are you planning on sending the patch set to the linux-rdma list for comments as well ?
It might be good to do so if you want review from the rdma subsystem experts, as many of them do not subscribe to the other
lists.

[toc] | [prev] | [next] | [standalone]

#1416572

FromSteve Wise <swise@opengridcomputing.com>
Date2016-06-07 22:20 +0200
Message-ID<rHvDI-7fg-25@gated-at.bofh.it>
In reply to#1416276
On 6/7/2016 9:55 AM, Woodruff, Robert J wrote:
> Sagi Grimberg wrote,
>
>> We forgot to CC Linux-rdma, CC'ing...
> Are you planning on sending the patch set to the linux-rdma list for comments as well ?
> It might be good to do so if you want review from the rdma subsystem experts, as many of them do not subscribe to the other
> lists.

It would be great to make sure and CC linux-rdma on v2 of all 4 series, 
so interested folks can review and/or test out the whole enchilada.

Anyway, today I used the github tree at 
git://git.infradead.org/nvme-fabrics.git, branch nvmf-all for testing 
NVME/Fabrics over RDMA.  I used nvme-cli from 
https://github.com/linux-nvme/nvme-cli.git, and nvmetcli from 
git://git.infradead.org/users/hch/nvmetcli.git for configuring.  I ran 
some xfs, fio and iozone tests over both iw_cxgb4 and mlx4, using ram 
disks and an NVME ssd.  Checks out good so far!

Tested-by: Steve Wise <swise@opengridcomputing.com>

[toc] | [prev] | [next] | [standalone]

#1416589

FromChristoph Hellwig <hch@lst.de>
Date2016-06-07 22:30 +0200
Message-ID<rHvNo-7ix-13@gated-at.bofh.it>
In reply to#1416572
On Tue, Jun 07, 2016 at 03:14:22PM -0500, Steve Wise wrote:
> It would be great to make sure and CC linux-rdma on v2 of all 4 series, so 
> interested folks can review and/or test out the whole enchilada.

Just go for the git tree at

	git://git.infradead.org/nvme-fabrics.git nvmf-all

to make your life easier for that..  I'll include the list on the next
repost, although I hope the first series with it's mostly protocol header
changes can go in before needing to repost the rest, they are all pretty
trivial.

[toc] | [prev] | [next] | [standalone]

#1416269 — Re: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver

FromKeith Busch <keith.busch@intel.com>
Date2016-06-07 16:50 +0200
SubjectRe: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver
Message-ID<rHqul-3V5-5@gated-at.bofh.it>
In reply to#1415484
On Mon, Jun 06, 2016 at 11:23:35PM +0200, Christoph Hellwig wrote:
> To connect to all NVMe over Fabrics controller reachable on a given taget
> port using RDMA/CM use the following command:
> 
> 	nvme connect-all -t rdma -a $IPADDR
> 
> This requires the latest version of nvme-cli with Fabrics support.

Is there a public fork or patch set available for the user tools? I'd
be happy to merge that in.

Overall, this whole series is looking really good. I'll try this out on
some machines today.

[toc] | [prev] | [next] | [standalone]

#1416293 — Re: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver

From"Freyensee, James P" <james.p.freyensee@intel.com>
Date2016-06-07 17:20 +0200
SubjectRe: [PATCH 5/5] nvme-rdma: add a NVMe over Fabrics RDMA host driver
Message-ID<rHqXn-4lt-21@gated-at.bofh.it>
In reply to#1416269
On Tue, 2016-06-07 at 10:47 -0400, Keith Busch wrote:
> On Mon, Jun 06, 2016 at 11:23:35PM +0200, Christoph Hellwig wrote:
> > To connect to all NVMe over Fabrics controller reachable on a given
> > taget
> > port using RDMA/CM use the following command:
> > 
> > 	nvme connect-all -t rdma -a $IPADDR
> > 
> > This requires the latest version of nvme-cli with Fabrics support.
> 
> Is there a public fork or patch set available for the user tools? I'd
> be happy to merge that in.
> 
> Overall, this whole series is looking really good. 

Special thanks to Sagi and Christoph for organizing all the patches of
this code project into a dynamite submission series for these mailing
lists.

> I'll try this out on
> some machines today.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.kernel

csiph-web