Re: [PATCH v10 08/22] IB/hns: Add icm support

From	Leon Romanovsky <leon@kernel.org>
Newsgroups	linux.kernel
Subject	Re: [PATCH v10 08/22] IB/hns: Add icm support
Date	2016-06-21 14:00 +0200
Message-ID	<rMsvv-5kN-9@gated-at.bofh.it> (permalink)
References	(5 earlier) <rM2hH-5qN-23@gated-at.bofh.it> <rM3Qu-6sw-21@gated-at.bofh.it> <rM40b-6wa-37@gated-at.bofh.it> <rM77I-d8-3@gated-at.bofh.it> <rMlNn-12h-9@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On Tue, Jun 21, 2016 at 12:37:39PM +0800, Wei Hu (Xavier) wrote:
> 
> 
> On 2016/6/20 21:04, Leon Romanovsky wrote:
> >On Mon, Jun 20, 2016 at 05:48:15PM +0800, Wei Hu (Xavier) wrote:
> >>
> >>On 2016/6/20 17:27, Leon Romanovsky wrote:
> >>>On Mon, Jun 20, 2016 at 03:49:24PM +0800, Wei Hu (Xavier) wrote:
> >>>>On 2016/6/20 14:06, Leon Romanovsky wrote:
> >>>>>On Mon, Jun 20, 2016 at 12:37:40PM +0800, Wei Hu (Xavier) wrote:
> >>>>>>On 2016/6/17 17:58, Leon Romanovsky wrote:
> >>>>>>>On Thu, Jun 16, 2016 at 10:35:16PM +0800, Lijun Ou wrote:
> >>>>>>>>This patch mainly added icm support for RoCE. It initializes icm
> >>>>>>>>which managers the relative memory blocks for RoCE. The data
> >>>>>>>>structures of RoCE will be located in it. For example, CQ table,
> >>>>>>>>QP table and MTPT table so on.
> >>>>>>>>
> >>>>>>>>Signed-off-by: Wei Hu <xavier.huwei@huawei.com>
> >>>>>>>>Signed-off-by: Nenglong Zhao <zhaonenglong@hisilicon.com>
> >>>>>>>>Signed-off-by: Lijun Ou <oulijun@huawei.com>
> >>>>>>>>---
> >>>>>>><...>
> >>>>>>>
> >>>>>>>>+
> >>>>>Another question which you didn't answer [1].
> >>>>>
> >>>>>"I wonder if you have the same needs for ICM as it is in mlx4 device.
> >>>>>Do you have firmware?"
> >>>>>
> >>>>>[1] http://marc.info/?l=linux-rdma&m=146545553104913&w=2
> >>>>Hi, Leon
> >>>>     Now we haven't firmware.
> >>>>     But hardware still need memory for QPC\CQC\MTPT\mtt etc.
> >>>ICM stands for InfiniHost (Interconnect) Context Memory is a specific
> >>>memory place to share between host <-> FW and host <-> HW if HW is
> >>>aware of specific structures.
> >>>
> >>>I assume that in your case, it is enough to allocate memory region and
> >>>supply it to HW. Am I right?
> >>For Our hardware,
> >>1. ICM has a memory management method, It's very good for QPC\CQC\MTPT\mtt
> >>etc. we need it.
> >You need special HW to leverage its. AFAIK it is Mellanox specific.
> For our hardware, we use ICM to memory management, the memory shared with
> host and HW.
> QPC\CQC\MTPT\mtt has specific memory requirement.
> QPC\CQC\MTPT need continuous memory. we use ICM to management the block of
> memory. It's very good！

I wasn't convinced why do you need to copy whole ICM logic which is
specific to Mellanox. Your requirements can be implemented by standard CMA
and/or DMA.

> >>2. The meomry for QPC\CQC\MTPT\mtt only used for RoCE hardware and driver,
> >>we don't want use MR.
> >I didn't mean Infiniband MR, but memory region returned from standard
> >allocation functions (kmalloc, ...).
> >
> >>3. Now we haven't firmware, maybe we need it next version.
> >You are always invited to add support once it will be needed, no need to
> >add it in advance.
> >
> >Thanks
> 
>

Thread

[PATCH v10 08/22] IB/hns: Add icm support Lijun Ou <oulijun@huawei.com> - 2016-06-16 16:30 +0200
  Re: [PATCH v10 08/22] IB/hns: Add icm support Leon Romanovsky <leon@kernel.org> - 2016-06-17 12:00 +0200
    Re: [PATCH v10 08/22] IB/hns: Add icm support Leon Romanovsky <leon@kernel.org> - 2016-06-20 08:10 +0200
      Re: [PATCH v10 08/22] IB/hns: Add icm support "Wei Hu (Xavier)" <xavier.huwei@huawei.com> - 2016-06-20 10:00 +0200
        Re: [PATCH v10 08/22] IB/hns: Add icm support Leon Romanovsky <leon@kernel.org> - 2016-06-20 11:40 +0200
          Re: [PATCH v10 08/22] IB/hns: Add icm support "Wei Hu (Xavier)" <xavier.huwei@huawei.com> - 2016-06-20 11:50 +0200
            Re: [PATCH v10 08/22] IB/hns: Add icm support Leon Romanovsky <leon@kernel.org> - 2016-06-20 15:10 +0200
              Re: [PATCH v10 08/22] IB/hns: Add icm support "Wei Hu (Xavier)" <xavier.huwei@huawei.com> - 2016-06-21 06:50 +0200
                Re: [PATCH v10 08/22] IB/hns: Add icm support Leon Romanovsky <leon@kernel.org> - 2016-06-21 14:00 +0200
                Re: [PATCH v10 08/22] IB/hns: Add icm support "Wei Hu (Xavier)" <xavier.huwei@huawei.com> - 2016-06-22 06:00 +0200

csiph-web