| From: |
| Jiri Pirko <jiri-AT-resnulli.us> |
| To: |
| linux-rdma-AT-vger.kernel.org |
| Subject: |
| [PATCH rdma-next 00/15] RDMA: Introduce generic buffer descriptor infrastructure for umem |
| Date: |
| Wed, 25 Mar 2026 16:00:33 +0100 |
| Message-ID: |
| <20260325150048.168341-1-jiri@resnulli.us> |
| Cc: |
| jgg-AT-ziepe.ca, leon-AT-kernel.org, mrgolin-AT-amazon.com, gal.pressman-AT-linux.dev, sleybo-AT-amazon.com, parav-AT-nvidia.com, mbloch-AT-nvidia.com, yanjun.zhu-AT-linux.dev, wangliang74-AT-huawei.com, marco.crivellari-AT-suse.com, roman.gushchin-AT-linux.dev, phaddad-AT-nvidia.com, lirongqing-AT-baidu.com, ynachum-AT-amazon.com, huangjunxian6-AT-hisilicon.com, kalesh-anakkur.purayil-AT-broadcom.com, ohartoov-AT-nvidia.com, michaelgur-AT-nvidia.com, shayd-AT-nvidia.com, edwards-AT-nvidia.com, sriharsha.basavapatna-AT-broadcom.com, andrew.gospodarek-AT-broadcom.com, selvin.xavier-AT-broadcom.com |
| Archive-link: |
| Article |
From: Jiri Pirko <jiri@nvidia.com>
This patchset introduces a generic buffer descriptor infrastructure
for passing memory buffers (dma-buf or user VA) to uverbs commands,
and wires it up for CQ and QP creation in the uverbs core, efa, mlx5,
bnxt_re and mlx4 drivers.
Instead of adding per-command UAPI attributes for each new buffer
type, a single UVERBS_ATTR_BUFFERS array attribute carries all buffer
descriptors. Each descriptor specifies a buffer type and is indexed by
per-command slot enums. A consumption check ensures userspace and
driver agree on which buffers are used.
The patchset:
1. Introduces the core ib_umem_list infrastructure and UAPI.
2. Factors out CQ buffer umem processing into a helper.
3. Integrates umem_list into CQ creation, with fallback to existing
per-attribute path.
4-7. Converts efa, mlx5, bnxt_re and mlx4 to use umem_list for CQ
buffer.
8. Removes the legacy umem field from struct ib_cq, now that all
drivers use umem_list for CQ buffer management.
9. Adds a consumption check verifying all umem_list buffers were
consumed by the driver after CQ creation.
10. Integrates umem_list into QP creation.
11. Converts mlx5 QP creation to use umem_list.
12-15. Extends CQ and QP with doorbell record buffer slots and
converts mlx5 to use them.
Note this re-works the original patchset trying to handle this:
https://lore.kernel.org/all/20260203085003.71184-1-jiri@r...
The code is so much different I'm sending this is a new patchset.
Jiri Pirko (15):
RDMA/core: Introduce generic buffer descriptor infrastructure for umem
RDMA/uverbs: Push out CQ buffer umem processing into a helper
RDMA/uverbs: Integrate umem_list into CQ creation
RDMA/efa: Use umem_list for user CQ buffer
RDMA/mlx5: Use umem_list for user CQ buffer
RDMA/bnxt_re: Use umem_list for user CQ buffer
RDMA/mlx4: Use umem_list for user CQ buffer
RDMA/uverbs: Remove legacy umem field from struct ib_cq
RDMA/uverbs: Verify all umem_list buffers are consumed after CQ
creation
RDMA/uverbs: Integrate umem_list into QP creation
RDMA/mlx5: Use umem_list for QP buffers in create_qp
RDMA/uverbs: Add doorbell record buffer slot to CQ umem_list
RDMA/mlx5: Use umem_list for CQ doorbell record
RDMA/uverbs: Add doorbell record buffer slot to QP umem_list
RDMA/mlx5: Use umem_list for QP doorbell record
drivers/infiniband/core/core_priv.h | 1 +
drivers/infiniband/core/umem.c | 248 ++++++++++++++++++
drivers/infiniband/core/uverbs_cmd.c | 18 +-
drivers/infiniband/core/uverbs_std_types_cq.c | 158 ++++++-----
drivers/infiniband/core/uverbs_std_types_qp.c | 26 +-
drivers/infiniband/core/verbs.c | 26 +-
drivers/infiniband/hw/bnxt_re/ib_verbs.c | 23 +-
drivers/infiniband/hw/efa/efa_verbs.c | 17 +-
drivers/infiniband/hw/mlx4/cq.c | 21 +-
drivers/infiniband/hw/mlx5/cq.c | 40 ++-
drivers/infiniband/hw/mlx5/doorbell.c | 41 ++-
drivers/infiniband/hw/mlx5/mlx5_ib.h | 3 +-
drivers/infiniband/hw/mlx5/qp.c | 76 ++++--
drivers/infiniband/hw/mlx5/srq.c | 2 +-
include/rdma/ib_umem.h | 54 ++++
include/rdma/ib_verbs.h | 5 +-
include/rdma/uverbs_ioctl.h | 14 +
include/uapi/rdma/ib_user_ioctl_cmds.h | 17 ++
include/uapi/rdma/ib_user_ioctl_verbs.h | 27 ++
19 files changed, 651 insertions(+), 166 deletions(-)
--
2.51.1