| From: |
| Håkon Bugge <haakon.bugge-AT-oracle.com> |
| To: |
| linux-rdma-AT-vger.kernel.org, linux-kernel-AT-vger.kernel.org, netdev-AT-vger.kernel.org, rds-devel-AT-oss.oracle.com |
| Subject: |
| [PATCH v3 0/6] rds: rdma: Add ability to force GFP_NOIO |
| Date: |
| Wed, 22 May 2024 15:54:32 +0200 |
| Message-ID: |
| <20240522135444.1685642-1-haakon.bugge@oracle.com> |
| Cc: |
| Jason Gunthorpe <jgg-AT-ziepe.ca>, Leon Romanovsky <leon-AT-kernel.org>, Saeed Mahameed <saeedm-AT-nvidia.com>, Tariq Toukan <tariqt-AT-nvidia.com>, "David S . Miller" <davem-AT-davemloft.net>, Eric Dumazet <edumazet-AT-google.com>, Jakub Kicinski <kuba-AT-kernel.org>, Paolo Abeni <pabeni-AT-redhat.com>, Tejun Heo <tj-AT-kernel.org>, Lai Jiangshan <jiangshanlai-AT-gmail.com>, Allison Henderson <allison.henderson-AT-oracle.com>, Manjunath Patil <manjunath.b.patil-AT-oracle.com>, Mark Zhang <markzhang-AT-nvidia.com>, Håkon Bugge <haakon.bugge-AT-oracle.com>, Chuck Lever <chuck.lever-AT-oracle.com>, Shiraz Saleem <shiraz.saleem-AT-intel.com>, Yang Li <yang.lee-AT-linux.alibaba.com> |
| Archive-link: |
| Article |
This series enables RDS and the RDMA stack to be used as a block I/O
device. This to support a filesystem on top of a raw block device
which uses RDS and the RDMA stack as the network transport layer.
Under intense memory pressure, we get memory reclaims. Assume the
filesystem reclaims memory, goes to the raw block device, which calls
into RDS, which calls the RDMA stack. Now, if regular GFP_KERNEL
allocations in RDS or the RDMA stack require reclaims to be fulfilled,
we end up in a circular dependency.
We break this circular dependency by:
1. Force all allocations in RDS and the relevant RDMA stack to use
GFP_NOIO, by means of a parenthetic use of
memalloc_noio_{save,restore} on all relevant entry points.
2. Make sure work-queues inherits current->flags
wrt. PF_MEMALLOC*, such that work executed on the
work-queue inherits the same flag(s).
Håkon Bugge (6):
workqueue: Inherit per-process allocation flags
rds: Brute force GFP_NOIO
RDMA/cma: Brute force GFP_NOIO
RDMA/cm: Brute force GFP_NOIO
RDMA/mlx5: Brute force GFP_NOIO
net/mlx5: Brute force GFP_NOIO
drivers/infiniband/core/cm.c | 15 ++++-
drivers/infiniband/core/cma.c | 20 ++++++-
drivers/infiniband/hw/mlx5/main.c | 22 +++++--
.../net/ethernet/mellanox/mlx5/core/main.c | 14 ++++-
include/linux/workqueue.h | 9 +++
kernel/workqueue.c | 60 +++++++++++++++++++
net/rds/af_rds.c | 59 +++++++++++++++++-
7 files changed, 187 insertions(+), 12 deletions(-)
--
2.31.1
