| From: |
| Yuanchu Xie <yuanchu-AT-google.com> |
| To: |
| Greg Kroah-Hartman <gregkh-AT-linuxfoundation.org>, "Rafael J . Wysocki" <rafael-AT-kernel.org>, "Michael S . Tsirkin" <mst-AT-redhat.com>, David Hildenbrand <david-AT-redhat.com>, Jason Wang <jasowang-AT-redhat.com>, Andrew Morton <akpm-AT-linux-foundation.org>, Johannes Weiner <hannes-AT-cmpxchg.org>, Michal Hocko <mhocko-AT-kernel.org>, Roman Gushchin <roman.gushchin-AT-linux.dev>, Shakeel Butt <shakeelb-AT-google.com>, Muchun Song <muchun.song-AT-linux.dev>, Yu Zhao <yuzhao-AT-google.com>, Kefeng Wang <wangkefeng.wang-AT-huawei.com>, Kairui Song <kasong-AT-tencent.com>, Yosry Ahmed <yosryahmed-AT-google.com>, Yuanchu Xie <yuanchu-AT-google.com>, "T . J . Alumbaugh" <talumbau-AT-google.com> |
| Subject: |
| [RFC PATCH v2 0/6] mm: working set reporting |
| Date: |
| Wed, 21 Jun 2023 18:04:48 +0000 |
| Message-ID: |
| <20230621180454.973862-1-yuanchu@google.com> |
| Cc: |
| Wei Xu <weixugc-AT-google.com>, SeongJae Park <sj-AT-kernel.org>, Sudarshan Rajagopalan <quic_sudaraja-AT-quicinc.com>, kai.huang-AT-intel.com, hch-AT-lst.de, jon-AT-nutanix.com, Aneesh Kumar K V <aneesh.kumar-AT-linux.ibm.com>, Matthew Wilcox <willy-AT-infradead.org>, Vasily Averin <vasily.averin-AT-linux.dev>, linux-kernel-AT-vger.kernel.org, virtualization-AT-lists.linux-foundation.org, linux-mm-AT-kvack.org, cgroups-AT-vger.kernel.org |
| Archive-link: |
| Article |
RFC v1: https://lore.kernel.org/linux-mm/20230509185419.1088297-1...
For background and interfaces, see the RFC v1 posting.
Changes from v1 -> v2:
- Refactored the patchs into smaller pieces
- Renamed interfaces and functions from wss to wsr (Working Set Reporting)
- Fixed build errors when CONFIG_WSR is not set
- Changed working_set_num_bins to u8 for virtio-balloon
- Added support for per-NUMA node reporting for virtio-balloon
The RFC adds CONFIG_WSR and requires MGLRU to function. T.J. and I aim to support
the active/inactive LRU and working set estimation from the userspace as well.
This series should be build with the following configs:
CONFIG_LRU_GEN=y
CONFIG_LRU_GEN_ENABLED=y
CONFIG_VIRTIO_BALLOON=y
CONFIG_WSR=y
TODO list:
- There's a hack in mm/vmscan.c that calls into the virtio-balloon driver,
which doesn't work if CONFIG_VIRTIO_BALLOON=m. T.J. Alumbaugh (talumbau@google.com)
and I plan on solving this problem with a working set notification mechanism
that would allow multiple consumers to subscribe for working set changes.
- memory.reaccess.histogram does not consider swapped out pages to be reaccessed.
I plan to implement this with the shadow entry computed from mm/workingset.c.
QEMU device implementation:
https://lists.gnu.org/archive/html/qemu-devel/2023-05/msg...
virtio-dev spec proposal v1 (v2 to be posted by T.J.):
https://lore.kernel.org/virtio-dev/CABmGT5Hv6Jd_F9EoQqVMD...
LSF/MM discussion slides:
https://lore.kernel.org/linux-mm/CABmGT5HK9xHz=E4q4sECCD8...
T.J. Alumbaugh (1):
virtio-balloon: Add Working Set reporting
Yuanchu Xie (5):
mm: aggregate working set information into histograms
mm: add working set refresh threshold to rate-limit aggregation
mm: report working set when under memory pressure
mm: extend working set reporting to memcgs
mm: add per-memcg reaccess histogram
drivers/base/node.c | 3 +
drivers/virtio/virtio_balloon.c | 288 +++++++++++++++++
include/linux/balloon_compaction.h | 3 +
include/linux/memcontrol.h | 6 +
include/linux/mmzone.h | 5 +
include/linux/wsr.h | 114 +++++++
include/uapi/linux/virtio_balloon.h | 33 ++
mm/Kconfig | 7 +
mm/Makefile | 1 +
mm/internal.h | 12 +
mm/memcontrol.c | 351 ++++++++++++++++++++-
mm/mmzone.c | 3 +
mm/vmscan.c | 194 +++++++++++-
mm/wsr.c | 464 ++++++++++++++++++++++++++++
14 files changed, 1480 insertions(+), 4 deletions(-)
create mode 100644 include/linux/wsr.h
create mode 100644 mm/wsr.c
--
2.41.0.162.gfafddb0af9-goog
