vt: more Unicode handling changes
From: | Nicolas Pitre <nico-AT-fluxnic.net> | |
To: | Greg Kroah-Hartman <gregkh-AT-linuxfoundation.org>, Jiri Slaby <jirislaby-AT-kernel.org> | |
Subject: | [PATCH v2 0/8] vt: more Unicode handling changes | |
Date: | Wed, 07 May 2025 10:13:15 -0400 | |
Message-ID: | <20250507141535.40655-1-nico@fluxnic.net> | |
Cc: | Nicolas Pitre <npitre-AT-baylibre.com>, linux-serial-AT-vger.kernel.org, linux-kernel-AT-vger.kernel.org | |
Archive-link: | Article |
The Linux VT console has many problems with regards to proper Unicode handling. A first set of patches was submitted here: https://lore.kernel.org/all/20250417184849.475581-1-nico@... Those patches are currently in Greg's tty-next branch. The first 2 patches in the following series contain fixes for those already-applied patches. Remaining patches introduce tables that map complex Unicode characters to simpler fallback characters for terminal display when corresponding glyphs are unavailable. Only the subset of Unicode that can reasonably be substituted by ASCII/Latin-1 characters is covered. Substitution may not be as good as the actual glyphs but still way more helpful than squared question marks. This applies on top of tty-next currently at commit 5ee558c5d9e9. Changes from v1 (https://lore.kernel.org/all/20250505170021.29944-1-nico@f...): - Reworked the gen_ucs_fallback_table.py script to be based on unidecode. This creates a much more comprehensive fallback table with a much smaller script. - Changed the fallback table encoding to be more space efficient. - Addressed style comments from Jiri. diffstat: drivers/tty/vt/.gitignore | 1 + drivers/tty/vt/Makefile | 8 +- drivers/tty/vt/gen_ucs_fallback_table.py | 360 +++ drivers/tty/vt/ucs.c | 102 +- drivers/tty/vt/ucs_fallback_table.h_shipped | 3346 +++++++++++++++++++++ drivers/tty/vt/vt.c | 93 +- include/linux/consolemap.h | 6 + 7 files changed, 3875 insertions(+), 41 deletions(-)