| From: |
| Jerry Shih <jerry.shih-AT-sifive.com> |
| To: |
| paul.walmsley-AT-sifive.com, palmer-AT-dabbelt.com, aou-AT-eecs.berkeley.edu, herbert-AT-gondor.apana.org.au, davem-AT-davemloft.net |
| Subject: |
| [PATCH 00/12] RISC-V: provide some accelerated cryptography implementations using vector extensions |
| Date: |
| Thu, 26 Oct 2023 02:36:32 +0800 |
| Message-ID: |
| <20231025183644.8735-1-jerry.shih@sifive.com> |
| Cc: |
| andy.chiu-AT-sifive.com, greentime.hu-AT-sifive.com, conor.dooley-AT-microchip.com, guoren-AT-kernel.org, bjorn-AT-rivosinc.com, heiko-AT-sntech.de, ebiggers-AT-kernel.org, ardb-AT-kernel.org, phoebe.chen-AT-sifive.com, hongrong.hsu-AT-sifive.com, linux-riscv-AT-lists.infradead.org, linux-kernel-AT-vger.kernel.org, linux-crypto-AT-vger.kernel.org |
| Archive-link: |
| Article |
This series provides cryptographic implementations using the vector crypto
extensions[1] including:
1. AES cipher
2. AES with CBC/CTR/ECB/XTS block modes
3. ChaCha20 stream cipher
4. GHASH for GCM
5. SHA-224/256 and SHA-384/512 hash
6. SM3 hash
7. SM4 cipher
This patch set is based on Heiko Stuebner's work at:
Link: https://lore.kernel.org/all/20230711153743.1970625-1-heik...
The implementations reuse the perl-asm scripts from OpenSSL[2] with some
changes adapting for the kernel crypto framework.
The perl-asm scripts generate the opcodes into `.S` files instead of asm
mnemonics. The reason for using opcodes is because the assembler hasn't
supported the vector-crypto extensions yet.
All changes pass the kernel run-time crypto self tests and the extra tests
with vector-crypto-enabled qemu.
Link: https://lists.gnu.org/archive/html/qemu-devel/2023-10/msg...
This series depend on:
1. kernel 6.6-rc7
Link: https://github.com/torvalds/linux/commit/05d3ef8bba77c1b5...
2. support kernel-mode vector
Link: https://lore.kernel.org/all/20230721112855.1006-1-andy.ch...
3. vector crypto extensions detection
Link: https://lore.kernel.org/lkml/20231017131456.2053396-1-cle...
4. fix the error message:
alg: skcipher: skipping comparison tests for xts-aes-aesni because
xts(ecb(aes-generic)) is unavailable
Link: https://lore.kernel.org/linux-crypto/20231009023116.26621...
Here is a branch on github applying with all dependent patches:
Link: https://github.com/JerryShih/linux/tree/dev/jerrys/vector...
[1]
Link: https://github.com/riscv/riscv-crypto/blob/56ed7952d13eb5...
[2]
Link: https://github.com/openssl/openssl/pull/21923
Heiko Stuebner (2):
RISC-V: add helper function to read the vector VLEN
RISC-V: hook new crypto subdir into build-system
Jerry Shih (10):
RISC-V: crypto: add OpenSSL perl module for vector instructions
RISC-V: crypto: add Zvkned accelerated AES implementation
crypto: scatterwalk - Add scatterwalk_next() to get the next
scatterlist in scatter_walk
RISC-V: crypto: add accelerated AES-CBC/CTR/ECB/XTS implementations
RISC-V: crypto: add Zvkg accelerated GCM GHASH implementation
RISC-V: crypto: add Zvknha/b accelerated SHA224/256 implementations
RISC-V: crypto: add Zvknhb accelerated SHA384/512 implementations
RISC-V: crypto: add Zvksed accelerated SM4 implementation
RISC-V: crypto: add Zvksh accelerated SM3 implementation
RISC-V: crypto: add Zvkb accelerated ChaCha20 implementation
arch/riscv/Kbuild | 1 +
arch/riscv/crypto/Kconfig | 122 ++
arch/riscv/crypto/Makefile | 68 +
.../crypto/aes-riscv64-block-mode-glue.c | 486 +++++++
arch/riscv/crypto/aes-riscv64-glue.c | 163 +++
arch/riscv/crypto/aes-riscv64-glue.h | 28 +
.../crypto/aes-riscv64-zvbb-zvkg-zvkned.pl | 944 +++++++++++++
arch/riscv/crypto/aes-riscv64-zvkb-zvkned.pl | 416 ++++++
arch/riscv/crypto/aes-riscv64-zvkned.pl | 1198 +++++++++++++++++
arch/riscv/crypto/chacha-riscv64-glue.c | 120 ++
arch/riscv/crypto/chacha-riscv64-zvkb.pl | 322 +++++
arch/riscv/crypto/ghash-riscv64-glue.c | 191 +++
arch/riscv/crypto/ghash-riscv64-zvkg.pl | 100 ++
arch/riscv/crypto/riscv.pm | 828 ++++++++++++
arch/riscv/crypto/sha256-riscv64-glue.c | 140 ++
.../sha256-riscv64-zvkb-zvknha_or_zvknhb.pl | 318 +++++
arch/riscv/crypto/sha512-riscv64-glue.c | 133 ++
.../crypto/sha512-riscv64-zvkb-zvknhb.pl | 266 ++++
arch/riscv/crypto/sm3-riscv64-glue.c | 121 ++
arch/riscv/crypto/sm3-riscv64-zvksh.pl | 230 ++++
arch/riscv/crypto/sm4-riscv64-glue.c | 120 ++
arch/riscv/crypto/sm4-riscv64-zvksed.pl | 268 ++++
arch/riscv/include/asm/vector.h | 11 +
crypto/Kconfig | 3 +
include/crypto/scatterwalk.h | 9 +-
25 files changed, 6604 insertions(+), 2 deletions(-)
create mode 100644 arch/riscv/crypto/Kconfig
create mode 100644 arch/riscv/crypto/Makefile
create mode 100644 arch/riscv/crypto/aes-riscv64-block-mode-glue.c
create mode 100644 arch/riscv/crypto/aes-riscv64-glue.c
create mode 100644 arch/riscv/crypto/aes-riscv64-glue.h
create mode 100644 arch/riscv/crypto/aes-riscv64-zvbb-zvkg-zvkned.pl
create mode 100644 arch/riscv/crypto/aes-riscv64-zvkb-zvkned.pl
create mode 100644 arch/riscv/crypto/aes-riscv64-zvkned.pl
create mode 100644 arch/riscv/crypto/chacha-riscv64-glue.c
create mode 100644 arch/riscv/crypto/chacha-riscv64-zvkb.pl
create mode 100644 arch/riscv/crypto/ghash-riscv64-glue.c
create mode 100644 arch/riscv/crypto/ghash-riscv64-zvkg.pl
create mode 100644 arch/riscv/crypto/riscv.pm
create mode 100644 arch/riscv/crypto/sha256-riscv64-glue.c
create mode 100644 arch/riscv/crypto/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl
create mode 100644 arch/riscv/crypto/sha512-riscv64-glue.c
create mode 100644 arch/riscv/crypto/sha512-riscv64-zvkb-zvknhb.pl
create mode 100644 arch/riscv/crypto/sm3-riscv64-glue.c
create mode 100644 arch/riscv/crypto/sm3-riscv64-zvksh.pl
create mode 100644 arch/riscv/crypto/sm4-riscv64-glue.c
create mode 100644 arch/riscv/crypto/sm4-riscv64-zvksed.pl
--
2.28.0