From patchwork Mon Jan 22 16:04:14 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Brown X-Patchwork-Id: 19274 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:2bc4:b0:101:a8e8:374 with SMTP id hx4csp2741418dyb; Mon, 22 Jan 2024 10:03:39 -0800 (PST) X-Google-Smtp-Source: AGHT+IHDZQe8aVocXVdroAOMYsTl9KFkDAoJtk9fL1rlYp+JbDl7RhPRMy6pitpQVxDzUCwWb6Vd X-Received: by 2002:a05:6a00:a81:b0:6db:5a5:186c with SMTP id b1-20020a056a000a8100b006db05a5186cmr7124364pfl.59.1705946618757; Mon, 22 Jan 2024 10:03:38 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1705946618; cv=pass; d=google.com; s=arc-20160816; b=JwyORdmI49MxelFIphTu6nsmfxPsYrXI7Eem46Sv1yA9NUf7cYJ4jLFsXimJc+xiYm IYolhWuwzWKkOmxD6yc5fp58wYkp7BG8zS3lKXS96fIue/HK64oQSZGQ/gkH0Y+nI2Pg 12b3yKcYdqbvqhGBiNqZCRtavoUycoDWz6+IiqoOjPIUVIe7keaLU7YCbAgNm44wyF2a R9leLoP2GUfgMJfYEXCScXf8v5FpFTdaOV6M7VKFTz7Zh3AVhkB678n6laPd3zHh7+Gc aZn2rEXdW9rF5YYtmzFhQUdGgQwF12o/o3YXbJFTYdGplgyh80V9Yp4S/vkXuBhtWG6d luZA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:message-id:date:subject:from :dkim-signature; bh=yTYwdA5MJ6oCZAI/PY1ITXCnTO3v1mEUESoBMZe6uqU=; fh=eBs+z3cdUgmHt86TGE0VSSkyDyUe/TSov8Em/nz9veM=; b=XmfTzUqipBkGLgOeSclJ0ruRwyRQzEH4j6tNFMSd5/YGyB3qKxSu11l/YP7A7+gfu8 RDNhXphZIv79tiYX4eyf57xL+ZoUs1xKTvFkZbZEfTxXwbHEx/gNIR0TL2aiJLaapzf+ BpZZ4gc3bVjNzsgfJDJRc8HvAxOT0Xo+8xxmPGTIxSvODWX2AGMqNlS8z+UD5T+YvkW1 79TGBN+IULNcxYHM3XEisukSIlB2yM09lOJrUqFwW1SXYHIv3LovDcb3wpsQWEmtpc2p pYNBftdJza9WlZnEpiDzQ39QkOzY9kD4X/sa/JWCZP+ZC8EKUm6MyYkKMbtgOA0Z0qg/ P6qQ== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PmveBwGU; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-33649-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-33649-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id c10-20020a631c4a000000b005cdc2cc9a15si8352381pgm.742.2024.01.22.10.03.38 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 22 Jan 2024 10:03:38 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-33649-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PmveBwGU; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-33649-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-33649-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 33B04B313C6 for ; Mon, 22 Jan 2024 17:15:03 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id F2D36633FA; Mon, 22 Jan 2024 16:04:29 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="PmveBwGU" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5F3F43EA83; Mon, 22 Jan 2024 16:04:27 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705939467; cv=none; b=jiB2Pa+E1Nciyk+DE8HPB2ivjDYi/VIpZh9aeVx9Hzg7E2u1JAlON+XgJcMjFxFu3n94r8Sh/MHD0rnDkmtIKvOM4bl6NU9FeEsVS2N2TNzVtrgWY4CjxEUGBA1qDur5FwPFDxjBjkUeqmXqHBJAa01MWHd6G4wMYnjVQzp0s5E= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1705939467; c=relaxed/simple; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; h=From:Subject:Date:Message-Id:MIME-Version:Content-Type:To:Cc; b=TjcWpxoZi3yxKb/hpj56HK05JZT2c6IhLzTxvP/kCrnSZiEsa+tEBVL2BeUsKKeYrp4AvOVnpsjcDB0quGlbNi0gj2IxbC3RZoPEAzauwkSmmijOy0d5gOFwc0zYlVdz0uC4WcNBtDy55ax2S+hDP17rCDSNys++rK/m484B9tU= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=PmveBwGU; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 33BC7C433F1; Mon, 22 Jan 2024 16:04:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1705939466; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; h=From:Subject:Date:To:Cc:From; b=PmveBwGUz8JvHM7e6ofP1ebzsZpdb43APmUivPMUAd7D3BO2vFuia6u+dSSJPY3Ck Xs1voI1XS4+rxqadPge+7SqUTTuUh1SJZ/ji26xOUDUVL+B0nbCNX3cFUpZ0mw1pfO Vo1WdWzhODF8vxiymPkL5hydPDQflwoaxE4Nl5IU2Tsoomp70k5oH9k/f0Kn4FvtkT ez2yu6DB8NQ9NT8FyiaU1yBEWuKKpy8ZfcgqgeAq8Lh8fJKM2/8Rd/S58Lb6rYGTX3 CaoskedoYo2ARCg98Wff9mU+J/05oX6vKz+u1m3eagWt0CGngQ5Qdnvy2CZ4iOUnq7 eIPkBP4lAUxWg== From: Mark Brown Subject: [PATCH v2 0/2] kselftest/seccomp: Convert to KTAP output Date: Mon, 22 Jan 2024 16:04:14 +0000 Message-Id: <20240122-b4-kselftest-seccomp-benchmark-ktap-v2-0-aed137eaea41@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-B4-Tracking: v=1; b=H4sIAP6RrmUC/5WNSw6CMBQAr2Le2mfaV+XjynsYFlAf0BRa0jZEQ 7i7lRu4nFnMbBA5GI5wP20QeDXReJeBzifQY+sGRvPKDCRISZI1dle0kac+cUwYWWs/L9ix0+P cBos2tQuqW1kIVZEqRQW5tATuzfu4PJvMo4nJh88xXeXP/tdfJQrs65qJqkLJTjwsB8fTxYcBm n3fv8+l4l/XAAAA To: Kees Cook , Andy Lutomirski , Will Drewry , Shuah Khan Cc: linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org, Mark Brown , Anders Roxell X-Mailer: b4 0.13-dev-5c066 X-Developer-Signature: v=1; a=openpgp-sha256; l=1145; i=broonie@kernel.org; h=from:subject:message-id; bh=9NOW4PJJJHRMNdIzMEfidVAyIfbuRCPZbGomXALQm0g=; b=owEBbQGS/pANAwAKASTWi3JdVIfQAcsmYgBlrpIG/0Ays7HCrytmcrA21yoUdZu+RYOgOVqEfPuu xXq3ASiJATMEAAEKAB0WIQSt5miqZ1cYtZ/in+ok1otyXVSH0AUCZa6SBgAKCRAk1otyXVSH0KhYB/ 9uafPxDt7FR88b0KSa2blor4TZ957DpjYC1XeYc/N3BdmNmn+O+jEI8xAe9OQXGbVzWspfgyBOO/iY O9WZlsvNFZle2TC+YpqahqKZoFjK0Jaza+Hi4Auv4rS69XisXrS704R2rpnHupruftoJ802DZpdhY+ ryqqby578Eb0ikADFCqrX3diOHE8Jj3aSkeOeLkMbq2qK3rJTUMIlPiwAVbSri0shbnqd3jATiE1dQ LtNefuMLrxHM+gXmvJtK5FgmxE/RzxLG+WrAi5PSWTyBPxHAk+GlRrn8boX7eRHHqKoiucZu+tOa3x 2M23AbzDAj1Xo88LQZPuSRLl4i+6F3 X-Developer-Key: i=broonie@kernel.org; a=openpgp; fpr=3F2568AAC26998F9E813A1C5C3F436CA30F5D8EB X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1788814681788346333 X-GMAIL-MSGID: 1788814681788346333 Currently the seccomp benchmark selftest produces non-standard output, meaning that while it makes a number of checks of the performance it observes this has to be parsed by humans. This means that automated systems running this suite of tests are almost certainly ignoring the results which isn't ideal for spotting problems. Let's rework things so that each check that the program does is reported as a test result to the framework. Signed-off-by: Mark Brown --- Changes in v2: - Rebase onto v6.8-rc1. - Link to v1: https://lore.kernel.org/r/20231219-b4-kselftest-seccomp-benchmark-ktap-v1-0-f99e228631b0@kernel.org --- Mark Brown (2): kselftest/seccomp: Use kselftest output functions for benchmark kselftest/seccomp: Report each expectation we assert as a KTAP test .../testing/selftests/seccomp/seccomp_benchmark.c | 105 +++++++++++++-------- 1 file changed, 65 insertions(+), 40 deletions(-) --- base-commit: 6613476e225e090cc9aad49be7fa504e290dd33d change-id: 20231219-b4-kselftest-seccomp-benchmark-ktap-357603823708 Best regards,