From patchwork Mon May 29 19:14:14 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mathieu Desnoyers X-Patchwork-Id: 100389 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:994d:0:b0:3d9:f83d:47d9 with SMTP id k13csp1722947vqr; Mon, 29 May 2023 12:20:58 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ4rSgFEmi+JNdknMiK5d4MJEEdvjzZHR3Ls37DLHeowvU6xDlb34VWuUK0W2f+PTKzPq0RA X-Received: by 2002:a05:6a20:549a:b0:10f:fea:1997 with SMTP id i26-20020a056a20549a00b0010f0fea1997mr37623pzk.5.1685388058096; Mon, 29 May 2023 12:20:58 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1685388058; cv=none; d=google.com; s=arc-20160816; b=WwiFVXrcjQDbHc5+bKjv+erFdWl/0g500tBhJxr5BO6KNImBv6vieSBGIGInri5mBg CfeZf37iu9Yvkh9Thj+EHSSvsujOQuMoOEOeBdZp1A3qk08IffSLPOAfSy1czKFH/hfo /cqSAXfW/k/R/v344G/VgWeV+Lc/HZf4qePYslAq99zHULRRL1MGhTR4R9BMYvBlvqav GhzmDJZa87uqzshmAD/akCY3M/5T21DuyMSXEhjlzPlYhKBR/lPkipgC08M5QFy5OhMZ hMyUt4JTaOO7zPWlj6kZUEVa1fSP8IUyI7VTtUAoUFadoVDZUkQoQM3bl6GDNT2nTy6S 4aNg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=hJbpA9guhgays83tJxGgreV4AGGG41TCjU0IDqP0kz0=; b=v/CoJixhPIQNJNMYgbYUfxiNhFFQuqVukPXJ04mMHvCCH8Bhhj6XDEK2uXff0nShME ByiGo3ZQ9ZtJ7KZwL7GNalaXGZ3ZgbdbTajIk6LOaNfzR1iXwn2aVW4amoGcjNCzKTIu mhXhdnZ7jQjhUy4FpRtK6UJrASQ5AqRBrn9BRbSmKoy1SEd5fW36zEvhd5mvbjMoIcMF kraY/DrCZ3PIZ4vhSzQZd/YawP67/l4dekgLdvfkCqSraJqUMrYBpIShzrwhYMSGl81y HU2u7s1dA4VhwRyXEQRPgVHIxMPSE3Rm4+OK1JkD63VTcr9+q6LSOn43JY5ggL047mA8 DvxA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@efficios.com header.s=smtpout1 header.b=iA6sYhg7; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=efficios.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id z13-20020aa7958d000000b0064d43f63156si309214pfj.354.2023.05.29.12.20.43; Mon, 29 May 2023 12:20:58 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@efficios.com header.s=smtpout1 header.b=iA6sYhg7; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=efficios.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229717AbjE2TOd (ORCPT + 99 others); Mon, 29 May 2023 15:14:33 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50846 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229457AbjE2TO1 (ORCPT ); Mon, 29 May 2023 15:14:27 -0400 Received: from smtpout.efficios.com (unknown [IPv6:2607:5300:203:b2ee::31e5]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id BD471D2; Mon, 29 May 2023 12:14:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=efficios.com; s=smtpout1; t=1685387663; bh=E7Q4JmbMKWpqkjo72GLBkCxs4FPIIvyJtEspj5idB/U=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=iA6sYhg7uvaIe/pCwyzk1Z6fglq2EMj8blDu8+QNsIltbH5xaQX/PGLCvJztR9ZbW 3HOWzbbek+f7mpT0kHnTz1jpLJSxd6TY3uMCaFNhJ1pLOPahcBAuk+nOo/+JrcdRhW Ic9FqDxpWxoZrdnpTmeJq+Sgkf1w8kwF+4hgKg/jyizLs34BqBCvDt9/3hapA/GmhU L6FspGdPOmUDPEauUIV5OK/A+5H5r3vT3xGfLLeop603Y2o0gPIWR+rtKR7TJC65r8 FIu6g/GOEpmf5c15Nz56T3ebqj1llXL6QdOsCG32aMGEHZK0yyR4rT5bK9sVr9fxvE YxEC05Z+gihjQ== Received: from localhost.localdomain (192-222-143-198.qc.cable.ebox.net [192.222.143.198]) by smtpout.efficios.com (Postfix) with ESMTPSA id 4QVQFB4ZFyz165P; Mon, 29 May 2023 15:14:22 -0400 (EDT) From: Mathieu Desnoyers To: Peter Zijlstra Cc: linux-kernel@vger.kernel.org, Thomas Gleixner , "Paul E . McKenney" , Boqun Feng , "H . Peter Anvin" , Paul Turner , linux-api@vger.kernel.org, Christian Brauner , Florian Weimer , David.Laight@ACULAB.COM, carlos@redhat.com, Peter Oskolkov , Alexander Mikhalitsyn , Chris Kennelly , Ingo Molnar , Darren Hart , Davidlohr Bueso , =?utf-8?q?Andr=C3=A9_Almeida?= , libc-alpha@sourceware.org, Steven Rostedt , Jonathan Corbet , Noah Goldstein , Daniel Colascione , longman@redhat.com, Mathieu Desnoyers Subject: [RFC PATCH v2 2/4] selftests/rseq: Add sched_state rseq field and getter Date: Mon, 29 May 2023 15:14:14 -0400 Message-Id: <20230529191416.53955-3-mathieu.desnoyers@efficios.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230529191416.53955-1-mathieu.desnoyers@efficios.com> References: <20230529191416.53955-1-mathieu.desnoyers@efficios.com> MIME-Version: 1.0 X-Spam-Status: No, score=-1.3 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RDNS_NONE,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1767257468028001197?= X-GMAIL-MSGID: =?utf-8?q?1767257468028001197?= Extend struct rseq in the rseq selftests to include the sched_state field. Implement a getter function for this field. Signed-off-by: Mathieu Desnoyers --- tools/testing/selftests/rseq/rseq-abi.h | 42 +++++++++++++++++++++++++ tools/testing/selftests/rseq/rseq.c | 13 ++++++++ tools/testing/selftests/rseq/rseq.h | 5 +++ 3 files changed, 60 insertions(+) diff --git a/tools/testing/selftests/rseq/rseq-abi.h b/tools/testing/selftests/rseq/rseq-abi.h index fb4ec8a75dd4..1092d6750386 100644 --- a/tools/testing/selftests/rseq/rseq-abi.h +++ b/tools/testing/selftests/rseq/rseq-abi.h @@ -37,6 +37,13 @@ enum rseq_abi_cs_flags { (1U << RSEQ_ABI_CS_FLAG_NO_RESTART_ON_MIGRATE_BIT), }; +enum rseq_abi_sched_state_flags { + /* + * Task is currently running on a CPU if bit is set. + */ + RSEQ_ABI_SCHED_STATE_FLAG_ON_CPU = (1U << 0), +}; + /* * struct rseq_abi_cs is aligned on 4 * 8 bytes to ensure it is always * contained within a single cache-line. It is usually declared as @@ -53,6 +60,32 @@ struct rseq_abi_cs { __u64 abort_ip; } __attribute__((aligned(4 * sizeof(__u64)))); +/* + * rseq_abi_sched_state should be aligned on the cache line size. + */ +struct rseq_abi_sched_state { + /* + * Version of this structure. Populated by the kernel, read by + * user-space. + */ + __u32 version; + /* + * The state is updated by the kernel. Read by user-space with + * single-copy atomicity semantics. This field can be read by any + * userspace thread. Aligned on 32-bit, and ideally on cache line size. + * Contains a bitmask of enum rseq_abi_sched_state_flags. This field is + * provided as a hint by the scheduler, and requires that the page + * holding this state is faulted-in for the state update to be + * performed by the scheduler. + */ + __u32 state; + /* + * Thread ID associated with the thread registering this structure. + * Initialized by user-space before registration. + */ + __u32 tid; +}; + /* * struct rseq_abi is aligned on 4 * 8 bytes to ensure it is always * contained within a single cache-line. @@ -164,6 +197,15 @@ struct rseq_abi { */ __u32 mm_cid; + __u32 padding1; + + /* + * Restartable sequences sched_state_ptr field. Initialized by + * userspace to the address at which the struct rseq_abi_sched_state is + * located. Read by the kernel on rseq registration. + */ + __u64 sched_state_ptr; + /* * Flexible array member at end of structure, after last feature field. */ diff --git a/tools/testing/selftests/rseq/rseq.c b/tools/testing/selftests/rseq/rseq.c index 4e4aa006004c..76925b116054 100644 --- a/tools/testing/selftests/rseq/rseq.c +++ b/tools/testing/selftests/rseq/rseq.c @@ -62,17 +62,28 @@ static int rseq_reg_success; /* At least one rseq registration has succeded. */ /* Allocate a large area for the TLS. */ #define RSEQ_THREAD_AREA_ALLOC_SIZE 1024 +/* Approximation of cacheline size. */ +#define CACHELINE_SIZE 128 + /* Original struct rseq feature size is 20 bytes. */ #define ORIG_RSEQ_FEATURE_SIZE 20 /* Original struct rseq allocation size is 32 bytes. */ #define ORIG_RSEQ_ALLOC_SIZE 32 +static +__thread struct rseq_abi_sched_state __rseq_abi_sched_state __attribute__((tls_model("initial-exec"), aligned(CACHELINE_SIZE))); + static __thread struct rseq_abi __rseq_abi __attribute__((tls_model("initial-exec"), aligned(RSEQ_THREAD_AREA_ALLOC_SIZE))) = { .cpu_id = RSEQ_ABI_CPU_ID_UNINITIALIZED, }; +static pid_t rseq_gettid(void) +{ + return syscall(__NR_gettid); +} + static int sys_rseq(struct rseq_abi *rseq_abi, uint32_t rseq_len, int flags, uint32_t sig) { @@ -109,6 +120,8 @@ int rseq_register_current_thread(void) /* Treat libc's ownership as a successful registration. */ return 0; } + __rseq_abi_sched_state.tid = rseq_gettid(); + __rseq_abi.sched_state_ptr = (uint64_t)(unsigned long)&__rseq_abi_sched_state; rc = sys_rseq(&__rseq_abi, rseq_size, 0, RSEQ_SIG); if (rc) { if (RSEQ_READ_ONCE(rseq_reg_success)) { diff --git a/tools/testing/selftests/rseq/rseq.h b/tools/testing/selftests/rseq/rseq.h index d7364ea4d201..4c14ef3f581f 100644 --- a/tools/testing/selftests/rseq/rseq.h +++ b/tools/testing/selftests/rseq/rseq.h @@ -236,6 +236,11 @@ static inline void rseq_prepare_unload(void) rseq_clear_rseq_cs(); } +static inline struct rseq_abi_sched_state *rseq_get_sched_state(struct rseq_abi *rseq) +{ + return (struct rseq_abi_sched_state *)(unsigned long)rseq->sched_state_ptr; +} + static inline __attribute__((always_inline)) int rseq_cmpeqv_storev(enum rseq_mo rseq_mo, enum rseq_percpu_mode percpu_mode, intptr_t *v, intptr_t expect,