From patchwork Thu Oct 19 23:35:43 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Frederic Weisbecker X-Patchwork-Id: 155742 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:612c:2010:b0:403:3b70:6f57 with SMTP id fe16csp717000vqb; Thu, 19 Oct 2023 16:36:50 -0700 (PDT) X-Google-Smtp-Source: AGHT+IEEIJUZXwr3BsvSmYKyaqF3zypzAvivDGseQRU+Q4a6RfnMI5aYUkKYNMIrq0npeLKJFu2m X-Received: by 2002:a05:6a20:7f91:b0:163:a041:336c with SMTP id d17-20020a056a207f9100b00163a041336cmr352202pzj.48.1697758609951; Thu, 19 Oct 2023 16:36:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1697758609; cv=none; d=google.com; s=arc-20160816; b=O5LLijoaLWIOnBfduoPOrjfWkLqCN+FIefgTIT+mKndly044VtD2eQEm6Z2SpZPPrW ah5NqSDVUDJw60Y5gkJ+myfOh9ozzJ5zo1U8yxe1mpPEIlzLz2lKPDIhLNsUVL8OAsvH RZIh51Uuee64YBUmbXgaR+/kcIZZ9nMepMDqLfffn7VKjtt/ZJmPR8S0cXx1j3ZzDCpV W8jt73RAht/biZDh1K8gFD+OSYOQ0J0atqdNLBDDuSr02PBgwPwHMzxEr5ratGyRNrXF fplSX/BQr+hrnujS12TtqYsD6HL3ZN9lK/Al2az07P6O7UrPCHUAjFtVcTlgPsi9WCcV 6j9Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=ttotqUIsFPIvhFt2O/OWr45T6+RSP2w6vkEJLwLvpbo=; fh=Xtw5ULhofgKZ29v5WdXlT+QfFq0h1vKmlRJPSOHLxgo=; b=IsUBJMVm0Wk1+0qx54MkGc58CbsJDINz4yIVDs1K7xgDk0wSTqnHgg8INr309QsC+J T0Bl2zLz0p5j4U1Pv99tMTPokCvVzvXDFOQtrUYXl2lKPJMT905BZTcLCDi3++6+rAt4 jr4IuIYWaaX1aHGBPTpQz5rYD8vTMdJvA9vqktuKVnQ5JXqorVNN7Sx6S4XJCUATbYqR nFaZsStI6YZPDKwsmrTEIQwuAFwhJwCWAKLfPoSGlQvoHdh0idPfueV83cADOtFXhmoK 6M8fIqoQpnK1Q4ErUwcfbxsq73xqW2iHgYLzfUt0WV6hveka4QzIrRKni+PanKN2cezZ xMqg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=thbIHCBu; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from snail.vger.email (snail.vger.email. [2620:137:e000::3:7]) by mx.google.com with ESMTPS id ay8-20020a1709028b8800b001c0eefc0dfesi518674plb.130.2023.10.19.16.36.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 19 Oct 2023 16:36:49 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) client-ip=2620:137:e000::3:7; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=thbIHCBu; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 108D181BAF3F; Thu, 19 Oct 2023 16:36:23 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1346792AbjJSXgT (ORCPT + 26 others); Thu, 19 Oct 2023 19:36:19 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35706 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1346755AbjJSXgJ (ORCPT ); Thu, 19 Oct 2023 19:36:09 -0400 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4017318A; Thu, 19 Oct 2023 16:36:07 -0700 (PDT) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 6E1AAC433CB; Thu, 19 Oct 2023 23:36:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1697758566; bh=SRJb9h+7LIx0+8pFOh4ACdoNOIWr+SDM51E4mSRaHRo=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=thbIHCBuTzwshUBgP4oE3WpBPBX/sHqzNus6LSOjGCnc+iREVAB3PRd5cGTPUtG90 rn40Yzh2FxHCTw8qAPCQ43znSvmGBkAK6Px6ifHhYyVF8YFMMUu8X0BGIajFntpPnh +8sxBf5TGEgifiSUPwyq+Nm2ej6yAh2oXuoNRqID5b+MttWoOAODJTwpQWG+aPCxKL Wa+5mtFGOApxGtFdsYgeh5mQAaaVn3uISiOsF9qZm/65yJFQsY68DAgmC0x7mBcLPR yK8zLr346hQ5QwZlZE8wpCChG4KsvVzOPabJj8uWge87VAWcI5vZXULvfpNpK0N/Ej OC1n6qchNxN/A== From: Frederic Weisbecker To: LKML Cc: Frederic Weisbecker , Boqun Feng , Joel Fernandes , Josh Triplett , Mathieu Desnoyers , Neeraj Upadhyay , "Paul E . McKenney" , Steven Rostedt , Uladzislau Rezki , rcu , Zqiang , Lai Jiangshan , "Liam R . Howlett" , Peter Zijlstra , Sebastian Siewior , Thomas Gleixner Subject: [PATCH 4/4] Revert "kernel/sched: Modify initial boot task idle setup" Date: Fri, 20 Oct 2023 01:35:43 +0200 Message-Id: <20231019233543.1243121-5-frederic@kernel.org> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20231019233543.1243121-1-frederic@kernel.org> References: <20231019233543.1243121-1-frederic@kernel.org> MIME-Version: 1.0 X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED, SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Thu, 19 Oct 2023 16:36:23 -0700 (PDT) X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1780228932544502040 X-GMAIL-MSGID: 1780228932544502040 Now that rcutiny can deal with early boot PF_IDLE setting, revert commit cff9b2332ab762b7e0586c793c431a8f2ea4db04. This fixes several subtle issues introduced on RCU-tasks(-trace): 1) RCU-tasks stalls when: 1.1 Grace period is started before init/0 had a chance to set PF_IDLE, keeping it stuck in the holdout list until idle ever schedules. 1.2 Grace period is started when some possible CPUs have never been online, keeping their idle tasks stuck in the holdout list until the CPU ever boots up. 1.3 Similar to 1.1 but with secondary CPUs: Grace period is started concurrently with secondary CPU booting, putting its idle task in the holdout list because PF_IDLE isn't yet observed on it. It stays then stuck in the holdout list until that CPU ever schedules. The effect is mitigated here by all the smpboot kthreads and the hotplug AP thread that must run to bring the CPU up. 2) Spurious warning on RCU task trace that assumes offline CPU's idle task is always PF_IDLE. More issues have been found in RCU-tasks related to PF_IDLE which should be fixed with later changes as those are not regressions: 3) The RCU-Tasks semantics consider the idle loop as a quiescent state, however: 3.1 The boot code preceding the idle entry is included in this quiescent state. Especially after the completion of kthreadd_done after which init/1 can launch userspace concurrently. The window is tiny before PF_IDLE is set but it exists. 3.2 Similarly, the boot code preceding the idle entry on secondary CPUs is wrongly accounted as RCU tasks quiescent state. Fixes: cff9b2332ab7 ("kernel/sched: Modify initial boot task idle setup") Cc: Liam R. Howlett Cc: Peter Zijlstra (Intel) Cc: Sebastian Siewior Cc: Thomas Gleixner Signed-off-by: Frederic Weisbecker --- kernel/sched/core.c | 2 +- kernel/sched/idle.c | 1 - 2 files changed, 1 insertion(+), 2 deletions(-) diff --git a/kernel/sched/core.c b/kernel/sched/core.c index ad960f97e4e1..b02dcbe98024 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -9269,7 +9269,7 @@ void __init init_idle(struct task_struct *idle, int cpu) * PF_KTHREAD should already be set at this point; regardless, make it * look like a proper per-CPU kthread. */ - idle->flags |= PF_KTHREAD | PF_NO_SETAFFINITY; + idle->flags |= PF_IDLE | PF_KTHREAD | PF_NO_SETAFFINITY; kthread_set_per_cpu(idle, cpu); #ifdef CONFIG_SMP diff --git a/kernel/sched/idle.c b/kernel/sched/idle.c index 5007b25c5bc6..342f58a329f5 100644 --- a/kernel/sched/idle.c +++ b/kernel/sched/idle.c @@ -373,7 +373,6 @@ EXPORT_SYMBOL_GPL(play_idle_precise); void cpu_startup_entry(enum cpuhp_state state) { - current->flags |= PF_IDLE; arch_cpu_idle_prepare(); cpuhp_online_idle(state); while (1)