From patchwork Thu Jan 26 18:41:56 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Luck, Tony" X-Patchwork-Id: 48853 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:adf:eb09:0:0:0:0:0 with SMTP id s9csp435186wrn; Thu, 26 Jan 2023 11:01:29 -0800 (PST) X-Google-Smtp-Source: AMrXdXsC0Tx2uyf3JTaczGEtq+2gnZU4eMMow7aznJWdSOrPMGRok9rilRXVjur2yEkbuk2fDmzO X-Received: by 2002:a17:907:c911:b0:870:5bf4:a3b1 with SMTP id ui17-20020a170907c91100b008705bf4a3b1mr34172698ejc.33.1674759689252; Thu, 26 Jan 2023 11:01:29 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1674759689; cv=none; d=google.com; s=arc-20160816; b=zBpDUUra6ThSy26T6FaOLDJM5L4toZy+OAZ34I1aH85TlyK9Kmw2qETyROMHFFkEu3 aWyVentguFbTLTYGZd0A7iBP1Vc+6eyEK2U/Bly9NjFoL//4rSd7+6qjc51oWr6gMRoY lzIIvGhVMPSbFbWuUTo/Dn8kS2PTL268QbsrI9DNLfO3ViXr7Ye9muk3FGKf+RwhQyWm 5YBg19m1tjmEMqJ58cLu3FYhFogDDNnyWMAs7ckTlpp5j3jR2gkzhqYVSWIhvlP+uzs0 Oqtx20JNcXEnf8RpXV6fkzcAagQstDLvwPGqbyCoapeNTh9fmtL436ta6L47ltRAYOww QalQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=EORnN+S6yQXpFuPLsQ/HLmhemsXlKm0e9b6XrA5l/yc=; b=hLoTvqLmEUoikzy9kiQWueYWCYGuGQxv5cXCTaBDuS8S2dwrIuw/xauYB150U0pn6B WNeaHrn7Z5pZQmdPGWhlMN7cuHspgyWPKP04UyLt7GYKjZwTH8VuM5vO7vx/87JXPE1O jrIdijgfggPlvH7N5BKcVgw8Duv3S6KKkVuJHOgcBvqTJGCXfP1cL0qZpiPkz465GSFM 9Ge3/DD9JJk+H0t9swaChkJyUtadrdTn5+feDdnfLHGNrwlB0nC7ma5V8ZTUxyDAFUvx nrtPp699TarggXIUfjRQ+wcQA4+t8Vq2lk4Is5Src+xlvmAyWCz6TRytiOc+GORCR33b 3pLA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=FizYTQwt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id ui42-20020a170907c92a00b0086e0afb91c8si1979312ejc.514.2023.01.26.11.01.06; Thu, 26 Jan 2023 11:01:29 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=FizYTQwt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232250AbjAZSmw (ORCPT + 99 others); Thu, 26 Jan 2023 13:42:52 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60926 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229530AbjAZSme (ORCPT ); Thu, 26 Jan 2023 13:42:34 -0500 Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 2E65C49022; Thu, 26 Jan 2023 10:42:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1674758553; x=1706294553; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=ivyLAdBKqYQLl3lR+fj5FZ2eFkx8GG4TgMFpd25I12Y=; b=FizYTQwtsAhHSYsGHMFYSBag+jzIr/fw0g/NX7I/LJAgmrAmf2O4MfsJ ksreZLGCDaz9ekhG1ZfcvwbyKfHYhrhhi3le55HoB4xZGBIQvlbaQYwGH r5zAHfUbR8x5EbHCczY4ThYoRa7XxJJXSTlOQiroYGqAQeI0Z9qC7b9tv jZH/vUB9Z+Im4MPMKVR2KHkzdiHgO3Owgss40Ix/ovH0+IFIG/t+Yw+Pl KFTbfz33PGNYXTEgu4sjQgcTsWbQqEUaxLA49Y478CUytOR/FnqopjjDi 8nRmdSrnp7QTPsTA3HOM95VGd4j27ZVyYI+tDzz5tq1rIG4iz5r4Wdn9t w==; X-IronPort-AV: E=McAfee;i="6500,9779,10602"; a="354203371" X-IronPort-AV: E=Sophos;i="5.97,249,1669104000"; d="scan'208";a="354203371" Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jan 2023 10:42:06 -0800 X-IronPort-AV: E=McAfee;i="6500,9779,10602"; a="991745455" X-IronPort-AV: E=Sophos;i="5.97,249,1669104000"; d="scan'208";a="991745455" Received: from agluck-desk3.sc.intel.com ([172.25.222.78]) by fmsmga005-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jan 2023 10:42:06 -0800 From: Tony Luck To: Fenghua Yu , Reinette Chatre , Peter Newman , Jonathan Corbet , x86@kernel.org Cc: Shaopeng Tan , James Morse , Jamie Iles , Babu Moger , linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, patches@lists.linux.dev, Tony Luck Subject: [PATCH 6/7] x86/resctrl: Update documentation with Sub-NUMA cluster changes Date: Thu, 26 Jan 2023 10:41:56 -0800 Message-Id: <20230126184157.27626-7-tony.luck@intel.com> X-Mailer: git-send-email 2.39.1 In-Reply-To: <20230126184157.27626-1-tony.luck@intel.com> References: <20230126184157.27626-1-tony.luck@intel.com> MIME-Version: 1.0 X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED, RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1756112816396620279?= X-GMAIL-MSGID: =?utf-8?q?1756112816396620279?= With Sub-NUMA Cluster mode enabled the scope of monitoring resources is per-NODE instead of per-L3 cache. Suffices of directories with "L3" in their name refer to Sun-NUMA nodes instead of L3 cache ids. Signed-off-by: Tony Luck --- Documentation/x86/resctrl.rst | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/Documentation/x86/resctrl.rst b/Documentation/x86/resctrl.rst index 71a531061e4e..9043a2d2f2d3 100644 --- a/Documentation/x86/resctrl.rst +++ b/Documentation/x86/resctrl.rst @@ -167,6 +167,11 @@ with the following files: bytes) at which a previously used LLC_occupancy counter can be considered for re-use. +"snc_ways": + A value of "1" marks that SNC mode is disabled. + Values of "2" or "4" indicate how many NUMA + nodes share an L3 cache. + Finally, in the top level of the "info" directory there is a file named "last_cmd_status". This is reset with every "command" issued via the file system (making new directories or writing to any of the @@ -254,9 +259,13 @@ When control is enabled all CTRL_MON groups will also contain: When monitoring is enabled all MON groups will also contain: "mon_data": - This contains a set of files organized by L3 domain and by - RDT event. E.g. on a system with two L3 domains there will - be subdirectories "mon_L3_00" and "mon_L3_01". Each of these + This contains a set of files organized by L3 domain or by NUMA + node (depending on whether SNC mode is disabled or enabled + respectively) and by RDT event. E.g. on a system with SNC + mode disabled with two L3 domains there will be subdirectories + "mon_L3_00" and "mon_L3_01" the numerical suffix refers to the + L3 cache id. With SNC enabled the directory names are the same, + but the numerical suffix refers to the node id. Each of these directories have one file per event (e.g. "llc_occupancy", "mbm_total_bytes", and "mbm_local_bytes"). In a MON group these files provide a read out of the current value of the event for