From patchwork Mon Jul 10 20:02:57 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alison Schofield X-Patchwork-Id: 11820 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:a6b2:0:b0:3e4:2afc:c1 with SMTP id c18csp44786vqm; Mon, 10 Jul 2023 13:07:13 -0700 (PDT) X-Google-Smtp-Source: APBJJlFRuOZWUA3mNorbUyHY7ax+auzyKy6ENYBhlCu0Q4KPLQEmJlcMrwFVRNQAUoLRdR+aJo2U X-Received: by 2002:a05:6402:280d:b0:51e:2c4b:6f1e with SMTP id h13-20020a056402280d00b0051e2c4b6f1emr19693788ede.14.1689019633204; Mon, 10 Jul 2023 13:07:13 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1689019633; cv=none; d=google.com; s=arc-20160816; b=0DWGSGp2EBv8wcIbZuliJ0z/tITRkRdy6esF6u/CbdefSQRmlcZRAa8+Gk/n1wOMNl iuHRgU2hvsp3SY6J/dVYaEDDnxWKvZZFhpbiXk4itwGHCqze6O2k70mbXdn+uxmcwYjj E41MkGSwiiKspvx88iI1fB3qAic3I27l1d3JOLjSoaDBOeDX4ZlhbGD6rGWNf58MtZ+K HAQtE01IOTzFpeIU5MtrzzqUTrtUqGSSXtyn9z6JG1lmzsKXbnjncIK2xPgB9a+gV0eM simn+n9GqMmprA+4cjG1N321afmniFgPCY0mCeb+aE2O2inILhLyp4z5JV8DXwmE9bQY d7/A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=XzqibjqPHJW22KkaDhyTWU5oPQgSMCR1QMf3NPCifJk=; fh=wM7VPZJdplXnKGRdyL7+qYLBvsVM1nipsywEvttP+Bs=; b=LUjBeqVA4UdWnG3pxyPSVgYsYQ6MNHJMMrAy9OFeTy6N2zz6ZZ/Jn0nJMACqu4GnJi 3PBTZPn7lcET9cjzfmu1d83R7ol/BdjGbVTReN4mdBdgWyjEyXHSsERc/V+DK2hiDEu8 5b4bPDWllQOk6K6ZbTnn+ScktDLCeUmjovUv7JuFgsVw9xowz1exMqZLVX16IgoR9IEn X0tHCmxJkJAoMavKHmBcaMgrTWDHmGMnaZrx+8u3rnKZh48zHKjOyjHxDxDrz1rGpBTn VP9qPTE56dXDsN9XCjiYXR1thl241Dqo2F6H8nH3895KXmPIbc3/hBgIhMrTWpC1d8g2 57rA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=ZYX5oEI+; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id n8-20020aa7db48000000b0051df74b43f1si263655edt.539.2023.07.10.13.06.49; Mon, 10 Jul 2023 13:07:13 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=ZYX5oEI+; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230329AbjGJUDF (ORCPT + 99 others); Mon, 10 Jul 2023 16:03:05 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56298 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229582AbjGJUDD (ORCPT ); Mon, 10 Jul 2023 16:03:03 -0400 Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A5B3B133; Mon, 10 Jul 2023 13:03:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1689019382; x=1720555382; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=MApgpjDb8XK5qpJn9vA5zowAtSOWLa+PVy9qXmZ/Nhs=; b=ZYX5oEI+eg7N14H/Eys8PLkaE2+icQt85QBX7t5lNABDF4zFmyplCjlL qVO1jahwgnG7LJFFp3zTCtE0sVOj+iB2hOOu6L1x6CiUkE0Md688PAv0m /Rmznpr2hPEkhOukloB982RMVscYi5FV2YcQUL5GNoibKT5EY7blwvF+b m2zjWadtFBgOYty8efGb/RKZJ/8ioeVKyzSHlfSlqAHpmfV/+NnsWVerb leLoJD1vYefaJq4zQQuQVHrD/9H77Vay8YPis3g7FBQj+9oku9/fGMwu/ QmzybSRhu62864y7q6ymPCtDgXvIIenTZSTE1PL2WZxrN/p33TE4kS1bc A==; X-IronPort-AV: E=McAfee;i="6600,9927,10767"; a="344764051" X-IronPort-AV: E=Sophos;i="6.01,195,1684825200"; d="scan'208";a="344764051" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Jul 2023 13:03:01 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10767"; a="714903568" X-IronPort-AV: E=Sophos;i="6.01,195,1684825200"; d="scan'208";a="714903568" Received: from aschofie-mobl2.amr.corp.intel.com (HELO localhost) ([10.209.93.201]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Jul 2023 13:03:01 -0700 From: alison.schofield@intel.com To: "Rafael J. Wysocki" , Len Brown , Dan Williams , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , "H. Peter Anvin" , Andy Lutomirski , Peter Zijlstra , Andrew Morton , Jonathan Cameron , Dave Jiang , Mike Rapoport Cc: Alison Schofield , x86@kernel.org, linux-cxl@vger.kernel.org, linux-acpi@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH v4 0/2] CXL: Apply SRAT defined PXM to entire CFMWS window Date: Mon, 10 Jul 2023 13:02:57 -0700 Message-Id: X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, RCVD_IN_DNSWL_BLOCKED,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1771065451338342635 X-GMAIL-MSGID: 1771065451338342635 From: Alison Schofield Changes in v4: - Remove useless export of numa_fill_memblks() (Dan) - Rebase on latest tip tree v3: https://lore.kernel.org/linux-cxl/cover.1687645837.git.alison.schofield@intel.com/ ---- Cover Letter: The CXL subsystem requires the creation of NUMA nodes for CFMWS Windows[1] not described in the SRAT. The existing implementation only addresses windows that the SRAT describes completely or not at all. This work addresses the case of partially described CFMWS Windows by extending proximity domains in a portion of a CFMWS window to the entire window. Introduce a NUMA helper, numa_fill_memblks(), to fill gaps in a numa_meminfo memblk address range. Update the CFMWS parsing in the ACPI driver to use numa_fill_memblks() to extend SRAT defined proximity domains to entire CXL windows. An RFC of this patchset was previously posted for CXL folks review here[2]. The RFC feedback led to the implementation here, extending existing memblks (Dan). Also, both Jonathan and Dan influenced the changelog comments in the ACPI patch, with regards to setting expectations on this evolving heuristic. Repeating here to set reviewer expectations: *Note that this heuristic will evolve when CFMWS Windows present a wider range of characteristics. The extension of the proximity domain, implemented here, is likely a step in developing a more sophisticated performance profile in the future. [1] CFMWS is defined in CXL Spec 3.0 Section 9.17.1.3 : https://www.computeexpresslink.org/spec-landing A CXL Fixed Memory Window is a region of Host Physical Address (HPA) Space which routes accesses to CXL Host bridges. The 'S', of CFMWS, stand for the structure that describes the window, hence it's common name, CFMWS. [2] https://lore.kernel.org/linux-cxl/cover.1683742429.git.alison.schofield@intel.com/ Alison Schofield (2): x86/numa: Introduce numa_fill_memblks() ACPI: NUMA: Apply SRAT proximity domain to entire CFMWS window arch/x86/include/asm/sparsemem.h | 2 + arch/x86/mm/numa.c | 80 ++++++++++++++++++++++++++++++++ drivers/acpi/numa/srat.c | 11 +++-- include/linux/numa.h | 7 +++ 4 files changed, 97 insertions(+), 3 deletions(-) base-commit: ac442f6a364dd23bc08086f07b4bc4ef8476a9fe