From patchwork Wed Sep 27 09:50:01 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ravi Jonnalagadda X-Patchwork-Id: 145331 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:cae8:0:b0:403:3b70:6f57 with SMTP id r8csp2558036vqu; Wed, 27 Sep 2023 04:29:36 -0700 (PDT) X-Google-Smtp-Source: AGHT+IET1IYk/YkXVAl2x1n1SMQPrJIyUKxB4pNuGPsPzxo1ZWg2UvDT6pU+yDXL8TK7jUbjgDYc X-Received: by 2002:a05:6a20:8f06:b0:161:3120:e888 with SMTP id b6-20020a056a208f0600b001613120e888mr1733196pzk.46.1695814176358; Wed, 27 Sep 2023 04:29:36 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1695814176; cv=pass; d=google.com; s=arc-20160816; b=wkf+P8HOrmsJT+i1Rd9J8oBSk1v7gTWjAJlfUrUfVO7dzVKWjwxVdI/xpe+H/3KlJi tMW4uX0Sf+BFLmPhw6rPwtwnOT/9JrHnd75ZxjOkQ7yv4QLE0rg26u3kPnY2VZmsLouD G/UlYj5/UtoL3BsT1GPINjH0slZsdKX/F+YRRbNzNURpdfbEK50HIuqGXzORXGS00ex7 1hQ//6SfnmI9agnxZouMQI3hcrhMKM3IC6jMs2EiWFm5pTHAks3op6pg6DJYOhKeP8lX rsD5IsrYiSKNnx2nWkWX3fhgdM+IX6P/PsdImAYw6VtPCNCwvNVH5EoI16Y2a4VPN73o VDSQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=thYVmvpinxBahG2GwRtw2flYX45FvPsdbyuUHWCf1NY=; fh=Jzg+gUVhe4Nii9xKAH4ipqbRyrGF7n1ZceEI1CmDRcc=; b=VELAtCwXERTLOvdp6/ANzg3Z9jc9RqEGMkyK9Ex9PkWTlHLN2mzxiCmOFCNmNYG70Y Ci3mFsu9T6CnQKmjNWikiT2iGgqfT5Ptb+anmG+ghItoRiRBDGv240Eiku32pSggcqtF B9xDUW3DdbyBste5g3tdKphCCUVRjMLbt+3IAL1sfdN+LCRKZ4TUzVpuvV9DT9p/4nbv UmgoDCW7juNHEk8voNVUVSGoz5tBKrzL7qGR2fCHMxL8nHsW3+KuTQ94HcME2VspULdQ 9At92ppdVUXPl531HgiYxO4DtJtzXhRqQ7li4peVHumssXt3/yRIH2NpUODjvzUHNTkI KPiw== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@micron.com header.s=selector2 header.b=cqgzrtFJ; arc=pass (i=1 spf=pass spfdomain=micron.com dmarc=pass fromdomain=micron.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=micron.com Received: from snail.vger.email (snail.vger.email. [23.128.96.37]) by mx.google.com with ESMTPS id x14-20020a17090abc8e00b00277374d74afsi9738420pjr.12.2023.09.27.04.29.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Sep 2023 04:29:36 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) client-ip=23.128.96.37; Authentication-Results: mx.google.com; dkim=pass header.i=@micron.com header.s=selector2 header.b=cqgzrtFJ; arc=pass (i=1 spf=pass spfdomain=micron.com dmarc=pass fromdomain=micron.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=micron.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 89D3F8217ED5; Wed, 27 Sep 2023 02:51:02 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230517AbjI0Juo (ORCPT + 22 others); Wed, 27 Sep 2023 05:50:44 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47880 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230481AbjI0Jul (ORCPT ); Wed, 27 Sep 2023 05:50:41 -0400 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2077.outbound.protection.outlook.com [40.107.237.77]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CB74F19A; Wed, 27 Sep 2023 02:50:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oQafWxuh6IS6unVrqrQSxaxOEI33DccjcRY6ScL4uZl/AG3UL3fDzpDXAEmvoioSfB/qQi3RFzXap7TznG8zKydTyQfPMxEjYsZ89ypHSYUIibwGZniyN1Mj1C0l6gZENemLCQeAPn/8x98BRoTCM2OHOxUFWTT/idiBSdi6p5mu+SULz2l+n6ysibdpa+z9qMde/LXH4u1MPUn7nVMHTsnV5jjOYB9SKG7VCbXb27uxcCjE2M9NdBzwV4E1Qhs2Tz9S/n8NJUZgvUeo39VBHS/HH8ggs4uwwuVUs6hG2ieIjHqaJsBJfZ8yna8UN5nREVfu+FdEVGMRsfIkqJbbGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=thYVmvpinxBahG2GwRtw2flYX45FvPsdbyuUHWCf1NY=; b=japeuDGkGXbsTpGpbrPg2mXY6IhfzEeya6+rOq1mv28MTNxjWHiKMQG7ZbxaTdyCOOkLzZlGRPpR53pJlVgRozlZQxuxM30EPfzFHloqD6OYLZ/J/5lj9SLw9Qrs76Y6JjaKswqvX+2M3D03wdUwa7AZhdTqrNAGP3bXlxZlOiqQ8oUQDFeQLJbIMILYW63n2ZLnY30s8yEnts9iyfyaDNwJzDrGPAlj0oeQHeAFOX2upEoyat03xsrWTTGEJ0YaRRrUnN8INU0X519UT6/j++cGfiQpgrq6ZH8d34EXRH0AK113CfvLApy2t8HUVHKTKcpCHo3ksxlmHCyZoM9QAg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 137.201.242.130) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=micron.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=micron.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=micron.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=thYVmvpinxBahG2GwRtw2flYX45FvPsdbyuUHWCf1NY=; b=cqgzrtFJPzrJHOALIR3oJXOkTzG93JNq3TcO0mo2CKx7hxuZ+X5JhiaEKQ4sl88HAwlipALqei5dO4FNMrGQ7uMtI19BnQ5dI/oyR1/BbHCoP+eiPwYrYPEmtU2g4HtSIsaIaU+Gu4l28Yj5uYHJROZok9SAGEdSHOnAk7bH+NthF9mv0JKc6d0AhVtAgkkaN/IJYXfL+aOybAP+lidXFtS+i6LiZ+zKxZPn08vmrHlh+b3sHsZmEDu5ssoLJusY1lwT0ehtBFftjBzFafvvG+8hwhjXL8MNpvWlpmGfwkTt04E34/I/BML0JqYokP7m4u4tlo+lCWsdda/gkOCPaQ== Received: from BYAPR07CA0079.namprd07.prod.outlook.com (2603:10b6:a03:12b::20) by PH7PR08MB8474.namprd08.prod.outlook.com (2603:10b6:510:2b5::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6813.23; Wed, 27 Sep 2023 09:50:35 +0000 Received: from CO1PEPF000044F1.namprd05.prod.outlook.com (2603:10b6:a03:12b:cafe::b6) by BYAPR07CA0079.outlook.office365.com (2603:10b6:a03:12b::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6838.22 via Frontend Transport; Wed, 27 Sep 2023 09:50:35 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 137.201.242.130) smtp.mailfrom=micron.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=micron.com; Received-SPF: Pass (protection.outlook.com: domain of micron.com designates 137.201.242.130 as permitted sender) receiver=protection.outlook.com; client-ip=137.201.242.130; helo=mail.micron.com; pr=C Received: from mail.micron.com (137.201.242.130) by CO1PEPF000044F1.mail.protection.outlook.com (10.167.241.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6838.14 via Frontend Transport; Wed, 27 Sep 2023 09:50:35 +0000 Received: from BOW17EX19B.micron.com (137.201.21.219) by BOW36EX1902.micron.com (137.201.85.98) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1258.16; Wed, 27 Sep 2023 03:50:31 -0600 Received: from VENKATARAVI-LAP.micron.com (10.70.32.235) by RestrictedRelay17EX19B.micron.com (137.201.21.219) with Microsoft SMTP Server id 15.2.1258.12 via Frontend Transport; Wed, 27 Sep 2023 03:50:24 -0600 From: Ravi Jonnalagadda To: , CC: , , , , , , , , , , , , , , , , , , , , , Subject: [PATCH 1/2] memory tier: Introduce sysfs for tier interleave weights. Date: Wed, 27 Sep 2023 15:20:01 +0530 Message-ID: <20230927095002.10245-2-ravis.opensrc@micron.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20230927095002.10245-1-ravis.opensrc@micron.com> References: <20230927095002.10245-1-ravis.opensrc@micron.com> MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PEPF000044F1:EE_|PH7PR08MB8474:EE_ X-MS-Office365-Filtering-Correlation-Id: 67e408db-996d-43fa-5dcb-08dbbf3f3275 X-EXT-ByPass: 1 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: t64jye0mnkNqqvcNPbxvc+8kFdAlwRkj/+JLrexztc2cY5AikoAU+Jd7PN8O6eUGJ5lIK9097F0auXJre4BnTshvxPJPCctPkZsp8ULZsq5vhIh0IvvkzYpipV3B5WfGc4ZpCgFcjDuTqxERldAYta+yAJPy+EX7oQ3gxekBBIh1i0Q0EgysWZgxn9ZwAv51OYfR5pnQmwLeeS15iWU2Z9Ljs+tj4zzo/oBODAXNe6Jh8Xy9P2uwzzl7vPyVE7vG2PhxfO3PN6xhGn/xteC7vpUoHamOL7301AT+kplXWluS/2b7dd1gdJavrjQ4Fs3641VnB3X/SxrrHIt3Xy4VxU2AnZYBqqe2qoiNyJpmhK784NCQemfPXntitjXd5uxvoO8VkAEP+m7NJ352XDTdmYhN/NreUOVinOdhQJAoAFQGe4WqA3zUS7bgzFnmDxOmp1uSPLwwWt0I/WL0so9TXoWG/oEP5WoBRpBzWfcyERZReRKSht6NM6j7loCqD7cnLm+cUyXKHwGZPedSib4tj38K2JNqbWMxDCwhzEKGOwieBL5hWo4e59N4Y89/LSzsNn+YRLGH4qobJqvekLQ5r42tnr544zOtTj3oKrFlF23AgofT+q/k9AudZ0U4rDDYrLZmk56AaAB0vgQqPtNDtlCenhYjR2Ibuykq7A2VxmLx33p6ipBRT1UDPfu3yFjzACKYpynP/wLazX7Sy6tEuxu9ETaE8TtT2BamPKJ/qo9NNIpprU6VbBU5HSyNg/rhIlFR4YQxjz9bNnJn/xP+Lw== X-Forefront-Antispam-Report: CIP:137.201.242.130;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.micron.com;PTR:masquerade.micron.com;CAT:NONE;SFS:(13230031)(4636009)(346002)(39860400002)(376002)(396003)(136003)(230922051799003)(451199024)(186009)(1800799009)(82310400011)(36840700001)(46966006)(40470700004)(8936002)(86362001)(8676002)(70206006)(4326008)(5660300002)(70586007)(36860700001)(54906003)(41300700001)(316002)(110136005)(7416002)(2906002)(47076005)(36756003)(83380400001)(478600001)(336012)(426003)(40480700001)(26005)(356005)(1076003)(7696005)(40460700003)(2616005)(7636003)(107886003)(82740400003)(6666004)(16393002);DIR:OUT;SFP:1101; X-OriginatorOrg: micron.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Sep 2023 09:50:35.2517 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 67e408db-996d-43fa-5dcb-08dbbf3f3275 X-MS-Exchange-CrossTenant-Id: f38a5ecd-2813-4862-b11b-ac1d563c806f X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f38a5ecd-2813-4862-b11b-ac1d563c806f;Ip=[137.201.242.130];Helo=[mail.micron.com] X-MS-Exchange-CrossTenant-AuthSource: CO1PEPF000044F1.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR08MB8474 X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO, RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Wed, 27 Sep 2023 02:51:02 -0700 (PDT) X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1778190045906108020 X-GMAIL-MSGID: 1778190045906108020 From: Srinivasulu Thanneeru Allocating pages across tiers is accomplished by provisioning interleave weights for each tier, with the distribution based on these weight values. By default, all tiers will have a weight of 1, which means default standard page allocation. By default all nodes within tier will have weight of 1. Signed-off-by: Srinivasulu Thanneeru Co-authored-by: Ravi Jonnalagadda --- include/linux/memory-tiers.h | 2 ++ mm/memory-tiers.c | 46 +++++++++++++++++++++++++++++++++++- 2 files changed, 47 insertions(+), 1 deletion(-) diff --git a/include/linux/memory-tiers.h b/include/linux/memory-tiers.h index 437441cdf78f..c62d286749d0 100644 --- a/include/linux/memory-tiers.h +++ b/include/linux/memory-tiers.h @@ -19,6 +19,8 @@ */ #define MEMTIER_ADISTANCE_DRAM ((4 * MEMTIER_CHUNK_SIZE) + (MEMTIER_CHUNK_SIZE >> 1)) +#define MAX_TIER_INTERLEAVE_WEIGHT 100 + struct memory_tier; struct memory_dev_type { /* list of memory types that are part of same tier as this type */ diff --git a/mm/memory-tiers.c b/mm/memory-tiers.c index 37a4f59d9585..7e06c9e0fa41 100644 --- a/mm/memory-tiers.c +++ b/mm/memory-tiers.c @@ -13,6 +13,11 @@ struct memory_tier { struct list_head list; /* list of all memory types part of this tier */ struct list_head memory_types; + /* + * By default all tiers will have weight as 1, which means they + * follow default standard allocation. + */ + unsigned short interleave_weight; /* * start value of abstract distance. memory tier maps * an abstract distance range, @@ -145,8 +150,45 @@ static ssize_t nodelist_show(struct device *dev, } static DEVICE_ATTR_RO(nodelist); +static ssize_t interleave_weight_show(struct device *dev, + struct device_attribute *attr, char *buf) +{ + int ret; + struct memory_tier *tier = to_memory_tier(dev); + + mutex_lock(&memory_tier_lock); + ret = sysfs_emit(buf, "%u\n", tier->interleave_weight); + mutex_unlock(&memory_tier_lock); + + return ret; +} + +static ssize_t interleave_weight_store(struct device *dev, + struct device_attribute *attr, + const char *buf, size_t size) +{ + unsigned short value; + int ret; + struct memory_tier *tier = to_memory_tier(dev); + + ret = kstrtou16(buf, 0, &value); + + if (ret) + return ret; + if (value > MAX_TIER_INTERLEAVE_WEIGHT) + return -EINVAL; + + mutex_lock(&memory_tier_lock); + tier->interleave_weight = value; + mutex_unlock(&memory_tier_lock); + + return size; +} +static DEVICE_ATTR_RW(interleave_weight); + static struct attribute *memtier_dev_attrs[] = { &dev_attr_nodelist.attr, + &dev_attr_interleave_weight.attr, NULL }; @@ -489,8 +531,10 @@ static struct memory_tier *set_node_memory_tier(int node) memtype = node_memory_types[node].memtype; node_set(node, memtype->nodes); memtier = find_create_memory_tier(memtype); - if (!IS_ERR(memtier)) + if (!IS_ERR(memtier)) { rcu_assign_pointer(pgdat->memtier, memtier); + memtier->interleave_weight = 1; + } return memtier; }