From patchwork Mon Jul 24 13:46:40 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Usama Arif X-Patchwork-Id: 12518 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:9010:0:b0:3e4:2afc:c1 with SMTP id l16csp1835015vqg; Mon, 24 Jul 2023 07:24:18 -0700 (PDT) X-Google-Smtp-Source: APBJJlGN7qycyeqMfAd8tlz2lrAit4tie/QiVT+Co+Y/3hjhSv25njw5GTXGhDPu9auzj/RGcFG9 X-Received: by 2002:a17:903:2350:b0:1bb:4861:d3a7 with SMTP id c16-20020a170903235000b001bb4861d3a7mr8235830plh.16.1690208658544; Mon, 24 Jul 2023 07:24:18 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1690208658; cv=none; d=google.com; s=arc-20160816; b=JxPjEHJapgS+xJlrgkaz9A5LEagRUTEY5t8QBFhhoKT5VOAU9hoDXGcyIntioNHJgp 56stC28pUywZ3/yk9m6YamPFyyDS9+VOly1Sx2M3KRMLJ8It1OFwIKIm+Bc2/U5LtZU7 8zakANoXmaCjmPPMRYczhU+4Eqc7u7JXKf2GsJe+XQtj/t29eoUH/6wfzVnclUXnEWIr 3FteMsic6T2W4o9KDc6DXxT5iD1kCUyHt/7x0F5Kegk1yo3tFKLqgkj9Fz2JZGZpEnba tCdGttJ9bCPUSF9JACBgXHstc/qwtOuq9UwBV8wF6KidBvuZBSN/dnDexajbOeTPexPS Sykg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=m7WubRds7jbJgkABDaAVUdckubvdEH0her0SUPsLcCQ=; fh=6ywE3cadAEHt3CqWKbi2najT+v0c7si89uhbZ0SfPzA=; b=Kaki+g/VvqLrx9QkHXeIUAbGDEX1G5gIX+KEIpqpVaNIeYE6uAWcU9/mGUQN/wfZdi Hi1vKfch/sKScQ/Tor+R2Pl9cpu0omG1R0qcrcriMPMpEIJpKLdIJpDzKQAu4Um1UL/6 jzEZt863nyKCF7j8hcOobYc8mdhAmPF5+LjbcXTzqrwT30syI8OmltWWe7A7M2palJ4C Ifck/v9hg+G9MFLPq3zKEePxH32l+YoAopvlq2fE29VQmzxZBPMLl6QyU26I/cLgYoyV Y7vPUkihZj0x++vJMsAJQv/YIHxGx7JfBYarCLw+J+dF27zcZ9KbNB6fFL/fLXlwfEBG ZPJw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=dkYXlVu6; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id kx14-20020a170902f94e00b001b8a3a8d707si8752214plb.573.2023.07.24.07.24.04; Mon, 24 Jul 2023 07:24:18 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=dkYXlVu6; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230498AbjGXNuI (ORCPT + 99 others); Mon, 24 Jul 2023 09:50:08 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49476 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230290AbjGXNtt (ORCPT ); Mon, 24 Jul 2023 09:49:49 -0400 Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D50C81BD4 for ; Mon, 24 Jul 2023 06:46:49 -0700 (PDT) Received: by mail-wm1-x329.google.com with SMTP id 5b1f17b1804b1-3fbc0609cd6so33483545e9.1 for ; Mon, 24 Jul 2023 06:46:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1690206407; x=1690811207; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=m7WubRds7jbJgkABDaAVUdckubvdEH0her0SUPsLcCQ=; b=dkYXlVu6q4UXC1OOZTn+s9EHl4DQIRFghcEm3PtTNXR7R7GxhNE5qRwO2R6JV+9aHU Rg+4kpM9w7Nc0l3IHmIWyyw9lVON9WE2tDfO9rM9vZOzXsJvEF9uJ8+EKW/JLqtMa3s/ moYx0FJ63BA2p52KAv5X67j04zVoOQ+RHrPbulnRNUIa/ettBTa8ixpqwliJqpCJHxLU 4BeRa5neK3F4JMafNap4hsVRhP6bQRPBhngyWwsbUQXTdf8ox0YY5NtemI2bKbXFvW1v AGKZxuchTpfjKxZA02S5JPPhCVjfaEPrQrl+SURDMpYKPPd1Pt8za0jSq7Vvh6ggeO5D WL0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1690206407; x=1690811207; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=m7WubRds7jbJgkABDaAVUdckubvdEH0her0SUPsLcCQ=; b=XnPzdMB/2zj33irS+ZG8Y0/Etp7wz6LsrjpR3TLqMuQXrwQemVOAEIOswLefwpcj2C e6YFe3fFoosNRIipiIeUGtYmHSULVSTTLCI6f8u/wpqnU2IV0dTuqAatqpPj1h2X2M3R AxMyTVEoUnAyQoHZe3zjlqNSwwsN+N6bjW2mYBmOihWloVLPbFlMF1TjTacMLxq0ujPi uucNByVBLaxN+p04XENkSaETwZfJO78X16QqPgoXXNtLxW7vyDKI1ICpfnylz5Gmf31y jv6zQUUPvM6hNGZ6eloWLZJ4/4OjSEo6Uu9iuDDuPCv3Ha8QXJrG79CeDcyjO7mIArMT 01lg== X-Gm-Message-State: ABy/qLbfpNmVCleSZSxHEqltq2mjW8e/A6l0jX6d7MOfzH9Z+kk88on8 3E9exOwz9QCHMdNOdhC9UbKUqQ== X-Received: by 2002:a05:600c:11c9:b0:3fc:4e0:be97 with SMTP id b9-20020a05600c11c900b003fc04e0be97mr5772449wmi.6.1690206407724; Mon, 24 Jul 2023 06:46:47 -0700 (PDT) Received: from localhost.localdomain ([2a02:6b6a:b465:0:d7c4:7f46:8fed:f874]) by smtp.gmail.com with ESMTPSA id e19-20020a05600c219300b003fbe791a0e8sm10209354wme.0.2023.07.24.06.46.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 24 Jul 2023 06:46:47 -0700 (PDT) From: Usama Arif To: linux-mm@kvack.org, muchun.song@linux.dev, mike.kravetz@oracle.com, rppt@kernel.org Cc: linux-kernel@vger.kernel.org, fam.zheng@bytedance.com, liangma@liangbit.com, simon.evans@bytedance.com, punit.agrawal@bytedance.com, Usama Arif Subject: [RFC 0/4] mm/memblock: Skip prep and initialization of struct pages freed later by HVO Date: Mon, 24 Jul 2023 14:46:40 +0100 Message-Id: <20230724134644.1299963-1-usama.arif@bytedance.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1772312234251358883 X-GMAIL-MSGID: 1772312234251358883 If the region is for gigantic hugepages and if HVO is enabled, then those struct pages which will be freed later by HVO don't need to be prepared and initialized. This can save significant time when a large number of hugepages are allocated at boot time. For a 1G hugepage, this series avoid initialization and preparation of 262144 - 64 = 262080 struct pages per hugepage. When tested on a 512G system (which can allocate max 500 1G hugepages), the kexec-boot time with HVO and DEFERRED_STRUCT_PAGE_INIT enabled without this patchseries to running init is 3.9 seconds. With this patch it is 1.2 seconds. This represents an approximately 70% reduction in boot time and will significantly reduce server downtime when using a large number of gigantic pages. Thanks, Usama Usama Arif (4): mm/hugetlb: Skip prep of tail pages when HVO is enabled mm/memblock: Add hugepage_size member to struct memblock_region mm/hugetlb_vmemmap: Use nid of the head page to reallocate it mm/memblock: Skip initialization of struct pages freed later by HVO arch/arm64/mm/kasan_init.c | 2 +- arch/powerpc/platforms/pasemi/iommu.c | 2 +- arch/powerpc/platforms/pseries/setup.c | 4 +- arch/powerpc/sysdev/dart_iommu.c | 2 +- include/linux/memblock.h | 8 +- mm/cma.c | 4 +- mm/hugetlb.c | 36 +++++--- mm/hugetlb_vmemmap.c | 6 +- mm/hugetlb_vmemmap.h | 4 + mm/memblock.c | 87 +++++++++++++------- mm/mm_init.c | 2 +- mm/sparse-vmemmap.c | 2 +- tools/testing/memblock/tests/alloc_nid_api.c | 2 +- 13 files changed, 106 insertions(+), 55 deletions(-)