From patchwork Thu Jan 26 21:51:13 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 4599 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:adf:eb09:0:0:0:0:0 with SMTP id s9csp505822wrn; Thu, 26 Jan 2023 13:55:11 -0800 (PST) X-Google-Smtp-Source: AMrXdXvJRdLbWw+Nxsa2Df+egxQsDRIItfGq4LTf3H+lD1CNHg+vBeryENy7GpdhmvKsWZIueymB X-Received: by 2002:a17:906:eb05:b0:84c:7974:8a73 with SMTP id mb5-20020a170906eb0500b0084c79748a73mr36152029ejb.57.1674770110694; Thu, 26 Jan 2023 13:55:10 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1674770110; cv=none; d=google.com; s=arc-20160816; b=ZGVywXr8LFwpL0hk+T4v1NmVQcIqFrAeSvArji3Rn7xRs6pfgXWD3uwWwEE403FCQ2 hnShgmIuOyUuAuyInyo8//CZRn8aE0iANbXi2k6CGCEl2HvjOJjPLxTmVH1L3SczOHgZ cy8SK4dM5FlbOGcEhFfqA1nykG4EG2ryWEyyWkngj2GzeRqP/+Qv0qkdENMI5mYblZyd rxtPira8nOyt/oilBmQ7D/1sTWGJo3XuXn879OVrYRxDPyVmEUAxISxBlpu7tgMUjJS4 k71Oliu8hh5VZunQbHvCV/eZvj6sdiNVyvPyIhxcFCcl3mRKO30Y8hzxA4fMMtWoSWNJ 0oxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=YSju8h3IcFoXJFagXVV/kEgcC/pDir68RdkcrZYyLwI=; b=a55un67IzHZ9SMigZLJ9Hm6rC1+cs3b/tuSdUiHc7vSleq2ttEP//zqPwdZsGDwaQc P94Y3oTbFMNrn6N2tWJzJY6fZgo3lkZgYOaB2FgyIPU4uWTZBGk6OhITfYtZNxfJ54oh nBn5bxt16FF6kFMvjkauN8BToXjuS3dHPAh7G+GRG8PwVwKpH/O9JPAybjEYnw3gjzkH GrW8gvBODYu9hS5Ozc/xjpDfGgfpZ7BfgSRWyf564t/DvMoO+FK8FWzeHLCH1+36BKYy kKSJaxaCExn1KCFu+157nkuZtw/hCjrOKA2DhVdRjtQO48YtpF7TxZZKOmXaCvXyutsJ YYWA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@meta.com header.s=s2048-2021-q4 header.b=RK0eODc0; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=meta.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id ui42-20020a170907c92a00b008775fc7097csi2418021ejc.774.2023.01.26.13.54.47; Thu, 26 Jan 2023 13:55:10 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@meta.com header.s=s2048-2021-q4 header.b=RK0eODc0; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=meta.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232861AbjAZVvl (ORCPT + 99 others); Thu, 26 Jan 2023 16:51:41 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34178 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231513AbjAZVvi (ORCPT ); Thu, 26 Jan 2023 16:51:38 -0500 Received: from mx0a-00082601.pphosted.com (mx0a-00082601.pphosted.com [67.231.145.42]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7D5CDFF2F for ; Thu, 26 Jan 2023 13:51:36 -0800 (PST) Received: from pps.filterd (m0109333.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKqvb7000849 for ; Thu, 26 Jan 2023 13:51:36 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=YSju8h3IcFoXJFagXVV/kEgcC/pDir68RdkcrZYyLwI=; b=RK0eODc0AYW8MNOFDP/1dkUB/QQe5YtJVLFOk/cTZAPUxYdkCpZ1BVnCIbdPDHoAHKI/ /C4426KZe/tMOI+1oaXVo+ggjof+LkZopPTc7bJ5AOs1zllEgCxljCOm/YNOoMVqEIS6 GvWzQiV47VFQHkUQJgRqL7MN78bFLgAf/dfAWs/SflUF9yt1rQdwojOy6s3e27map76/ rLBLhV9BtGFR7BaW6GgtdlD3Ix1zccpf6OAqzFZkR7qpJegbXszkvssICmTGVKZuapX2 XYG9B4fFAH144s94n15CG+uNBRkUA9Av97PiCi4e+ovfyTx6R9kJzcPOxXzFNRHdQ2TS Yw== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nb7mbshbn-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:51:36 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:108::8) by mail.thefacebook.com (2620:10d:c085:21d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:51:35 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id D3B55FE80A8B; Thu, 26 Jan 2023 13:51:25 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 00/12] dmapool enhancements Date: Thu, 26 Jan 2023 13:51:13 -0800 Message-ID: <20230126215125.4069751-1-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-GUID: FSyEvlbM0WilvJQ0pokZi1BmNVetNOe- X-Proofpoint-ORIG-GUID: FSyEvlbM0WilvJQ0pokZi1BmNVetNOe- X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1756123743611550327?= X-GMAIL-MSGID: =?utf-8?q?1756123743611550327?= From: Keith Busch Time spent in dma_pool alloc/free increases linearly with the number of pages backing the pool. We can reduce this to constant time with minor changes to how free pages are tracked. Changes since v4: Added received reviews Applied comments from Christoph: Combined all debug code in one #ifdef block Fixed some whitespace Keith Busch (8): dmapool: add alloc/free performance test dmapool: move debug code to own functions dmapool: rearrange page alloc failure handling dmapool: consolidate page initialization dmapool: simplify freeing dmapool: don't memset on free twice dmapool: link blocks across pages dmapool: create/destroy cleanup Tony Battersby (4): dmapool: remove checks for dev == NULL dmapool: use sysfs_emit() instead of scnprintf() dmapool: cleanup integer types dmapool: speedup DMAPOOL_DEBUG with init_on_alloc mm/Kconfig | 9 ++ mm/Makefile | 1 + mm/dmapool.c | 402 ++++++++++++++++++++++------------------------ mm/dmapool_test.c | 147 +++++++++++++++++ 4 files changed, 350 insertions(+), 209 deletions(-) create mode 100644 mm/dmapool_test.c