From patchwork Fri Dec 2 09:43:16 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: David Howells X-Patchwork-Id: 2528 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:adf:f944:0:0:0:0:0 with SMTP id q4csp745863wrr; Fri, 2 Dec 2022 02:05:49 -0800 (PST) X-Google-Smtp-Source: AA0mqf6hnkHRyRbuqwttQtua95mvGIM1w3vLL8kdJqxuB+I60jQOVlWg0sn3ikW9EDsHHaseYIGk X-Received: by 2002:a17:90a:8c04:b0:219:5b3c:6983 with SMTP id a4-20020a17090a8c0400b002195b3c6983mr15350462pjo.131.1669975549155; Fri, 02 Dec 2022 02:05:49 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1669975549; cv=none; d=google.com; s=arc-20160816; b=wc4t3GYhFaStI9p30UI02ZiXsCLu5yrjlia94lIeaVU5X9D/cYW8B7LGRp32m5dxd6 er4wlBrE6qqM/4OD/kDV1BqYZBIZz7H6jHrrftfSOGEiJGhedbhmmmBUD/MEKaSXPPoM 7HbL23XpaLKFpATEnAU2+mblFwOBUiAhsneCj3iESLP/fWw4i3Gc6EOhKK8c1H+pCtAB Ga2teNyaKY+KF3VgB5skAGySLyA2W06nWiQnbmaYFSR5UVOXpbLQ4L9ZMxg2UTa1VbuI hqltxpSF+VGKE95hZn8d7mRnQneEBMHJWKNrglf8OCCU/82/dopkKWrd8+8Smcp4h1Yj a4hQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :user-agent:message-id:date:cc:to:from:subject:dkim-signature; bh=JPL3HeqWrrSKDJIfWXlo82sdG8gZ+m15F8/peAepuFE=; b=mMIlfOhtd8vCQpEqsr+2gfl8QbMRUHeuEyqHGoh/CKd6xY+JSNKrP5MKbW9unfC4GJ INnNhwMAMUb3NcsmHvrCObylq4x6lhRde8BdeJr+qD3Dp5Z4a5dkvkdfz2YkKcJpd52j d8r/1qoY3PLet0wkYv2cWkgPd9wF62z2k6WUsf3WnuSJow10VPcpdIEUp7yv8bHSR79N QkdHogXiuXH9+9IdSPj+DhLU/PoK6tdtnd3mAOYTUoqT47mZH59nIxYFsVho7TgNQnBw PlJV2K2/lCzYcWwh6pTjJppYZnekj4PhlFqvx+UnB5+JEjZ8e9uTgtA/vfgg7cFSdogO fLSg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=C+JlyDCt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id c2-20020a170902b68200b0018905bd4a58si6309071pls.169.2022.12.02.02.05.36; Fri, 02 Dec 2022 02:05:49 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=C+JlyDCt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232957AbiLBJor (ORCPT + 99 others); Fri, 2 Dec 2022 04:44:47 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46760 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232874AbiLBJoZ (ORCPT ); Fri, 2 Dec 2022 04:44:25 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id AA5F3B7DC3 for ; Fri, 2 Dec 2022 01:43:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1669974205; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=JPL3HeqWrrSKDJIfWXlo82sdG8gZ+m15F8/peAepuFE=; b=C+JlyDCtR57nKSm1HBGiAQr5bAoyerXOzrq/T7NrrMVhpeN0DrZCcH8ilwoz/XKZMaR9GS Buhnss1ZVuY+v9HiR4QF+0vxE3CvhdZjOiFkd87jbUNUzf+YhtJCNn8ZlYzXAi0JSwZiiH cTvtfb56njpKtRicE3ggUIXCRxzMZaY= Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-348-6efNmvdpPW2mpW2TiorUrg-1; Fri, 02 Dec 2022 04:43:22 -0500 X-MC-Unique: 6efNmvdpPW2mpW2TiorUrg-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 0DD0338173CB; Fri, 2 Dec 2022 09:43:22 +0000 (UTC) Received: from warthog.procyon.org.uk (unknown [10.33.36.116]) by smtp.corp.redhat.com (Postfix) with ESMTP id 7A55E2028E96; Fri, 2 Dec 2022 09:43:19 +0000 (UTC) Subject: [PATCH v3 0/4] iov_iter: Add extraction helpers From: David Howells To: Al Viro Cc: linux-fsdevel@vger.kernel.org, Shyam Prasad N , Christoph Hellwig , linux-cachefs@redhat.com, linux-cifs@vger.kernel.org, linux-mm@kvack.org, Steve French , Rohith Surabattula , Matthew Wilcox , John Hubbard , Jeff Layton , dhowells@redhat.com, Christoph Hellwig , Matthew Wilcox , Jeff Layton , Logan Gunthorpe , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org Date: Fri, 02 Dec 2022 09:43:16 +0000 Message-ID: <166997419665.9475.15014699817597102032.stgit@warthog.procyon.org.uk> User-Agent: StGit/1.5 MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.1 on 10.11.54.4 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1751096281409391882?= X-GMAIL-MSGID: =?utf-8?q?1751096281409391882?= Hi Al, Here are four patches to provide support for extracting pages from an iov_iter, where such a thing makes sense, if you could take a look? [!] NOTE that I've switched the functions to be exported GPL-only at Christoph's request[1]. They are, however, intended as a replacement for iov_iter_get_pages*(), which is not marked _GPL - so that functionality will probably become unavailable to non-GPL 3rd party modules in future. The first couple of patches provide iov_iter general stuff: (1) Move the FOLL_* flags to linux/mm_types.h so that linux/uio.h can make use of them. (2) Add a function to list-only, get or pin pages from an iterator as a future replacement for iov_iter_get_pages*(). Pointers to the pages are placed into an array (which will get allocated if not provided) and, depending on the iterator type and direction, the pages will have a ref or a pin get on them, or left untouched (on the assumption that the caller manages their lifetime). The determination is: UBUF/IOVEC + READ -> pin UBUF/IOVEC + WRITE -> get PIPE + READ -> list-only BVEC/XARRAY -> list-only Anything else -> EFAULT The function also returns an indication of which of "list only, get or pin" the extraction function did to aid in cleaning up (returning 0, FOLL_GET or FOLL_PIN as appropriate). Then there are a couple of patches that add stuff to netfslib that I want to use there as well as in cifs: (3) Add a netfslib function to use (2) to extract pages from an ITER_IOBUF or ITER_UBUF iterator into an ITER_BVEC iterator. This will get or pin the pages as appropriate. (4) Add a netfslib function to extract pages from an iterator that's of type ITER_UBUF/IOVEC/BVEC/KVEC/XARRAY and add them to a scatterlist. The function in (2) is used for a UBUF and IOVEC iterators, so those need cleaning up afterwards. BVEC and XARRAY iterators are ungot and unpinned and may be rendered into elements that span multiple pages, for example if large folios are present. Changes: ======== ver #3) - Switch to using EXPORT_SYMBOL_GPL to prevent indirect 3rd-party access to get/pin_user_pages_fast()[1]. ver #2) - Rolled the extraction cleanup mode query function into the extraction function, returning the indication through the argument list. - Fixed patch 4 (extract to scatterlist) to actually use the new extraction API. I've pushed the patches here also: https://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs.git/log/?h=iov-extract David Link: https://lore.kernel.org/r/Y3zFzdWnWlEJ8X8/@infradead.org/ [1] Link: https://lore.kernel.org/r/166697254399.61150.1256557652599252121.stgit@warthog.procyon.org.uk/ # rfc Link: https://lore.kernel.org/r/166722777223.2555743.162508599131141451.stgit@warthog.procyon.org.uk/ # rfc Link: https://lore.kernel.org/r/166732024173.3186319.18204305072070871546.stgit@warthog.procyon.org.uk/ # rfc Link: https://lore.kernel.org/r/166869687556.3723671.10061142538708346995.stgit@warthog.procyon.org.uk/ # rfc --- David Howells (4): mm: Move FOLL_* defs to mm_types.h iov_iter: Add a function to extract a page list from an iterator netfs: Add a function to extract a UBUF or IOVEC into a BVEC iterator netfs: Add a function to extract an iterator into a scatterlist fs/netfs/Makefile | 1 + fs/netfs/iterator.c | 367 +++++++++++++++++++++++++++++++++++++++ include/linux/mm.h | 74 -------- include/linux/mm_types.h | 73 ++++++++ include/linux/netfs.h | 7 + include/linux/uio.h | 4 + lib/iov_iter.c | 350 +++++++++++++++++++++++++++++++++++++ mm/vmalloc.c | 1 + 8 files changed, 803 insertions(+), 74 deletions(-) create mode 100644 fs/netfs/iterator.c