From patchwork Wed Jan 31 12:25:41 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 194724 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:2087:b0:106:209c:c626 with SMTP id gs7csp1849929dyb; Wed, 31 Jan 2024 04:26:32 -0800 (PST) X-Google-Smtp-Source: AGHT+IFpDMS242qLdMT62BkT1OxTTWTUwcoiIffqh6DZ5kcE6qAPDLdKb20/2GMzbJe2s8IxfyxG X-Received: by 2002:a05:6808:114b:b0:3bd:c08d:91f6 with SMTP id u11-20020a056808114b00b003bdc08d91f6mr1718666oiu.29.1706703992793; Wed, 31 Jan 2024 04:26:32 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706703992; cv=pass; d=google.com; s=arc-20160816; b=g93xOHcJ3agCbbC1ge0JvYyHGQ/ZhpsSsRsedJlGZ2VaSh7JJANfDdnT2AKVF6//n7 egZbBUeHBnd68JZMCP6zTivKizyca5yYo4y2lA162AhYSrxD/6P4XaRu47Y2tFLMtlWR giQ5mAQperxpEO+fQg+LV5mMq20m50WTJZTX7motTs5LCigMrbNYVYuwoCf+6MyqH6gI K0dlCPWt/6HBR4dqsg39ESToGTGmKynHJ29iwRIuV8AK1pcNPotKJQor5+A1tI1/+VA2 15C4T6kSaHIJujS7Yj2oWRErNyFsxfVKQvt1IeTOJeNQSQXTffgh1OEe2FpsjPyW5+Fw S7mQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=Wrc+lukRBwjS6iMa4Zp7xPYRQWSIsfV05EyociA7i+4=; fh=AuEEM0eYeB+OfdLYRwvcPVavI1HOXjKoKaEKfE06m6A=; b=lFAnMZZaqh+U3fjmiFjd+xqxaMSqZRpmWvo5H5/k1in+UPtYQQMXcVEvN5tnKa0a7i YmBl7mXzehoccYZNcOOop9D+Gw42MUcNlAfyDxoyWavUIk0zE6Z3XnOvFNeRFtWQN2Lt /5NJ0TYhz/HjzRIcYAPiFgSq3mJOLEXebyQfVfutVROC2MjLKkNlCkPUxyzOwdR2WSMj Llo86SKSOjIt5LpTxDtgGLUX2687/wdcyLGwCAvEMva4hFzQdDESCCKft9oxUZgOpReX lolahi4zMEDsRM8+IooUKx1HbZNTk3jQKyymWk7pT/VuHxePXllYs5gWAf+oAuBFllao I2mw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=iRH0iXMC; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46416-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46416-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCVcT5eP/+u4iw+EdvD0wzHJFQvWkCIeZz3OEss1mn1k7powe9heVvPRi+SiCLRjKEXviDgBauCXa+1cep33wm9F9OQ5LQ== Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id t26-20020a056a00139a00b006dbdda40004si9712373pfg.108.2024.01.31.04.26.32 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 31 Jan 2024 04:26:32 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-46416-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=iRH0iXMC; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46416-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46416-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 8E502294905 for ; Wed, 31 Jan 2024 12:26:32 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id CF33D79DD9; Wed, 31 Jan 2024 12:25:54 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="iRH0iXMC" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 07F2D79DBA; Wed, 31 Jan 2024 12:25:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703952; cv=none; b=cGRXI6zRBWXsVCkBZB0zySy8bxm8Ny72wGyVEDuu65s52F7PtZ+UMGP8Lokzwlr9BGV0fJNcFWrAHYJnbUYIESO0MpM6nrlipZnt2eIdkM3J4TeoTpj6l1zoDO7OkW+WmD2F7wPiQs8I6D6qTmimo+/S2efCLLc2PQtjT0jMU24= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703952; c=relaxed/simple; bh=yyPp81tTf7X1CFkP3aY3Bslp8DRgVUi3y++5NTa6UTU=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=g7DhPPY+5ieeW0KwWr4BTCajUnV2zg/uIqZrquCwQlo39UpeqWPw8s52gePfFQ9bipu1TkHBc6wcpYpShOOIuZrjhfacoaHtc0e41g0xrtwZruy1IAwk7HJbnk0qlKaRiMj2fFwi7GfpuoE30wc82YHsznmF8Vkqds2CtbR2nSU= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=iRH0iXMC; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id B0BCFC433F1; Wed, 31 Jan 2024 12:25:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706703951; bh=yyPp81tTf7X1CFkP3aY3Bslp8DRgVUi3y++5NTa6UTU=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=iRH0iXMCF3ie/3WBc/jRy4rV4aMO/tXFNnTpH/R5DMvfiBaeAQratSSQGCe8Df6+C M4JoydOdj2t8+CZcYjwBHqxnEgkyQa9yTwdEd5zTCqF7OxEjlPPjhWIa/o+j1hWqpQ yyGmOAxqSenA2C47D/4WCx/fxUyoFKGuSz1bLU/po6nzdHwxjIFyQLx2aV88zeMCxN Gs1KgeGklRlRKDZgYFZ/I+H63WzuNMqkYBZmLmbnjQqKcHiiHE+ZWQE4dc7zTSd+wV WwzjpbBeV0SwWb0OCWUzKf9NJr8GoJipuIkUcjcqJ4UQSCL06JQ+3iJMbTrjSx6mRg atfmXhnvMaBsw== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v2 1/3] swiotlb: Fix allocation alignment requirement when searching slots Date: Wed, 31 Jan 2024 12:25:41 +0000 Message-Id: <20240131122543.14791-2-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240131122543.14791-1-will@kernel.org> References: <20240131122543.14791-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1789608845732583577 X-GMAIL-MSGID: 1789608845732583577 Commit bbb73a103fbb ("swiotlb: fix a braino in the alignment check fix"), which was a fix for commit 0eee5ae10256 ("swiotlb: fix slot alignment checks"), causes a functional regression with vsock in a virtual machine using bouncing via a restricted DMA SWIOTLB pool. When virtio allocates the virtqueues for the vsock device using dma_alloc_coherent(), the SWIOTLB search fails to take into account the 8KiB buffer size and returns page-unaligned allocations if 'area->index' was left unaligned by a previous allocation from the buffer: # Final address in brackets is the SWIOTLB address returned to the caller | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1645-1649/7168 (0x98326800) | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1649-1653/7168 (0x98328800) | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1653-1657/7168 (0x9832a800) This ends in tears (typically buffer corruption and/or a hang) because swiotlb_alloc() blindly returns a pointer to the 'struct page' corresponding to the allocation and therefore the first half of the page ends up being allocated twice. Fix the problem by treating the allocation alignment separately to any additional alignment requirements from the device, using the maximum of the two as the stride to search the buffer slots. Fixes: bbb73a103fbb ("swiotlb: fix a braino in the alignment check fix") Fixes: 0eee5ae10256 ("swiotlb: fix slot alignment checks") Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Signed-off-by: Will Deacon --- kernel/dma/swiotlb.c | 29 +++++++++++++++-------------- 1 file changed, 15 insertions(+), 14 deletions(-) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index b079a9a8e087..56cc08b1fbd6 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -982,7 +982,7 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool phys_to_dma_unencrypted(dev, pool->start) & boundary_mask; unsigned long max_slots = get_max_slots(boundary_mask); unsigned int iotlb_align_mask = - dma_get_min_align_mask(dev) | alloc_align_mask; + dma_get_min_align_mask(dev) & ~(IO_TLB_SIZE - 1); unsigned int nslots = nr_slots(alloc_size), stride; unsigned int offset = swiotlb_align_offset(dev, orig_addr); unsigned int index, slots_checked, count = 0, i; @@ -993,19 +993,18 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool BUG_ON(!nslots); BUG_ON(area_index >= pool->nareas); + /* + * For mappings with an alignment requirement don't bother looping to + * unaligned slots once we found an aligned one. + */ + stride = get_max_slots(max(alloc_align_mask, iotlb_align_mask)); + /* * For allocations of PAGE_SIZE or larger only look for page aligned * allocations. */ if (alloc_size >= PAGE_SIZE) - iotlb_align_mask |= ~PAGE_MASK; - iotlb_align_mask &= ~(IO_TLB_SIZE - 1); - - /* - * For mappings with an alignment requirement don't bother looping to - * unaligned slots once we found an aligned one. - */ - stride = (iotlb_align_mask >> IO_TLB_SHIFT) + 1; + stride = max(stride, PAGE_SHIFT - IO_TLB_SHIFT + 1); spin_lock_irqsave(&area->lock, flags); if (unlikely(nslots > pool->area_nslabs - area->used)) @@ -1015,14 +1014,16 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool index = area->index; for (slots_checked = 0; slots_checked < pool->area_nslabs; ) { - slot_index = slot_base + index; + phys_addr_t tlb_addr; - if (orig_addr && - (slot_addr(tbl_dma_addr, slot_index) & - iotlb_align_mask) != (orig_addr & iotlb_align_mask)) { + slot_index = slot_base + index; + tlb_addr = slot_addr(tbl_dma_addr, slot_index); + + if ((tlb_addr & alloc_align_mask) || + (orig_addr && (tlb_addr & iotlb_align_mask) != + (orig_addr & iotlb_align_mask))) { index = wrap_area_index(pool, index + 1); slots_checked++; - continue; } if (!iommu_is_span_boundary(slot_index, nslots, From patchwork Wed Jan 31 12:25:42 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 194726 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:2087:b0:106:209c:c626 with SMTP id gs7csp1850357dyb; Wed, 31 Jan 2024 04:27:21 -0800 (PST) X-Google-Smtp-Source: AGHT+IHrMFJekCZxvkfChSXWr3gj24KobJYZZocIp5sWNqi1d9k93ixiXzOd8uD0RY5PdvolGS4g X-Received: by 2002:a17:906:2b0e:b0:a36:3b53:8f07 with SMTP id a14-20020a1709062b0e00b00a363b538f07mr870340ejg.71.1706704041737; Wed, 31 Jan 2024 04:27:21 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706704041; cv=pass; d=google.com; s=arc-20160816; b=OXc7JmjUtQAkoPHFPrZf4lHKu14dSa6OmRkecNBLRjxptyNnGh7gFQ5SSvEKjjNSc2 za54NEb7hRd8ujCQ69IhYB3BEl3AVqdQR+ZNFu65HpqEqYbHemA/kFEhOQqqMLkMsFRD Qs6GnaR5t4JQJFTkHKMkXwMwI9HK5gPOH4cb6OWX76TeIdsCl7sEPGPf7//xFD6agu+0 g6hVaZDy+3wKO6hqCA1m60kgeHyAXl74ZnEpS7MCVo0+EdK7X2U6ZN96NIRvR1+VA4KP ysG8lYvuW+rErHmFSAfao9NeVxGBDydKmKj/KiNx/SjutAIrbu4k8tjQThB/5GExNlPR j1Rw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=gfrJ/MvOpfNo3jOw+ZQoYujZ58OWTw2bWKwzL7hKU98=; fh=vNnWmzI6l4e5KT+bs4l1nJie8frkq6PggQpJlPhg9og=; b=cJ02/jmoX1TGxSOERG+eD4TsPiZiq2CsBz8cfwwWhxAa6qt0dpymkwpBaveq9c4Sk1 N+mv3XVZnQBtYjPNyOpBvSJILOoj/VxpWZfB4ID5CgV2cYmJG8ZFDd4qQIwOQhXc/i5B nqQzcpyei6cLKnt4AB5hd0d9CRCfKYhYq6FyQcUW90PVsG6yw0KdoBntkjEttMLh/MKc LA+Hc1c+MEZuIINk6U+dU7WNaE/qLnFYmW74woYHefoIB+fQRfed8z7IGQiGf8eRk6yX MK/MfacO+Mynuk9UOdVEZvXxShFeJr91h7D2Uj/sQA16RLTNzpr0U8T2D4HLyvu4HOzZ zmGg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=psoPX5uw; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46417-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46417-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCVmExNOzJzfyaQfp+1FiAtkHCVUYEClps7esc9dQXqz9pYIA0Bz877Q90kFGR7ZARsmo4Bm3wfNRbBA42GfofCe0Z3qSw== Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id b1-20020a1709063ca100b00a35eab484b9si2367839ejh.894.2024.01.31.04.27.21 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 31 Jan 2024 04:27:21 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-46417-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=psoPX5uw; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46417-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46417-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 6785E1F296F7 for ; Wed, 31 Jan 2024 12:26:46 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id BE2A47993F; Wed, 31 Jan 2024 12:25:56 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="psoPX5uw" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 250757AE43; Wed, 31 Jan 2024 12:25:53 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703954; cv=none; b=oYlFCJIPrL/AiPggh29n6+X8ZcJmx3RhANmp5uRX9RLXQuWPhx8le0Q9Hde7HiF4AGhhktjj1Gi3PLrNsQaFPY8CsNbn5HZOF6JNrOa3Bh5bzxnlwZuN2yUGPqoLyVXSQV6ikf3JeB3UfAezpO05X9oW38x31o5etlmjOjCRChI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703954; c=relaxed/simple; bh=tvZfP5ZDpz93rBnkWzn8NpisHuCrYWdGw0rDfTGSi0w=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=WBCC5JC6QIQ4WZkaYHAfzdB49yS88jDXXkjjrb2kSScPCdP0RuRz/LkLNXHGEibV6IDwZ04VnHCq+K/UbtrB5vuaio+pu4SxOJCh1bikLym/Q2wAzGLOaz+SQs/Fwvc0d3ut0BvkmM00TP4idac45nc0j14rP9p9keb7W0X4E2U= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=psoPX5uw; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id EF82CC43399; Wed, 31 Jan 2024 12:25:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706703953; bh=tvZfP5ZDpz93rBnkWzn8NpisHuCrYWdGw0rDfTGSi0w=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=psoPX5uw05sqXOPDqQR+NcDpcVMXHTxr+ToULGVDXA91pOO4sDKAW6xGUtj1rRygW D1EtgsNsBW9z5MOfJUcBMMPzBLOjsRe5XTga8bzLOa9b4zvWWAc2G2Q2iTA5t4xNLl KtKJroPbgWfp2SuaPIwX5pRBEAo2p5SdfaIqjyriutK+J0vITqUdA8IevRtxbZ7C04 OzPdkiEMEfkJhGuV3ncoGiA+2hyHBoPDwsAJF/MLOQHkHbTppxE4W+zQfG4r1Zm9El u4b0V5kMmLRzZWIqNX2v763gsFq1lQNl7pyDMsvD0ODRbE5iBJ23OxIZf3HL5EqGZG v8VuNBl1Xzb+w== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v2 2/3] swiotlb: Enforce page alignment in swiotlb_alloc() Date: Wed, 31 Jan 2024 12:25:42 +0000 Message-Id: <20240131122543.14791-3-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240131122543.14791-1-will@kernel.org> References: <20240131122543.14791-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1789608897112554770 X-GMAIL-MSGID: 1789608897112554770 When allocating pages from a restricted DMA pool in swiotlb_alloc(), the buffer address is blindly converted to a 'struct page *' that is returned to the caller. In the unlikely event of an allocation bug, page-unaligned addresses are not detected and slots can silently be double-allocated. Add a simple check of the buffer alignment in swiotlb_alloc() to make debugging a little easier if something has gone wonky. Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Signed-off-by: Will Deacon --- kernel/dma/swiotlb.c | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index 56cc08b1fbd6..4485f216e620 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -1642,6 +1642,12 @@ struct page *swiotlb_alloc(struct device *dev, size_t size) return NULL; tlb_addr = slot_addr(pool->start, index); + if (unlikely(!PAGE_ALIGNED(tlb_addr))) { + dev_WARN_ONCE(dev, 1, "Cannot allocate pages from non page-aligned swiotlb addr 0x%pa.\n", + &tlb_addr); + swiotlb_release_slots(dev, tlb_addr); + return NULL; + } return pfn_to_page(PFN_DOWN(tlb_addr)); } From patchwork Wed Jan 31 12:25:43 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 194725 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:2087:b0:106:209c:c626 with SMTP id gs7csp1850151dyb; Wed, 31 Jan 2024 04:26:59 -0800 (PST) X-Google-Smtp-Source: AGHT+IHpL97fdYXVQOdHyp+sMl/UvpUVHuq9Ln8uTX2ULuqmfiyEXo1iR8pW32PJ44aX8++eYpT6 X-Received: by 2002:a62:e311:0:b0:6d9:b588:2053 with SMTP id g17-20020a62e311000000b006d9b5882053mr1436461pfh.2.1706704019125; Wed, 31 Jan 2024 04:26:59 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706704019; cv=pass; d=google.com; s=arc-20160816; b=UdWPhbr2PyGHNFT1vn+f7nXJEaehNxxN3u0slq7TRMcnfye4VWHD/0OEk6pwiP50YT 1uhEkRfCCSUPGwCZjtYNtzIUYYKLJ48ajEpmjlICxJTPsGu6Vyt6SLH6I97Qs7Z7Oq0r ejWPxByOAkQtSHxlkIEiIhCXJHVAN+MnFIIzyjdQaLJe/s+WBjuazgSDkleI+d7B6tXw FZ6bEz/4AClvxjHUYy2Jqedd7zGOVW58FQPSbTVhSBRjQWrbji/CHDQUEg8lfw5vT5dw GwlfyeyUTLKKa8jipoahWNwv50XAhPNk6nh5Wk98APdthMUW5UuE9RGsfXOzrwCW2ge6 2daA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=vN0PppCRl3fPf1FUdVod8fxZZ++AN2Z20bzt44AeK/A=; fh=74enmF4/q/XP/Vqs4K6A711d7TvkHr3uWTNAP45mN68=; b=DlR6lTgOV2+clm5WABKx5Kvn5K/r3CjYvCrb4VeMwhdbSO+QoFAv8EWIOQ42WW/o9A DjXNTHMEcnosmA1pS0FOcATiWxT8Ht5qa6WgfUp5NEwDVg9YLiHbT/DufjXD6h541X8S jrQCXWxVjqHYqknAeOg235uRbe5Mf3yGrBV5pcF+8OHydnfbFD76dw9xE23JNa17cvdU pFNSXKDXhQ3D8H2f5VVsLsbYfMQPM8ZNIS0EV9vCfpYcTD96U7nhUMdn3nDbHk7lnWbH 8WtN8sVKe0T/5d9UUGG+QSPZNhM3eDGxCu3+kQ2uaeoI/wqe9dBgMDJgo4luzef1158q +oTA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PS8Lt+3J; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46418-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46418-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCXb8MhbGohtEUVaoY0YrOwzrgQhkzM6b7nsYBSwu1AY76VOV9Am5+uJLtwJDqOuHDsHW7pC0/RHrcPPthOSLqIPL6hQVQ== Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id e8-20020a631e08000000b005d8e22d633bsi3374855pge.70.2024.01.31.04.26.58 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 31 Jan 2024 04:26:59 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-46418-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=PS8Lt+3J; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-46418-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-46418-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 73542294945 for ; Wed, 31 Jan 2024 12:26:58 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 45DB979958; Wed, 31 Jan 2024 12:25:59 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="PS8Lt+3J" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8891479938; Wed, 31 Jan 2024 12:25:56 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703956; cv=none; b=phvaHaEcwLKqBV2fiNoGuOD/ucxEQvoY0bd+Xy23s5ZZ64kfb2y2C/ODJBwmEDlyjAw59+ezHOsO1YuwIa2ocu2mVgmeSqAwBsuecNLLAeWLmV+AfPCbjnHGW5hUWIeOnqZakIQNyARAGkx8R9qcC60VaD/4DTOVOOh+AAAwAXE= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706703956; c=relaxed/simple; bh=97FSX4oU5s9ZlUZoIaV1rFcSltgv+fl+Z/Ia3ZsihrQ=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=jdgpoiukA4FV2jxJ4idtvsyjbiE5U9LLtO5VxEEPlNbG0ecZljKTvoEjT51/r27YjA8Q4j7oOxXVSqzJC1soqCnrnaOPm1d6VWkfWY4+Ha035OXis+IdrEVNepm27wmE/c3RWPEX/a/Lb8mSGoElS4W7AR+6ty9yNtKWv8LYFTg= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=PS8Lt+3J; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 3AAD9C43390; Wed, 31 Jan 2024 12:25:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706703956; bh=97FSX4oU5s9ZlUZoIaV1rFcSltgv+fl+Z/Ia3ZsihrQ=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=PS8Lt+3J3Xs0kHh+rJD0hfTP0DSeJUPH7CN4ilOfxfaxEBTtABTQKFhU1Vt6Fpl2h SXSdHDwsTGoxoDqLkFJctSVVpGe6bcg8D+ruZJSMQ9FtOZvbd2j6ArIUmJTydEP6Vq EtyOYy0RIbZaKV+hZb32fZ/s5BBWwSM3KYRey7qNdeHvVKj0KOC2C77zkelgMAGfM6 f1BcJFsEuDj8878ZiNGUZ8oz51mPpdupW5+NYpRewfsMIkoqZRWfkwondppd3ymkBO vNd4nflHvdfxun1SphQ32VxWLLgyY6a49tQ2rU989y6BJ5OHpugMz8mm/PWTuiVa8W nJvTjeNIafLhA== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v2 3/3] swiotlb: Honour dma_alloc_coherent() alignment in swiotlb_alloc() Date: Wed, 31 Jan 2024 12:25:43 +0000 Message-Id: <20240131122543.14791-4-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240131122543.14791-1-will@kernel.org> References: <20240131122543.14791-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1789608873490792091 X-GMAIL-MSGID: 1789608873490792091 core-api/dma-api-howto.rst states the following properties of dma_alloc_coherent(): | The CPU virtual address and the DMA address are both guaranteed to | be aligned to the smallest PAGE_SIZE order which is greater than or | equal to the requested size. However, swiotlb_alloc() passes zero for the 'alloc_align_mask' parameter of swiotlb_find_slots() and so this property is not upheld. Instead, allocations larger than a page are aligned to PAGE_SIZE, Calculate the mask corresponding to the page order suitable for holding the allocation and pass that to swiotlb_find_slots(). Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Signed-off-by: Will Deacon --- kernel/dma/swiotlb.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index 4485f216e620..8ec37006ac70 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -1632,12 +1632,14 @@ struct page *swiotlb_alloc(struct device *dev, size_t size) struct io_tlb_mem *mem = dev->dma_io_tlb_mem; struct io_tlb_pool *pool; phys_addr_t tlb_addr; + unsigned int align; int index; if (!mem) return NULL; - index = swiotlb_find_slots(dev, 0, size, 0, &pool); + align = (1 << (get_order(size) + PAGE_SHIFT)) - 1; + index = swiotlb_find_slots(dev, 0, size, align, &pool); if (index == -1) return NULL;