From patchwork Mon Feb 5 19:01:25 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 196997 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:168b:b0:106:860b:bbdd with SMTP id ma11csp1092332dyb; Mon, 5 Feb 2024 11:21:46 -0800 (PST) X-Google-Smtp-Source: AGHT+IG9bgoEXElCmfu26jHhfswSuufiyCdROc1sR8RK8vBZAYT3Lxjm0A7589fVptdMsLNCgUlm X-Received: by 2002:a05:6a20:6a0d:b0:19e:399f:7bed with SMTP id p13-20020a056a206a0d00b0019e399f7bedmr607320pzk.35.1707160905802; Mon, 05 Feb 2024 11:21:45 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707160905; cv=pass; d=google.com; s=arc-20160816; b=c5xYB948Db9LMjL9KM5gXU/C8GSU5lXvItOb9oD3hCA/82y6eFpfXTXNrsP/EvC0iG dHGCEE0GPaZvbautOx/JzrAV6n1We0uoLA67MNFA9j0xMr35zaLdG3m2FZM4GBq1i7L1 Clu4NWszOh9Kx9YZcP1smYDf3TAwI7ZspGocPwP+LiuVSkG4aMj95n3wsL7FWBL4nyAp uyBir4dpCIVWhc/WKFyphcTfrfGfiH/2QvN01WutHTUetotcLbG1BATzWdCYhOtkm//j CkPutJj3M4Pu2P8IYbpjeOOZEda55/Rej70GNhw/jvJed4uVGOKnbdcvLn8czHLebQYz Dfsw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=RbJsvuh1H1nNzMUaLA66f+JCNWRQO44q5AaF2q2nYlw=; fh=dODa4XvhPMBlefBgKRnNjUAStLK5fdX1eE4q+VJ6nVg=; b=S0epGJm4Z75Qa9xs5Na1D4z8irrL9p9OQexEugKUeMlubI24drPefiBPo4FMEikHi+ IMuMFJaB4NqWMOY0TWlg+SHp940DJgAtbPnVoa+mVSBENEbLwdAik5UqqHsBRTe3IhDS lg1nnGtsklxskvWZg8BSIGmMNl17JLiN7sIjYL8ua1r/nGLh1l0fPwR+IX1aum6qvnJ+ saN45hrRL+M8baGpNkHR+0D1lPUorKRZwWOR9S0cRX8atzOPB1OItjxzkv0EFqJjnUV3 n9FLPZUOn3QunnOyGvL6SAmto4C+/KsdlxCPhQtl6BS5SCoL3KmzIbp9WsN8xRWZbmOx 0x6Q==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="lKWhAX/r"; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53274-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53274-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCXhKnpAC3Q6dIA84cYeBCFTARGTi884rbTwrka4WkPZ48fnjxI+zu1eSK/nR4B4rYLrMZC2T9wd34WEaI7bTfFtLNGLJQ== Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id ka29-20020a056a00939d00b006e05089200fsi260017pfb.61.2024.02.05.11.21.45 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 05 Feb 2024 11:21:45 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-53274-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b="lKWhAX/r"; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53274-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53274-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 459D2B26D0B for ; Mon, 5 Feb 2024 19:02:49 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3FCE34CB45; Mon, 5 Feb 2024 19:01:42 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="lKWhAX/r" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 582E648CFE; Mon, 5 Feb 2024 19:01:39 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159699; cv=none; b=CYkotU4VhUsCGFsEW/zABKhkgGfUMXlVoI64HYywpCMF5L4lw4HFLej6WudTs+wORuijmPKeq+n2v6ws4gw7RlEvzWdVtbcyRcMB+wIhsNdE7xdP33/rbuvah70xlbf/brshj5Ad9Xtd3acvIdkU+/VRE0OEgqSJjJcC+ZeWMCw= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159699; c=relaxed/simple; bh=q1DctEBmJoDY/umidsjcFfwC11ROonZMe8mf1M+EGs0=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=ucKUDpSybKyNGZoM6nMGO4a87yY7QEYJ5bvvBxMKNvdy9pMqBsGSGc3SRRjtiwIChmncXvmTlfLMuRJmEjfLKXBFX+s3nAxZkV/g5Oo0UqkoXqRK1fcTkUoUiVm/Ooqa23Rhd+jZhjU1Mu5ZuDfZjwyOby37rv8p8e6zrTsUcRk= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=lKWhAX/r; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 123FCC433F1; Mon, 5 Feb 2024 19:01:36 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1707159698; bh=q1DctEBmJoDY/umidsjcFfwC11ROonZMe8mf1M+EGs0=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=lKWhAX/r0SSww5PSxbVGrO4q2dskM4sK4uZZ20Cpo4oNq83EEsVORFqLLBcsvg2PP HKkKJovaEtF1aHtMHpBu2M5FPMx0c1sJxQb1gA+XcsTU4pf4fhFDl62zvf64zjJtQ/ ita18vLaf9lcnMzi5tCBJwA9imsVMITnGmHMtiEbthic8DgGcxJtodc0TAkAjYtrgN GjJo8Y6kvNlhwGNlEh5TN4qVIYDBhazuusrfnLULMhYABHT19ga+W6U2ixDywLJ14W RSRt65VyZSRcDSb4GyYeQLWsskDlQUsx2CRsESpH2uRT6BzhL9bDRz+4dOVsSrxaGX 8W5Z7Wqdx/uCg== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v3 1/3] swiotlb: Fix double-allocation of slots due to broken alignment handling Date: Mon, 5 Feb 2024 19:01:25 +0000 Message-Id: <20240205190127.20685-2-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240205190127.20685-1-will@kernel.org> References: <20240205190127.20685-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1790087953910160793 X-GMAIL-MSGID: 1790087953910160793 Commit bbb73a103fbb ("swiotlb: fix a braino in the alignment check fix"), which was a fix for commit 0eee5ae10256 ("swiotlb: fix slot alignment checks"), causes a functional regression with vsock in a virtual machine using bouncing via a restricted DMA SWIOTLB pool. When virtio allocates the virtqueues for the vsock device using dma_alloc_coherent(), the SWIOTLB search can return page-unaligned allocations if 'area->index' was left unaligned by a previous allocation from the buffer: # Final address in brackets is the SWIOTLB address returned to the caller | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1645-1649/7168 (0x98326800) | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1649-1653/7168 (0x98328800) | virtio-pci 0000:00:07.0: orig_addr 0x0 alloc_size 0x2000, iotlb_align_mask 0x800 stride 0x2: got slot 1653-1657/7168 (0x9832a800) This ends badly (typically buffer corruption and/or a hang) because swiotlb_alloc() is expecting a page-aligned allocation and so blindly returns a pointer to the 'struct page' corresponding to the allocation, therefore double-allocating the first half (2KiB slot) of the 4KiB page. Fix the problem by treating the allocation alignment separately to any additional alignment requirements from the device, using the maximum of the two as the stride to search the buffer slots and taking care to ensure a minimum of page-alignment for buffers larger than a page. Fixes: bbb73a103fbb ("swiotlb: fix a braino in the alignment check fix") Fixes: 0eee5ae10256 ("swiotlb: fix slot alignment checks") Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Signed-off-by: Will Deacon Reviewed-by: Petr Tesarik --- kernel/dma/swiotlb.c | 28 +++++++++++++++------------- 1 file changed, 15 insertions(+), 13 deletions(-) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index b079a9a8e087..9ff909a0039a 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -982,7 +982,7 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool phys_to_dma_unencrypted(dev, pool->start) & boundary_mask; unsigned long max_slots = get_max_slots(boundary_mask); unsigned int iotlb_align_mask = - dma_get_min_align_mask(dev) | alloc_align_mask; + dma_get_min_align_mask(dev) & ~(IO_TLB_SIZE - 1); unsigned int nslots = nr_slots(alloc_size), stride; unsigned int offset = swiotlb_align_offset(dev, orig_addr); unsigned int index, slots_checked, count = 0, i; @@ -993,19 +993,18 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool BUG_ON(!nslots); BUG_ON(area_index >= pool->nareas); + /* + * For mappings with an alignment requirement don't bother looping to + * unaligned slots once we found an aligned one. + */ + stride = get_max_slots(max(alloc_align_mask, iotlb_align_mask)); + /* * For allocations of PAGE_SIZE or larger only look for page aligned * allocations. */ if (alloc_size >= PAGE_SIZE) - iotlb_align_mask |= ~PAGE_MASK; - iotlb_align_mask &= ~(IO_TLB_SIZE - 1); - - /* - * For mappings with an alignment requirement don't bother looping to - * unaligned slots once we found an aligned one. - */ - stride = (iotlb_align_mask >> IO_TLB_SHIFT) + 1; + stride = max(stride, PAGE_SHIFT - IO_TLB_SHIFT + 1); spin_lock_irqsave(&area->lock, flags); if (unlikely(nslots > pool->area_nslabs - area->used)) @@ -1015,11 +1014,14 @@ static int swiotlb_search_pool_area(struct device *dev, struct io_tlb_pool *pool index = area->index; for (slots_checked = 0; slots_checked < pool->area_nslabs; ) { - slot_index = slot_base + index; + phys_addr_t tlb_addr; - if (orig_addr && - (slot_addr(tbl_dma_addr, slot_index) & - iotlb_align_mask) != (orig_addr & iotlb_align_mask)) { + slot_index = slot_base + index; + tlb_addr = slot_addr(tbl_dma_addr, slot_index); + + if ((tlb_addr & alloc_align_mask) || + (orig_addr && (tlb_addr & iotlb_align_mask) != + (orig_addr & iotlb_align_mask))) { index = wrap_area_index(pool, index + 1); slots_checked++; continue; From patchwork Mon Feb 5 19:01:26 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 196992 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:168b:b0:106:860b:bbdd with SMTP id ma11csp1079963dyb; Mon, 5 Feb 2024 11:03:07 -0800 (PST) X-Google-Smtp-Source: AGHT+IEfAHiwRHIykY48o8vbwgGtkrESw8TTJUUN9sqo9CjV7y81Ky/o5Uiu0kHyhWoqojvdS3Sv X-Received: by 2002:a05:6214:2424:b0:68c:a6e7:5dfc with SMTP id gy4-20020a056214242400b0068ca6e75dfcmr5688164qvb.31.1707159787643; Mon, 05 Feb 2024 11:03:07 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707159787; cv=pass; d=google.com; s=arc-20160816; b=KkUXx/Jp4s0QJzfVP26Fl0TtMZ9ecWUZ6+t7e6frsY5sdmItNY2dT1pkhghukjI4tx jin59VqiOUShW47bexuU7onqO1x+phxXnQn+mJMnc6P91JbIR09FtjhuxwYLIsbFczfD 4aYe7aTrju8AgDHHgxxphdGjkFfkd2rcEBr/78mitZ5ZkxNIUopEBcVkaCS7YXACLzQU DJsM16XllwusWbob+DlGaiYmBBj2iaeT4wUt9WdxNQmZcrwppTyPhZiGNs09w99SlgPn eOLjvG9PEQRxY0YnkkD2H/f5m3yYredWoJqPjuqYurZ5gVzkXaLmQUOXR7hKxUuwPXOG tWvw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=GRPv3lA+N9l1B9AL3Rf0jB62dNvadY7vTk/wi4j1b3Q=; fh=dbzfMS+PxbVaT4LlHheKXW8CsHPbfGvifjaxiKEZrUg=; b=dWfTOwWO+5O4SdCARxPZVszWPnCJehppAcKuHoK+5qFfyNRVYzCJzLR/zp6bHT/xlr /y9Fq/ZuBX6I/LLyOBF9VnYdX0QeMjjbZDZiFypyAyoNNA+/OwzrXrqKQex/NlatM7pv 2Z0DSFtuPATO55y26sKK3nebd6YVqmAsT4tlakR+00l1E0O8fR1g/LyDgFeSJVWp3CfN bxr87arPzDqtH0fWHR82frZ8uNM3wXrsr8TjyTT8Apqz+aW/em6hobpS7m6fEkkleyRM SEEQKV8RNgCmbo7WpcqGyF93i2uu94W+KQC6RCdlZgaH5DxU56humFpSc8pIaL/gwUvm 7uBg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=GkLGdqbt; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53275-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53275-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCU0zGcwW/gIAGvbjhayiEtP2Wf/6kHPaK0CTLIo1DcabklbPrFsEdy0i/9lgJtacCgV+SDhfNoYldi+r0SXz12nx3o3DA== Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id el18-20020ad459d2000000b0068c83271adcsi531475qvb.228.2024.02.05.11.03.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 05 Feb 2024 11:03:07 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-53275-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=GkLGdqbt; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53275-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53275-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 3CA041C24340 for ; Mon, 5 Feb 2024 19:03:07 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 6B9954D5BF; Mon, 5 Feb 2024 19:01:44 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="GkLGdqbt" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A3B074BA96; Mon, 5 Feb 2024 19:01:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159701; cv=none; b=kx56FlHZKSe4uRgzTJ988OG0o4roD/27K4Q5AWgJxMLtnY0Yc9OarIuP5MUw7o++ISqQxq+UQRy6JtvEK4yIK+w+ZUtPerU6wQ4DBpcAQCNpLG8GFjn5unF9e4idV88UV/6UX65V952t3mbf/6hLmht0l74L3FDrTITIjK8HTNc= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159701; c=relaxed/simple; bh=Xm+zNHaI1L6yDroz8J/2SUT0P9yQzO240Q33Rj/NF8c=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=Xwt8at4/6Rz9UNBXi2kixRqCskCGhp/X1zWjqo2MPgZZhK1ne1dckibKeCKqu0GWmcMqlTC/akhSD160ctkXQ7qoHE5jrnT2AAYDCf9gorT8hSK4AthGsMeykiCY480p8c16l4HzAsy9qU0TBR/NfS9Z3QaDNUeRKt9jiVFXgho= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=GkLGdqbt; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 50CA9C43390; Mon, 5 Feb 2024 19:01:39 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1707159701; bh=Xm+zNHaI1L6yDroz8J/2SUT0P9yQzO240Q33Rj/NF8c=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=GkLGdqbtVBK2Cn0h+xSZ/PXnBH9ZzuzbPxDZyJevoa4KTz2c2JKWo1J2L05OMfoS4 yE2WSQWMmIr+86D8xLTHJrok/gyrBAGAuVSDbJfev3T4Mcxq4ey++Ii6xYQfBWJgJ7 ppbmSp9LecvqGB8aOHD4Iz2LQZOpnoPbcFjjgh6dZfFO0sOan7u5OnFvMFCnrgLcKj L20sMxRTnQakMyFSO7MkjdfUERnK3w63JicuVJcWO3zHLWTmH1pK4/uc6K2KZJGaLJ 7XHeeFFe0RO8KFvhdwCa3HHZWuL8rJMcM8DBSsgLZqmZ4dYC9A5VTsYUJzHrJfd78Y x7YJ6seoe6whw== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v3 2/3] swiotlb: Enforce page alignment in swiotlb_alloc() Date: Mon, 5 Feb 2024 19:01:26 +0000 Message-Id: <20240205190127.20685-3-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240205190127.20685-1-will@kernel.org> References: <20240205190127.20685-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1790086781686975610 X-GMAIL-MSGID: 1790086781686975610 When allocating pages from a restricted DMA pool in swiotlb_alloc(), the buffer address is blindly converted to a 'struct page *' that is returned to the caller. In the unlikely event of an allocation bug, page-unaligned addresses are not detected and slots can silently be double-allocated. Add a simple check of the buffer alignment in swiotlb_alloc() to make debugging a little easier if something has gone wonky. Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Signed-off-by: Will Deacon Reviewed-by: Petr Tesarik --- kernel/dma/swiotlb.c | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index 9ff909a0039a..adbb3143238b 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -1643,6 +1643,12 @@ struct page *swiotlb_alloc(struct device *dev, size_t size) return NULL; tlb_addr = slot_addr(pool->start, index); + if (unlikely(!PAGE_ALIGNED(tlb_addr))) { + dev_WARN_ONCE(dev, 1, "Cannot allocate pages from non page-aligned swiotlb addr 0x%pa.\n", + &tlb_addr); + swiotlb_release_slots(dev, tlb_addr); + return NULL; + } return pfn_to_page(PFN_DOWN(tlb_addr)); } From patchwork Mon Feb 5 19:01:27 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Will Deacon X-Patchwork-Id: 196993 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:168b:b0:106:860b:bbdd with SMTP id ma11csp1080236dyb; Mon, 5 Feb 2024 11:03:27 -0800 (PST) X-Google-Smtp-Source: AGHT+IF4FyisV8LaEcrL9nugiLfAalrXDPqcD04Eflbm4PSMveBQj4DwZV7ZOcwRJJqRwXUW8xAf X-Received: by 2002:a05:6808:6046:b0:3be:9ae8:16be with SMTP id dd6-20020a056808604600b003be9ae816bemr554449oib.38.1707159807376; Mon, 05 Feb 2024 11:03:27 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707159807; cv=pass; d=google.com; s=arc-20160816; b=L9u9s8LBc9+bpz+WnFFuUJm+CyB7Vcq8NZd6Q+HxUxEFwyaPK5giUE7WrXOTU48PBQ mIr3Le6C1nKT0QDzSQbjxj7Xoswos6y2LrKGHV7qE7TLEerWQAozllZcCNQe+NW9nGLf XaiaIgnHn63PlGR00V7Qdcxs0rjptAz/6Nq/w/O1E51svkU8tyLWxFE+mGQdlH+B5opm Ad1E3i1+/QymdRFCg+E6U0swTFgxmJEGR+u24kvzbnLeB4ZrC/L5cvkYjdwhkB2ekTj8 xA0PfHhY5IE+rWdJvq6T+luuF0G1Px2N64SSCX/YbHPY3DWPY0DCEIgy+3vQCruiHhcb T2UQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=TYWd+25EZKHgv9DFcU1CxEQiMmgf4I9Lf1cAo66RCbk=; fh=VBKWtEpegNagfzBVKRKp9InbQv1zE2Y+aCYZMN7SllQ=; b=N2cVUR9J5+PjFLHNMXcVcNuhV8JZlEVkJ5w0GJdrgWEpRkZ0VFrJyex/itYCI/rTNf Okew7QouRwIPlereTRVluol6MM8EFSgIWJw/3cfPlCzWp9MA0DjlMj0YIOagXpbfpL1d yFap8zDapOMlaZxCtwAwEW78T9OglZ03I4lQylkDq6C8DKvT8rG4itHzuY9VUb0O1jSq JMjxgYs2hFUEJczSCZnmD6SQvfgvndp3gp6YrX9G8CfiHyjQpfFuKu29Xh3oxwnxB1of fk5pZ43DmEPeSJ8cIkTWmmGkbHXnWk3wdaxtr57V0BeTDtnlNdUiuGb2EZvrI5E/bJC2 fUuA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=lmoQR25l; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53276-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53276-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=1; AJvYcCWy2XnsfDG+TV1Zk39QFXgRRf5C7kSFJ/4q0wjEEyuDR51oOoJEuVzzzZ68Bn2JUrW1h4nD8YARcVNJTheV1Eu/L5Btug== Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id w18-20020a05622a135200b0042a53b932b4si488058qtk.9.2024.02.05.11.03.27 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 05 Feb 2024 11:03:27 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-53276-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=lmoQR25l; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-53276-ouuuleilei=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-53276-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id EF6961C245F0 for ; Mon, 5 Feb 2024 19:03:26 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 724564EB46; Mon, 5 Feb 2024 19:01:46 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="lmoQR25l" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BFE5B4D5A2; Mon, 5 Feb 2024 19:01:43 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159703; cv=none; b=TEStmv/W4HEh2xs4ZnHa0gMW9L6OKfT5dd/ZnZrdYylJca7xzWOugSZFR1MzqAbnkTqyYOGJ9E9jhPdnrI/X9Wx8jActuSQ2WMcASEbf9Jp82yoz/FOn4CinjUhVinFdQj6fDaF+NAf1DQmDhhp88/PAZIDesDPc49zS/53SdWY= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707159703; c=relaxed/simple; bh=hQZUe3sC6qvAlN4FEOPtkqPiMEdJZuABY+olfP99JFc=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=onhezXw0PNdLALIc2dmdLq9lhso9r6kdxNd6q45rbosFwGI5wClEpu6DyIYCXyLYeHlNgIEALwSMeglPE1Lpp+DZSzj/6BUvHlO70B0CHDp2BIEt5eqZVNHmSaYNde6pyt+JTG6CTTcmjGA53lKajO3xserM8g9Q2ztUSz4mrA0= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=lmoQR25l; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 8FB3AC433F1; Mon, 5 Feb 2024 19:01:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1707159703; bh=hQZUe3sC6qvAlN4FEOPtkqPiMEdJZuABY+olfP99JFc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=lmoQR25ludhgwq7pg6I1EhIk/p8uQEqt8nLNz7TzzLBOX2wlnQlMhVmrCVOaVrDmI oGP61dg+FoZ3JflOYRYPQgaDLxt6gMLeGUImiWBiwoQi3A+DFrUxQWBbvpgteIh7Nf RoNzLKYE075wvJp57XGu+9niQCouMmcWRsD/PyMTjOekbdS4ajwjOj4Y8yNQFANaT6 caBhmNO0eWy25b0h8FlrrDvpIze5J1cKCt2I8dfPMPV0j0PkszJ/02+LMdXZgYQQWn BUra+IidX2GQ5qUJH3X0XnOHipUoBWgrjTEas1zkICOsnv7QJwUUWmJ53edEGpT7qN FI3PM05JbV7fA== From: Will Deacon To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Will Deacon , iommu@lists.linux.dev, Christoph Hellwig , Marek Szyprowski , Robin Murphy , Petr Tesarik , Dexuan Cui Subject: [PATCH v3 3/3] swiotlb: Honour dma_alloc_coherent() alignment in swiotlb_alloc() Date: Mon, 5 Feb 2024 19:01:27 +0000 Message-Id: <20240205190127.20685-4-will@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20240205190127.20685-1-will@kernel.org> References: <20240205190127.20685-1-will@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1790086802188144430 X-GMAIL-MSGID: 1790086802188144430 core-api/dma-api-howto.rst states the following properties of dma_alloc_coherent(): | The CPU virtual address and the DMA address are both guaranteed to | be aligned to the smallest PAGE_SIZE order which is greater than or | equal to the requested size. However, swiotlb_alloc() passes zero for the 'alloc_align_mask' parameter of swiotlb_find_slots() and so this property is not upheld. Instead, allocations larger than a page are aligned to PAGE_SIZE, Calculate the mask corresponding to the page order suitable for holding the allocation and pass that to swiotlb_find_slots(). Cc: Christoph Hellwig Cc: Marek Szyprowski Cc: Robin Murphy Cc: Petr Tesarik Cc: Dexuan Cui Fixes: e81e99bacc9f ("swiotlb: Support aligned swiotlb buffers") Signed-off-by: Will Deacon Reviewed-by: Petr Tesarik --- kernel/dma/swiotlb.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/kernel/dma/swiotlb.c b/kernel/dma/swiotlb.c index adbb3143238b..283eea33dd22 100644 --- a/kernel/dma/swiotlb.c +++ b/kernel/dma/swiotlb.c @@ -1633,12 +1633,14 @@ struct page *swiotlb_alloc(struct device *dev, size_t size) struct io_tlb_mem *mem = dev->dma_io_tlb_mem; struct io_tlb_pool *pool; phys_addr_t tlb_addr; + unsigned int align; int index; if (!mem) return NULL; - index = swiotlb_find_slots(dev, 0, size, 0, &pool); + align = (1 << (get_order(size) + PAGE_SHIFT)) - 1; + index = swiotlb_find_slots(dev, 0, size, align, &pool); if (index == -1) return NULL;