From patchwork Tue Mar 21 00:12:51 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yonggil Song X-Patchwork-Id: 72555 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:604a:0:0:0:0:0 with SMTP id j10csp1513514wrt; Mon, 20 Mar 2023 17:37:11 -0700 (PDT) X-Google-Smtp-Source: AK7set/ieXkk9fK9GquP0gwAKKoGKXRXHyu4lkUDhdR+mNxh6djt/eo5BTNxrhwnD1Ka/RMx88sc X-Received: by 2002:a17:90b:1d0b:b0:237:e1d2:c65e with SMTP id on11-20020a17090b1d0b00b00237e1d2c65emr601611pjb.4.1679359031364; Mon, 20 Mar 2023 17:37:11 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1679359031; cv=none; d=google.com; s=arc-20160816; b=KUpOiM0nzsShvjdyOuZ57k+U4/nlncnLaVMUVIfSEnY0ns4aafyMzUS+eY3UJYl/2t 1sb5AoI9qwCeKCPsVm1AfVQ2WQoc+OP3F9ORITreAXjb0s2kg0QD4EsEyWrDfpk+JRy5 Nm5KWmBcxMFSFg5Up1nQeR1Jvhy+MKkzvkXCTVPLOQPueaYnb/AEf/vDRh+Q2/nQDe1U BQoTN28Fq4RVxwVIrTAd5tKEOeSIl7VPB8eQxvk98roIwDdZ+EAikD7cj/U2vkY66UR6 V0lzJSTE0CXq+vkhwudTrwSwCwTiwjtEVPmSxBWJ34Q6Wt7FbxVwzAFIrZYGS9zK2XMl CU0A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:references:dlp-filter:cms-type :content-transfer-encoding:date:message-id:to:from:sender:reply-to :subject:mime-version:dkim-signature:dkim-filter; bh=PaEWPPd/BY1we4un0qO+7j4N9iZdp9EdLrjCEp8lr8k=; b=swpUhEAtg5cDdYMx1KHhYnYXvVPDJR1dBOioL4qJuvifESrtR1uzyh1zy4W0spN5wt 7EPErKxpCIJ7O2LkFa6wCk6nYI2ZjyJ9TqXf7ogIpZ42YN+GOVPxdi/rHNlznG1gQC6m J4zYUzuZ8hDNy+WugB3FhCthmM+ktWONriMcBHAPEVqtd/RrSfEheSAyhaGH3nS1wPi5 R2ohxpi2N3/Duw48CIFO/y+qynd2prVEFthjGn/55EdU95rz0M/C2wAz3KPtkt4LpcOT KYCbaf3REr7yGXTiXO6PxmEO9p8hF1zNJ2DjIFw0FsvZKfvmmIhvbDmmCmp+iHpvzkZy Bycg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@samsung.com header.s=mail20170921 header.b=E+EbrR2l; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=samsung.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id 23-20020a630617000000b004fc29a7445asi12021055pgg.89.2023.03.20.17.36.57; Mon, 20 Mar 2023 17:37:11 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@samsung.com header.s=mail20170921 header.b=E+EbrR2l; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=samsung.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229869AbjCUANO (ORCPT + 99 others); Mon, 20 Mar 2023 20:13:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47440 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229601AbjCUANI (ORCPT ); Mon, 20 Mar 2023 20:13:08 -0400 Received: from mailout4.samsung.com (mailout4.samsung.com [203.254.224.34]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B736E2A167 for ; Mon, 20 Mar 2023 17:12:56 -0700 (PDT) Received: from epcas2p1.samsung.com (unknown [182.195.41.53]) by mailout4.samsung.com (KnoxPortal) with ESMTP id 20230321001252epoutp04ae5f558d9d5d36de9a380b0cbfbdecde~ORtCiLPtP0704907049epoutp049 for ; Tue, 21 Mar 2023 00:12:52 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 mailout4.samsung.com 20230321001252epoutp04ae5f558d9d5d36de9a380b0cbfbdecde~ORtCiLPtP0704907049epoutp049 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsung.com; s=mail20170921; t=1679357572; bh=PaEWPPd/BY1we4un0qO+7j4N9iZdp9EdLrjCEp8lr8k=; h=Subject:Reply-To:From:To:Date:References:From; b=E+EbrR2lLPb5QMjv+zWONLw/Y9DEqFS6YrJinHL8VQpH010u7cEE8znOnQX0C93qh Gz0szdXpDiBX6xi0VEfeKXe+M04AzGCWeO29pGNey1Q/g8m50OLL1udmnWchoaD1mr n26jGdFP+l+JRSd5BkxS8Qm1yA4AdXsg7/ArsBEc= Received: from epsnrtp3.localdomain (unknown [182.195.42.164]) by epcas2p2.samsung.com (KnoxPortal) with ESMTP id 20230321001252epcas2p2af72b0899698fac1eafa829ad5fd7e98~ORtCN_PP21912619126epcas2p2K; Tue, 21 Mar 2023 00:12:52 +0000 (GMT) Received: from epsmges2p2.samsung.com (unknown [182.195.36.69]) by epsnrtp3.localdomain (Postfix) with ESMTP id 4PgX9v56kMz4x9Pt; Tue, 21 Mar 2023 00:12:51 +0000 (GMT) X-AuditID: b6c32a46-743fa70000007a4b-df-6418f6832e4c Received: from epcas2p1.samsung.com ( [182.195.41.53]) by epsmges2p2.samsung.com (Symantec Messaging Gateway) with SMTP id 44.EE.31307.386F8146; Tue, 21 Mar 2023 09:12:51 +0900 (KST) Mime-Version: 1.0 Subject: [PATCH v2] f2fs: Fix system crash due to lack of free space in LFS Reply-To: yonggil.song@samsung.com Sender: Yonggil Song From: Yonggil Song To: "jaegeuk@kernel.org" , "chao@kernel.org" , "linux-f2fs-devel@lists.sourceforge.net" , "linux-kernel@vger.kernel.org" X-Priority: 3 X-Content-Kind-Code: NORMAL X-CPGS-Detection: blocking_info_exchange X-Drm-Type: N,general X-Msg-Generator: Mail X-Msg-Type: PERSONAL X-Reply-Demand: N Message-ID: <20230321001251epcms2p4c1fd48495643dbfca2cf82a433490bb8@epcms2p4> Date: Tue, 21 Mar 2023 09:12:51 +0900 X-CMS-MailID: 20230321001251epcms2p4c1fd48495643dbfca2cf82a433490bb8 X-Sendblock-Type: AUTO_CONFIDENTIAL CMS-TYPE: 102P X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrJKsWRmVeSWpSXmKPExsWy7bCmqW7zN4kUgze35CxOTz3LZPFk/Sxm i0uL3C0u75rDZjH1/BEmB1aPTas62Tx2L/jM5NG3ZRWjx+dNcgEsUdk2GamJKalFCql5yfkp mXnptkrewfHO8aZmBoa6hpYW5koKeYm5qbZKLj4Bum6ZOUBrlRTKEnNKgUIBicXFSvp2NkX5 pSWpChn5xSW2SqkFKTkF5gV6xYm5xaV56Xp5qSVWhgYGRqZAhQnZGTNfPWUq+KdTcXZmE3MD 4wLVLkZODgkBE4kj6+6zdzFycQgJ7GCUWDx7G1MXIwcHr4CgxN8dwiA1wgLeEn2nHrCB2EIC ShLXDvSyQMT1JTYvXsYOYrMJ6Er83bAczBYReMUocWa1KMR8XokZ7U9ZIGxpie3LtzJC2BoS P5b1MkPYohI3V79lh7HfH5sPVSMi0XrvLFSNoMSDn7uh4pISiw6dZ4Kw8yX+rrjOBmHXSGxt aIOK60tc69gItpdXwFfiU+tHsPksAqoS7w6cgZrjIrHzxF1WEJtZQF5i+9s5zCCvMwtoSqzf pQ9iSggoSxy5xQJRwSfRcfgvO8xXO+Y9gdqkJrF502ZWCFtG4sLjNqjpHhL7e+6zQkItUOLj xPlsExjlZyHCdhaSvbMQ9i5gZF7FKJZaUJybnlpsVGAEj87k/NxNjOA0p+W2g3HK2w96hxiZ OBgPMUpwMCuJ8LoxS6QI8aYkVlalFuXHF5XmpBYfYjQF+ngis5Rocj4w0eaVxBuaWBqYmJkZ mhuZGpgrifNK255MFhJITyxJzU5NLUgtgulj4uCUamBqbzOcO0FMNsrJZYX5NCVNN267HQrP 3+/qM+eaaZibtO12rt+DpC83rrx1ZOuZyqDK6WLTe/hSTZbOdFGjuJnHctKffuyV+/j21NL9 GVcWqLwQmMGqWSLBWHVqfpn83V6TFg0BkZdlbmtf9jYf/ZsXfUE90e/hyuNmGx8lXXU9k7u5 9Nzd8Hs5Stx2VdKK2Qdubo7/8OySobF4UNCvTCn/h1rhP1+u7eoTj12jF6C9f87M+6dy1XZu +7afg8FnNc/Eqq6vu03Kz8+6kn30zUGFN/rdf7dcOW1zL31RXL6zSGUHu5tm8GrvY0oVNxzm 5/v1mUzNeLTtGMeyZ2H5Zyp2C11J9E9xid337881relKLMUZiYZazEXFiQCS/11T/AMAAA== DLP-Filter: Pass X-CFilter-Loop: Reflected X-CMS-RootMailID: 20230321001251epcms2p4c1fd48495643dbfca2cf82a433490bb8 References: X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED, RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_PASS,SPF_PASS, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1760935576043320994?= X-GMAIL-MSGID: =?utf-8?q?1760935576043320994?= When f2fs tries to checkpoint during foreground gc in LFS mode, system crash occurs due to lack of free space if the amount of dirty node and dentry pages generated by data migration exceeds free space. The reproduction sequence is as follows. - 20GiB capacity block device (null_blk) - format and mount with LFS mode - create a file and write 20,000MiB - 4k random write on full range of the file RIP: 0010:new_curseg+0x48a/0x510 [f2fs] Code: 55 e7 f5 89 c0 48 0f af c3 48 8b 5d c0 48 c1 e8 20 83 c0 01 89 43 6c 48 83 c4 28 5b 41 5c 41 5d 41 5e 41 5f 5d c3 cc cc cc cc <0f> 0b f0 41 80 4f 48 04 45 85 f6 0f 84 ba fd ff ff e9 ef fe ff ff RSP: 0018:ffff977bc397b218 EFLAGS: 00010246 RAX: 00000000000027b9 RBX: 0000000000000000 RCX: 00000000000027c0 RDX: 0000000000000000 RSI: 00000000000027b9 RDI: ffff8c25ab4e74f8 RBP: ffff977bc397b268 R08: 00000000000027b9 R09: ffff8c29e4a34b40 R10: 0000000000000001 R11: ffff977bc397b0d8 R12: 0000000000000000 R13: ffff8c25b4dd81a0 R14: 0000000000000000 R15: ffff8c2f667f9000 FS: 0000000000000000(0000) GS:ffff8c344ec80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000c00055d000 CR3: 0000000e30810003 CR4: 00000000003706e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: allocate_segment_by_default+0x9c/0x110 [f2fs] f2fs_allocate_data_block+0x243/0xa30 [f2fs] ? __mod_lruvec_page_state+0xa0/0x150 do_write_page+0x80/0x160 [f2fs] f2fs_do_write_node_page+0x32/0x50 [f2fs] __write_node_page+0x339/0x730 [f2fs] f2fs_sync_node_pages+0x5a6/0x780 [f2fs] block_operations+0x257/0x340 [f2fs] f2fs_write_checkpoint+0x102/0x1050 [f2fs] f2fs_gc+0x27c/0x630 [f2fs] ? folio_mark_dirty+0x36/0x70 f2fs_balance_fs+0x16f/0x180 [f2fs] This patch adds checking whether free sections are enough before checkpoint during gc. Signed-off-by: Yonggil Song Signed-off-by: Yonggil Song Signed-off-by: Jaegeuk Kim Reviewed-by: Chao Yu --- fs/f2fs/gc.c | 10 ++++++++-- fs/f2fs/gc.h | 2 ++ fs/f2fs/segment.h | 27 ++++++++++++++++++++++----- 3 files changed, 32 insertions(+), 7 deletions(-) diff --git a/fs/f2fs/gc.c b/fs/f2fs/gc.c index 4546e01b2ee0..dd563866d3c9 100644 --- a/fs/f2fs/gc.c +++ b/fs/f2fs/gc.c @@ -1773,6 +1773,7 @@ int f2fs_gc(struct f2fs_sb_info *sbi, struct f2fs_gc_control *gc_control) .iroot = RADIX_TREE_INIT(gc_list.iroot, GFP_NOFS), }; unsigned int skipped_round = 0, round = 0; + unsigned int need_lower = 0, need_upper = 0; trace_f2fs_gc_begin(sbi->sb, gc_type, gc_control->no_bg_gc, gc_control->nr_free_secs, @@ -1858,8 +1859,13 @@ int f2fs_gc(struct f2fs_sb_info *sbi, struct f2fs_gc_control *gc_control) } } - /* Write checkpoint to reclaim prefree segments */ - if (free_sections(sbi) < NR_CURSEG_PERSIST_TYPE && + ret = get_need_secs(sbi, &need_lower, &need_upper); + + /* + * Write checkpoint to reclaim prefree segments. + * We need more three extra sections for writer's data/node/dentry. + */ + if (free_sections(sbi) <= need_upper + NR_GC_CHECKPOINT_SECS && prefree_segments(sbi)) { ret = f2fs_write_checkpoint(sbi, &cpc); if (ret) diff --git a/fs/f2fs/gc.h b/fs/f2fs/gc.h index 19b956c2d697..e81d22bf3772 100644 --- a/fs/f2fs/gc.h +++ b/fs/f2fs/gc.h @@ -30,6 +30,8 @@ /* Search max. number of dirty segments to select a victim segment */ #define DEF_MAX_VICTIM_SEARCH 4096 /* covers 8GB */ +#define NR_GC_CHECKPOINT_SECS (3) /* data/node/dentry sections */ + struct f2fs_gc_kthread { struct task_struct *f2fs_gc_task; wait_queue_head_t gc_wait_queue_head; diff --git a/fs/f2fs/segment.h b/fs/f2fs/segment.h index be8f2d7d007b..52a6d1ed4f24 100644 --- a/fs/f2fs/segment.h +++ b/fs/f2fs/segment.h @@ -605,8 +605,12 @@ static inline bool has_curseg_enough_space(struct f2fs_sb_info *sbi, return true; } -static inline bool has_not_enough_free_secs(struct f2fs_sb_info *sbi, - int freed, int needed) +/* + * calculate needed sections for dirty node/dentry + * and call has_curseg_enough_space + */ +static inline bool get_need_secs(struct f2fs_sb_info *sbi, + unsigned int *lower, unsigned int *upper) { unsigned int total_node_blocks = get_pages(sbi, F2FS_DIRTY_NODES) + get_pages(sbi, F2FS_DIRTY_DENTS) + @@ -616,20 +620,33 @@ static inline bool has_not_enough_free_secs(struct f2fs_sb_info *sbi, unsigned int dent_secs = total_dent_blocks / CAP_BLKS_PER_SEC(sbi); unsigned int node_blocks = total_node_blocks % CAP_BLKS_PER_SEC(sbi); unsigned int dent_blocks = total_dent_blocks % CAP_BLKS_PER_SEC(sbi); + + *lower = node_secs + dent_secs; + *upper = *lower + (node_blocks ? 1 : 0) + (dent_blocks ? 1 : 0); + + return !has_curseg_enough_space(sbi, node_blocks, dent_blocks); +} + +static inline bool has_not_enough_free_secs(struct f2fs_sb_info *sbi, + int freed, int needed) +{ unsigned int free, need_lower, need_upper; + bool curseg_enough; if (unlikely(is_sbi_flag_set(sbi, SBI_POR_DOING))) return false; + curseg_enough = get_need_secs(sbi, &need_lower, &need_upper); + free = free_sections(sbi) + freed; - need_lower = node_secs + dent_secs + reserved_sections(sbi) + needed; - need_upper = need_lower + (node_blocks ? 1 : 0) + (dent_blocks ? 1 : 0); + need_lower += (needed + reserved_sections(sbi)); + need_upper += (needed + reserved_sections(sbi)); if (free > need_upper) return false; else if (free <= need_lower) return true; - return !has_curseg_enough_space(sbi, node_blocks, dent_blocks); + return curseg_enough; } static inline bool f2fs_is_checkpoint_ready(struct f2fs_sb_info *sbi)