Message ID | 20240215042654.359210-4-eugen.hristev@collabora.com |
---|---|
State | New |
Headers |
Return-Path: <linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org> Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7300:b825:b0:106:860b:bbdd with SMTP id da37csp164571dyb; Wed, 14 Feb 2024 20:28:42 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCWCvDyBqZkBxSEcUjx6DoKML3otUfNFvH0tBIur73GakKlEym2vylF/E79VYS6vyJTUJhjW0qlrxoOAjfSnlS0yDYWEFw== X-Google-Smtp-Source: AGHT+IHde7UCeu9SUONdDbmwntWZvPgDIFG+skG1GBXoN1mOCDluUYQbwXwpKDgLZ4Ch663YH7eP X-Received: by 2002:ae9:e714:0:b0:787:35aa:77cb with SMTP id m20-20020ae9e714000000b0078735aa77cbmr572710qka.5.1707971322590; Wed, 14 Feb 2024 20:28:42 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707971322; cv=pass; d=google.com; s=arc-20160816; b=dbAa2YityGEy2gO97L+7YzXNM0LxJmI/QFd7u93L3Qwcn16ewcwxd8DHifvWEc8fKk RkjF07MKo+MZkqzPKjNCotsnIaEyhVUsDAwbdQDFik1gt43f5hgBzxaevQqrKVpVkOhp GUVTLvYGtMpiY9L3mvc7CFRTTQhxr0917MsV6Yr5zFNwamN4zctTRRILXZ39J/uhQI8F /PSo/xOlN48NVJHXZ1pDGI5O3jkGKXHQZkHW9e3zI3REiwlntxLKIYyspO7uj6FDTYBD rhkRptSATzKenWYDQ/lMEkt7RzYx9Y0X2ha2mfE8FQBSCRnjDPgvIqVqYm3vW/1Ns3Xp Rq4w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=Cy7z8H89MBnBLftUZQrp7nu413Jc4ar7/bv2lhOC8fs=; fh=zf0NNkRrVzzNLxoWnmq9qpFBuYVKEQmjRPQIjT6JsCY=; b=DTT8O7RFsULYSRjicf96pxNF1Rmo/Te+1vr+KY3GkwWjkUjFZSoUz0NOQqBl021+eB b/mXAh2U4GTB7DvowXGxIXv9GYzQMs4SHH32yYLgiVxzsU8cHzJGKClzlXHuDZzmRdLk s0PrUGkcspo7LfPgDG/lwp0Oduuej75OvgTMY1Ypuy2vyGPpUuoRG5+DNjnA6Ek1thv2 SR7/vziceJoz12l3/Ll+AavV95JCisUzSKyE9SKB6FUdY4dqXKrGPxWYwSkERYA6DIk2 TE6ttYoO6oGPW+mKaVM234vXgm/rrQyKvyKwAhhQxddZ7TjBWQQ84fhbI6Rg4W3/Xp+x pnJg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@collabora.com header.s=mail header.b=tMJWb7BM; arc=pass (i=1 spf=pass spfdomain=collabora.com dkim=pass dkdomain=collabora.com dmarc=pass fromdomain=collabora.com); spf=pass (google.com: domain of linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=collabora.com Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [2604:1380:45d1:ec00::1]) by mx.google.com with ESMTPS id x24-20020ae9f818000000b007872f05c78fsi669350qkh.60.2024.02.14.20.28.42 for <ouuuleilei@gmail.com> (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 14 Feb 2024 20:28:42 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@collabora.com header.s=mail header.b=tMJWb7BM; arc=pass (i=1 spf=pass spfdomain=collabora.com dkim=pass dkdomain=collabora.com dmarc=pass fromdomain=collabora.com); spf=pass (google.com: domain of linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-66287-ouuuleilei=gmail.com@vger.kernel.org"; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=collabora.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 206A31C231F3 for <ouuuleilei@gmail.com>; Thu, 15 Feb 2024 04:28:42 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3D703134DB; Thu, 15 Feb 2024 04:27:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="tMJWb7BM" Received: from madrid.collaboradmins.com (madrid.collaboradmins.com [46.235.227.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E4E8E134A0; Thu, 15 Feb 2024 04:27:29 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=46.235.227.194 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707971251; cv=none; b=O2vFfxa11yE+C/4vzARzP8H8hzL5rOyUhYB7hAvPy7udBTmYY0K9hd4sCC93sxQhVRaS8qWgw06MiczsnkiXGZiHu4vpdXxtMihOttkQL3gFiwM7i389s44yS78Kqvn5/1eNlw56QIzrG6qQTyXA3uVt0ZsywWU+2Qh0uvEdPC4= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707971251; c=relaxed/simple; bh=r5QM4nGPXD+IG/Bct8X4+GkfjZyg/HCZtSD4LIsBnEc=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=JuXzp/Gl0qtyN0UfClCDgKJuFCk+FJGa4ZiBQstiYV2+reBq743uQjoKZnkiT656CX4JNMFkBza/GRF/GIbzAjIq7ESZPVK8YZaW352qB2z0MX/KrBe8IZmyZmwsiXW4d2IIpob6LY5RhSohYVcmep/eG44kB7EmlZuUAjYiNrg= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=tMJWb7BM; arc=none smtp.client-ip=46.235.227.194 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1707971248; bh=r5QM4nGPXD+IG/Bct8X4+GkfjZyg/HCZtSD4LIsBnEc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=tMJWb7BMFdao+VV4nV9uZIBpFJ5phgAwsjo6d7Y6Ujgyw9ncKgrK5+Elp7PfNCZJT +vyg6DbjswL3ftJKtxcmiFaEG/S3TgvAyqX0tl2oY4SgjYa6WY+kdqgJkDyubv+Ns2 J7qjICakRpCVQ8zo5D2AHp7X5gftjEUNaVwtvLne3mBza5bi4eXJSJxE1cOdHUc/l5 SVVQ2edV72fT4N0yzkuGcva7B/UGf+Ud+HNqut1dqpb3V2mETmaSg5HSovzphhBDIk vZFr5w01A3haM29wPsPL1XruqbwZ5hOJOLIEZaxN4m9bkhDPXMPPRVYCqVvamw65CU x8pY1wVJrweVQ== Received: from eugen-station.. (cola.collaboradmins.com [195.201.22.229]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: ehristev) by madrid.collaboradmins.com (Postfix) with ESMTPSA id 891BE378208E; Thu, 15 Feb 2024 04:27:23 +0000 (UTC) From: Eugen Hristev <eugen.hristev@collabora.com> To: tytso@mit.edu, adilger.kernel@dilger.ca, linux-ext4@vger.kernel.org, jaegeuk@kernel.org, chao@kernel.org, linux-f2fs-devel@lists.sourceforge.net, linux-fsdevel@vger.kernel.org Cc: linux-kernel@vger.kernel.org, kernel@collabora.com, eugen.hristev@collabora.com, viro@zeniv.linux.org.uk, brauner@kernel.org, jack@suse.cz, krisman@suse.de, Gabriel Krisman Bertazi <krisman@collabora.com> Subject: [PATCH v10 3/8] libfs: Introduce case-insensitive string comparison helper Date: Thu, 15 Feb 2024 06:26:49 +0200 Message-Id: <20240215042654.359210-4-eugen.hristev@collabora.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240215042654.359210-1-eugen.hristev@collabora.com> References: <20240215042654.359210-1-eugen.hristev@collabora.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: <linux-kernel.vger.kernel.org> List-Subscribe: <mailto:linux-kernel+subscribe@vger.kernel.org> List-Unsubscribe: <mailto:linux-kernel+unsubscribe@vger.kernel.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1790937737448789672 X-GMAIL-MSGID: 1790937737448789672 |
Series |
[v10,1/8] ext4: Simplify the handling of cached insensitive names
|
|
Commit Message
Eugen Hristev
Feb. 15, 2024, 4:26 a.m. UTC
From: Gabriel Krisman Bertazi <krisman@collabora.com> generic_ci_match can be used by case-insensitive filesystems to compare strings under lookup with dirents in a case-insensitive way. This function is currently reimplemented by each filesystem supporting casefolding, so this reduces code duplication in filesystem-specific code. Signed-off-by: Gabriel Krisman Bertazi <krisman@collabora.com> [eugen.hristev@collabora.com: rework to first test the exact match] Signed-off-by: Eugen Hristev <eugen.hristev@collabora.com> --- fs/libfs.c | 80 ++++++++++++++++++++++++++++++++++++++++++++++ include/linux/fs.h | 4 +++ 2 files changed, 84 insertions(+)
Comments
Eugen Hristev <eugen.hristev@collabora.com> writes: > From: Gabriel Krisman Bertazi <krisman@collabora.com> > > generic_ci_match can be used by case-insensitive filesystems to compare > strings under lookup with dirents in a case-insensitive way. This > function is currently reimplemented by each filesystem supporting > casefolding, so this reduces code duplication in filesystem-specific > code. > > Signed-off-by: Gabriel Krisman Bertazi <krisman@collabora.com> > [eugen.hristev@collabora.com: rework to first test the exact match] > Signed-off-by: Eugen Hristev <eugen.hristev@collabora.com> > --- > fs/libfs.c | 80 ++++++++++++++++++++++++++++++++++++++++++++++ > include/linux/fs.h | 4 +++ > 2 files changed, 84 insertions(+) > > diff --git a/fs/libfs.c b/fs/libfs.c > index bb18884ff20e..82871fa1b066 100644 > --- a/fs/libfs.c > +++ b/fs/libfs.c > @@ -1773,6 +1773,86 @@ static const struct dentry_operations generic_ci_dentry_ops = { > .d_hash = generic_ci_d_hash, > .d_compare = generic_ci_d_compare, > }; > + > +/** > + * generic_ci_match() - Match a name (case-insensitively) with a dirent. > + * This is a filesystem helper for comparison with directory entries. > + * generic_ci_d_compare should be used in VFS' ->d_compare instead. > + * > + * @parent: Inode of the parent of the dirent under comparison > + * @name: name under lookup. > + * @folded_name: Optional pre-folded name under lookup > + * @de_name: Dirent name. > + * @de_name_len: dirent name length. > + * > + * Since this need a respin, mind dropping the extra empty line here? > + * Test whether a case-insensitive directory entry matches the filename > + * being searched. If @folded_name is provided, it is used instead of > + * recalculating the casefold of @name. > + * > + * Return: > 0 if the directory entry matches, 0 if it doesn't match, or > + * < 0 on error. > + */ > +int generic_ci_match(const struct inode *parent, > + const struct qstr *name, > + const struct qstr *folded_name, > + const u8 *de_name, u32 de_name_len) > +{ > + const struct super_block *sb = parent->i_sb; > + const struct unicode_map *um = sb->s_encoding; > + struct fscrypt_str decrypted_name = FSTR_INIT(NULL, de_name_len); > + struct qstr dirent = QSTR_INIT(de_name, de_name_len); > + int res; > + > + if (IS_ENCRYPTED(parent)) { > + const struct fscrypt_str encrypted_name = > + FSTR_INIT((u8 *) de_name, de_name_len); > + > + if (WARN_ON_ONCE(!fscrypt_has_encryption_key(parent))) > + return -EINVAL; > + > + decrypted_name.name = kmalloc(de_name_len, GFP_KERNEL); > + if (!decrypted_name.name) > + return -ENOMEM; > + res = fscrypt_fname_disk_to_usr(parent, 0, 0, &encrypted_name, > + &decrypted_name); > + if (res < 0) > + goto out; > + dirent.name = decrypted_name.name; > + dirent.len = decrypted_name.len; > + } > + > + /* > + * Attempt a case-sensitive match first. It is cheaper and > + * should cover most lookups, including all the sane > + * applications that expect a case-sensitive filesystem. > + * > + * This comparison is safe under RCU because the caller > + * guarantees the consistency between str and len. See > + * __d_lookup_rcu_op_compare() for details. > + */ This paragraph doesn't really make sense here. It is originally from the d_compare hook, which can be called under RCU, but there is no RCU here. Also, here we are comparing the dirent with the name-under-lookup, name which is already safe. > + if (folded_name->name) { > + if (dirent.len == folded_name->len && > + !memcmp(folded_name->name, dirent.name, dirent.len)) { > + res = 1; > + goto out; > + } > + res = !utf8_strncasecmp_folded(um, folded_name, &dirent); Hmm, second thought on this. This will ignore errors from utf8_strncasecmp*, which CAN happen for the first time here, if the dirent itself is corrupted on disk (exactly why we have patch 6). Yes, ext4_match will drop the error, but we want to propagate it from here, such that the warning on patch 6 can trigger. This is why I did that match dance on the original submission. Sorry for suggesting it. We really want to get the error from utf8 and propagate it if it is negative. basically: res > 0: match res == 0: no match. res < 0: propagate error and let the caller handle it > + } else { > + if (dirent.len == name->len && > + !memcmp(name->name, dirent.name, dirent.len) && > + (!sb_has_strict_encoding(sb) || !utf8_validate(um, name))) { > + res = 1; > + goto out; > + } > + res = !utf8_strncasecmp(um, name, &dirent); > + } > + > +out: > + kfree(decrypted_name.name); > + return res; > +} > +EXPORT_SYMBOL(generic_ci_match); > #endif > > #ifdef CONFIG_FS_ENCRYPTION > diff --git a/include/linux/fs.h b/include/linux/fs.h > index 820b93b2917f..7af691ff8d44 100644 > --- a/include/linux/fs.h > +++ b/include/linux/fs.h > @@ -3296,6 +3296,10 @@ extern int generic_file_fsync(struct file *, loff_t, loff_t, int); > extern int generic_check_addressable(unsigned, u64); > > extern void generic_set_encrypted_ci_d_ops(struct dentry *dentry); > +extern int generic_ci_match(const struct inode *parent, > + const struct qstr *name, > + const struct qstr *folded_name, > + const u8 *de_name, u32 de_name_len); > > static inline bool sb_has_encoding(const struct super_block *sb) > {
On 2/16/24 18:12, Gabriel Krisman Bertazi wrote: > Eugen Hristev <eugen.hristev@collabora.com> writes: > >> From: Gabriel Krisman Bertazi <krisman@collabora.com> >> >> generic_ci_match can be used by case-insensitive filesystems to compare >> strings under lookup with dirents in a case-insensitive way. This >> function is currently reimplemented by each filesystem supporting >> casefolding, so this reduces code duplication in filesystem-specific >> code. >> >> Signed-off-by: Gabriel Krisman Bertazi <krisman@collabora.com> >> [eugen.hristev@collabora.com: rework to first test the exact match] >> Signed-off-by: Eugen Hristev <eugen.hristev@collabora.com> >> --- >> fs/libfs.c | 80 ++++++++++++++++++++++++++++++++++++++++++++++ >> include/linux/fs.h | 4 +++ >> 2 files changed, 84 insertions(+) >> >> diff --git a/fs/libfs.c b/fs/libfs.c >> index bb18884ff20e..82871fa1b066 100644 >> --- a/fs/libfs.c >> +++ b/fs/libfs.c >> @@ -1773,6 +1773,86 @@ static const struct dentry_operations generic_ci_dentry_ops = { >> .d_hash = generic_ci_d_hash, >> .d_compare = generic_ci_d_compare, >> }; >> + >> +/** >> + * generic_ci_match() - Match a name (case-insensitively) with a dirent. >> + * This is a filesystem helper for comparison with directory entries. >> + * generic_ci_d_compare should be used in VFS' ->d_compare instead. >> + * >> + * @parent: Inode of the parent of the dirent under comparison >> + * @name: name under lookup. >> + * @folded_name: Optional pre-folded name under lookup >> + * @de_name: Dirent name. >> + * @de_name_len: dirent name length. >> + * >> + * > > Since this need a respin, mind dropping the extra empty line here? > >> + * Test whether a case-insensitive directory entry matches the filename >> + * being searched. If @folded_name is provided, it is used instead of >> + * recalculating the casefold of @name. >> + * >> + * Return: > 0 if the directory entry matches, 0 if it doesn't match, or >> + * < 0 on error. >> + */ >> +int generic_ci_match(const struct inode *parent, >> + const struct qstr *name, >> + const struct qstr *folded_name, >> + const u8 *de_name, u32 de_name_len) >> +{ >> + const struct super_block *sb = parent->i_sb; >> + const struct unicode_map *um = sb->s_encoding; >> + struct fscrypt_str decrypted_name = FSTR_INIT(NULL, de_name_len); >> + struct qstr dirent = QSTR_INIT(de_name, de_name_len); >> + int res; >> + >> + if (IS_ENCRYPTED(parent)) { >> + const struct fscrypt_str encrypted_name = >> + FSTR_INIT((u8 *) de_name, de_name_len); >> + >> + if (WARN_ON_ONCE(!fscrypt_has_encryption_key(parent))) >> + return -EINVAL; >> + >> + decrypted_name.name = kmalloc(de_name_len, GFP_KERNEL); >> + if (!decrypted_name.name) >> + return -ENOMEM; >> + res = fscrypt_fname_disk_to_usr(parent, 0, 0, &encrypted_name, >> + &decrypted_name); >> + if (res < 0) >> + goto out; >> + dirent.name = decrypted_name.name; >> + dirent.len = decrypted_name.len; >> + } >> + >> + /* >> + * Attempt a case-sensitive match first. It is cheaper and >> + * should cover most lookups, including all the sane >> + * applications that expect a case-sensitive filesystem. >> + * > > >> + * This comparison is safe under RCU because the caller >> + * guarantees the consistency between str and len. See >> + * __d_lookup_rcu_op_compare() for details. >> + */ > > This paragraph doesn't really make sense here. It is originally from > the d_compare hook, which can be called under RCU, but there is no RCU > here. Also, here we are comparing the dirent with the > name-under-lookup, name which is already safe. > > >> + if (folded_name->name) { >> + if (dirent.len == folded_name->len && >> + !memcmp(folded_name->name, dirent.name, dirent.len)) { >> + res = 1; >> + goto out; >> + } >> + res = !utf8_strncasecmp_folded(um, folded_name, &dirent); > > Hmm, second thought on this. This will ignore errors from utf8_strncasecmp*, > which CAN happen for the first time here, if the dirent itself is > corrupted on disk (exactly why we have patch 6). Yes, ext4_match will drop the > error, but we want to propagate it from here, such that the warning on > patch 6 can trigger. > > This is why I did that match dance on the original submission. Sorry > for suggesting it. We really want to get the error from utf8 and > propagate it if it is negative. basically: > > res > 0: match > res == 0: no match. > res < 0: propagate error and let the caller handle it In that case I will revert to the original v9 implementation and send a v11 to handle that. Eugen > > >> + } else { >> + if (dirent.len == name->len && >> + !memcmp(name->name, dirent.name, dirent.len) && >> + (!sb_has_strict_encoding(sb) || !utf8_validate(um, name))) { >> + res = 1; >> + goto out; >> + } >> + res = !utf8_strncasecmp(um, name, &dirent); >> + } >> + >> +out: >> + kfree(decrypted_name.name); >> + return res; >> +} >> +EXPORT_SYMBOL(generic_ci_match); >> #endif >> >> #ifdef CONFIG_FS_ENCRYPTION >> diff --git a/include/linux/fs.h b/include/linux/fs.h >> index 820b93b2917f..7af691ff8d44 100644 >> --- a/include/linux/fs.h >> +++ b/include/linux/fs.h >> @@ -3296,6 +3296,10 @@ extern int generic_file_fsync(struct file *, loff_t, loff_t, int); >> extern int generic_check_addressable(unsigned, u64); >> >> extern void generic_set_encrypted_ci_d_ops(struct dentry *dentry); >> +extern int generic_ci_match(const struct inode *parent, >> + const struct qstr *name, >> + const struct qstr *folded_name, >> + const u8 *de_name, u32 de_name_len); >> >> static inline bool sb_has_encoding(const struct super_block *sb) >> { >
Eugen Hristev <eugen.hristev@collabora.com> writes: > On 2/16/24 18:12, Gabriel Krisman Bertazi wrote: >> Eugen Hristev <eugen.hristev@collabora.com> writes: >> >>> From: Gabriel Krisman Bertazi <krisman@collabora.com> >>> >>> generic_ci_match can be used by case-insensitive filesystems to compare >>> strings under lookup with dirents in a case-insensitive way. This >>> function is currently reimplemented by each filesystem supporting >>> casefolding, so this reduces code duplication in filesystem-specific >>> code. >>> >>> Signed-off-by: Gabriel Krisman Bertazi <krisman@collabora.com> >>> [eugen.hristev@collabora.com: rework to first test the exact match] >>> Signed-off-by: Eugen Hristev <eugen.hristev@collabora.com> >>> --- >>> fs/libfs.c | 80 ++++++++++++++++++++++++++++++++++++++++++++++ >>> include/linux/fs.h | 4 +++ >>> 2 files changed, 84 insertions(+) >>> >>> diff --git a/fs/libfs.c b/fs/libfs.c >>> index bb18884ff20e..82871fa1b066 100644 >>> --- a/fs/libfs.c >>> +++ b/fs/libfs.c >>> @@ -1773,6 +1773,86 @@ static const struct dentry_operations generic_ci_dentry_ops = { >>> .d_hash = generic_ci_d_hash, >>> .d_compare = generic_ci_d_compare, >>> }; >>> + >>> +/** >>> + * generic_ci_match() - Match a name (case-insensitively) with a dirent. >>> + * This is a filesystem helper for comparison with directory entries. >>> + * generic_ci_d_compare should be used in VFS' ->d_compare instead. >>> + * >>> + * @parent: Inode of the parent of the dirent under comparison >>> + * @name: name under lookup. >>> + * @folded_name: Optional pre-folded name under lookup >>> + * @de_name: Dirent name. >>> + * @de_name_len: dirent name length. >>> + * >>> + * >> >> Since this need a respin, mind dropping the extra empty line here? >> >>> + * Test whether a case-insensitive directory entry matches the filename >>> + * being searched. If @folded_name is provided, it is used instead of >>> + * recalculating the casefold of @name. >>> + * >>> + * Return: > 0 if the directory entry matches, 0 if it doesn't match, or >>> + * < 0 on error. >>> + */ >>> +int generic_ci_match(const struct inode *parent, >>> + const struct qstr *name, >>> + const struct qstr *folded_name, >>> + const u8 *de_name, u32 de_name_len) >>> +{ >>> + const struct super_block *sb = parent->i_sb; >>> + const struct unicode_map *um = sb->s_encoding; >>> + struct fscrypt_str decrypted_name = FSTR_INIT(NULL, de_name_len); >>> + struct qstr dirent = QSTR_INIT(de_name, de_name_len); >>> + int res; >>> + >>> + if (IS_ENCRYPTED(parent)) { >>> + const struct fscrypt_str encrypted_name = >>> + FSTR_INIT((u8 *) de_name, de_name_len); >>> + >>> + if (WARN_ON_ONCE(!fscrypt_has_encryption_key(parent))) >>> + return -EINVAL; >>> + >>> + decrypted_name.name = kmalloc(de_name_len, GFP_KERNEL); >>> + if (!decrypted_name.name) >>> + return -ENOMEM; >>> + res = fscrypt_fname_disk_to_usr(parent, 0, 0, &encrypted_name, >>> + &decrypted_name); >>> + if (res < 0) >>> + goto out; >>> + dirent.name = decrypted_name.name; >>> + dirent.len = decrypted_name.len; >>> + } >>> + >>> + /* >>> + * Attempt a case-sensitive match first. It is cheaper and >>> + * should cover most lookups, including all the sane >>> + * applications that expect a case-sensitive filesystem. >>> + * >> >> >>> + * This comparison is safe under RCU because the caller >>> + * guarantees the consistency between str and len. See >>> + * __d_lookup_rcu_op_compare() for details. >>> + */ >> >> This paragraph doesn't really make sense here. It is originally from >> the d_compare hook, which can be called under RCU, but there is no RCU >> here. Also, here we are comparing the dirent with the >> name-under-lookup, name which is already safe. >> >> >>> + if (folded_name->name) { >>> + if (dirent.len == folded_name->len && >>> + !memcmp(folded_name->name, dirent.name, dirent.len)) { >>> + res = 1; >>> + goto out; >>> + } >>> + res = !utf8_strncasecmp_folded(um, folded_name, &dirent); >> >> Hmm, second thought on this. This will ignore errors from utf8_strncasecmp*, >> which CAN happen for the first time here, if the dirent itself is >> corrupted on disk (exactly why we have patch 6). Yes, ext4_match will drop the >> error, but we want to propagate it from here, such that the warning on >> patch 6 can trigger. >> >> This is why I did that match dance on the original submission. Sorry >> for suggesting it. We really want to get the error from utf8 and >> propagate it if it is negative. basically: >> >> res > 0: match >> res == 0: no match. >> res < 0: propagate error and let the caller handle it > > In that case I will revert to the original v9 implementation and send a v11 to > handle that. Please, note that the memcmp optimization is still valid. On match, we know the name is valid utf8. It is just a matter of propagating the error code from utf8 to the caller if we need to call it.
On 2/19/24 16:55, Gabriel Krisman Bertazi wrote: > Eugen Hristev <eugen.hristev@collabora.com> writes: > >> On 2/16/24 18:12, Gabriel Krisman Bertazi wrote: >>> Eugen Hristev <eugen.hristev@collabora.com> writes: >>> >>>> From: Gabriel Krisman Bertazi <krisman@collabora.com> >>>> >>>> generic_ci_match can be used by case-insensitive filesystems to compare >>>> strings under lookup with dirents in a case-insensitive way. This >>>> function is currently reimplemented by each filesystem supporting >>>> casefolding, so this reduces code duplication in filesystem-specific >>>> code. >>>> >>>> Signed-off-by: Gabriel Krisman Bertazi <krisman@collabora.com> >>>> [eugen.hristev@collabora.com: rework to first test the exact match] >>>> Signed-off-by: Eugen Hristev <eugen.hristev@collabora.com> >>>> --- >>>> fs/libfs.c | 80 ++++++++++++++++++++++++++++++++++++++++++++++ >>>> include/linux/fs.h | 4 +++ >>>> 2 files changed, 84 insertions(+) >>>> >>>> diff --git a/fs/libfs.c b/fs/libfs.c >>>> index bb18884ff20e..82871fa1b066 100644 >>>> --- a/fs/libfs.c >>>> +++ b/fs/libfs.c >>>> @@ -1773,6 +1773,86 @@ static const struct dentry_operations generic_ci_dentry_ops = { >>>> .d_hash = generic_ci_d_hash, >>>> .d_compare = generic_ci_d_compare, >>>> }; >>>> + >>>> +/** >>>> + * generic_ci_match() - Match a name (case-insensitively) with a dirent. >>>> + * This is a filesystem helper for comparison with directory entries. >>>> + * generic_ci_d_compare should be used in VFS' ->d_compare instead. >>>> + * >>>> + * @parent: Inode of the parent of the dirent under comparison >>>> + * @name: name under lookup. >>>> + * @folded_name: Optional pre-folded name under lookup >>>> + * @de_name: Dirent name. >>>> + * @de_name_len: dirent name length. >>>> + * >>>> + * >>> >>> Since this need a respin, mind dropping the extra empty line here? >>> >>>> + * Test whether a case-insensitive directory entry matches the filename >>>> + * being searched. If @folded_name is provided, it is used instead of >>>> + * recalculating the casefold of @name. >>>> + * >>>> + * Return: > 0 if the directory entry matches, 0 if it doesn't match, or >>>> + * < 0 on error. >>>> + */ >>>> +int generic_ci_match(const struct inode *parent, >>>> + const struct qstr *name, >>>> + const struct qstr *folded_name, >>>> + const u8 *de_name, u32 de_name_len) >>>> +{ >>>> + const struct super_block *sb = parent->i_sb; >>>> + const struct unicode_map *um = sb->s_encoding; >>>> + struct fscrypt_str decrypted_name = FSTR_INIT(NULL, de_name_len); >>>> + struct qstr dirent = QSTR_INIT(de_name, de_name_len); >>>> + int res; >>>> + >>>> + if (IS_ENCRYPTED(parent)) { >>>> + const struct fscrypt_str encrypted_name = >>>> + FSTR_INIT((u8 *) de_name, de_name_len); >>>> + >>>> + if (WARN_ON_ONCE(!fscrypt_has_encryption_key(parent))) >>>> + return -EINVAL; >>>> + >>>> + decrypted_name.name = kmalloc(de_name_len, GFP_KERNEL); >>>> + if (!decrypted_name.name) >>>> + return -ENOMEM; >>>> + res = fscrypt_fname_disk_to_usr(parent, 0, 0, &encrypted_name, >>>> + &decrypted_name); >>>> + if (res < 0) >>>> + goto out; >>>> + dirent.name = decrypted_name.name; >>>> + dirent.len = decrypted_name.len; >>>> + } >>>> + >>>> + /* >>>> + * Attempt a case-sensitive match first. It is cheaper and >>>> + * should cover most lookups, including all the sane >>>> + * applications that expect a case-sensitive filesystem. >>>> + * >>> >>> >>>> + * This comparison is safe under RCU because the caller >>>> + * guarantees the consistency between str and len. See >>>> + * __d_lookup_rcu_op_compare() for details. >>>> + */ >>> >>> This paragraph doesn't really make sense here. It is originally from >>> the d_compare hook, which can be called under RCU, but there is no RCU >>> here. Also, here we are comparing the dirent with the >>> name-under-lookup, name which is already safe. >>> >>> >>>> + if (folded_name->name) { >>>> + if (dirent.len == folded_name->len && >>>> + !memcmp(folded_name->name, dirent.name, dirent.len)) { >>>> + res = 1; >>>> + goto out; >>>> + } >>>> + res = !utf8_strncasecmp_folded(um, folded_name, &dirent); >>> >>> Hmm, second thought on this. This will ignore errors from utf8_strncasecmp*, >>> which CAN happen for the first time here, if the dirent itself is >>> corrupted on disk (exactly why we have patch 6). Yes, ext4_match will drop the >>> error, but we want to propagate it from here, such that the warning on >>> patch 6 can trigger. >>> >>> This is why I did that match dance on the original submission. Sorry >>> for suggesting it. We really want to get the error from utf8 and >>> propagate it if it is negative. basically: >>> >>> res > 0: match >>> res == 0: no match. >>> res < 0: propagate error and let the caller handle it >> >> In that case I will revert to the original v9 implementation and send a v11 to >> handle that. > > Please, note that the memcmp optimization is still valid. On match, we > know the name is valid utf8. It is just a matter of propagating the > error code from utf8 to the caller if we need to call it. > Okay, I am changing it. By the way, is this supposed to work like this on case-insensitive directories ? user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/*cuc ls: cannot access '/media/CI_dir/*cuc': No such file or directory user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/*CUC -rw-r--r-- 1 root root 0 Feb 12 17:47 /media/CI_dir/CUC user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/cuc -rw-r--r-- 1 root root 0 Feb 12 17:47 /media/CI_dir/cuc user@debian-rockchip-rock5b-rk3588:~$ basically wildcards don't work. Thanks, Eugen
Eugen Hristev <eugen.hristev@collabora.com> writes: > Okay, I am changing it. > > By the way, is this supposed to work like this on case-insensitive directories ? > > user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/*cuc > ls: cannot access '/media/CI_dir/*cuc': No such file or directory > user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/*CUC > -rw-r--r-- 1 root root 0 Feb 12 17:47 /media/CI_dir/CUC > user@debian-rockchip-rock5b-rk3588:~$ ls -la /media/CI_dir/cuc > -rw-r--r-- 1 root root 0 Feb 12 17:47 /media/CI_dir/cuc > user@debian-rockchip-rock5b-rk3588:~$ > > > basically wildcards don't work. Yes, at least from a kernel point of view. Your shell does wildcards in userspace, probably by doing getdents and then comparing with possible matches. Since the shell itself is not case-insensitive aware, its comparison is case-sensitive, and you get these apparent weird semantics. Not ideal from a user point of view. But not a kernel bug. If it pushes people away from using case-insensitive directories in their day-to-day work and leave it to only be used by Windows compatibility layers, maybe that's a win? :)
diff --git a/fs/libfs.c b/fs/libfs.c index bb18884ff20e..82871fa1b066 100644 --- a/fs/libfs.c +++ b/fs/libfs.c @@ -1773,6 +1773,86 @@ static const struct dentry_operations generic_ci_dentry_ops = { .d_hash = generic_ci_d_hash, .d_compare = generic_ci_d_compare, }; + +/** + * generic_ci_match() - Match a name (case-insensitively) with a dirent. + * This is a filesystem helper for comparison with directory entries. + * generic_ci_d_compare should be used in VFS' ->d_compare instead. + * + * @parent: Inode of the parent of the dirent under comparison + * @name: name under lookup. + * @folded_name: Optional pre-folded name under lookup + * @de_name: Dirent name. + * @de_name_len: dirent name length. + * + * + * Test whether a case-insensitive directory entry matches the filename + * being searched. If @folded_name is provided, it is used instead of + * recalculating the casefold of @name. + * + * Return: > 0 if the directory entry matches, 0 if it doesn't match, or + * < 0 on error. + */ +int generic_ci_match(const struct inode *parent, + const struct qstr *name, + const struct qstr *folded_name, + const u8 *de_name, u32 de_name_len) +{ + const struct super_block *sb = parent->i_sb; + const struct unicode_map *um = sb->s_encoding; + struct fscrypt_str decrypted_name = FSTR_INIT(NULL, de_name_len); + struct qstr dirent = QSTR_INIT(de_name, de_name_len); + int res; + + if (IS_ENCRYPTED(parent)) { + const struct fscrypt_str encrypted_name = + FSTR_INIT((u8 *) de_name, de_name_len); + + if (WARN_ON_ONCE(!fscrypt_has_encryption_key(parent))) + return -EINVAL; + + decrypted_name.name = kmalloc(de_name_len, GFP_KERNEL); + if (!decrypted_name.name) + return -ENOMEM; + res = fscrypt_fname_disk_to_usr(parent, 0, 0, &encrypted_name, + &decrypted_name); + if (res < 0) + goto out; + dirent.name = decrypted_name.name; + dirent.len = decrypted_name.len; + } + + /* + * Attempt a case-sensitive match first. It is cheaper and + * should cover most lookups, including all the sane + * applications that expect a case-sensitive filesystem. + * + * This comparison is safe under RCU because the caller + * guarantees the consistency between str and len. See + * __d_lookup_rcu_op_compare() for details. + */ + if (folded_name->name) { + if (dirent.len == folded_name->len && + !memcmp(folded_name->name, dirent.name, dirent.len)) { + res = 1; + goto out; + } + res = !utf8_strncasecmp_folded(um, folded_name, &dirent); + } else { + if (dirent.len == name->len && + !memcmp(name->name, dirent.name, dirent.len) && + (!sb_has_strict_encoding(sb) || !utf8_validate(um, name))) { + res = 1; + goto out; + } + res = !utf8_strncasecmp(um, name, &dirent); + } + +out: + kfree(decrypted_name.name); + return res; +} +EXPORT_SYMBOL(generic_ci_match); #endif #ifdef CONFIG_FS_ENCRYPTION diff --git a/include/linux/fs.h b/include/linux/fs.h index 820b93b2917f..7af691ff8d44 100644 --- a/include/linux/fs.h +++ b/include/linux/fs.h @@ -3296,6 +3296,10 @@ extern int generic_file_fsync(struct file *, loff_t, loff_t, int); extern int generic_check_addressable(unsigned, u64); extern void generic_set_encrypted_ci_d_ops(struct dentry *dentry); +extern int generic_ci_match(const struct inode *parent, + const struct qstr *name, + const struct qstr *folded_name, + const u8 *de_name, u32 de_name_len); static inline bool sb_has_encoding(const struct super_block *sb) {