Message ID | 20230108192317.2988108-1-masahiroy@kernel.org |
---|---|
State | New |
Headers |
Return-Path: <linux-kernel-owner@vger.kernel.org> Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:4e01:0:0:0:0:0 with SMTP id p1csp1824814wrt; Sun, 8 Jan 2023 11:29:14 -0800 (PST) X-Google-Smtp-Source: AMrXdXvBxOyB0YDiobPkFAF/bgascA1JR5Xm7oh4ewgJmtIsVVpuSr4lfUamvxFgBGDwGKJKB2pi X-Received: by 2002:aa7:9568:0:b0:582:c719:c4c3 with SMTP id x8-20020aa79568000000b00582c719c4c3mr20181056pfq.1.1673206153786; Sun, 08 Jan 2023 11:29:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1673206153; cv=none; d=google.com; s=arc-20160816; b=R3Ahs2601KuKhVOTosYMB5zgAj/20vdjqNPqexahSZEB+4mVcGwMP5dnz0CPOfKRw8 3lXcIMi7LoLeww9oL06H4Sx/Tk8HJSxasBu0wJMn1W5w3IMznramkkPOsEdbDxKRoFJx zAE2yOcqbHDXcMajPpagKzjxn7dJP+EOnZIsJjWqWerflCozDtBDEpapgJNGmvxsy+1c xO5OZmJpxNUcTTG8O1l6qZcDmhtk/qmtkyKmP6EV843WT+1VStE2PPf80LSZk4EelTF/ yfe7eCSDMrzuYZYiazLY0OqvEzRu/ZKwMLYGAZG/jU/dFAEebDp7xVXHs3ra5PMJrW/h 9qEQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=qhvm2UPdxCbBYRxsVBmZVbGwCTh/ckjl0d3R+oHEWD4=; b=N2rcdXNSLicD9WyNM539EG4MnvdClBmRfxHF0KUENxGD6zlXw2qKfpAe5ef3Gppkq8 EfWsK6CYGMTvltkAEQZob+wzKNZBQg8YMZgWgMmVj+6WYVTD+cxvPFj6GAYCD31gdhTX CLFOlj3KEBhODyqZumPx6w6IWARcHnWQg1mHxivAZwgdjbRCxo44Zc1UsF50xKgciI0C Uuql8d3I1dhJhFzTHnfLq1RyFkp2KeprDskh/nWS1q5FfT9f9suicTiNqJW88F3wJ0Is wAcSt9Xp0RVE/2m/MYwFyor7HYrLim82/KRKnrfn+4BReEXOo6MOHrjL+DxBonU4nNqx A8+A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=Z3QiAklD; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id u4-20020a056a00158400b005752602f950si8101051pfk.208.2023.01.08.11.28.51; Sun, 08 Jan 2023 11:29:13 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=Z3QiAklD; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233365AbjAHTXc (ORCPT <rfc822;dolce.eric@gmail.com> + 99 others); Sun, 8 Jan 2023 14:23:32 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:45354 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229520AbjAHTX3 (ORCPT <rfc822;linux-kernel@vger.kernel.org>); Sun, 8 Jan 2023 14:23:29 -0500 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 9A39E32B; Sun, 8 Jan 2023 11:23:25 -0800 (PST) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 30BC460DBC; Sun, 8 Jan 2023 19:23:25 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 0DF40C433D2; Sun, 8 Jan 2023 19:23:22 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1673205804; bh=S/YzwT6FzIsQ1JpAEmE6HfkP5R0JUwVaQei8ou4tv+M=; h=From:To:Cc:Subject:Date:From; b=Z3QiAklDzI1EDoAzW7fLQ7NRxP8k9spAbJ8CCydGYBEMUNoU8SwLRzfrhikdSiUDV NWN66hRvCe8RLoMDjzNpj16V3uCAm3dYsN7rcOD0gkoB8JTrDFc39HWsZVrmYMAfRl HOV6QGHd0CJ+1D8ITeVrFHxGZqJaedS3qzgePFDqpReJ1yYr77AdrqqxkAV5anClyB tTxj+XezTchSjwk1pQqL8EB8E1vknFSkOU1SwXsiDNZFTEXV4c5aljfNohER13pM8a Ql5p183McoySRfbCLzA3DQ7mCwa9L/wnV0AggCXzJDJlU1RC0Qr2/OfJTBsiH51a1y nzuAgjK5lPxpQ== From: Masahiro Yamada <masahiroy@kernel.org> To: linux-kbuild@vger.kernel.org Cc: linux-kernel@vger.kernel.org, Masahiro Yamada <masahiroy@kernel.org>, Nathan Chancellor <nathan@kernel.org>, Nicolas Schier <nicolas@fjasle.eu>, Nick Desaulniers <ndesaulniers@google.com> Subject: [PATCH v3] kbuild: export top-level LDFLAGS_vmlinux only to scripts/Makefile.vmlinux Date: Mon, 9 Jan 2023 04:23:17 +0900 Message-Id: <20230108192317.2988108-1-masahiroy@kernel.org> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-7.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: <linux-kernel.vger.kernel.org> X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1754483816192364994?= X-GMAIL-MSGID: =?utf-8?q?1754483816192364994?= |
Series |
[v3] kbuild: export top-level LDFLAGS_vmlinux only to scripts/Makefile.vmlinux
|
|
Commit Message
Masahiro Yamada
Jan. 8, 2023, 7:23 p.m. UTC
Nathan Chancellor reports that $(NM) emits an error message when GNU Make 4.4 is used to build the ARM zImage. $ make-4.4 ARCH=arm CROSS_COMPILE=arm-linux-gnueabi- O=build defconfig zImage [snip] LD vmlinux NM System.map SORTTAB vmlinux OBJCOPY arch/arm/boot/Image Kernel: arch/arm/boot/Image is ready arm-linux-gnueabi-nm: 'arch/arm/boot/compressed/../../../../vmlinux': No such file /bin/sh: 1: arithmetic expression: expecting primary: " " LDS arch/arm/boot/compressed/vmlinux.lds AS arch/arm/boot/compressed/head.o GZIP arch/arm/boot/compressed/piggy_data AS arch/arm/boot/compressed/piggy.o CC arch/arm/boot/compressed/misc.o This occurs since GNU Make commit 98da874c4303 ("[SV 10593] Export variables to $(shell ...) commands"), and the O= option is needed to reproduce it. The generated zImage is correct despite the error message. As the commit description of 98da874c4303 [1] says, exported variables are passed down to $(shell ) functions, which means exported recursive variables might be expanded earlier than before, in the parse stage. The following test code demonstrates the change for GNU Make 4.4. [Test Makefile] $(shell echo hello > foo) export foo = $(shell cat bar/../foo) $(shell mkdir bar) all: @echo $(foo) [GNU Make 4.3] $ rm -rf bar; make-4.3 hello [GNU Make 4.4] $ rm -rf bar; make-4.4 cat: bar/../foo: No such file or directory hello The 'foo' is a resursively expanded (i.e. lazily expanded) variable. GNU Make 4.3 expands 'foo' just before running the recipe '@echo $(foo)', at this point, the directory 'bar' exists. GNU Make 4.4 expands 'foo' to evaluate $(shell mkdir bar) because it is exported. At this point, the directory 'bar' does not exit yet. The cat command cannot resolve the bar/../foo path, hence the error message. Let's get back to the kernel Makefile. In arch/arm/boot/compressed/Makefile, KBSS_SZ is referenced by LDFLAGS_vmlinux, which is recursive and also exported by the top Makefile. GNU Make 4.3 expands KBSS_SZ just before running the recipes, so no error message. GNU Make 4.4 expands KBSS_SZ in the parse stage, where the directory arm/arm/boot/compressed does not exit yet. When compiled with O=, the output directory is created by $(shell mkdir -p $(obj-dirs)) in scripts/Makefile.build. There are two ways to fix this particular issue: - change "$(obj)/../../../../vmlinux" in KBSS_SZ to "vmlinux" - unexport LDFLAGS_vmlinux This commit takes the latter course because it is what I originally intended. Commit 3ec8a5b33dea ("kbuild: do not export LDFLAGS_vmlinux") unexported LDFLAGS_vmlinux. Commit 5d4aeffbf709 ("kbuild: rebuild .vmlinux.export.o when its prerequisite is updated") accidentally exported it again. We can clean up arch/arm/boot/compressed/Makefile later. [1]: https://git.savannah.gnu.org/cgit/make.git/commit/?id=98da874c43035a490cdca81331724f233a3d0c9a Link: https://lore.kernel.org/all/Y7i8+EjwdnhHtlrr@dev-arch.thelio-3990X/ Fixes: 5d4aeffbf709 ("kbuild: rebuild .vmlinux.export.o when its prerequisite is updated") Reported-by: Nathan Chancellor <nathan@kernel.org> Signed-off-by: Masahiro Yamada <masahiroy@kernel.org> Reviewed-by: Nicolas Schier <nicolas@fjasle.eu> --- Changes in v3: - Minimize the scope of exporting. LDFLAGS_vmlinux is only exported to scripts/Makefile.vmlinux Changes in v2: - Postpone the change for arch/arm/boot/compressed/Makefile - Update the commit description Makefile | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-)
Comments
On Mon, Jan 09, 2023 at 04:23:17AM +0900, Masahiro Yamada wrote: > Nathan Chancellor reports that $(NM) emits an error message when > GNU Make 4.4 is used to build the ARM zImage. > > $ make-4.4 ARCH=arm CROSS_COMPILE=arm-linux-gnueabi- O=build defconfig zImage > [snip] > LD vmlinux > NM System.map > SORTTAB vmlinux > OBJCOPY arch/arm/boot/Image > Kernel: arch/arm/boot/Image is ready > arm-linux-gnueabi-nm: 'arch/arm/boot/compressed/../../../../vmlinux': No such file > /bin/sh: 1: arithmetic expression: expecting primary: " " > LDS arch/arm/boot/compressed/vmlinux.lds > AS arch/arm/boot/compressed/head.o > GZIP arch/arm/boot/compressed/piggy_data > AS arch/arm/boot/compressed/piggy.o > CC arch/arm/boot/compressed/misc.o > > This occurs since GNU Make commit 98da874c4303 ("[SV 10593] Export > variables to $(shell ...) commands"), and the O= option is needed to > reproduce it. The generated zImage is correct despite the error message. > > As the commit description of 98da874c4303 [1] says, exported variables > are passed down to $(shell ) functions, which means exported recursive > variables might be expanded earlier than before, in the parse stage. > > The following test code demonstrates the change for GNU Make 4.4. > > [Test Makefile] > > $(shell echo hello > foo) > export foo = $(shell cat bar/../foo) > $(shell mkdir bar) > > all: > @echo $(foo) > > [GNU Make 4.3] > > $ rm -rf bar; make-4.3 > hello > > [GNU Make 4.4] > > $ rm -rf bar; make-4.4 > cat: bar/../foo: No such file or directory > hello > > The 'foo' is a resursively expanded (i.e. lazily expanded) variable. > > GNU Make 4.3 expands 'foo' just before running the recipe '@echo $(foo)', > at this point, the directory 'bar' exists. > > GNU Make 4.4 expands 'foo' to evaluate $(shell mkdir bar) because it is > exported. At this point, the directory 'bar' does not exit yet. The cat > command cannot resolve the bar/../foo path, hence the error message. > > Let's get back to the kernel Makefile. > > In arch/arm/boot/compressed/Makefile, KBSS_SZ is referenced by > LDFLAGS_vmlinux, which is recursive and also exported by the top > Makefile. > > GNU Make 4.3 expands KBSS_SZ just before running the recipes, so no > error message. > > GNU Make 4.4 expands KBSS_SZ in the parse stage, where the directory > arm/arm/boot/compressed does not exit yet. When compiled with O=, > the output directory is created by $(shell mkdir -p $(obj-dirs)) > in scripts/Makefile.build. > > There are two ways to fix this particular issue: > > - change "$(obj)/../../../../vmlinux" in KBSS_SZ to "vmlinux" > - unexport LDFLAGS_vmlinux > > This commit takes the latter course because it is what I originally > intended. > > Commit 3ec8a5b33dea ("kbuild: do not export LDFLAGS_vmlinux") > unexported LDFLAGS_vmlinux. > > Commit 5d4aeffbf709 ("kbuild: rebuild .vmlinux.export.o when its > prerequisite is updated") accidentally exported it again. > > We can clean up arch/arm/boot/compressed/Makefile later. > > [1]: https://git.savannah.gnu.org/cgit/make.git/commit/?id=98da874c43035a490cdca81331724f233a3d0c9a > > Link: https://lore.kernel.org/all/Y7i8+EjwdnhHtlrr@dev-arch.thelio-3990X/ > Fixes: 5d4aeffbf709 ("kbuild: rebuild .vmlinux.export.o when its prerequisite is updated") > Reported-by: Nathan Chancellor <nathan@kernel.org> > Signed-off-by: Masahiro Yamada <masahiroy@kernel.org> > Reviewed-by: Nicolas Schier <nicolas@fjasle.eu> Tested-by: Nathan Chancellor <nathan@kernel.org> Thank you again for digging into this! > --- > > Changes in v3: > - Minimize the scope of exporting. > LDFLAGS_vmlinux is only exported to scripts/Makefile.vmlinux > > Changes in v2: > - Postpone the change for arch/arm/boot/compressed/Makefile > - Update the commit description > > Makefile | 14 +++++++++++++- > 1 file changed, 13 insertions(+), 1 deletion(-) > > diff --git a/Makefile b/Makefile > index dfba294ae790..9eed3e9b3657 100644 > --- a/Makefile > +++ b/Makefile > @@ -549,7 +549,7 @@ LDFLAGS_MODULE = > CFLAGS_KERNEL = > RUSTFLAGS_KERNEL = > AFLAGS_KERNEL = > -export LDFLAGS_vmlinux = > +LDFLAGS_vmlinux = > > # Use USERINCLUDE when you must reference the UAPI directories only. > USERINCLUDE := \ > @@ -1248,6 +1248,18 @@ vmlinux.o modules.builtin.modinfo modules.builtin: vmlinux_o > @: > > PHONY += vmlinux > +# LDFLAGS_vmlinux in the top Makefile defines linker flags for the top vmlinux, > +# not for decompressors. LDFLAGS_vmlinux in arch/*/boot/compressed/Makefile is > +# unrelated; the decompressors just happen to have the same base name, > +# arch/*/boot/compressed/vmlinux. > +# Export LDFLAGS_vmlinux only to scripts/Makefile.vmlinux. > +# > +# _LDFLAGS_vmlinux is an indirection to work around the bug: > +# https://savannah.gnu.org/bugs/?61463 > +# For Make > 4.4, the following simple code will work: > +# vmlinux: private export LDFLAGS_vmlinux := $(LDFLAGS_vmlinux) > +vmlinux: private _LDFLAGS_vmlinux := $(LDFLAGS_vmlinux) > +vmlinux: export LDFLAGS_vmlinux = $(_LDFLAGS_vmlinux) > vmlinux: vmlinux.o $(KBUILD_LDS) modpost > $(Q)$(MAKE) -f $(srctree)/scripts/Makefile.vmlinux > > -- > 2.34.1 >
diff --git a/Makefile b/Makefile index dfba294ae790..9eed3e9b3657 100644 --- a/Makefile +++ b/Makefile @@ -549,7 +549,7 @@ LDFLAGS_MODULE = CFLAGS_KERNEL = RUSTFLAGS_KERNEL = AFLAGS_KERNEL = -export LDFLAGS_vmlinux = +LDFLAGS_vmlinux = # Use USERINCLUDE when you must reference the UAPI directories only. USERINCLUDE := \ @@ -1248,6 +1248,18 @@ vmlinux.o modules.builtin.modinfo modules.builtin: vmlinux_o @: PHONY += vmlinux +# LDFLAGS_vmlinux in the top Makefile defines linker flags for the top vmlinux, +# not for decompressors. LDFLAGS_vmlinux in arch/*/boot/compressed/Makefile is +# unrelated; the decompressors just happen to have the same base name, +# arch/*/boot/compressed/vmlinux. +# Export LDFLAGS_vmlinux only to scripts/Makefile.vmlinux. +# +# _LDFLAGS_vmlinux is an indirection to work around the bug: +# https://savannah.gnu.org/bugs/?61463 +# For Make > 4.4, the following simple code will work: +# vmlinux: private export LDFLAGS_vmlinux := $(LDFLAGS_vmlinux) +vmlinux: private _LDFLAGS_vmlinux := $(LDFLAGS_vmlinux) +vmlinux: export LDFLAGS_vmlinux = $(_LDFLAGS_vmlinux) vmlinux: vmlinux.o $(KBUILD_LDS) modpost $(Q)$(MAKE) -f $(srctree)/scripts/Makefile.vmlinux