From patchwork Tue Nov 28 07:38:37 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Li Wei X-Patchwork-Id: 170574 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:ce62:0:b0:403:3b70:6f57 with SMTP id o2csp3743491vqx; Mon, 27 Nov 2023 23:39:14 -0800 (PST) X-Google-Smtp-Source: AGHT+IGWK+hETMDLPJR2MHVWp/VPdZk1KIcZE6IsjzfGlTMHL42J/eOQczNG+ftDaGKICo9gBlq+ X-Received: by 2002:a0c:ec0f:0:b0:67a:225f:7722 with SMTP id y15-20020a0cec0f000000b0067a225f7722mr12546886qvo.51.1701157154226; Mon, 27 Nov 2023 23:39:14 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1701157154; cv=pass; d=google.com; s=arc-20160816; b=u/I9zn7vqY/FG/eYpzn8kkQconCKk7jkF+VNkuOJKZROBmFPJ+2vbueAPmzUbifcr9 Fp2s1ychQXeP5PtBuAmMMefQwaKQb/9sZZCJgDCsod1LQvewfwb4Pygr5uD61vdfJ2cv HVs1WON4kPWKk9Cmiwg2mFf/DCGno8S9rH8jJe5/DVzSYuw7pOV+r9TuuN/XN8R/kqCX UcQhKCJqGZdfOL/jVQlBlWnQjZb+6iM1IuHKaFy0Mx6f3vnAOj4oZ0tgwrrPU/3HbbDy ekYyci7F/45pdOBgzIid6GoQ22t1o/TXoqBRT8/2+5oE9e/okwxCEASXc0aAQdozKxoz m7dw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:arc-filter :dmarc-filter:delivered-to; bh=pJZmu2GS3May/v6HYs+9cca6XTeeVXNOhwEaffVrVMQ=; fh=qByQSPvg+/wD954+0Cj99cs2VLzuSy0bdUhDlHLuDa4=; b=yKWKX2DSzzk1mPmCO6U4sLoeSSNdkXWtJvTRWbkhfMXSdEcndN0NKH8lN1zPcol2tl n4r/aMO/9B4XmUPgew7FM/Tdbc6OHFkbrXOxzEKFI4PA2vTFSaortZwNpG/87b+HP0qo 8Dk4sB28u7oeSlFuiAjwf5S1juxtham+QSYmJN9FYUPqYa9qf8CAaYbz2IvMGnpQ5Emi K2S78Q5vZKkC/t9OXX32o6wMJktvfNmss17hCdS8dIgIALozCEUC3hgHmxfG2POJpr4U R2G6EJNtZ5JAxd4SDtZJjPDW6F+GwkjHPVSJwRQHtOiww2EsFau68EBhyfIJUIjvS5VK LloA== ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" Received: from server2.sourceware.org (server2.sourceware.org. [2620:52:3:1:0:246e:9693:128c]) by mx.google.com with ESMTPS id i2-20020a056214030200b0067a148bd432si8928109qvu.366.2023.11.27.23.39.14 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 27 Nov 2023 23:39:14 -0800 (PST) Received-SPF: pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) client-ip=2620:52:3:1:0:246e:9693:128c; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id D51553857BAA for ; Tue, 28 Nov 2023 07:39:13 +0000 (GMT) X-Original-To: gcc-patches@gcc.gnu.org Delivered-To: gcc-patches@gcc.gnu.org Received: from mail.loongson.cn (mail.loongson.cn [114.242.206.163]) by sourceware.org (Postfix) with ESMTP id 609D33858D38 for ; Tue, 28 Nov 2023 07:38:48 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 609D33858D38 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=loongson.cn Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=loongson.cn ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 609D33858D38 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=114.242.206.163 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1701157130; cv=none; b=AbIAzxNb24KagcEdfVNtvV5cKd6m042YdRWTHGNmXZ7ioSAEcvcf6nYVs1c+TkyhrWTEn2g1WX+qN3a/EgX1EiHMTWGfWlksnE4cIoASaQvw4SY+YnhzdZpwoHxwpL8vlBgWbocmEdtmuThUx96xMphROWeZH6oMacXfMkGwLRE= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1701157130; c=relaxed/simple; bh=GDTPsvZ5XixkQPLN4EYYZgW4GDAP12QaeKEA1EjhJls=; h=From:To:Subject:Date:Message-Id:MIME-Version; b=iK8jJSA11k5f98I3hCLMNhiE1cV/a57aWdSqTxvGTwWQI/iVQqHbOVTwn8g1YaoNFjpxi1tiDey7Cmfb+ZMEzc0Zl3tO2AsizDlcCef1bRgPmJVryznKWQRKR7tTpE4zdgcRddp+pf06kP4QMlPsXTycOxiv+BeX74oW+w3z+0A= ARC-Authentication-Results: i=1; server2.sourceware.org Received: from loongson.cn (unknown [10.2.6.5]) by gateway (Coremail) with SMTP id _____8BxHOsEmWVl_1g9AA--.52128S3; Tue, 28 Nov 2023 15:38:44 +0800 (CST) Received: from 5.5.5 (unknown [10.2.6.5]) by localhost.localdomain (Coremail) with SMTP id AQAAf8Dxvi8CmWVlXY9OAA--.42582S4; Tue, 28 Nov 2023 15:38:42 +0800 (CST) From: Li Wei To: gcc-patches@gcc.gnu.org Cc: xry111@xry111.site, i@xen0n.name, xuchenghua@loongson.cn, chenglulu@loongson.cn, Li Wei Subject: [PATCH v1 1/2] LoongArch: Accelerate optimization of scalar signed/unsigned popcount. Date: Tue, 28 Nov 2023 15:38:37 +0800 Message-Id: <20231128073837.2451935-1-liwei@loongson.cn> X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 X-CM-TRANSID: AQAAf8Dxvi8CmWVlXY9OAA--.42582S4 X-CM-SenderInfo: 5olzvxo6or00hjvr0hdfq/ X-Coremail-Antispam: 1Uk129KBj93XoWxXrWfCrWkKr43uFyUAr4rXrc_yoWrXF1xpw srAry5tF48JFZ7G3Z3Ka43Jw4Yqr4xCF47Zay3t34Ikw12q3sFq3W8try2qFW7Ja15WryS qw4ru3Wj93W2qabCm3ZEXasCq-sJn29KB7ZKAUJUUUUU529EdanIXcx71UUUUU7KY7ZEXa sCq-sGcSsGvfJ3Ic02F40EFcxC0VAKzVAqx4xG6I80ebIjqfuFe4nvWSU5nxnvy29KBjDU 0xBIdaVrnRJUUUkYb4IE77IF4wAFF20E14v26r1j6r4UM7CY07I20VC2zVCF04k26cxKx2 IYs7xG6rWj6s0DM7CIcVAFz4kK6r106r15M28lY4IEw2IIxxk0rwA2F7IY1VAKz4vEj48v e4kI8wA2z4x0Y4vE2Ix0cI8IcVAFwI0_Jr0_JF4l84ACjcxK6xIIjxv20xvEc7CjxVAFwI 0_Jr0_Gr1l84ACjcxK6I8E87Iv67AKxVWxJVW8Jr1l84ACjcxK6I8E87Iv6xkF7I0E14v2 6r4UJVWxJr1le2I262IYc4CY6c8Ij28IcVAaY2xG8wAqjxCEc2xF0cIa020Ex4CE44I27w Aqx4xG64xvF2IEw4CE5I8CrVC2j2WlYx0E2Ix0cI8IcVAFwI0_Jr0_Jr4lYx0Ex4A2jsIE 14v26r1j6r4UMcvjeVCFs4IE7xkEbVWUJVW8JwACjcxG0xvY0x0EwIxGrwCF04k20xvY0x 0EwIxGrwCFx2IqxVCFs4IE7xkEbVWUJVW8JwC20s026c02F40E14v26r1j6r18MI8I3I0E 7480Y4vE14v26r106r1rMI8E67AF67kF1VAFwI0_JF0_Jw1lIxkGc2Ij64vIr41lIxAIcV C0I7IYx2IY67AKxVWUJVWUCwCI42IY6xIIjxv20xvEc7CjxVAFwI0_Jr0_Gr1lIxAIcVCF 04k26cxKx2IYs7xG6r1j6r1xMIIF0xvEx4A2jsIE14v26r1j6r4UMIIF0xvEx4A2jsIEc7 CjxVAFwI0_Jr0_GrUvcSsGvfC2KfnxnUUI43ZEXa7IU8czVUUUUUU== X-Spam-Status: No, score=-13.5 required=5.0 tests=BAYES_00, GIT_PATCH_0, KAM_DMARC_STATUS, KAM_SHORT, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: gcc-patches@gcc.gnu.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Gcc-patches mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1783792563757153888 X-GMAIL-MSGID: 1783792563757153888 In LoongArch, the vector popcount has corresponding instructions, while the scalar does not. Currently, the scalar popcount is calculated through a loop, and the value of a non-power of two needs to be iterated several times, so the vector popcount instruction is considered for optimization. gcc/ChangeLog: * config/loongarch/loongarch.md (v2di): Used to simplify the following templates. (popcount2): New. gcc/testsuite/ChangeLog: * gcc.target/loongarch/popcnt.c: New test. * gcc.target/loongarch/popcount.c: New test. --- gcc/config/loongarch/loongarch.md | 27 +++++++++++- gcc/testsuite/gcc.target/loongarch/popcnt.c | 41 +++++++++++++++++++ gcc/testsuite/gcc.target/loongarch/popcount.c | 17 ++++++++ 3 files changed, 83 insertions(+), 2 deletions(-) create mode 100644 gcc/testsuite/gcc.target/loongarch/popcnt.c create mode 100644 gcc/testsuite/gcc.target/loongarch/popcount.c diff --git a/gcc/config/loongarch/loongarch.md b/gcc/config/loongarch/loongarch.md index cd4ed495697..c440d9c348f 100644 --- a/gcc/config/loongarch/loongarch.md +++ b/gcc/config/loongarch/loongarch.md @@ -1515,7 +1515,30 @@ (define_insn "truncdfsf2" (set_attr "cnv_mode" "D2S") (set_attr "mode" "SF")]) - +;; In vector registers, popcount can be implemented directly through +;; the vector instruction [X]VPCNT. For GP registers, we can implement +;; it through the following method. Compared with loop implementation +;; of popcount, the following method has better performance. + +;; This attribute used for get connection of scalar mode and corresponding +;; vector mode. +(define_mode_attr cntmap [(SI "v4si") (DI "v2di")]) + +(define_expand "popcount2" + [(set (match_operand:GPR 0 "register_operand") + (popcount:GPR (match_operand:GPR 1 "register_operand")))] + "ISA_HAS_LSX" +{ + rtx in = operands[1]; + rtx out = operands[0]; + rtx vreg = mode == SImode ? gen_reg_rtx (V4SImode) : + gen_reg_rtx (V2DImode); + emit_insn (gen_lsx_vinsgr2vr_ (vreg, in, vreg, GEN_INT (1))); + emit_insn (gen_popcount2 (vreg, vreg)); + emit_insn (gen_lsx_vpickve2gr_ (out, vreg, GEN_INT (0))); + DONE; +}) + ;; ;; .................... ;; @@ -3882,7 +3905,7 @@ (define_peephole2 (any_extend:SI (match_dup 3)))])] "") - + (define_mode_iterator QHSD [QI HI SI DI]) diff --git a/gcc/testsuite/gcc.target/loongarch/popcnt.c b/gcc/testsuite/gcc.target/loongarch/popcnt.c new file mode 100644 index 00000000000..a10fca42092 --- /dev/null +++ b/gcc/testsuite/gcc.target/loongarch/popcnt.c @@ -0,0 +1,41 @@ +/* { dg-do compile } */ +/* { dg-options "-O2 -mlsx" } */ +/* { dg-final { scan-assembler-not {popcount} } } */ +/* { dg-final { scan-assembler-times "vpcnt.d" 2 { target { loongarch64*-*-* } } } } */ +/* { dg-final { scan-assembler-times "vpcnt.w" 4 { target { loongarch64*-*-* } } } } */ + +int +foo (int x) +{ + return __builtin_popcount (x); +} + +long +foo1 (long x) +{ + return __builtin_popcountl (x); +} + +long long +foo2 (long long x) +{ + return __builtin_popcountll (x); +} + +int +foo3 (int *p) +{ + return __builtin_popcount (*p); +} + +unsigned +foo4 (int x) +{ + return __builtin_popcount (x); +} + +unsigned long +foo5 (int x) +{ + return __builtin_popcount (x); +} diff --git a/gcc/testsuite/gcc.target/loongarch/popcount.c b/gcc/testsuite/gcc.target/loongarch/popcount.c new file mode 100644 index 00000000000..390ff067617 --- /dev/null +++ b/gcc/testsuite/gcc.target/loongarch/popcount.c @@ -0,0 +1,17 @@ +/* { dg-do compile } */ +/* { dg-options "-O2 -mlsx -fdump-tree-optimized" } */ +/* { dg-final { scan-tree-dump-times "__builtin_popcount|\\.POPCOUNT" 1 "optimized" } } */ + +int +PopCount (long b) +{ + int c = 0; + + while (b) + { + b &= b - 1; + c++; + } + + return c; +} From patchwork Tue Nov 28 07:39:00 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Li Wei X-Patchwork-Id: 170575 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:ce62:0:b0:403:3b70:6f57 with SMTP id o2csp3743602vqx; Mon, 27 Nov 2023 23:39:31 -0800 (PST) X-Google-Smtp-Source: AGHT+IFh0QbyNMeDAMclIFDmU03Gp8XlfsZbaSnGMqYPkHwjA8a2h8oQC5bofR7WXpT334lV/9kn X-Received: by 2002:a05:6102:449:b0:462:e1ec:eaa8 with SMTP id e9-20020a056102044900b00462e1eceaa8mr12015540vsq.24.1701157171737; Mon, 27 Nov 2023 23:39:31 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1701157171; cv=pass; d=google.com; s=arc-20160816; b=MEpsFVDubvHIpeaVwnEor7kqB3ZnTZWrGdV0VmhIK9xmCBSR+ak2eoD8YXbvhLYBMl WvC1OKNNkEbj78Ku/EbG6zYIDHJC8WbbGqucxqGi8ymPr4gMt0AuRIPKRlZxp8nOJQeO oVkS6p5l5jNWNmBe09HaKDEsWCq6hKx4gPS4e7eH3N5uyPBpJldq/Z57xQq2mDLc4OH/ wILCkMN5RONOkbQg4IQz9KDVZmuTXbUBJdiXb6yyfAt0FISBYSnnkDUF+snbD5F0emb3 CVNuYTn7rkAXgvQhXP700uyhZJg93cjg7qat5QXU2B6KKWjTekHe8hGqH6t7O2CTGnTR V4dA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:arc-filter :dmarc-filter:delivered-to; bh=z31HiktIm+l8PIbJ9UK2TAxB6uO8VLcEFTGMOmX5onc=; fh=qByQSPvg+/wD954+0Cj99cs2VLzuSy0bdUhDlHLuDa4=; b=DAChRteMvxbeXp2ig1Z9UqAyyaKPqWrMNpeEkJbsVgbWxYSAlRAlda7Nnta+UMv99W MtrFP9NXxTUi4q6cTi6XTq6oiwgcvlo/hIEl2YDIHjU4J2fEjdYE7P9L/D2foPXdbo3i oQ3mCZfREAHoKdGXYQYkTJJj1FM7KsS0p/PKs9rloRiMUWpvyi4sztKYyRzosj5af91b FUekGxz1TJnUHl+S+WihoYH5KnEk7WjkOGOKmlgY5HBoo1WbymKJkZgGcKSLM5XAFDCh mtEKx9k8j1FDiQkVyYFUp1wF0aZYE3ALAZ2x8HfSqqZ/MZKRLavrCn30/IheRIFGXagp KPFQ== ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 8.43.85.97 as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" Received: from server2.sourceware.org (server2.sourceware.org. [8.43.85.97]) by mx.google.com with ESMTPS id h20-20020a0cf414000000b0067802f8cee0si10488769qvl.161.2023.11.27.23.39.31 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 27 Nov 2023 23:39:31 -0800 (PST) Received-SPF: pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 8.43.85.97 as permitted sender) client-ip=8.43.85.97; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 8.43.85.97 as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 803DB3858039 for ; Tue, 28 Nov 2023 07:39:31 +0000 (GMT) X-Original-To: gcc-patches@gcc.gnu.org Delivered-To: gcc-patches@gcc.gnu.org Received: from mail.loongson.cn (mail.loongson.cn [114.242.206.163]) by sourceware.org (Postfix) with ESMTP id EBE883857B9C for ; Tue, 28 Nov 2023 07:39:06 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org EBE883857B9C Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=loongson.cn Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=loongson.cn ARC-Filter: OpenARC Filter v1.0.0 sourceware.org EBE883857B9C Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=114.242.206.163 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1701157149; cv=none; b=ksJ1ltUW7BEcPEzUyTTpTM1iw/Gp50dVRye2ua6DaqwDnRSOpZi0NpBrbzZy9OcN8zF3lQrC54vzy3BRrti+rHeknNdjkaXrc2EUns/XOqEm7u3iIYGjMPCITZaH8tCLJFbkACQuNFDaFw+Wsmtw7G8/WFz8FbrSV1xQ+hKM/ek= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1701157149; c=relaxed/simple; bh=Df0QMT11FKo8UxlvkhbYdgW5fMdlY7j44HBMaSShERA=; h=From:To:Subject:Date:Message-Id:MIME-Version; b=i+IJG4eKxPOWaS8UtST4OKdCIbBwATtpp64JJ1/EIir6AYbR2bh4FU3ACWVUTxTM0jIJrxGe+JiTmyqxoEB1JRual+8sZOSJIx740nvFwFxxNN7lF0q+VugOwSNql0d6gHm2pfE/XkKZlwliapCQ4JaSedmtS2iEh9aKg1nE3u4= ARC-Authentication-Results: i=1; server2.sourceware.org Received: from loongson.cn (unknown [10.2.6.5]) by gateway (Coremail) with SMTP id _____8DxxPAYmWVlBFk9AA--.57640S3; Tue, 28 Nov 2023 15:39:04 +0800 (CST) Received: from 5.5.5 (unknown [10.2.6.5]) by localhost.localdomain (Coremail) with SMTP id AQAAf8DxiuQWmWVlao9OAA--.44106S4; Tue, 28 Nov 2023 15:39:02 +0800 (CST) From: Li Wei To: gcc-patches@gcc.gnu.org Cc: xry111@xry111.site, i@xen0n.name, xuchenghua@loongson.cn, chenglulu@loongson.cn, Li Wei Subject: [PATCH v1 2/2] LoongArch: Optimize vector constant extract-{even/odd} permutation. Date: Tue, 28 Nov 2023 15:39:00 +0800 Message-Id: <20231128073900.2452086-1-liwei@loongson.cn> X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 X-CM-TRANSID: AQAAf8DxiuQWmWVlao9OAA--.44106S4 X-CM-SenderInfo: 5olzvxo6or00hjvr0hdfq/ X-Coremail-Antispam: 1Uk129KBj93XoWxZr48Wr17GFy5tr1ktr1DArc_yoWrAw18pa y7ArnxKF48JFs3Gw48J3y5XrnxKrWxWr1avFnxKw1Sk347WryqqF1rtr9F9F1Uta1rWrn2 qw1Fk3WY9F42y3cCm3ZEXasCq-sJn29KB7ZKAUJUUUU8529EdanIXcx71UUUUU7KY7ZEXa sCq-sGcSsGvfJ3Ic02F40EFcxC0VAKzVAqx4xG6I80ebIjqfuFe4nvWSU5nxnvy29KBjDU 0xBIdaVrnRJUUUkYb4IE77IF4wAFF20E14v26r1j6r4UM7CY07I20VC2zVCF04k26cxKx2 IYs7xG6rWj6s0DM7CIcVAFz4kK6r1j6r18M28lY4IEw2IIxxk0rwA2F7IY1VAKz4vEj48v e4kI8wA2z4x0Y4vE2Ix0cI8IcVAFwI0_JFI_Gr1l84ACjcxK6xIIjxv20xvEc7CjxVAFwI 0_Jr0_Gr1l84ACjcxK6I8E87Iv67AKxVWxJVW8Jr1l84ACjcxK6I8E87Iv6xkF7I0E14v2 6r4UJVWxJr1le2I262IYc4CY6c8Ij28IcVAaY2xG8wAqjxCEc2xF0cIa020Ex4CE44I27w Aqx4xG64xvF2IEw4CE5I8CrVC2j2WlYx0E2Ix0cI8IcVAFwI0_Jrv_JF1lYx0Ex4A2jsIE 14v26r1j6r4UMcvjeVCFs4IE7xkEbVWUJVW8JwACjcxG0xvY0x0EwIxGrwCF04k20xvY0x 0EwIxGrwCFx2IqxVCFs4IE7xkEbVWUJVW8JwC20s026c02F40E14v26r1j6r18MI8I3I0E 7480Y4vE14v26r106r1rMI8E67AF67kF1VAFwI0_JF0_Jw1lIxkGc2Ij64vIr41lIxAIcV C0I7IYx2IY67AKxVWUJVWUCwCI42IY6xIIjxv20xvEc7CjxVAFwI0_Jr0_Gr1lIxAIcVCF 04k26cxKx2IYs7xG6r1j6r1xMIIF0xvEx4A2jsIE14v26r1j6r4UMIIF0xvEx4A2jsIEc7 CjxVAFwI0_Jr0_GrUvcSsGvfC2KfnxnUUI43ZEXa7IU1QVy3UUUUU== X-Spam-Status: No, score=-13.5 required=5.0 tests=BAYES_00, GIT_PATCH_0, KAM_DMARC_STATUS, KAM_SHORT, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: gcc-patches@gcc.gnu.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Gcc-patches mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1783792582547901454 X-GMAIL-MSGID: 1783792582547901454 For vector constant extract-{even/odd} permutation replace the default [x]vshuf instruction combination with [x]vilv{l/h} instruction, which can reduce instructions and improves performance. gcc/ChangeLog: * config/loongarch/loongarch.cc (loongarch_is_odd_extraction): Supplementary function prototype. (loongarch_is_even_extraction): Adjust. (loongarch_try_expand_lsx_vshuf_const): Adjust. (loongarch_is_extraction_permutation): Adjust. (loongarch_expand_vec_perm_const_2): Adjust. gcc/testsuite/ChangeLog: * gcc.target/loongarch/lasx-extract-even_odd-opt.c: New test. --- gcc/config/loongarch/loongarch.cc | 33 +++++++++++- .../loongarch/lasx-extract-even_odd-opt.c | 54 +++++++++++++++++++ 2 files changed, 85 insertions(+), 2 deletions(-) create mode 100644 gcc/testsuite/gcc.target/loongarch/lasx-extract-even_odd-opt.c diff --git a/gcc/config/loongarch/loongarch.cc b/gcc/config/loongarch/loongarch.cc index d3896d72bc2..f89c346815d 100644 --- a/gcc/config/loongarch/loongarch.cc +++ b/gcc/config/loongarch/loongarch.cc @@ -8672,6 +8672,12 @@ loongarch_expand_vec_perm (rtx target, rtx op0, rtx op1, rtx sel) } } +static bool +loongarch_is_odd_extraction (struct expand_vec_perm_d *); + +static bool +loongarch_is_even_extraction (struct expand_vec_perm_d *); + static bool loongarch_try_expand_lsx_vshuf_const (struct expand_vec_perm_d *d) { @@ -8694,6 +8700,24 @@ loongarch_try_expand_lsx_vshuf_const (struct expand_vec_perm_d *d) if (d->testing_p) return true; + /* If match extract-even and extract-odd permutations pattern, use + * vselect much better than vshuf. */ + if (loongarch_is_odd_extraction (d) + || loongarch_is_even_extraction (d)) + { + if (loongarch_expand_vselect_vconcat (d->target, d->op0, d->op1, + d->perm, d->nelt)) + return true; + + unsigned char perm2[MAX_VECT_LEN]; + for (i = 0; i < d->nelt; ++i) + perm2[i] = (d->perm[i] + d->nelt) & (2 * d->nelt - 1); + + if (loongarch_expand_vselect_vconcat (d->target, d->op1, d->op0, + perm2, d->nelt)) + return true; + } + for (i = 0; i < d->nelt; i += 1) { rperm[i] = GEN_INT (d->perm[i]); @@ -8878,7 +8902,7 @@ loongarch_is_even_extraction (struct expand_vec_perm_d *d) result = false; break; } - buf += 1; + buf += 2; } return result; @@ -8900,7 +8924,7 @@ loongarch_is_extraction_permutation (struct expand_vec_perm_d *d) result = false; break; } - buf += 2; + buf += 1; } return result; @@ -9377,6 +9401,11 @@ loongarch_expand_vec_perm_const_2 (struct expand_vec_perm_d *d) Selector after: { 1, 3, 1, 3 }. Even extraction selector sample: E_V4DImode, { 0, 2, 4, 6 } Selector after: { 0, 2, 0, 2 }. */ + + /* Better implement of extract-even and extract-odd permutations. */ + if (loongarch_expand_vec_perm_even_odd (d)) + return true; + for (i = 0; i < d->nelt / 2; i += 1) { idx = d->perm[i]; diff --git a/gcc/testsuite/gcc.target/loongarch/lasx-extract-even_odd-opt.c b/gcc/testsuite/gcc.target/loongarch/lasx-extract-even_odd-opt.c new file mode 100644 index 00000000000..515f0c8621a --- /dev/null +++ b/gcc/testsuite/gcc.target/loongarch/lasx-extract-even_odd-opt.c @@ -0,0 +1,54 @@ +/* { dg-do compile } */ +/* { dg-options "-O3 -mlasx" } */ +/* { dg-final { scan-assembler "xvilvl.d" } } */ +/* { dg-final { scan-assembler "xvilvh.d" } } */ + +#define CMUL(a, b, c) \ + { \ + (c).ai = (a).ai * (b).ai - (a).bi * (b).bi; \ + (c).bi = (a).ai * (b).bi + (a).bi * (b).ai; \ + (c).ci = (a).ci * (b).ci - (a).di * (b).di; \ + (c).di = (a).ci * (b).di + (a).di * (b).ci; \ + } +#define CSUM(a, b) \ + { \ + (a).ai += (b).ai; \ + (a).bi += (b).bi; \ + (a).ci += (b).ci; \ + (a).di += (b).di; \ + } + +typedef struct +{ + double ai; + double bi; + double ci; + double di; +} complex; + +typedef struct +{ + complex e[6][6]; +} matrix; + +typedef struct +{ + complex c[6]; +} vector; + +void +mult_adj_mat_vec (matrix *a, vector *b, vector *c) +{ + register int i, j; + register complex x, y; + for (i = 0; i < 6; i++) + { + x.ai = x.bi = x.ci = x.di = 0.0; + for (j = 0; j < 6; j++) + { + CMUL (a->e[j][i], b->c[j], y); + CSUM (x, y); + } + c->c[i] = x; + } +}