From patchwork Thu Feb 1 08:43:24 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "juzhe.zhong@rivai.ai" X-Patchwork-Id: 195202 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a05:7301:2719:b0:106:209c:c626 with SMTP id hl25csp10289dyb; Thu, 1 Feb 2024 00:45:21 -0800 (PST) X-Google-Smtp-Source: AGHT+IHAmjFp7R1Po0ed5e1jHtRF4CMCinDM8RFIRPy5VQrDAUIZQLiheHY9EHnSuuMNY6vJyWHb X-Received: by 2002:a05:6214:19cc:b0:68c:5cd7:a7b4 with SMTP id j12-20020a05621419cc00b0068c5cd7a7b4mr4421399qvc.14.1706777120905; Thu, 01 Feb 2024 00:45:20 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706777120; cv=pass; d=google.com; s=arc-20160816; b=Evf6k35Klvgm+MmEdJAO4/BLqwUrOQHuWhI1ZYeJkhZ0vosEYoNx45W/ENttKJkVEX Op/sn3XktaAMvqPhQ3IzkgskCWIvkXMH0RHurem+eGqROAVOtNDPfjBSep4y4pYKfAKQ zYeGili9aFeVcV+J6PRAb8wmQ3OkfSz8Nd9AEfm/RhYU6mKNEbHXUWTap/mhsrf5BUrE /OvYxHQEj70Fi76QazyjzhIZoszkB/sYSLa+/w6VfT59JHCmf1xNdIpUfrGUImbNf4S4 +Bch0LBroM9el74KKO0WPT+TrP34ZI5drb2A5VufLTe+daehuD527pcdjc4ZUrOMMPos hKuA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:feedback-id :content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:arc-filter:dmarc-filter:delivered-to; bh=9XVvLjoiywSVp9rAmRSHGCvn/p7q/YZbjcKwvFHFCp8=; fh=uihBZLcnNJ/QvDUL8aRQz7r5Up6BOB7Lh3+QqWE5y88=; b=EVI27oFerBJpLhKrbxDwfKrmMdFiscBKK9e8SBklKJNqV5NpUIXHTvxTg+tfdG9jE7 A7ieuW6yEqqAk2A2KFgJhHYtf9ulN5NilBvvy71EeOwoA0Z1dvrkXxFN/A6rnmGWBH1X eulKrw8DQGqZ1wlNTzQ9mV+XbdiEfhVX+lFlOrbHyygBUn17RUOIUlfkumYSC9Li3Lls nlLwBDBJaJMz97SrbbXcLg2IbazAkctP8TvQL8mFy1b3Gvc50AG3XdGAsIvD8ke3pw4U 3hj9Bq6n8PcfzXgGAmfkPZtQ89YcZn2deza0rAIcajnhCIU4VDpu7rMmTOjd0fXxb3hM E6rw==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" X-Forwarded-Encrypted: i=1; AJvYcCUYuC5uS2+tqITllLD1oL6S5ausRTC+bbJfM9GD4hNzfAEMjJT5u91ByNiQ1nOn8PP5ItDontyLg06SxstosIcsgf97Mw== Received: from server2.sourceware.org (server2.sourceware.org. [2620:52:3:1:0:246e:9693:128c]) by mx.google.com with ESMTPS id 4-20020a0562140d0400b0068c6fc0e647si2407014qvh.211.2024.02.01.00.45.20 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Feb 2024 00:45:20 -0800 (PST) Received-SPF: pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) client-ip=2620:52:3:1:0:246e:9693:128c; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org designates 2620:52:3:1:0:246e:9693:128c as permitted sender) smtp.mailfrom="gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org" Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 86F073858C3A for ; Thu, 1 Feb 2024 08:45:20 +0000 (GMT) X-Original-To: gcc-patches@gcc.gnu.org Delivered-To: gcc-patches@gcc.gnu.org Received: from smtpbguseast2.qq.com (smtpbguseast2.qq.com [54.204.34.130]) by sourceware.org (Postfix) with ESMTPS id A65F53858C20 for ; Thu, 1 Feb 2024 08:43:38 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org A65F53858C20 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=rivai.ai Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=rivai.ai ARC-Filter: OpenARC Filter v1.0.0 sourceware.org A65F53858C20 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=54.204.34.130 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1706777022; cv=none; b=GHujGQmDrjScF55CPTifU3lntZ1aaqQwszcVOySfKhnAHKQxKuMSzzmUR1dwZ8YfBMwpb6UP0Trj1nImyOXqhvzo8ZKjVwtw2Pd14hkBx1h0OuOguC3e9tP9e12YYjSYqRTG0dTPExDxelVQXF3tY+DXuC+koEaUWhfELLvW/Sw= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1706777022; c=relaxed/simple; bh=e9nIvUf2AnlJC0l02+sDQj/bT7XAsTM4acYEf/+pOEE=; h=From:To:Subject:Date:Message-Id:MIME-Version; b=fUWa6PTJOZi5Rl6m9zJpv1xA5qmFRErMDErHizX/5gkOrL89ruTzvaLwBM1FOCF4U4zLjZoc+OldEPil0Uu3lXX6ZUyB++97AYpHqy1nMeKDhnGIkniUoQMUJbECTGYFmrUbUbotkvE0DIfhnA25lLcREwOwc4xSFybfsSRWagA= ARC-Authentication-Results: i=1; server2.sourceware.org X-QQ-mid: bizesmtp73t1706777008tr9av9hy X-QQ-Originating-IP: O4Sx3lLqWuecLxgSeEFSUYRhODANRbWxnKNkDPm7Ny8= Received: from server1.localdomain ( [58.60.1.8]) by bizesmtp.qq.com (ESMTP) with id ; Thu, 01 Feb 2024 16:43:26 +0800 (CST) X-QQ-SSF: 01400000000000G0V000000A0000000 X-QQ-FEAT: +ynUkgUhZJnUmNrZO7baHbZ2sLn3W1MXE+6J5tO39ifFf6TP9VdIBzqVczNg6 YYp4DFNy1ntI/f3xMPjDuBNvhGowpy6N1dUuG/2FIPilg4EGAgs2XImXRH66oYYb1qapl8l 8+y7aKvH9/5kilkJSufsNk4Lvf7YyICSPxv6FYeJyMxIsQcNomeuAjUycSv9rvn2LcJhStI z63JalhRQrTqOUjz2NM6mIJnz99weYr9A+kPBp3JVRZzSNbT41OLpglbbKcYOuPtc/vbZrO cOh4E4dJ63hXqi1Gwn/wWMslGgs04Tcl47qg1bFgw9vX8PC+dKkL0MFeb9khkmRCOb4lFLB VsDibosoG6rFK8sHNyhYlYfo1xzoNFkeLI/foitzKfkkTygOKrVgUt3q+d3T5wTOvgOZPS2 Db2Zsph2osg= X-QQ-GoodBg: 2 X-BIZMAIL-ID: 4266870430224566103 From: Juzhe-Zhong To: gcc-patches@gcc.gnu.org Cc: kito.cheng@gmail.com, kito.cheng@sifive.com, jeffreyalaw@gmail.com, rdapp.gcc@gmail.com, Juzhe-Zhong Subject: [PATCH] RISC-V: Disable the vsetvl fusion for conflict successors Date: Thu, 1 Feb 2024 16:43:24 +0800 Message-Id: <20240201084324.335561-1-juzhe.zhong@rivai.ai> X-Mailer: git-send-email 2.36.1 MIME-Version: 1.0 X-QQ-SENDSIZE: 520 Feedback-ID: bizesmtp:rivai.ai:qybglogicsvrgz:qybglogicsvrgz7a-one-0 X-Spam-Status: No, score=-8.8 required=5.0 tests=BAYES_00, GIT_PATCH_0, KAM_DMARC_STATUS, KAM_SHORT, LIKELY_SPAM_BODY, RCVD_IN_BARRACUDACENTRAL, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL, SCC_5_SHORT_WORD_LINES, SPF_HELO_PASS, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: gcc-patches@gcc.gnu.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Gcc-patches mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: gcc-patches-bounces+ouuuleilei=gmail.com@gcc.gnu.org X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1789685526676708068 X-GMAIL-MSGID: 1789685526676708068 This patch fixes the following ineffective vsetvl insertion: #include "riscv_vector.h" void f (int32_t * restrict in, int32_t * restrict out, size_t n, size_t cond, size_t cond2) { for (size_t i = 0; i < n; i++) { if (i == cond) { vint8mf8_t v = *(vint8mf8_t*)(in + i + 100); *(vint8mf8_t*)(out + i + 100) = v; } else if (i == cond2) { vfloat32mf2_t v = *(vfloat32mf2_t*)(in + i + 200); *(vfloat32mf2_t*)(out + i + 200) = v; } else if (i == (cond2 - 1)) { vuint16mf2_t v = *(vuint16mf2_t*)(in + i + 300); *(vuint16mf2_t*)(out + i + 300) = v; } else { vint8mf4_t v = *(vint8mf4_t*)(in + i + 400); *(vint8mf4_t*)(out + i + 400) = v; } } } Before this patch: f: .LFB0: .cfi_startproc beq a2,zero,.L12 addi a7,a0,400 addi a6,a1,400 addi a0,a0,1600 addi a1,a1,1600 li a5,0 addi t6,a4,-1 vsetvli t3,zero,e8,mf8,ta,ma ---> ineffective uplift .L7: beq a3,a5,.L15 beq a4,a5,.L16 beq t6,a5,.L17 vsetvli t1,zero,e8,mf4,ta,ma vle8.v v1,0(a0) vse8.v v1,0(a1) vsetvli t3,zero,e8,mf8,ta,ma .L4: addi a5,a5,1 addi a7,a7,4 addi a6,a6,4 addi a0,a0,4 addi a1,a1,4 bne a2,a5,.L7 .L12: ret .L15: vle8.v v1,0(a7) vse8.v v1,0(a6) j .L4 .L17: vsetvli t1,zero,e8,mf4,ta,ma addi t5,a0,-400 addi t4,a1,-400 vle16.v v1,0(t5) vse16.v v1,0(t4) vsetvli t3,zero,e8,mf8,ta,ma j .L4 .L16: addi t5,a0,-800 addi t4,a1,-800 vle32.v v1,0(t5) vse32.v v1,0(t4) j .L4 It's obvious that we are hoisting the e8mf8 vsetvl to the top. It's ineffective since e8mf8 comes from low probability block which is if (i == cond). For this case, we disable such fusion. After this patch: f: beq a2,zero,.L12 addi a7,a0,400 addi a6,a1,400 addi a0,a0,1600 addi a1,a1,1600 li a5,0 addi t6,a4,-1 .L7: beq a3,a5,.L15 beq a4,a5,.L16 beq t6,a5,.L17 vsetvli t1,zero,e8,mf4,ta,ma vle8.v v1,0(a0) vse8.v v1,0(a1) .L4: addi a5,a5,1 addi a7,a7,4 addi a6,a6,4 addi a0,a0,4 addi a1,a1,4 bne a2,a5,.L7 .L12: ret .L15: vsetvli t3,zero,e8,mf8,ta,ma vle8.v v1,0(a7) vse8.v v1,0(a6) j .L4 .L17: addi t5,a0,-400 addi t4,a1,-400 vsetvli t1,zero,e8,mf4,ta,ma vle16.v v1,0(t5) vse16.v v1,0(t4) j .L4 .L16: addi t5,a0,-800 addi t4,a1,-800 vsetvli t3,zero,e32,mf2,ta,ma vle32.v v1,0(t5) vse32.v v1,0(t4) j .L4 Tested on both RV32/RV64 no regression. Ok for trunk ? PR target/113696 gcc/ChangeLog: * config/riscv/riscv-vsetvl.cc (pre_vsetvl::earliest_fuse_vsetvl_info): Suppress vsetvl fusion. gcc/testsuite/ChangeLog: * gcc.target/riscv/rvv/vsetvl/pr113696.c: New test. --- gcc/config/riscv/riscv-vsetvl.cc | 14 ++++++++++ .../gcc.target/riscv/rvv/vsetvl/pr113696.c | 26 +++++++++++++++++++ 2 files changed, 40 insertions(+) create mode 100644 gcc/testsuite/gcc.target/riscv/rvv/vsetvl/pr113696.c diff --git a/gcc/config/riscv/riscv-vsetvl.cc b/gcc/config/riscv/riscv-vsetvl.cc index cec862329c5..79fc2ec2401 100644 --- a/gcc/config/riscv/riscv-vsetvl.cc +++ b/gcc/config/riscv/riscv-vsetvl.cc @@ -2959,6 +2959,20 @@ pre_vsetvl::earliest_fuse_vsetvl_info (int iter) src_block_info.set_empty_info (); src_block_info.probability = profile_probability::uninitialized (); + /* See PR113696, we should reset immediate dominator to + empty since we may uplift ineffective vsetvl which + locate at low probability block. */ + basic_block dom + = get_immediate_dominator (CDI_DOMINATORS, eg->src); + auto &dom_block_info = get_block_info (dom); + if (dom_block_info.has_info () + && !m_dem.compatible_p ( + dom_block_info.get_exit_info (), curr_info)) + { + dom_block_info.set_empty_info (); + dom_block_info.probability + = profile_probability::uninitialized (); + } changed = true; } /* Choose the one with higher probability. */ diff --git a/gcc/testsuite/gcc.target/riscv/rvv/vsetvl/pr113696.c b/gcc/testsuite/gcc.target/riscv/rvv/vsetvl/pr113696.c new file mode 100644 index 00000000000..5d7c5f52ead --- /dev/null +++ b/gcc/testsuite/gcc.target/riscv/rvv/vsetvl/pr113696.c @@ -0,0 +1,26 @@ +/* { dg-do compile } */ +/* { dg-options "--param=riscv-autovec-preference=scalable -march=rv64gcv -mabi=lp64d -O3" } */ + +#include "riscv_vector.h" + +void f (int32_t * restrict in, int32_t * restrict out, size_t n, size_t cond, size_t cond2) +{ + for (size_t i = 0; i < n; i++) + { + if (i == cond) { + vint8mf8_t v = *(vint8mf8_t*)(in + i + 100); + *(vint8mf8_t*)(out + i + 100) = v; + } else if (i == cond2) { + vfloat32mf2_t v = *(vfloat32mf2_t*)(in + i + 200); + *(vfloat32mf2_t*)(out + i + 200) = v; + } else if (i == (cond2 - 1)) { + vuint16mf2_t v = *(vuint16mf2_t*)(in + i + 300); + *(vuint16mf2_t*)(out + i + 300) = v; + } else { + vint8mf4_t v = *(vint8mf4_t*)(in + i + 400); + *(vint8mf4_t*)(out + i + 400) = v; + } + } +} + +/* { dg-final { scan-assembler-times {vsetvli} 4 { target { no-opts "-O0" no-opts "-Os" no-opts "-Oz" no-opts "-funroll-loops" no-opts "-g" } } } } */