From patchwork Fri Mar 17 17:28:58 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Etienne Carriere X-Patchwork-Id: 71376 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:604a:0:0:0:0:0 with SMTP id j10csp475128wrt; Fri, 17 Mar 2023 10:45:24 -0700 (PDT) X-Google-Smtp-Source: AK7set+oM23AvDjh7y6CTmW8eub3nRiRY+oxJMaYfTaPwYOiyBCpcVxR48IR/8ha40PgIiwq3jFn X-Received: by 2002:a05:6a00:b45:b0:5de:a362:ecf1 with SMTP id p5-20020a056a000b4500b005dea362ecf1mr12234942pfo.0.1679075124523; Fri, 17 Mar 2023 10:45:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1679075124; cv=none; d=google.com; s=arc-20160816; b=ZyZ1iyON3q2LhyRqopeipR5WL93NOfR3M716KEeD37dNKJn4gzshgbnCxS0ir1skMn VrAJ0EoHRmj+BoiHyp4l+xlkzwajhnKycDeWunVp6Qb7EyJ2/p2ov+qwcXtdL38BZgMq 9uuK0gbEtId0Z9WvmLMRhKeJDghShsceyKkqt3++uMf/I5Ig0i7c7/do6dhWOQRUKj8u zC6Je4bYazVsj+jS5LV9cTmmyIbGjtG8n31eiU5TdJfKCO2iqNQcw5W17M2Gb3Oi5jzw HIeauTgJQfM6gkCoKWyYVQfH7DVgL5KS9Ctwo1X0OU+mx2yzJz6XztZb0hzMdgj44oz+ dpkA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=0AHQcv/bratJAdxK3ULpQpAGRa2qj1qoNnym4PAT7wg=; b=WiAB9dkHPNgywrWKuAz0v8aX0nZ80+Yo4I/CWDT/dfGO2nCGPtjcs+D97fS9GRK8X+ gbHob243GGKFumOPtTUkU656XWGeFOE9eeCBPlu7IYTMU3dqdw6afG7H6xxpguXG5VAJ 4DQ5ZOhdb4bOnuMTe9KAmK499vprF3jjUL7icf+p92aNOs+reSAh0jgKpJZ9JQBXdeDH oQ/BhTVrpZh3+J8D1vNJp+Zq6hpYSr0m8DrjkrGjvHN488QMN408v+EWQjSVqroRrBAu ke28aAGelQhTllpV8l5BGV2PkMnv4icvJqRb6/C7vW9XeslaL0BmOvm5in9n4hnXCPLG 0VUw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=P3qYQwjq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id w10-20020a056a0014ca00b005a8cf0d93cbsi3345186pfu.3.2023.03.17.10.45.08; Fri, 17 Mar 2023 10:45:24 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=P3qYQwjq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229928AbjCQR3I (ORCPT + 99 others); Fri, 17 Mar 2023 13:29:08 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54782 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229755AbjCQR3G (ORCPT ); Fri, 17 Mar 2023 13:29:06 -0400 Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4F9622B2B3 for ; Fri, 17 Mar 2023 10:29:04 -0700 (PDT) Received: by mail-ed1-x52d.google.com with SMTP id cy23so23149909edb.12 for ; Fri, 17 Mar 2023 10:29:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1679074142; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=0AHQcv/bratJAdxK3ULpQpAGRa2qj1qoNnym4PAT7wg=; b=P3qYQwjqIxftAhCvTvD0PfzVuZbAnV1KT502bmSIGNe7xa2LYBVdAIZ2haJaEvTuKu TP7UNBCiUOTRJ5jtoG301JmImBSIt2E+IeheEhfAwxu61iX0juRxDtyTtjGAIL+9cfyI udICmfus/NO8ciGqdnS884e4V6ptcSDPtNvZ3QaonEchkgpiZIrsBNAukzKlYfuQAmUn ahc+OwR4F0mydiL01ZKE5z+O88DLpC9WK+yyLuA5ve1QnGamLhuoelO8RVm07oQbmPyq fUuoBuQ/g0Co5qulVsmPJfWvPsIFADwxL39qClHUqtBDNrqD8nu2Ct+fGzAb2m0KEfZy hytQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679074142; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=0AHQcv/bratJAdxK3ULpQpAGRa2qj1qoNnym4PAT7wg=; b=7v8FrYS81lQ56wCrF7ylTIH1VsiSn9xZPsKnTjeYdurs3FPfcXqOyrkL9ZrQxRQmT9 vqfqDrn+3RcAleQcLAK6hfhOxLL7H1+5obYKS+SFIm4WADIsfQ621oZNx3FY0W2OaHmW JTmIexHCILnUjMHXoOS3EDwhJhKhoYcoUXNooIUUISKBFw5loEBxATWdrE1LnMhwEyeP zAj1NsWnkRGZ+eKWABGexjr1xwNvvLTLIEt6QE4Q/v1U3YmGg8UVDIZigYmqLvzW+3Kr MORJeXI+O/D9DcnjKuFbPDp1U31m0JHbMzx4HcJ7n2ECE9gHeeW0hpBxkQamrxHxewpW 2RNg== X-Gm-Message-State: AO0yUKWa9+m+80UBLw2b6WeRa6N6NO32PVVbWgMQYCYBwNIxS6nM4n2Q B0xjSvsdRAysENvgK5GTlkPWzhknFrdSdmOgUwg= X-Received: by 2002:a17:906:17d3:b0:931:ed:e379 with SMTP id u19-20020a17090617d300b0093100ede379mr84845eje.67.1679074142534; Fri, 17 Mar 2023 10:29:02 -0700 (PDT) Received: from lmecxl1178.lme.st.com ([2a04:cec0:10af:6120:4312:7f15:6b35:a247]) by smtp.gmail.com with ESMTPSA id la18-20020a170907781200b00914001c91fcsm1200089ejc.86.2023.03.17.10.29.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 17 Mar 2023 10:29:02 -0700 (PDT) From: Etienne Carriere To: linux-kernel@vger.kernel.org Cc: linux-arm-kernel@lists.infradead.org, Sumit Garg , Krzysztof Kozlowski , Rob Herring , Jens Wiklander , Etienne Carriere Subject: [PATCH v5 1/2] dt-bindings: optee driver interrupt can be a per-cpu interrupt Date: Fri, 17 Mar 2023 18:28:58 +0100 Message-Id: <20230317172859.989650-1-etienne.carriere@linaro.org> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1760637877765609696?= X-GMAIL-MSGID: =?utf-8?q?1760637877765609696?= Explicit in optee firmware device tree bindings that the interrupt used by optee driver for async notification can be a peripheral interrupt or a per-cpu interrupt. Signed-off-by: Etienne Carriere Acked-by: Krzysztof Kozlowski --- No change since v4 Changes since v3: - Patch added in this v4 to address review comments. --- .../devicetree/bindings/arm/firmware/linaro,optee-tz.yaml | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/Documentation/devicetree/bindings/arm/firmware/linaro,optee-tz.yaml b/Documentation/devicetree/bindings/arm/firmware/linaro,optee-tz.yaml index d4dc0749f9fd..5d033570b57b 100644 --- a/Documentation/devicetree/bindings/arm/firmware/linaro,optee-tz.yaml +++ b/Documentation/devicetree/bindings/arm/firmware/linaro,optee-tz.yaml @@ -28,7 +28,8 @@ properties: maxItems: 1 description: | This interrupt which is used to signal an event by the secure world - software is expected to be edge-triggered. + software is expected to be either a per-cpu interrupt or an + edge-triggered peripheral interrupt. method: enum: [smc, hvc] From patchwork Fri Mar 17 17:28:59 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Etienne Carriere X-Patchwork-Id: 71374 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:604a:0:0:0:0:0 with SMTP id j10csp474177wrt; Fri, 17 Mar 2023 10:43:10 -0700 (PDT) X-Google-Smtp-Source: AK7set8fhEVpR+HM8I7jIW8vaoq4JURvfJDU+bHOa8dCobCJ0XTtuUqdTggA1HCbPtXypyKqg1gb X-Received: by 2002:a17:903:2c1:b0:1a0:7663:731b with SMTP id s1-20020a17090302c100b001a07663731bmr10783526plk.5.1679074990504; Fri, 17 Mar 2023 10:43:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1679074990; cv=none; d=google.com; s=arc-20160816; b=vK/Wr/ilVtmT1rRUmOfMcMVYqM1f3FpuI/OFzqhMnIgVwCTdfOP75hDUrkzOcSqgBf 1HIkofWG+8nzQ3PSQwui0EOSbLkiQQY+sAaVjK1HNVYMemqVuGvP89LtJWeXmwpeoEUr NgXtEzM5SxsDgCiVDIBHz4odgY5COd5A4sHhBh6dXxbkENuqivyYC5q9MVfjRbJOB2ic FxJjA90kIEK9v60+1oitL2CfrN4WUqEwUrQl23LjSRymgLOZr2SoMBTJCfdyPTzIZGns AXG4NBq8e8pt1Kq/q9Tr8ksQdhGOvT/teOPn7sftrtLptUtd64C24Izn6K3/mHfvAfcC ef7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=9RN/6059EmJ8uecEffZz5gMIvnjjePGQHRIIWUkBdNM=; b=aDzlpdbN73+NjMPMihHrPuTfOjbU36+LYuUCF28CUWtJ8g4twkOEiFTw60v/aCjwAN PiA/7XT8ucvCgVDVJmb63YHElW+iWl6zDmSrd3ivPbC9Rjk9DE7aS5v8pnXJ6jqskCHc UOwfCPVgxZL7TYmsyUAdLjkeysEf1Uu38IstDJvRIauPOmTD1oEhT7rN/HaE2CxnqeEs aLieqbruPOmYqOsdcam9jrsy2soMc0BpNpL0loyDo4h/X8kBurnfpKS0/aYxo269BRmU LZKVItb6KyzUNqw05bXQI7D/QIL5lsfiKVXMm98lAnij8ug8tBA/XM2+VjkQt0DDhj7n qN4g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b="Ut/RR2xA"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id iy6-20020a170903130600b0019f33cb669asi2704112plb.615.2023.03.17.10.42.57; Fri, 17 Mar 2023 10:43:10 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b="Ut/RR2xA"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230078AbjCQR3O (ORCPT + 99 others); Fri, 17 Mar 2023 13:29:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54858 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230071AbjCQR3K (ORCPT ); Fri, 17 Mar 2023 13:29:10 -0400 Received: from mail-ed1-x531.google.com (mail-ed1-x531.google.com [IPv6:2a00:1450:4864:20::531]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 04C92399FC for ; Fri, 17 Mar 2023 10:29:05 -0700 (PDT) Received: by mail-ed1-x531.google.com with SMTP id er8so11513871edb.0 for ; Fri, 17 Mar 2023 10:29:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1679074143; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=9RN/6059EmJ8uecEffZz5gMIvnjjePGQHRIIWUkBdNM=; b=Ut/RR2xA56vEYKrKuS7gEo2q7AVA0iFdxzfP2WAnh6Ag7Ja3e9TZZyuNBuXkY2/RaA bWYJAMWbSkEVCwpz0K6Or0TamzEPRMgnKA8NmsmgxUq3uBQk0P/h6FAl4SvTdAgqicb4 Tcx4OU8+A60lqCbJjZdCn6e8O3cIscx+VnzYYZyAn+/gD5tEPrs7xR0t5YUSrIFg/TIM WaKe/2CjwBdoxq+gCFwfFmmfWssB3hONH25pIKGz0dqbHD8iV5nsIIsPcMFoICPW4PEK cGBRSZFJY5HmHAt+hR5S2tzISVr/7xV3CEVeQZG1Dntr6fgV/HQ+GeCPIbCobPbfL4K9 PNEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679074143; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=9RN/6059EmJ8uecEffZz5gMIvnjjePGQHRIIWUkBdNM=; b=hnHLUz49MJ/GGO4+2zspCTpq0t6kZehgV8cide5d4vzOwPq8rKixpBXmMT1mAxP0Eo DkP37I2Px9DgF9H23PgydzQ1QDNn5XVBAnA0lpGWRJHKSxkwADyaCgyj6gSGiHBQ88pw y+IX8ZtqW674Xea4Grf80msYhjVvDHU0VFWYyi+/0t9EIZdASUEdxC3PGeJm/G3T4BES +eSMAomsqbECGNQTTF6JR5IqtQJ9/JvBIDNDtG2TcVVGzspxIJ8RuWBONiFTcYN6XJC5 IWHlM99HFR43hUVoRKZB8RD8KWF1FeuJocs70TXc1XSuFf/XbK8sCcUGTvYvFZqkNTNP FSgg== X-Gm-Message-State: AO0yUKXI78Q4zGlZyIBuhsID/m8LJzX2EEwOOCi9LNE0o5ZQ95nnN6rQ mLs5d4508BQm37oR3Hmh9x5ZQAXNRMv2plbQUjo= X-Received: by 2002:a17:906:849a:b0:931:cac0:60ec with SMTP id m26-20020a170906849a00b00931cac060ecmr114338ejx.48.1679074143629; Fri, 17 Mar 2023 10:29:03 -0700 (PDT) Received: from lmecxl1178.lme.st.com ([2a04:cec0:10af:6120:4312:7f15:6b35:a247]) by smtp.gmail.com with ESMTPSA id la18-20020a170907781200b00914001c91fcsm1200089ejc.86.2023.03.17.10.29.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 17 Mar 2023 10:29:03 -0700 (PDT) From: Etienne Carriere To: linux-kernel@vger.kernel.org Cc: linux-arm-kernel@lists.infradead.org, Sumit Garg , Krzysztof Kozlowski , Rob Herring , Jens Wiklander , Etienne Carriere , Marc Zyngier , Alexandre Torgue Subject: [PATCH v5 2/2] optee: add per cpu asynchronous notification Date: Fri, 17 Mar 2023 18:28:59 +0100 Message-Id: <20230317172859.989650-2-etienne.carriere@linaro.org> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230317172859.989650-1-etienne.carriere@linaro.org> References: <20230317172859.989650-1-etienne.carriere@linaro.org> MIME-Version: 1.0 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1760637736899078715?= X-GMAIL-MSGID: =?utf-8?q?1760637736899078715?= Implements use of per-cpu irq for optee asynchronous notification. Existing optee async notif implementation allows OP-TEE world to raise an interrupt on which Linux optee driver will query some pending events. This change allows the signaling interrupt to be a per-cpu interrupt as with Arm GIC PPIs. Using a PPI instead of an SPI is useful when no GIC lines are provisioned in the chip design and there are spare PPI lines. Cc: Jens Wiklander Cc: Sumit Garg Cc: Marc Zyngier Co-developed-by: Alexandre Torgue Signed-off-by: Alexandre Torgue Signed-off-by: Etienne Carriere --- Changes since v4: - Used cpuhp_setup_state()/cpuhp_remove_state() to enable/disable the per-cpu interrupt and let CPU hotplug also manage it. - Added a call to destroy_workqueue() that was missing in uninit_pcpu_irq(). - Rephrased commit message. Changes since v3: - Fixed typo in commit message. - Added few words in commit message about why we do this change. - Appended a 2nd commit to the series for request DT bindings update. Changes since v2: - Irq and per-cpu irq no more share the primary same handler function but have a common irq_handler() helper function. - Removed useless spinlocks. - Wrapped lines > 80 char. Changes since v1: - Fixed missing __percpu attribute reported by kernel test robot. - Rephrased commit message and added Cc tags. --- drivers/tee/optee/optee_private.h | 24 ++++++ drivers/tee/optee/smc_abi.c | 125 +++++++++++++++++++++++++++++- 2 files changed, 145 insertions(+), 4 deletions(-) diff --git a/drivers/tee/optee/optee_private.h b/drivers/tee/optee/optee_private.h index 04ae58892608..6129d43dd354 100644 --- a/drivers/tee/optee/optee_private.h +++ b/drivers/tee/optee/optee_private.h @@ -94,11 +94,35 @@ struct optee_supp { struct completion reqs_c; }; +/* + * struct optee_pcpu - per cpu notif private struct passed to work functions + * @optee optee device reference + */ +struct optee_pcpu { + struct optee *optee; +}; + +/* + * struct optee_smc - optee smc communication struct + * @invoke_fn handler function to invoke secure monitor + * @memremaped_shm virtual address of memory in shared memory pool + * @sec_caps: secure world capabilities defined by + * OPTEE_SMC_SEC_CAP_* in optee_smc.h + * @notif_irq interrupt used as async notification by OP-TEE or 0 + * @optee_pcpu per_cpu optee instance for per cpu work or NULL + * @notif_pcpu_wq workqueue for per cpu aynchronous notification or NULL + * @notif_pcpu_work work for per cpu asynchronous notification + * @notif_cpuhp_state CPU hotplug state assigned for pcpu interrupt management + */ struct optee_smc { optee_invoke_fn *invoke_fn; void *memremaped_shm; u32 sec_caps; unsigned int notif_irq; + struct optee_pcpu __percpu *optee_pcpu; + struct workqueue_struct *notif_pcpu_wq; + struct work_struct notif_pcpu_work; + unsigned int notif_cpuhp_state; }; /** diff --git a/drivers/tee/optee/smc_abi.c b/drivers/tee/optee/smc_abi.c index a1c1fa1a9c28..a2473fbe2461 100644 --- a/drivers/tee/optee/smc_abi.c +++ b/drivers/tee/optee/smc_abi.c @@ -52,6 +52,23 @@ */ #define OPTEE_MIN_STATIC_POOL_ALIGN 9 /* 512 bytes aligned */ +/* SMC ABI considers at most a single TEE firmware */ +static unsigned int pcpu_irq_num; + +static int optee_cpuhp_enable_pcpu_irq(unsigned int cpu) +{ + enable_percpu_irq(pcpu_irq_num, IRQ_TYPE_NONE); + + return 0; +} + +static int optee_cpuhp_disable_pcpu_irq(unsigned int cpu) +{ + disable_percpu_irq(pcpu_irq_num); + + return 0; +} + /* * 1. Convert between struct tee_param and struct optee_msg_param * @@ -991,9 +1008,8 @@ static u32 get_async_notif_value(optee_invoke_fn *invoke_fn, bool *value_valid, return res.a1; } -static irqreturn_t notif_irq_handler(int irq, void *dev_id) +static irqreturn_t irq_handler(struct optee *optee) { - struct optee *optee = dev_id; bool do_bottom_half = false; bool value_valid; bool value_pending; @@ -1016,6 +1032,13 @@ static irqreturn_t notif_irq_handler(int irq, void *dev_id) return IRQ_HANDLED; } +static irqreturn_t notif_irq_handler(int irq, void *dev_id) +{ + struct optee *optee = dev_id; + + return irq_handler(optee); +} + static irqreturn_t notif_irq_thread_fn(int irq, void *dev_id) { struct optee *optee = dev_id; @@ -1025,7 +1048,7 @@ static irqreturn_t notif_irq_thread_fn(int irq, void *dev_id) return IRQ_HANDLED; } -static int optee_smc_notif_init_irq(struct optee *optee, u_int irq) +static int init_irq(struct optee *optee, u_int irq) { int rc; @@ -1040,12 +1063,106 @@ static int optee_smc_notif_init_irq(struct optee *optee, u_int irq) return 0; } +static irqreturn_t notif_pcpu_irq_handler(int irq, void *dev_id) +{ + struct optee_pcpu __percpu *pcpu = (struct optee_pcpu *)dev_id; + struct optee *optee = pcpu->optee; + + if (irq_handler(optee) == IRQ_WAKE_THREAD) + queue_work(optee->smc.notif_pcpu_wq, + &optee->smc.notif_pcpu_work); + + return IRQ_HANDLED; +} + +static void notif_pcpu_irq_work_fn(struct work_struct *work) +{ + struct optee_smc *optee_smc = container_of(work, struct optee_smc, + notif_pcpu_work); + struct optee *optee = container_of(optee_smc, struct optee, smc); + + optee_smc_do_bottom_half(optee->ctx); +} + +static int init_pcpu_irq(struct optee *optee, u_int irq) +{ + struct optee_pcpu __percpu *optee_pcpu; + int cpu, rc; + + optee_pcpu = alloc_percpu(struct optee_pcpu); + if (!optee_pcpu) + return -ENOMEM; + + for_each_present_cpu(cpu) { + struct optee_pcpu __percpu *p = per_cpu_ptr(optee_pcpu, cpu); + + p->optee = optee; + } + + rc = request_percpu_irq(irq, notif_pcpu_irq_handler, + "optee_pcpu_notification", optee_pcpu); + if (rc) + goto err_free_pcpu; + + INIT_WORK(&optee->smc.notif_pcpu_work, notif_pcpu_irq_work_fn); + optee->smc.notif_pcpu_wq = create_workqueue("optee_pcpu_notification"); + if (!optee->smc.notif_pcpu_wq) { + rc = -EINVAL; + goto err_free_pcpu_irq; + } + + optee->smc.optee_pcpu = optee_pcpu; + optee->smc.notif_irq = irq; + + pcpu_irq_num = irq; + rc = cpuhp_setup_state(CPUHP_AP_ONLINE_DYN, "optee/pcpu-notif:starting", + optee_cpuhp_enable_pcpu_irq, + optee_cpuhp_disable_pcpu_irq); + if (!rc) + rc = -EINVAL; + if (rc < 0) + goto err_free_pcpu_irq; + + optee->smc.notif_cpuhp_state = rc; + + return 0; + +err_free_pcpu_irq: + free_percpu_irq(irq, optee_pcpu); +err_free_pcpu: + free_percpu(optee_pcpu); + + return rc; +} + +static int optee_smc_notif_init_irq(struct optee *optee, u_int irq) +{ + if (irq_is_percpu_devid(irq)) + return init_pcpu_irq(optee, irq); + else + return init_irq(optee, irq); +} + +static void uninit_pcpu_irq(struct optee *optee) +{ + cpuhp_remove_state(optee->smc.notif_cpuhp_state); + + destroy_workqueue(optee->smc.notif_pcpu_wq); + + free_percpu_irq(optee->smc.notif_irq, optee->smc.optee_pcpu); + free_percpu(optee->smc.optee_pcpu); +} + static void optee_smc_notif_uninit_irq(struct optee *optee) { if (optee->smc.sec_caps & OPTEE_SMC_SEC_CAP_ASYNC_NOTIF) { optee_smc_stop_async_notif(optee->ctx); if (optee->smc.notif_irq) { - free_irq(optee->smc.notif_irq, optee); + if (irq_is_percpu_devid(optee->smc.notif_irq)) + uninit_pcpu_irq(optee); + else + free_irq(optee->smc.notif_irq, optee); + irq_dispose_mapping(optee->smc.notif_irq); } }