From patchwork Tue Nov 1 10:04:44 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Hsia-Jun Li X-Patchwork-Id: 961 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:6687:0:0:0:0:0 with SMTP id l7csp2867351wru; Tue, 1 Nov 2022 03:24:40 -0700 (PDT) X-Google-Smtp-Source: AMsMyM70BWjs+d5EevtVTpxA+p2UIlFTcLCCKpldY945NexQSV8E349wIeQS9I8U1Y3+nZCxDcxW X-Received: by 2002:a63:ff06:0:b0:46f:75bc:8415 with SMTP id k6-20020a63ff06000000b0046f75bc8415mr16170626pgi.487.1667298280239; Tue, 01 Nov 2022 03:24:40 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1667298280; cv=pass; d=google.com; s=arc-20160816; b=Uzy22tO+CHrmwzRE60Hx3W1neiuEzVyKlBCMp1nSPQ8pfiVvL1SbFbuvU5ceYnMoOm C6nq9uRIwasuW5Vrxl0JGd4oMnq312+jeGDd0rW0fsawxNRgjCpua4uy8Ig4aAnryfXA QILbT7qzdFgfD742+fjvrgfTxjHN7kboYR/Nzop+iWkPhiYIqJ6iCUwfEctyGMNUcAV5 gV5h7J7/H9M5sUI+luGiTVntd/n3j1EAQon9aDZ3IgUqE1hYYSe0UXWrNpvZlxAEzRTT bn4+5keKT1JnDJWsewIQsSBgVmSDGRgrW7O8Su1MkcBytdjN+wnYZBfBeJMTcpYjE8zr bDBg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:content-transfer-encoding :message-id:date:subject:cc:to:from:dkim-signature; bh=0+GatoSjycqbXjqB9SME82V0EHpo8AghMtUfzP87ano=; b=LTyUjTF2RSXR+yfO17layuFuI56w4LhcEo1NCbpWqndbNS1aH3ajnWg1inrnjpINPu Hm2lkEF6aNdvlrOP13HKuRXIQLBr/F5H45Z0K/defhrWWEyXli9n+nNMb9Scdd54jjML kDaZRcqtwKeLXqsGcjXWhLVhYxmzsXtqEcqyuoL8ewrXf6ocNP/ju/qXmgNx95MhJF0w wMA4xZo3d1ELAkYzs9fnj03eWQmshMN/54nQeYW/3cRncmm94jwW/XYkDoJEXlYVfj1E v/+E7EJwbh/h+FsQ5ydT354T4sQyyD9Qx/dUStJxKz1yKSnGJ9xD1wbPAPgVz6G59YgV Objg== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Synaptics.onmicrosoft.com header.s=selector2-Synaptics-onmicrosoft-com header.b=EiBX8hri; arc=pass (i=1 spf=pass spfdomain=synaptics.com dkim=pass dkdomain=synaptics.com dmarc=pass fromdomain=synaptics.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=synaptics.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id b10-20020a631b4a000000b0043941763eadsi13178459pgm.835.2022.11.01.03.24.26; Tue, 01 Nov 2022 03:24:40 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@Synaptics.onmicrosoft.com header.s=selector2-Synaptics-onmicrosoft-com header.b=EiBX8hri; arc=pass (i=1 spf=pass spfdomain=synaptics.com dkim=pass dkdomain=synaptics.com dmarc=pass fromdomain=synaptics.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=synaptics.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229928AbiKAKFm (ORCPT + 99 others); Tue, 1 Nov 2022 06:05:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38888 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229487AbiKAKFk (ORCPT ); Tue, 1 Nov 2022 06:05:40 -0400 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on2072.outbound.protection.outlook.com [40.107.93.72]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D09DA2626; Tue, 1 Nov 2022 03:05:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=I4fNHAFjeA42Ft69RMMYFNwWqi+xIl790k9Wc7/D6ZA+Nqq2kSAkNyL288TBQrsF3J2KNUNQPhxKLkw5O7FxVBSZN10Kt3gOUwWfP8BenWkR4ZR8iHdHJGrlnNccCekmHpNan94sS8UJ/y1jAa4FYmdBJoUwMdRdLSwKzS27nw2xxYamJNyvTHI+lzNsRD77ahJxc6B/1xGP8U/xM/ovtWwQ4hAbqJJ01QDNIkPDSIplWLhQzEhLpSnfhzgMiZRzX1wIeFFvSqpwx2G1cLaOMRCklxx8lxKRNm9gkDwsFTD9aKl6dFLI/je8lUzIsiI3DwaWJFdsjpflbuioUqWWYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=0+GatoSjycqbXjqB9SME82V0EHpo8AghMtUfzP87ano=; b=dgtBjYVh5M9dp9QmsPWhYB7HzKlS0XR7qU84eUaKdJFfSQQi+jAIyPfjeCvJ2evJ1D2T9DXmiEBSHFJNdZxDzK8+qhamZfvVf2xZj17cEw4Siby0v5bYs+zEpMcEcKuKMqYJaMbErFnMWdz+FL5KKJV4J+MlBPmeyIt+u3VTKyDjYtf9yF4qh20g7KqGsSkopBq3Wome93TkQcWteQeWOXBlnCOXvv9Yceb3/Sm1UVvojG/HyFcyiblO9MrCV9HqEAsy3lcGgpwVTdimb591Iqwxa366NDPJvjhJwn8MFg4I/6Udezh/9nGiiJR+1mjzAzAnzQrYJoqSlZ2iwhxizw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=synaptics.com; dmarc=pass action=none header.from=synaptics.com; dkim=pass header.d=synaptics.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Synaptics.onmicrosoft.com; s=selector2-Synaptics-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0+GatoSjycqbXjqB9SME82V0EHpo8AghMtUfzP87ano=; b=EiBX8hri493/oBGMQi7sskjLw15XKLZXq3eVC/BvsiAeT0SWEklKXqgX6KbtBcZolDFDGHEx6MI6FbuWqwLLrW56oSaSoD7i7si2KOV24ZbuQkzzymIRZE0X/qdloTZdLHq5Zx6l0+u5J29CVJzfSWekKicrcel2/HJCr9T7KDU= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=synaptics.com; Received: from DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) by MW4PR03MB6362.namprd03.prod.outlook.com (2603:10b6:303:11d::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5769.19; Tue, 1 Nov 2022 10:05:35 +0000 Received: from DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1]) by DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1%7]) with mapi id 15.20.5769.021; Tue, 1 Nov 2022 10:05:34 +0000 From: Hsia-Jun Li To: dri-devel@lists.freedesktop.org Cc: airlied@linux.ie, daniel@ffwll.ch, ezequiel@vanguardiasur.com.ar, helen.koike@collabora.com, hverkuil-cisco@xs4all.nl, jszhang@kernel.org, laurent.pinchart@ideasonboard.com, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-media@vger.kernel.org, maarten.lankhorst@linux.intel.com, mchehab@kernel.org, mripard@kernel.org, nicolas@ndufresne.ca, ribalda@chromium.org, sakari.ailus@linux.intel.com, sebastian.hesselbarth@gmail.com, tfiga@chromium.org, tzimmermann@suse.de, "Hsia-Jun(Randy) Li" Subject: [PATCH v3 0/4] Add pixel formats used in Synatpics SoC Date: Tue, 1 Nov 2022 18:04:44 +0800 Message-Id: <20221101100448.66712-1-randy.li@synaptics.com> X-Mailer: git-send-email 2.37.3 X-ClientProxiedBy: PH0PR07CA0027.namprd07.prod.outlook.com (2603:10b6:510:5::32) To DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6PR03MB5196:EE_|MW4PR03MB6362:EE_ X-MS-Office365-Filtering-Correlation-Id: d15f44b2-6ec6-47c8-f1b0-08dabbf09e00 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: gYhT6XY4bwzc8UWyGlk+0wPFON6KuiDGI6Vq1CTeH0/2OSQlZDrG8Y1Jrn3+Gdn7ISjIIx67x42Tp7b/LXt5Epk1EavxogHnK3noiPZV5AJ45KHqPWLAI5gaiD8DRyAOx0Hbn4rdumw2tw8Z7gmzDQcvd/QzDh2BGZJq+f1Kc6qy6CCOwnO8pCEmSRJvllhlYi9ewtb1UQQl3gLvNWyzKk+yvHkksz1/IIiKj5Px1TbkSYAwzohMMg2rn+MiYlbB19S6Z26seTvtDO3PE8ZO3NUmaLXRs3H0z2fL6xUycc0VPj+sbaQV9xW6tZ23I5ftHnYW2Tyn1GrLa7PAivD6ZJNKCyrqHRhbMgZ561LCpVpmpKKUF3j+B6zZZmFOF4l+m9qnhcYxyaeyqIR21Xga7YWh0Pa4euoVyNtN99+8/mPDA4kuIzMVZVaJ6yN/57EQwrCuAd5fvJZNvHDzXFBMkntCPwagX6owbrCK/Nw7JR80FZVmXIEM9WLDo+CqlxEWwfRGiw7DgSdVVBL7LLfBDLnETE2IMwqCzNjcAxtatJuZJ98gznsjejZmshPv6SdveycJQiQWokXXv19KiHW6dhZGPqJFLIZp6yTtLukK2c9z59UKSKwIatXK19V/85wbsmgnUxr2Yv2unspYAWWD0Ljl9SzQ/4cPa+qWmD/V7K7S3de6jQ+4S5E+ArjfeLFE2Aa0Nq/e8rhYqJoFlK/K6jFOmv5VByKKyskQ01o6e5cKqPD/1BswSMSReXrVgIldSgnIxVZQgiOiDGdf2axCEjqzO8voAGQve0O6vZEAmgI= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR03MB5196.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230022)(376002)(346002)(39860400002)(396003)(136003)(366004)(451199015)(36756003)(478600001)(86362001)(966005)(6486002)(6506007)(66946007)(316002)(6916009)(66476007)(66556008)(107886003)(4326008)(8676002)(6666004)(52116002)(6512007)(83380400001)(8936002)(5660300002)(26005)(41300700001)(1076003)(2906002)(186003)(7416002)(2616005)(38350700002)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: DuWNtCXmRMRZhbFuElAaGqynOTd5GVY112Ou0BdJip+4Y35X+fFxqxZRxQRHHvSdUB/lvKxnQ6t2b0oMmKLK0czmhRJoCnv5vhDstitXX+KX4nw5pxWCG7ZJV943KNyj30B2hkfQDz7FitRmIWpxeO+Z3dkoIOUKCfXIg9Bdyxm0Pcy0HjV8bQ7CZw9hMwygLU38CNv6YtqSXrZGAzX/6A35rskKh+ZrEg9RACRhx3z0niQB5GQ6Rhqv6jFgQfVZs7dnw89EbRert/syMojcVPsUedJTNfLCxois9RALWn2m6pO7UietcVN8qQGhpFb8/TF33WGd4WW4OyvCbTawu1SF7Ci09C8CIHfMa+jeC9pOgReAjgU2NjkZ+CC5pZzulXmaVVeWu8P+7eXwv/7ApBPltRulQtuPCbBGDniIs1JjyzwDwZUmeCB7g5OMCetHW7hhe5DaVhxGvYxhFKbVLZ/117Q6fd1QNqxKvWROG87oqPHs0a8X7J83fxu4cMb7iiAhel0D5+9fOyfNfvOpA9JBMiH3s5QRL8p1AGOoePUJF0MQNi16kQVdN0nXvt3/2n52Pb7ijD25MqmyeZSLOVe4mCmjzWXJ77KKdcEFyBVXLdAY4MJ5twzvwHfFl9k0Uz5piYVzoc/y7y+uF1srr02Us5T+OWfMpS8oAyYulVld8NT5Cb40norVpGqxBeHPDuWXW2aGuOjlOpwnl97JSbzocFipQCdUtGiSHvJF8KiiJIKhLnnnlQqMRRseZ5sN87U6pSNBIFblpDJfKA/wLniourpTXbOHgpgkUzkYVJISRXrJvbm8wHGP1OnyAEpabhlVrM1PTvN+xIKA+73+Ll7bxBucFfgcbaha0ufjN7Om87ArrzX7yCmJw/upDI7LSyyCeNm9Pg3EV9jql5d4Tkc1b5ivgBbLAHiKAq++PjQVy9XP/gYgaLhUOdZAL3m/upcFAjdN88/nK8HM4n41QiEPFjsbG+aGwoHMgL3bEo4Wn7WZO6OHB/+831TyRXEwJGs4Fl56FG+F9ehJr5roVp0TjNOurkRbMFMEay6CD1UC1WOH+n/fVCZZlUco5cIQJu6xjbjDxs4h1kCFQ1S6bDQYWoLynQCHBy8AspIML4MmfHghvD793niVdpkbvJ1EAvai0Qx87l5X3/3XySitds71QYUbRlFFw7QHzOSdCj2/D6psY1gyOTBE6AUOwEir2a9TcWDFxYb1yXf1XI57d8mEhjKcVfGGJJzmyIfiGJYYErq1SqXrEA7Y9VIZ403mK6/wDdQ7SRGVLGne1OQjPDlUS2vEJkxe5za4s3JZ+mRHM/8F4fP4IFtnOZD5C9MF776XC4gUB1UoxrDQ89/rfFNncj5L2pNQ0rL9BF5tyzd1g2anSoZUes5ZtQmSrvX1fYBMvDXYpFM6uTRQSunKywLwoJMa/atpSX8deVuTNiJQcjT2Hw+z7cliFBGDQ5/2kHtlV0GDPidmtfM76l/99z+1JW6cGasaa965hfUzeDi/iPynNNQZ4MyWNfgxIh9Ebx70hrKO63JNKMo0bjiXYgi6e4EzA9mV97yenbqzv+8y/gKp0S+q6wJ9P2uLAlb7 X-OriginatorOrg: synaptics.com X-MS-Exchange-CrossTenant-Network-Message-Id: d15f44b2-6ec6-47c8-f1b0-08dabbf09e00 X-MS-Exchange-CrossTenant-AuthSource: DM6PR03MB5196.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Nov 2022 10:05:34.7190 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335d1fbc-2124-4173-9863-17e7051a2a0e X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: tuQWynMoFjFco30w8CMkF6O9qc+6BbD0nODEj4/6ldY+gvb9jCV1O9YYQZQAWM1DMDfWvoHXrsZL1S1CJy88SA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR03MB6362 X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1748288961336426246?= X-GMAIL-MSGID: =?utf-8?q?1748288961336426246?= From: "Hsia-Jun(Randy) Li" Those pixel formats are used in Synaptics's VideoSmart series SoCs, likes VS640, VS680. I just disclose the pixel formats used in the video codecs and display pipeline this time. Actually any device connected to the MTR module could support those tiled and compressed pixel formats. We may not be able to post any drivers here in a short time, the most of work in this platform is done in the Trusted Execution Environment and we didn't use the optee event its client framework. Please notice that, the memory planes needed for video codecs could be one more than display case. That extra planes in the video codecs is for the decoding internal usage, it can't append to the luma or chroma buffer as many other drivers do, because this buffer could be only accessed by the video codecs itself, it requests a different memory security attributes. There is not a proper place in v4l2 m2m to allocate a large size buffer, we don't know when the users won't allocate more graphics buffers. Although we could allocate it in a step likes STREAMON, it would lead unusual delaying in starting of video playbacl. https://synaptics.com/products/multimedia-solutions Changlog v3: There was a mistake in format macro. Correcting the description of 64L4 variant modifiers. v2: The DRM modifiers in the first draft is too simple, it can't tell the tiles in group attribute in memory layout. Removing the v4l2 fourcc. Adding a document for the future v4l2 extended fmt. v1: first draft of DRM modifiers Try to put basic tile formats into v4l2 fourcc Hsia-Jun(Randy) Li (3): drm/fourcc: Add Synaptics VideoSmart tiled modifiers media: videodev2.h: add pixel format modifiers media: videodev2.h: add Synaptics tiled modifiers Randy Li (1): media: docs: Add Synpatics tile modifiers .../media/v4l/pixfmt-synaptics.rst | 80 +++++++++++++++++++ .../userspace-api/media/v4l/pixfmt.rst | 1 + include/uapi/drm/drm_fourcc.h | 75 +++++++++++++++++ include/uapi/linux/videodev2.h | 50 ++++++++++++ 4 files changed, 206 insertions(+) create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-synaptics.rst