From patchwork Sun Oct 30 17:18:05 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Hsia-Jun Li X-Patchwork-Id: 887 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:6687:0:0:0:0:0 with SMTP id l7csp1889768wru; Sun, 30 Oct 2022 10:24:12 -0700 (PDT) X-Google-Smtp-Source: AMsMyM7P/MivNAh0knQk8grYRSn04VnHaq1t0/hJNZdfADoD/BbkLdd4OclWoWpBRx8RPSrhy1Ru X-Received: by 2002:a63:2318:0:b0:452:598a:92de with SMTP id j24-20020a632318000000b00452598a92demr9133965pgj.73.1667150652652; Sun, 30 Oct 2022 10:24:12 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1667150652; cv=pass; d=google.com; s=arc-20160816; b=ZFx4tXStXwN01sJtkbK9ATe5BkBkv2DR/Ayf0ziZomWaz1CaNgXcg5s+JgVe9nmAkM FrDb0WptBNnxNEpJDDSeOnPxCn9OMcded4wzFmD0IM9E1p0ns1vm8VH89hoee3XBwOfU KO/cuZNjXTw9K3uVCemQBRsi/53WYZ0ZPnAinAx/jN/SwfOwFxqnD4gVayMxYH2htlK1 hIygbZ2RRraT9ZplH5d+vwmuPtVGxmimFhz6kSDtZoi9aeFE8XckQ/LZb/UTdi2L54YT yYOwsd1ICF/oCPFTVg/ZU8K1U/VC7cPF/7fDQTXEg6YbUgIBkuzknEnaadM3cfLQVdU3 xwrQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:content-transfer-encoding :message-id:date:subject:cc:to:from:dkim-signature; bh=oBEB+XU1Y3v8CgpdrFfFMlqIo9NuepkdHNtccG1o9XU=; b=GUL/yIarJzKkqohDZcX2Sn6N6rtODA9PwlaXsZrv7PsRPOZ8BfMwgqjnCWkEsyPJRq Q0S8S8MhxdS8C7rUUPFOfT0eVyGq0yW05UPQcSmUv4Nif5/4WgOJkUN5LT59xooxjoG6 1jECPD+YxqqnVB9tR7LbRvy5hJcKE61WYZcCRM0udI8nSnLxLLjL4x0MCwbTCb6tawxt gS9Pg+C8VTDCUZZIYYwCzQB5JLzRTKWMIwuQy4JNNmBMk4G/GRAmeZX4TzieVQ2btjTf gLFugRgkOi5e+ESF4Q1+upzCiVFci4V4Ovcj0jtJxdk1S/vzvOR7wkWauRsdhfXb/tTK HAYQ== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@Synaptics.onmicrosoft.com header.s=selector2-Synaptics-onmicrosoft-com header.b=WnJtzsYz; arc=pass (i=1 spf=pass spfdomain=synaptics.com dkim=pass dkdomain=synaptics.com dmarc=pass fromdomain=synaptics.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=synaptics.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id m4-20020a170902d18400b00185569697d7si4952738plb.376.2022.10.30.10.24.00; Sun, 30 Oct 2022 10:24:12 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@Synaptics.onmicrosoft.com header.s=selector2-Synaptics-onmicrosoft-com header.b=WnJtzsYz; arc=pass (i=1 spf=pass spfdomain=synaptics.com dkim=pass dkdomain=synaptics.com dmarc=pass fromdomain=synaptics.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=synaptics.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229816AbiJ3RTB (ORCPT + 99 others); Sun, 30 Oct 2022 13:19:01 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53902 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229865AbiJ3RS4 (ORCPT ); Sun, 30 Oct 2022 13:18:56 -0400 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2055.outbound.protection.outlook.com [40.107.220.55]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1CE9F25ED; Sun, 30 Oct 2022 10:18:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NXSdS9xq2cZWp6FliUXm3Fw2d7R5AxsJ74NH8T8RgiJ8KQpM62WhrCP4z7k8Nz1QIYW1ygvRGr0lm+jS4dgBJzur3Hk0f+tM8GxMUU6xqg4OU4LnY/XLXuWhHOlvzV9vg8mCyabQZuapFY0HrCyOtWfaXNzKlb0THSsrqd6t3N447S3i9WcHtylwlSqivrBHYpCno9A74oGlETamT+MPwt5xhMNLy/iD4svJD3lQCyvsAvoNAdlHt8E7AmKcivLQdimMXhy5SDCvW4A4rWgjGdsaRiTEyrJ4pHf0d6NJGyaHz49f3/Ie0qkBNSC50I4wxK5Y/SfpDR8Rg/pVVRQeGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oBEB+XU1Y3v8CgpdrFfFMlqIo9NuepkdHNtccG1o9XU=; b=XXVPH5Ijf7SGMlKbVzvJgxcfKM+NhS6iMoyNOh9f83DTW5Uw0JEI9O0SFT/3GETD4mBAm+br8PWCUVaeRN1DGa9xwBS6qWLz81Q92KjnnuqkujitYcKezR/3VOOCGcrtYNi0bIakzgbLekPAxAWeVh+W2sN1E3TQUFASqWTDI2wXbOSN67BNpz1CikrF6Pq0eaRRUjhGEHTDFOOVdIjB8r176LJ7kQlw/FgPMgPm8zvdqenkbiwE1twVvnVIR24KvDV7xjBlnHA99ObmxadPcHJzzeoBu1qQq8siRtcla3mBpn+lb3uTcjaIALmizFch0moExJUCQoANCb/HYejivQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=synaptics.com; dmarc=pass action=none header.from=synaptics.com; dkim=pass header.d=synaptics.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Synaptics.onmicrosoft.com; s=selector2-Synaptics-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oBEB+XU1Y3v8CgpdrFfFMlqIo9NuepkdHNtccG1o9XU=; b=WnJtzsYzTNs6pa+Z2mwfy1qqtUkB79AwZ2YbfMcbZs+L9PXAwf3EUA8YHEJu/b85nGry3HEhBjAalXWrRJMyFWDtv6ZswjjfybPSLs87pVL8k2hcnkmfwWmuDGbucQ5V+5Giqk9Qqwk2bdb1AQN6bpzTfKlEvmyJKgi08vojpUM= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=synaptics.com; Received: from DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) by DS7PR03MB5637.namprd03.prod.outlook.com (2603:10b6:5:2ca::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5769.16; Sun, 30 Oct 2022 17:18:50 +0000 Received: from DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1]) by DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1%6]) with mapi id 15.20.5769.019; Sun, 30 Oct 2022 17:18:50 +0000 From: Hsia-Jun Li To: dri-devel@lists.freedesktop.org Cc: maarten.lankhorst@linux.intel.com, mripard@kernel.org, tzimmermann@suse.de, airlied@linux.ie, daniel@ffwll.ch, mchehab@kernel.org, hverkuil-cisco@xs4all.nl, ezequiel@vanguardiasur.com.ar, sakari.ailus@linux.intel.com, ribalda@chromium.org, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, tfiga@chromium.org, sebastian.hesselbarth@gmail.com, jszhang@kernel.org, linux-arm-kernel@lists.infradead.org, laurent.pinchart@ideasonboard.com, nicolas@ndufresne.ca, helen.koike@collabora.com, "Hsia-Jun(Randy) Li" Subject: [PATCH v2 0/2] Add pixel formats used in Synatpics SoC Date: Mon, 31 Oct 2022 01:18:05 +0800 Message-Id: <20221030171807.55837-1-randy.li@synaptics.com> X-Mailer: git-send-email 2.37.3 X-ClientProxiedBy: BYAPR05CA0010.namprd05.prod.outlook.com (2603:10b6:a03:c0::23) To DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6PR03MB5196:EE_|DS7PR03MB5637:EE_ X-MS-Office365-Filtering-Correlation-Id: 05f96525-ab6d-4952-169c-08daba9acfd5 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: jJ6C5v08r24ALfLwK2pOzKq8QYxA2yX1MSo8RRhWert09J2SxvFCKJMV8f+99befMZKs51yy9AI+Ic9oqWHgm3Wsp4mpDa2HbKCaPJd82y719/ViooswnJqW2ftiFYkrLuaMuMJ1GRjobxNLuVYJB62kNtudqYSbU3uGAzkKtyMqR6PcnbuZ5LS5ZL3dIi4oHA7u8Ib8kmQ4DWlorGS2ZdovFQ82Z8ZQfSwx4M9GdjKw50nJDsi/Qyy4vaTlasbqBpD/4o8mMMFQNmt6zL1JPCcbVAtWvOKO8n5yy0mIPqbNhv0EQ7ldgvSKTQUs1HSMUr7UKFV4fCy4cFfHFpz+GcdET7iC5jX0/t08+yiwXWqj0pe5j9En9rLFL+ThhBDBYOP81yYO9uobt0w3EVxOoTGj5/sdZS+3aZjbcgUytRQi09IoQeLWAUzAgRbR3kQXnIgB3aB17DdKYmGPtnEn6vzRK5p8JMJl3ldOiu79ep2xlQyb6Ib7+w3YnjADZVtvoRyP34cf1AQXMvvQik2d9woBkmvSrD85fiPvXLUcbGb09QSnqqLZGctEZmmxm/dZXvd29OYufx5cCYQKJJTcHSZurgAWmWTRxNgNTSy/MVK8K3HmmnnivyKOfqgY7jrcBeKLLlMpy8cbpE8hrTBYoiBu+4NKKvW1iK8bfSK1vvvalDogztjoi1Zl3qX64GKOzzmx3y8BqoM4oSXOBzkAV0KUXom+rmwtYu+NMYKh6k8TATinqV6L70hLxHw9fjw6lDCITRVak9lKj/InwEUvtHuAc88YOP/FUmMkE6uFM8w= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR03MB5196.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230022)(39860400002)(366004)(346002)(136003)(376002)(396003)(451199015)(6486002)(966005)(6506007)(107886003)(6666004)(478600001)(316002)(6916009)(38350700002)(6512007)(2616005)(36756003)(1076003)(26005)(52116002)(38100700002)(83380400001)(186003)(2906002)(86362001)(4326008)(66556008)(8676002)(66476007)(66946007)(41300700001)(8936002)(5660300002)(7416002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: +hPhZ4PBN2ex7EBpbgPOZ9pJH9xipQDrZDsr5pihugS7l8CmiwM8aDwWyxfTDJFcmi3d1ZygvNQ4Glpv6AWdZeUNRKX13Hy82RAJC6K4GwV7EIL8p3dXVyQqiscJQ/xxYATvZsjZoanMG+D00UmEGdWFM3R0JXYUGWJ4zDS4bkZFRaZIek9M7d8gBaeWA98ofT99+l+NgHm8DfKFvl8LF8ftbYO0S1aG3G/5+oAjSqH9SSMtuZOKe9wX762YFlrjhlyAkd+JBoHHPbNfwN83hCeiU8cLVWO8b7EU+tDopun/N9ykXwMd7Ymgnyp+srCbatlxxnz4xO8ttfS1nfbHIvZwYVlnE+7yUkQZ88Sm6ruNCn996yUuNAIz2nWKgXL9cNAv8uy057hzXAml23fNNW9YTiUzAlrtEgcWxg7s6N9dWAuXKfK1ZhcugSgA3UUF0oXTMbXReJTPq6FhAqsYn4E3aOaSRKjbIKC17G1Y1RGak/xdhvPonxf2XOLxBE7/Tqli6SszJ/TUYy5keSR/SUZ6oDpFErdmO2yEk8zABXcnvoNUgLJXYtXI9vkU+RB8oIQxWNN2i3I3URIyYLXAcbeVi5Uz2h4LK0tC4CYtulqG/x78vxUo8rRMNUB4uScJqK3x56Q+ho/eDeZPwACsGU0/3E8vUfMfJnRBD2MlVnxS0xdM699lxUEoBvDtyyO9wN0Gt638bM9VdI9LE3ophp35iMHqt8nGsvIkw4z326orJAqBk2Hq//BuJQw0gvYuAiivGywiU3GQ+xcQ+5RjHipn6/k9BLXEFU+qUd+VUcXq10FNMY3B1nfIDIBq7VSfaZ13lBG8lqN1/Tdb9ZiOg1B7/cl/mz5PtY6/xliDk9mDOoyim6VcFEAWc1qcdLKoFfnKcYsV0eLvsp+Jjsmsd2m2m1VrPl3RBV5kiSBISVAaORQK9Rvq8NNvROcP/aN0wdRjcXyISjse1gVJ/hJ4hTfcVrWWPaGm5Pb3mKg8R5vLyy1J5JdFC4DSALe2Sfmp615OnAk+ZttCpxeA6VI2T2eY97gSW/ngG0GuLN6ReqJkIZopQSrI7K8mQy96nYGW7I1KP71BIq5ieb0e8cQMabk150/Zzu4+sIUfiVORCx6EMbz5ZwMzQ5nSO3mLepE8U/KCHUq5K9Ic3CPMEHs2ZVzxcKEVESlhw4B6hzaz/vZVyYXZsl1XAc4SveJ4eJqZ15hnWNuiL5Q/Kp36T5ZLJTBJW4gcwxHfDsw+16uxqOD3c9AaOxJZsyubIVAN1XdfwDuXVon7NdgWcN8Mrc2ZXdoLeYRjGLzMIgpjRP8Tb3V9VMQqkFwqZEo8yhOIRJj/QvrQlvogANCRj+WCinEz1jEZDjLXXd7EIM3nqywt349u1gtRnugpYYMqxCtKZnHM1ndAJsuDymq6RxzvW9sR0fqOii4BokDfLsgCzzqE96ZD/yV/hIlYxdiCeSzsU53BK5Jpg/ZZ7jr2/EAALpNkvnIPtDgjVn8+2jQq2ltL4u2yU2ChUN4e5/VnttxXTX9JW93M10n+7LfcShgjRsabNxWdiMIfbE+N3jiqG7+YseBFPdBPc6S16ced0ynPMrWE X-OriginatorOrg: synaptics.com X-MS-Exchange-CrossTenant-Network-Message-Id: 05f96525-ab6d-4952-169c-08daba9acfd5 X-MS-Exchange-CrossTenant-AuthSource: DM6PR03MB5196.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Oct 2022 17:18:50.4361 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335d1fbc-2124-4173-9863-17e7051a2a0e X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: koDeBjE6nd3jjRndjQ//5iVjz7KA1CPtYpTG8fu7Kl6DJna1lndXw5Xp/NdDg/M1CKaWEubHGP9/4e4fB2aw9Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR03MB5637 X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1748134162608017707?= X-GMAIL-MSGID: =?utf-8?q?1748134162608017707?= From: "Hsia-Jun(Randy) Li" Those pixel formats are used in Synaptics's VideoSmart series SoCs, likes VS640, VS680. I just disclose the pixel formats used in the video codecs and display pipeline this time. Actually any device connected to the MTR module could support those tiled and compressed pixel formats. The more detail about MTR module could be found in the first patch of this serial of mail. We may not be able to post any drivers here in a short time, the most of work in this platform is done in the Trusted Execution Environment and we didn't use the optee event its client framework. Please notice that, the memory planes used for video codecs could be one more than display case. That extra planes in the video codecs is for the decoding internally usage, it can't append the luma or chroma buffer as many other drivers do, because this buffer could be only accessed by the video codecs itself, it requests a different memory security attributes. There is not a proper place in v4l2 m2m to allocate a large size buffer, we don't know when the users won't allocate more graphics buffers. Although we could allocate it in a step likes STREAMON, it would lead unusual delaying in starting of video playbacl. https://synaptics.com/products/multimedia-solutions Changlog v2: The DRM modifiers in the first draft is too simple, it can't tell the tiles in group attribute in memory layout. Removing the v4l2 fourcc. Adding a document for the future v4l2 extended fmt. v1: first draft of DRM modifiers Try to put basic tile formats into v4l2 fourcc Hsia-Jun(Randy) Li (1): drm/fourcc: Add Synaptics VideoSmart tiled modifiers Randy Li (1): media: docs: Add Synpatics tile modifiers .../media/v4l/pixfmt-synaptics.rst | 80 +++++++++++++++++++ .../userspace-api/media/v4l/pixfmt.rst | 1 + include/uapi/drm/drm_fourcc.h | 75 +++++++++++++++++ 3 files changed, 156 insertions(+) create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-synaptics.rst