Message ID | 20230407133852.2850145-1-luca.ceresoli@bootlin.com |
---|---|
Headers |
Return-Path: <linux-kernel-owner@vger.kernel.org> Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:b0ea:0:b0:3b6:4342:cba0 with SMTP id b10csp293104vqo; Fri, 7 Apr 2023 06:40:21 -0700 (PDT) X-Google-Smtp-Source: AKy350bwpsqXHui3TCCrhh09l74XsErx5lPrU6k8DISZNOC+ejKhlS+VKvp8Tin0KG6bX7KwlP2P X-Received: by 2002:a17:90b:1d07:b0:23d:133a:62cc with SMTP id on7-20020a17090b1d0700b0023d133a62ccmr2445160pjb.17.1680874821367; Fri, 07 Apr 2023 06:40:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1680874821; cv=none; d=google.com; s=arc-20160816; b=MBvX5C8rC8QUp5R6DjTIXL/rfPyaBEcVsHf3V1j7Qg57H9t+DaE1TihoXDlb53yTwe 4QNvZO8nsg8OFcCMJOMZAVTC/j1x4RX2ojlS2lyrys0LgdF3yiP57JIXgJBvV5FAgIO/ j1JeNSzB+fzQfvxLEk1Fy+HpWxagwFRUQhcwhZ4kKTAJ5pJ3g5X1XOEwT+0Mb15QOp/V xjTjc0hHvrBbF9ws76Sabcx2baqpxPRFsy93L6CW8nOWHHX5nXv1dG46AKdvRS4bmaKm zm1crZmAQ1DChoqGj5gSt+f34rZmoRXM+IJGLZ5szpW0J5nF1HeDFBx0WG4bebgIezP9 UTRQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=VVN0XOngDYz3uGp4wCGBZNM2OHBQACSdvb++Rh+7vvs=; b=uHLp8L0tYnAxKNhKTJLYdsNid3Mpp1WFz+mTU1o0N0wFk/BE+USDGnCdH2Qo7xPfe6 MDr4hqPdS/HtgDi2LNs15akgCAw07q9Xmgxca7OBCO3RCPrHdWP0mxNwy8OOmJYrX5QG +ECmAOwd/o2PpaEotNA/+7rM7+U5xrSNCG7NRJn1cE866j8s0Hyctx0ff9sNkrDbYlRJ 3WJpAY1+GrpjdfkQwHx8BIMmCt0ugxWdG3cTAo9axoEEM5bq9pnPGyR73gTliWQg4UgH dOh7wZJppKGRNPLeQEZ7iSdLtKDCvgZUArsPOa/5IW7p6nnQJg8DDEDtCDZ/X3G5ZNjj VSPg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bootlin.com header.s=gm1 header.b=SI+lxDSN; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=bootlin.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id t17-20020a17090a5d9100b0023b4158aaf1si3568271pji.62.2023.04.07.06.40.06; Fri, 07 Apr 2023 06:40:21 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@bootlin.com header.s=gm1 header.b=SI+lxDSN; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=bootlin.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233684AbjDGNjO (ORCPT <rfc822;a1648639935@gmail.com> + 99 others); Fri, 7 Apr 2023 09:39:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46366 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230361AbjDGNjM (ORCPT <rfc822;linux-kernel@vger.kernel.org>); Fri, 7 Apr 2023 09:39:12 -0400 Received: from relay8-d.mail.gandi.net (relay8-d.mail.gandi.net [IPv6:2001:4b98:dc4:8::228]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 6C2E893; Fri, 7 Apr 2023 06:39:09 -0700 (PDT) Received: from booty.fritz.box (unknown [77.244.183.192]) (Authenticated sender: luca.ceresoli@bootlin.com) by mail.gandi.net (Postfix) with ESMTPA id C45F31BF20A; Fri, 7 Apr 2023 13:39:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bootlin.com; s=gm1; t=1680874747; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=VVN0XOngDYz3uGp4wCGBZNM2OHBQACSdvb++Rh+7vvs=; b=SI+lxDSNzORAqgYxur6f7/ldWLJSIqGCO7TYflpS2hfjrz59oR4h0iczIYxpetpxUf+UhJ ESeHWh7albPLHlQ/J4cWqCntV9KwjfOF7psQW/fM+4ly4SFdB0/FJ4q1eRb+V+h1GOdhe2 ywHf3Uf46Bc/plUn+c8gkzkAtKWAt+XYyOsOj3FiV6JvbSvDC1RpnEVktRkcXTnr7jRuwf uOY+o5MEFLOMTiK3qKAxqbPEuzcyJavXwtzahTOHaA9XGr2944bS+GGLkyi0rJxA3aUNTV 8KU4XvQMUCATp9HPQf5PBl6TbvSf/xIaUsJoIC854ZpmFjQMeb58YyOzd+wxSQ== From: Luca Ceresoli <luca.ceresoli@bootlin.com> To: linux-tegra@vger.kernel.org Cc: Luca Ceresoli <luca.ceresoli@bootlin.com>, Thierry Reding <thierry.reding@gmail.com>, Jonathan Hunter <jonathanh@nvidia.com>, Sowjanya Komatineni <skomatineni@nvidia.com>, David Airlie <airlied@gmail.com>, Daniel Vetter <daniel@ffwll.ch>, Rob Herring <robh+dt@kernel.org>, Krzysztof Kozlowski <krzysztof.kozlowski+dt@linaro.org>, Mauro Carvalho Chehab <mchehab@kernel.org>, Greg Kroah-Hartman <gregkh@linuxfoundation.org>, linux-media@vger.kernel.org, dri-devel@lists.freedesktop.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org, linux-staging@lists.linux.dev, Laurent Pinchart <laurent.pinchart@ideasonboard.com>, Hans Verkuil <hverkuil-cisco@xs4all.nl>, Thomas Petazzoni <thomas.petazzoni@bootlin.com>, Paul Kocialkowski <paul.kocialkowski@bootlin.com>, Richard Leitner <richard.leitner@skidata.com> Subject: [PATCH v5 00/20] Add Tegra20 parallel video input capture Date: Fri, 7 Apr 2023 15:38:32 +0200 Message-Id: <20230407133852.2850145-1-luca.ceresoli@bootlin.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: <linux-kernel.vger.kernel.org> X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1762524996708363972?= X-GMAIL-MSGID: =?utf-8?q?1762524996708363972?= |
Series |
Add Tegra20 parallel video input capture
|
|
Message
Luca Ceresoli
April 7, 2023, 1:38 p.m. UTC
New in v5: dropped the patch that was removing lots of the logic behind enum_format, after discussion with Hans. The rest is unmodified except for rebasing and fixing a couple typos in comments. Full details follow. Tegra20 and other Tegra SoCs have a video input (VI) peripheral that can receive from either MIPI CSI-2 or parallel video (called respectively "CSI" and "VIP" in the documentation). The kernel currently has a staging driver for Tegra210 CSI capture. This patch set adds support for Tegra20 VIP capture. Unfortunately I had no real documentation available to base this work on. I only had a working downstream 3.1 kernel, so I started with the driver found there and heavily reworked it to fit into the mainline tegra-video driver structure. The existing code appears written with the intent of being modular and allow adding new input mechanisms and new SoCs while keeping a unique VI core module. However its modularity and extensibility was not enough to add Tegra20 VIP support, so I added some hooks to turn hard-coded behaviour into per-SoC or per-bus customizable code. There are also a fix, some generic cleanups and DT bindings. Quick tour of the patches: * Device tree bindings 01. dt-bindings: display: tegra: add Tegra20 VIP 02. dt-bindings: display: tegra: vi: add 'vip' property and example * Minor improvements to logging, comments, cleanups 03. staging: media: tegra-video: improve documentation of tegra_video_format fields 04. staging: media: tegra-video: document tegra_channel_get_remote_source_subdev 05. staging: media: tegra-video: fix typos in comment 06. staging: media: tegra-video: improve error messages 07. staging: media: tegra-video: slightly simplify cleanup on errors 08. staging: media: tegra-video: move private struct declaration to C file 09. staging: media: tegra-video: move tegra210_csi_soc to C file 10. staging: media: tegra-video: remove unneeded include * Preparation to make the VI module generic enough to host Tegra20 and VIP 11. staging: media: tegra-video: Kconfig: allow TPG only on Tegra210 12. staging: media: tegra-video: move tegra_channel_fmt_align to a per-soc op 13. staging: media: tegra-video: move default format to soc-specific data 14. staging: media: tegra-video: move MIPI calibration calls from VI to CSI 15. staging: media: tegra-video: add a per-soc enable/disable op 16. staging: media: tegra-video: move syncpt init/free to a per-soc op 17. staging: media: tegra-video: add syncpts for Tegra20 to struct tegra_vi 18. staging: media: tegra-video: add hooks for planar YUV and H/V flip 19. staging: media: tegra-video: add H/V flip controls * Implementation of VIP and Tegra20 20. staging: media: tegra-video: add support for Tegra20 parallel input Enjoy! Changed in v5: - removed patch 3 as requested by Hans Verkuil; now the driver is kept video-node-centric and the enum_format logic is unchanged - rebased on top of that - trivial fixes (typos) Changed in RESEND,v4: - add Rob's review tag on patch 2 Changed in v4: - fixed the leftovers after the removal of 'channel@0' in DT - added review tags by Dimtry Changed in v3: - removed the 'channel@0' node from the device tree representation of vip - squashed the last two patches (VIP + T20) into one - small cleanups - rebase on v6.2-rc1 Changed in v2: - improved dt-bindings patches based on reviews - removed patches 3 and 4 adding DT labels without a mainline user - two small fixes to the last patch [v4,resend] https://lore.kernel.org/linux-tegra/20230309144320.2937553-1-luca.ceresoli@bootlin.com/ [v4] https://lore.kernel.org/linux-tegra/20230130141603.323221-1-luca.ceresoli@bootlin.com/ [v3] https://lore.kernel.org/linux-media/20221229133205.981397-1-luca.ceresoli@bootlin.com/ [v2] https://lore.kernel.org/linux-tegra/20221222100328.6e341874@booty/T/#t [v1] https://lore.kernel.org/linux-tegra/20221124155634.5bc2a423@booty/T/#t Luca Luca Ceresoli (20): dt-bindings: display: tegra: add Tegra20 VIP dt-bindings: display: tegra: vi: add 'vip' property and example staging: media: tegra-video: improve documentation of tegra_video_format fields staging: media: tegra-video: document tegra_channel_get_remote_source_subdev staging: media: tegra-video: fix typos in comment staging: media: tegra-video: improve error messages staging: media: tegra-video: slightly simplify cleanup on errors staging: media: tegra-video: move private struct declaration to C file staging: media: tegra-video: move tegra210_csi_soc to C file staging: media: tegra-video: remove unneeded include staging: media: tegra-video: Kconfig: allow TPG only on Tegra210 staging: media: tegra-video: move tegra_channel_fmt_align to a per-soc op staging: media: tegra-video: move default format to soc-specific data staging: media: tegra-video: move MIPI calibration calls from VI to CSI staging: media: tegra-video: add a per-soc enable/disable op staging: media: tegra-video: move syncpt init/free to a per-soc op staging: media: tegra-video: add syncpts for Tegra20 to struct tegra_vi staging: media: tegra-video: add hooks for planar YUV and H/V flip staging: media: tegra-video: add H/V flip controls staging: media: tegra-video: add support for Tegra20 parallel input .../display/tegra/nvidia,tegra20-vi.yaml | 59 ++ .../display/tegra/nvidia,tegra20-vip.yaml | 41 ++ MAINTAINERS | 3 + drivers/staging/media/tegra-video/Kconfig | 1 + drivers/staging/media/tegra-video/Makefile | 2 + drivers/staging/media/tegra-video/csi.c | 48 ++ drivers/staging/media/tegra-video/csi.h | 4 - drivers/staging/media/tegra-video/tegra20.c | 661 ++++++++++++++++++ drivers/staging/media/tegra-video/tegra210.c | 90 +++ drivers/staging/media/tegra-video/vi.c | 222 ++---- drivers/staging/media/tegra-video/vi.h | 71 +- drivers/staging/media/tegra-video/video.c | 5 + drivers/staging/media/tegra-video/video.h | 2 +- drivers/staging/media/tegra-video/vip.c | 290 ++++++++ drivers/staging/media/tegra-video/vip.h | 68 ++ 15 files changed, 1380 insertions(+), 187 deletions(-) create mode 100644 Documentation/devicetree/bindings/display/tegra/nvidia,tegra20-vip.yaml create mode 100644 drivers/staging/media/tegra-video/tegra20.c create mode 100644 drivers/staging/media/tegra-video/vip.c create mode 100644 drivers/staging/media/tegra-video/vip.h
Comments
Hello Hans, On Fri, 7 Apr 2023 15:38:32 +0200 Luca Ceresoli <luca.ceresoli@bootlin.com> wrote: > New in v5: dropped the patch that was removing lots of the logic behind > enum_format, after discussion with Hans. The rest is unmodified except for > rebasing and fixing a couple typos in comments. > > Full details follow. > > Tegra20 and other Tegra SoCs have a video input (VI) peripheral that can > receive from either MIPI CSI-2 or parallel video (called respectively "CSI" > and "VIP" in the documentation). The kernel currently has a staging driver > for Tegra210 CSI capture. This patch set adds support for Tegra20 VIP > capture. > > Unfortunately I had no real documentation available to base this work on. > I only had a working downstream 3.1 kernel, so I started with the driver > found there and heavily reworked it to fit into the mainline tegra-video > driver structure. The existing code appears written with the intent of > being modular and allow adding new input mechanisms and new SoCs while > keeping a unique VI core module. However its modularity and extensibility > was not enough to add Tegra20 VIP support, so I added some hooks to turn > hard-coded behaviour into per-SoC or per-bus customizable code. There are > also a fix, some generic cleanups and DT bindings. > > Quick tour of the patches: > > * Device tree bindings > > 01. dt-bindings: display: tegra: add Tegra20 VIP > 02. dt-bindings: display: tegra: vi: add 'vip' property and example > > * Minor improvements to logging, comments, cleanups > > 03. staging: media: tegra-video: improve documentation of tegra_video_format fields > 04. staging: media: tegra-video: document tegra_channel_get_remote_source_subdev > 05. staging: media: tegra-video: fix typos in comment > 06. staging: media: tegra-video: improve error messages > 07. staging: media: tegra-video: slightly simplify cleanup on errors > 08. staging: media: tegra-video: move private struct declaration to C file > 09. staging: media: tegra-video: move tegra210_csi_soc to C file > 10. staging: media: tegra-video: remove unneeded include > > * Preparation to make the VI module generic enough to host Tegra20 and VIP > > 11. staging: media: tegra-video: Kconfig: allow TPG only on Tegra210 > 12. staging: media: tegra-video: move tegra_channel_fmt_align to a per-soc op > 13. staging: media: tegra-video: move default format to soc-specific data > 14. staging: media: tegra-video: move MIPI calibration calls from VI to CSI > 15. staging: media: tegra-video: add a per-soc enable/disable op > 16. staging: media: tegra-video: move syncpt init/free to a per-soc op > 17. staging: media: tegra-video: add syncpts for Tegra20 to struct tegra_vi > 18. staging: media: tegra-video: add hooks for planar YUV and H/V flip > 19. staging: media: tegra-video: add H/V flip controls > > * Implementation of VIP and Tegra20 > > 20. staging: media: tegra-video: add support for Tegra20 parallel input > > Enjoy! > > Changed in v5: > - removed patch 3 as requested by Hans Verkuil; now the driver is kept > video-node-centric and the enum_format logic is unchanged > - rebased on top of that > - trivial fixes (typos) According to your review of v4, removing patch 3 was the only change required, and I didn't do anything else, and there have been no big changes since v1 anyway, so I was wondering whether this series has any hope to make it for 6.4... Best regards, Luca
On 12/04/2023 11:16, Luca Ceresoli wrote: > Hello Hans, > > On Fri, 7 Apr 2023 15:38:32 +0200 > Luca Ceresoli <luca.ceresoli@bootlin.com> wrote: > >> New in v5: dropped the patch that was removing lots of the logic behind >> enum_format, after discussion with Hans. The rest is unmodified except for >> rebasing and fixing a couple typos in comments. >> >> Full details follow. >> >> Tegra20 and other Tegra SoCs have a video input (VI) peripheral that can >> receive from either MIPI CSI-2 or parallel video (called respectively "CSI" >> and "VIP" in the documentation). The kernel currently has a staging driver >> for Tegra210 CSI capture. This patch set adds support for Tegra20 VIP >> capture. >> >> Unfortunately I had no real documentation available to base this work on. >> I only had a working downstream 3.1 kernel, so I started with the driver >> found there and heavily reworked it to fit into the mainline tegra-video >> driver structure. The existing code appears written with the intent of >> being modular and allow adding new input mechanisms and new SoCs while >> keeping a unique VI core module. However its modularity and extensibility >> was not enough to add Tegra20 VIP support, so I added some hooks to turn >> hard-coded behaviour into per-SoC or per-bus customizable code. There are >> also a fix, some generic cleanups and DT bindings. >> >> Quick tour of the patches: >> >> * Device tree bindings >> >> 01. dt-bindings: display: tegra: add Tegra20 VIP >> 02. dt-bindings: display: tegra: vi: add 'vip' property and example >> >> * Minor improvements to logging, comments, cleanups >> >> 03. staging: media: tegra-video: improve documentation of tegra_video_format fields >> 04. staging: media: tegra-video: document tegra_channel_get_remote_source_subdev >> 05. staging: media: tegra-video: fix typos in comment >> 06. staging: media: tegra-video: improve error messages >> 07. staging: media: tegra-video: slightly simplify cleanup on errors >> 08. staging: media: tegra-video: move private struct declaration to C file >> 09. staging: media: tegra-video: move tegra210_csi_soc to C file >> 10. staging: media: tegra-video: remove unneeded include >> >> * Preparation to make the VI module generic enough to host Tegra20 and VIP >> >> 11. staging: media: tegra-video: Kconfig: allow TPG only on Tegra210 >> 12. staging: media: tegra-video: move tegra_channel_fmt_align to a per-soc op >> 13. staging: media: tegra-video: move default format to soc-specific data >> 14. staging: media: tegra-video: move MIPI calibration calls from VI to CSI >> 15. staging: media: tegra-video: add a per-soc enable/disable op >> 16. staging: media: tegra-video: move syncpt init/free to a per-soc op >> 17. staging: media: tegra-video: add syncpts for Tegra20 to struct tegra_vi >> 18. staging: media: tegra-video: add hooks for planar YUV and H/V flip >> 19. staging: media: tegra-video: add H/V flip controls >> >> * Implementation of VIP and Tegra20 >> >> 20. staging: media: tegra-video: add support for Tegra20 parallel input >> >> Enjoy! >> >> Changed in v5: >> - removed patch 3 as requested by Hans Verkuil; now the driver is kept >> video-node-centric and the enum_format logic is unchanged >> - rebased on top of that >> - trivial fixes (typos) > > According to your review of v4, removing patch 3 was the only change > required, and I didn't do anything else, and there have been no big > changes since v1 anyway, so I was wondering whether this series has any > hope to make it for 6.4... It's borderline. I first need to test it again, and I can do that Friday at the earliest (if I find the time). I'll try, but no promises... Regards, Hans