From patchwork Thu Nov 9 21:02:52 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Umang Jain X-Patchwork-Id: 16431 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:b129:0:b0:403:3b70:6f57 with SMTP id q9csp705119vqs; Thu, 9 Nov 2023 13:03:39 -0800 (PST) X-Google-Smtp-Source: AGHT+IFg+Aa0KUrtvdJY9bf3KtJy7JaYjbY8aUACzGJFPYXSjV/1GOiWa2ajtwTopmFspF8IT6gc X-Received: by 2002:a17:90a:34cd:b0:27d:2601:bc92 with SMTP id m13-20020a17090a34cd00b0027d2601bc92mr589753pjf.11.1699563818885; Thu, 09 Nov 2023 13:03:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1699563818; cv=none; d=google.com; s=arc-20160816; b=y/qk8dAs0p9axeoIXK7ICuVSByxW1XbKr1ap8BZ9USyzl8JKcX9pxQTZyDk+M8ROqb TOgn8YOjVfWlCPd40tlqAwuSeKE0VCp4aR77JS9gDx7gAr82OGC7xWpIyv3B4m2YqIYr 1RwizEYu76T8eaf1UV7J5w4bQw+Sui8yERAaq8T7GUDaeGe0S8EmIR3Sa43auH1zBUiD 3RG3oOCxiZHxloETSIrvhMmCU35umG4nC4V1Mb+F5PgyL4jsnwipJoT77ROk/snsLVV7 8fn6+UZHxNWflJaNyf1IzCnzjRJxygCwPdyJkAstYTnyyT5nN0m/ANflMKBWGEwOKeV0 JPjQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=F2hiUAAIWPpcWXxznM0BY4FGaGLJ+YS4ZYLdtWsv7BY=; fh=jB4ZJnu48Rd5A9Gw+jJTxc8V04xPsHLMeRevtz00HEY=; b=lkG6aI96PZT4XBHAIK9DTNh2wohTbHFEdcJVKcAQtT4MSFQgcZv7GPeodiP6A/UJ2c faVGbrq5rSgpoM+En01S1XKsG/Yudd0eoWgJc8MQwH3VKyhJJrxRUTPw9UgOn084qm/T /i3DYG2lw0K45RNXQ+VmIGrfU8KMnFNVBgB+t6angIQGFE7LBqWYc04FHgKpem2jh9nv hi1q7rQBPm/RriRNVKVWx/FH3xbS3pvT8E7gOydjomf3g827e2zuhsfctCr7jHWaxIvs OUT6BJeKmXcuXyzW7H46klG7i9DeLNPH8P7XXTihNyfA8+Og3Qtw52gUPrknuA3irNoi xNTA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass (test mode) header.i=@ideasonboard.com header.s=mail header.b=BhEBrXzv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: from snail.vger.email (snail.vger.email. [2620:137:e000::3:7]) by mx.google.com with ESMTPS id lw5-20020a17090b180500b0028047ab56desi2726576pjb.36.2023.11.09.13.03.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 09 Nov 2023 13:03:38 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) client-ip=2620:137:e000::3:7; Authentication-Results: mx.google.com; dkim=pass (test mode) header.i=@ideasonboard.com header.s=mail header.b=BhEBrXzv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 7EF11839C866; Thu, 9 Nov 2023 13:03:36 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1345141AbjKIVDX (ORCPT + 30 others); Thu, 9 Nov 2023 16:03:23 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35000 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229871AbjKIVDW (ORCPT ); Thu, 9 Nov 2023 16:03:22 -0500 Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [IPv6:2001:4b98:dc2:55:216:3eff:fef7:d647]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 652123A8D; Thu, 9 Nov 2023 13:03:20 -0800 (PST) Received: from umang.jain (unknown [103.251.226.64]) by perceval.ideasonboard.com (Postfix) with ESMTPSA id 4C9E56EF; Thu, 9 Nov 2023 22:02:53 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1699563775; bh=mmbO87nh5mz7pqHh+iTwGNB+opdv/5av5rOCwQbRdhU=; h=From:To:Cc:Subject:Date:From; b=BhEBrXzv2YD+14NCMuaJBGgd1S/2uG68SNi1UPwk5s83IRhDj6+cH+5YeOUN61G0C r//ORYr9FlRb1INss0Jy+aNIX4PtJj/h/qZDDmCQrcKbnavRp0DN306PMNb5FTdt87 9f54S1b3SY2+StENBB1meyWlealKX8+oewhL+Zr0= From: Umang Jain To: linux-media@vger.kernel.org, kernel-list@raspberrypi.com, linux-kernel@vger.kernel.org, linux-rpi-kernel@lists.infradead.org, linux-arm-kernel@lists.infradead.org, linux-staging@lists.linux.dev Cc: Dave Stevenson , Kieran Bingham , Laurent Pinchart , "Ricardo B . Marliere" , Dan Carpenter , Stefan Wahren , Umang Jain Subject: [PATCH v2 00/15] staging: vc04_services: bcm2835-isp support Date: Thu, 9 Nov 2023 16:02:52 -0500 Message-ID: <20231109210309.638594-1-umang.jain@ideasonboard.com> X-Mailer: git-send-email 2.41.0 MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Thu, 09 Nov 2023 13:03:36 -0800 (PST) X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: 1782121830856203489 X-GMAIL-MSGID: 1782121830856203489 This series aims to upport bcm2835-isp from the RPi kernel. It is developed on top of staging-next which comprises many VC04 changes for it's de-staging. Hence, the merge of this driver is targeted when VC04 is de-staged completely (which I have been pushing), but it can be helped getting reviewed meanwhile. Hence, the reason for posting the series. Patch (01-02)/15 adds a new driver named vc-sm-cma to handle memory sharing with the VC4 VPU. Patch 03/15 adds a small extension to videobuf2 to allow exporting as a dma_buf instead of a file-descriptor. Patch (04-05)/15 adds a couple of improvements/support for bcm2835-isp(event callback and zero-copy) to vchiq-mmal. Patch (06-10)/15 adds the core bcm2835-isp driver along with headers and format defintions. 09/15 is a standalone patch which can be merged independently I believe. Patch (11-12)/15 deals with the colorspace support. Patch 13/15 allows multiple instances of the ISP. Patch 14/15 adds a admin-guide document on bcm2835-isp. Patch 15/15 deals with driver registeration. Dave Stevenson (6): staging: vc04_services: Add new vc-sm-cma driver media: videobuf2: Allow exporting of a struct dmabuf staging: mmal-vchiq: Add support for event callbacks staging: mmal-vchiq: Use vc-sm-cma to support zero copy staging: mmal_vchiq: Add image formats to be used by bcm2835-isp uapi: bcm2835-isp: Add bcm2835-isp uapi header file David Plowman (2): vc04_services: bcm2835-isp: Allow formats with different colour spaces vc04_services: bcm2835-isp: Permit all sRGB colour spaces on ISP outputs Naushir Patuck (4): media: uapi: v4l2-core: Add ISP statistics output V4L2 fourcc type staging: vc04_services: bcm2835-isp: Add a more complex ISP processing component staging: vc04_services: bcm2835_isp: Allow multiple users docs: admin-guide: media: bcm2835-isp: Add documentation for bcm2835-isp Umang Jain (3): staging: vc04_services: vchiq_arm: Register vcsm-cma driver staging: vc04_services: Add helpers for vchiq driver data staging: vc04_services: vchiq: Register bcm2835-isp .../admin-guide/media/bcm2835-isp.rst | 127 ++ .../userspace-api/media/drivers/index.rst | 1 + .../userspace-api/media/v4l/meta-formats.rst | 1 + .../v4l/pixfmt-meta-bcm2835-isp-stats.rst | 32 + MAINTAINERS | 9 + .../media/common/videobuf2/videobuf2-core.c | 36 +- drivers/media/v4l2-core/v4l2-ioctl.c | 1 + drivers/staging/vc04_services/Kconfig | 4 + drivers/staging/vc04_services/Makefile | 3 +- .../staging/vc04_services/bcm2835-isp/Kconfig | 14 + .../vc04_services/bcm2835-isp/Makefile | 4 + .../bcm2835-isp/bcm2835-isp-ctrls.h | 72 + .../bcm2835-isp/bcm2835-isp-fmts.h | 559 +++++ .../bcm2835-isp/bcm2835-v4l2-isp.c | 1822 +++++++++++++++++ .../interface/vchiq_arm/vchiq_arm.c | 6 + .../interface/vchiq_arm/vchiq_bus.h | 10 + .../staging/vc04_services/vc-sm-cma/Kconfig | 10 + .../staging/vc04_services/vc-sm-cma/Makefile | 4 + .../staging/vc04_services/vc-sm-cma/vc_sm.c | 817 ++++++++ .../staging/vc04_services/vc-sm-cma/vc_sm.h | 54 + .../vc04_services/vc-sm-cma/vc_sm_cma_vchi.c | 507 +++++ .../vc04_services/vc-sm-cma/vc_sm_cma_vchi.h | 63 + .../vc04_services/vc-sm-cma/vc_sm_defs.h | 187 ++ .../vc04_services/vc-sm-cma/vc_sm_knl.h | 28 + .../staging/vc04_services/vchiq-mmal/Kconfig | 1 + .../vc04_services/vchiq-mmal/mmal-common.h | 5 + .../vc04_services/vchiq-mmal/mmal-encodings.h | 66 + .../vc04_services/vchiq-mmal/mmal-msg.h | 35 + .../vchiq-mmal/mmal-parameters.h | 165 +- .../vc04_services/vchiq-mmal/mmal-vchiq.c | 253 ++- .../vc04_services/vchiq-mmal/mmal-vchiq.h | 5 + include/media/videobuf2-core.h | 15 + include/uapi/linux/bcm2835-isp.h | 347 ++++ include/uapi/linux/v4l2-controls.h | 5 + include/uapi/linux/videodev2.h | 1 + 35 files changed, 5235 insertions(+), 34 deletions(-) create mode 100644 Documentation/admin-guide/media/bcm2835-isp.rst create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-meta-bcm2835-isp-stats.rst create mode 100644 drivers/staging/vc04_services/bcm2835-isp/Kconfig create mode 100644 drivers/staging/vc04_services/bcm2835-isp/Makefile create mode 100644 drivers/staging/vc04_services/bcm2835-isp/bcm2835-isp-ctrls.h create mode 100644 drivers/staging/vc04_services/bcm2835-isp/bcm2835-isp-fmts.h create mode 100644 drivers/staging/vc04_services/bcm2835-isp/bcm2835-v4l2-isp.c create mode 100644 drivers/staging/vc04_services/vc-sm-cma/Kconfig create mode 100644 drivers/staging/vc04_services/vc-sm-cma/Makefile create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm.c create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm.h create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm_cma_vchi.c create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm_cma_vchi.h create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm_defs.h create mode 100644 drivers/staging/vc04_services/vc-sm-cma/vc_sm_knl.h create mode 100644 include/uapi/linux/bcm2835-isp.h