[libcamera-devel,v5,00/10] libcamera: ipa: Add basic IPA support

2138 mbox series

Hi,

This series adds basic support for Image Processing Algorithms (IPA). It
extends the pipeline handler framework to optionally allow an IPA plugin
to interact with buffers and to send actions to the pipeline.

This series adds an Auto Exposure control and extends the rkisp1
pipeline with and IPA that implements a very basic control loop for
exposure time and gain. The series compared to v2 have been merged with
the meta data series that was developed on top of this and now supports
reporting meta data back to the application about the control loop
state.

* Changes since v4
 - Improved documentation.
 - Moved the generic Timeline to be RkISP1 specific. Documentation for 
   the Timeline is kept to make it easier to break out later if needed.

* Changes since v3
 - Rebase to make use of ControlLists.
 - Total redesign on the IPA/pipeline interface. Fall out of this is 
   more or less all patches in the series have been reworked compared to 
   v3.

* Changes since v2
 - The series is more or less rewritten from v2 so a meaningful change
   log is hard to produce.

Niklas Söderlund (10):
  libcamera: pipeline: Move IPA from pipeline to camera data
  libcamera: controls: Fix documentation of AwbEnable
  libcamera: controls: Add AeEnable control
  libcamera: controls: Add AeLocked control
  libcamera: request: Add metadata information
  libcamera: ipa: meson: Allow access to internal libcamera headers
  libcamera: ipa: Extend to support IPA interactions
  include: linux: Add rkisp1 kernel header and format definitions
  libcamera: ipa: rkisp1: Add basic control of auto exposure
  libcamera: pipeline: rkisp1: Attach to an IPA

 include/ipa/ipa_interface.h                   |  38 +
 include/ipa/rkisp1.h                          |  23 +
 include/libcamera/request.h                   |   2 +
 include/linux/rkisp1-config.h                 | 816 ++++++++++++++++++
 include/linux/videodev2.h                     |   4 +
 src/ipa/ipa_dummy.cpp                         |   7 +-
 src/ipa/ipa_rkisp1.cpp                        | 281 ++++++
 src/ipa/meson.build                           |  15 +-
 src/libcamera/control_ids.yaml                |  20 +-
 src/libcamera/include/pipeline_handler.h      |   2 +
 src/libcamera/ipa_interface.cpp               | 195 +++++
 src/libcamera/pipeline/rkisp1/meson.build     |   2 +
 .../pipeline/rkisp1/rkisp1-timeline.cpp       |  51 ++
 src/libcamera/pipeline/rkisp1/rkisp1.cpp      | 328 ++++++-
 src/libcamera/pipeline/rkisp1/rkisp1.h        |  78 ++
 src/libcamera/pipeline/rkisp1/timeline.cpp    | 229 +++++
 src/libcamera/pipeline/rkisp1/timeline.h      |  72 ++
 src/libcamera/pipeline/vimc.cpp               |  12 +-
 src/libcamera/pipeline_handler.cpp            |   8 +
 src/libcamera/proxy/ipa_proxy_linux.cpp       |  14 +-
 src/libcamera/request.cpp                     |  14 +
 21 files changed, 2180 insertions(+), 31 deletions(-)
 create mode 100644 include/ipa/rkisp1.h
 create mode 100644 include/linux/rkisp1-config.h
 create mode 100644 src/ipa/ipa_rkisp1.cpp
 create mode 100644 src/libcamera/pipeline/rkisp1/rkisp1-timeline.cpp
 create mode 100644 src/libcamera/pipeline/rkisp1/rkisp1.h
 create mode 100644 src/libcamera/pipeline/rkisp1/timeline.cpp
 create mode 100644 src/libcamera/pipeline/rkisp1/timeline.h