From patchwork Wed Feb 23 10:48:20 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jean-Michel Hautbois X-Patchwork-Id: 15372 Return-Path: X-Original-To: parsemail@patchwork.libcamera.org Delivered-To: parsemail@patchwork.libcamera.org Received: from lancelot.ideasonboard.com (lancelot.ideasonboard.com [92.243.16.209]) by patchwork.libcamera.org (Postfix) with ESMTPS id 5B170BE08A for ; Wed, 23 Feb 2022 10:48:32 +0000 (UTC) Received: from lancelot.ideasonboard.com (localhost [IPv6:::1]) by lancelot.ideasonboard.com (Postfix) with ESMTP id CBD826115A; Wed, 23 Feb 2022 11:48:30 +0100 (CET) Authentication-Results: lancelot.ideasonboard.com; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=ideasonboard.com header.i=@ideasonboard.com header.b="DDPJsTfq"; dkim-atps=neutral Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [IPv6:2001:4b98:dc2:55:216:3eff:fef7:d647]) by lancelot.ideasonboard.com (Postfix) with ESMTPS id 74541601FE for ; Wed, 23 Feb 2022 11:48:28 +0100 (CET) Received: from tatooine.ideasonboard.com (unknown [IPv6:2a01:e0a:169:7140:7ebc:9e38:c4df:c57]) by perceval.ideasonboard.com (Postfix) with ESMTPSA id F300FDD; Wed, 23 Feb 2022 11:48:27 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1645613308; bh=JgcKQOljnU/VsNvv07Qw+zXWU2woFR6QrnMuCigZTmU=; h=From:To:Cc:Subject:Date:From; b=DDPJsTfqExpCveZpGztOHV+W0tVGT851ZQfcj6LEBGWFOTgFNVkvaHosGxRCOeFKY yIONgHPOpxIsXneAzXKrigvOgg+7D8R47X90B7nA/CIB+BvGahActXYwffkiYik3jU t+do6jjYnuGxwKSa38ataAK67u4sD3u+zx8eiHs0= From: Jean-Michel Hautbois To: libcamera-devel@lists.libcamera.org Date: Wed, 23 Feb 2022 11:48:20 +0100 Message-Id: <20220223104824.25723-1-jeanmichel.hautbois@ideasonboard.com> X-Mailer: git-send-email 2.32.0 MIME-Version: 1.0 Subject: [libcamera-devel] [PATCH v2 0/4] IPA RkISP1 awb and misc improvements X-BeenThere: libcamera-devel@lists.libcamera.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libcamera-devel-bounces@lists.libcamera.org Sender: "libcamera-devel" Hello, This series introduces several algorithms or tuning parameters for the RkISP1 IPA. The first algorithm is the black level correction. The output is washed out if no black correction is applied. It uses the tuning values from the imx219 data file in RPi. Patch 3/4 introduces the histogram IQ mean estimation as for the IPU3 and uses the maximum of the relative luminance gain and the iqMean gain to determine the shutter speed and analogue gain to apply. Now, patch 4/4 can estimate the AWB gains to apply on the red and blue channels. The RkISP1 could theoretically give us the red, green and blue mean values for the current frame, but the kernel seems to lack support for this. Use the YCrCb estimation instead, and convert the values to RGB before estimating the gains. We don't have a grid of average values, only a global mean for each channel. I have removed two algorithms from this series: sensor degamma and crosstalk matrix. Those need a bit more work (sdg curve may be the wrong one according to the previous review, and the crosstalk matrix is not a tuned one). I have made some captures (qcam seems to invert width and height when saving the image though): [1]: agc only (current master): https://snipboard.io/dFO23J.jpg [2]: [1] with histogram and black level: https://snipboard.io/fd9zC2.jpg [3]: [2] with awb: https://snipboard.io/Sp9Ei6.jpg This is the state with this v2 series applied on top of master. And for the record, I picked the previous sdg and ctk algorithms to capture with those: [4]: [3] with sensor degamma: https://snipboard.io/5QO46g.jpg [5]: [4] with crosstalk matrix: https://snipboard.io/tDOV7l.jpg Jean-Michel Hautbois (4): ipa: rkisp1: Use frame index ipa: rkisp1: Introduce Black Level Correction ipa: rkisp1: agc: Introduce histogram calculation ipa: rkisp1: Introduce AWB src/ipa/rkisp1/algorithms/agc.cpp | 102 ++++++++++++++--- src/ipa/rkisp1/algorithms/agc.h | 4 +- src/ipa/rkisp1/algorithms/awb.cpp | 155 ++++++++++++++++++++++++++ src/ipa/rkisp1/algorithms/awb.h | 33 ++++++ src/ipa/rkisp1/algorithms/blc.cpp | 57 ++++++++++ src/ipa/rkisp1/algorithms/blc.h | 30 +++++ src/ipa/rkisp1/algorithms/meson.build | 2 + src/ipa/rkisp1/ipa_context.cpp | 36 ++++++ src/ipa/rkisp1/ipa_context.h | 19 ++++ src/ipa/rkisp1/rkisp1.cpp | 15 ++- 10 files changed, 428 insertions(+), 25 deletions(-) create mode 100644 src/ipa/rkisp1/algorithms/awb.cpp create mode 100644 src/ipa/rkisp1/algorithms/awb.h create mode 100644 src/ipa/rkisp1/algorithms/blc.cpp create mode 100644 src/ipa/rkisp1/algorithms/blc.h