{"id":13179,"url":"https://patchwork.libcamera.org/api/1.1/patches/13179/?format=json","web_url":"https://patchwork.libcamera.org/patch/13179/","project":{"id":1,"url":"https://patchwork.libcamera.org/api/1.1/projects/1/?format=json","name":"libcamera","link_name":"libcamera","list_id":"libcamera_core","list_email":"libcamera-devel@lists.libcamera.org","web_url":"","scm_url":"","webscm_url":""},"msgid":"<20210803133205.6599-3-umang.jain@ideasonboard.com>","date":"2021-08-03T13:32:03","name":"[libcamera-devel,2/4] ipu3: cio2: Replicate CameraSensor::getFormats() to a member function","commit_ref":null,"pull_url":null,"state":"superseded","archived":false,"hash":"5c64c4d2dd62cd6311af1a75cf4c5749b89e5f24","submitter":{"id":86,"url":"https://patchwork.libcamera.org/api/1.1/people/86/?format=json","name":"Umang Jain","email":"umang.jain@ideasonboard.com"},"delegate":{"id":12,"url":"https://patchwork.libcamera.org/api/1.1/users/12/?format=json","username":"uajain","first_name":"Umang","last_name":"Jain","email":"umang.jain@ideasonboard.com"},"mbox":"https://patchwork.libcamera.org/patch/13179/mbox/","series":[{"id":2296,"url":"https://patchwork.libcamera.org/api/1.1/series/2296/?format=json","web_url":"https://patchwork.libcamera.org/project/libcamera/list/?series=2296","date":"2021-08-03T13:32:01","name":"ipu3: Change sensor size selection policy","version":1,"mbox":"https://patchwork.libcamera.org/series/2296/mbox/"}],"comments":"https://patchwork.libcamera.org/api/patches/13179/comments/","check":"pending","checks":"https://patchwork.libcamera.org/api/patches/13179/checks/","tags":{},"headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id 709CBC3235\n\tfor ;\n\tTue, 3 Aug 2021 13:32:31 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id 287C1687BC;\n\tTue, 3 Aug 2021 15:32:31 +0200 (CEST)","from perceval.ideasonboard.com (perceval.ideasonboard.com\n\t[IPv6:2001:4b98:dc2:55:216:3eff:fef7:d647])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id CFF056026A\n\tfor ;\n\tTue, 3 Aug 2021 15:32:29 +0200 (CEST)","from perceval.ideasonboard.com (unknown [103.238.109.12])\n\tby perceval.ideasonboard.com (Postfix) with ESMTPSA id 7281E3F0;\n\tTue, 3 Aug 2021 15:32:28 +0200 (CEST)"],"Authentication-Results":"lancelot.ideasonboard.com;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=ideasonboard.com header.i=@ideasonboard.com\n\theader.b=\"cS0Pgq0/\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com;\n\ts=mail; t=1627997549;\n\tbh=XI2fwNT/vRzreI/MHOIyCO6zOrg+qzwqMxOr0NiIQ70=;\n\th=From:To:Cc:Subject:Date:In-Reply-To:References:From;\n\tb=cS0Pgq0/3VT4lktHkcXNSJKonKsHJ+pVuUIlPoRTVc5UO1LVypDlpKDYxySkyjVdn\n\tafsIkocJKTJVD8WEPDozoyyGNFOwP+SZt8toGL5ryJgXrCKyEIWX4+/fYJB2/NLbmc\n\tRyqBOh+3njgcIDFf32DNzsu5AV6I+CyjOTG9x9kg=","From":"Umang Jain ","To":"libcamera-devel@lists.libcamera.org","Date":"Tue, 3 Aug 2021 19:02:03 +0530","Message-Id":"<20210803133205.6599-3-umang.jain@ideasonboard.com>","X-Mailer":"git-send-email 2.31.1","In-Reply-To":"<20210803133205.6599-1-umang.jain@ideasonboard.com>","References":"<20210803133205.6599-1-umang.jain@ideasonboard.com>","MIME-Version":"1.0","Content-Transfer-Encoding":"8bit","Subject":"[libcamera-devel] [PATCH 2/4] ipu3: cio2: Replicate\n\tCameraSensor::getFormats() to a member function","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "},"content":"This prepares a base to introduce custom selection of sensor format\nbased on platform(soraka or nautilus) constraints. The changes in\nselection policy will be introduced in a subsequent patch.\n\nThe replication of the function is not verbatim and has small changes.\nCameraSensor::getFormats() has accesss to all the supported sensor\nformats via a V4L2Subdevice::Formats internally and use it directly.\nWe do not want to expose V4L2Subdevice::Formats directly to the\npipeline-handler hence, the patch is adapted to use the\nCameraSensor::sizes(mbusCode) instead, to get the range of sensor sizes\nsupported for desired media bus codes.\n\nNo functional changes in this patch.\n\nSigned-off-by: Umang Jain \n---\n src/libcamera/pipeline/ipu3/cio2.cpp | 91 +++++++++++++++++++++++++++-\n src/libcamera/pipeline/ipu3/cio2.h | 3 +\n 2 files changed, 92 insertions(+), 2 deletions(-)","diff":"diff --git a/src/libcamera/pipeline/ipu3/cio2.cpp b/src/libcamera/pipeline/ipu3/cio2.cpp\nindex 6f2ef321..be063613 100644\n--- a/src/libcamera/pipeline/ipu3/cio2.cpp\n+++ b/src/libcamera/pipeline/ipu3/cio2.cpp\n@@ -7,6 +7,8 @@\n \n #include \"cio2.h\"\n \n+#include \n+\n #include \n \n #include \n@@ -170,7 +172,7 @@ int CIO2Device::configure(const Size &size, V4L2DeviceFormat *outputFormat)\n \t * the CIO2 output device.\n \t */\n \tstd::vector mbusCodes = utils::map_keys(mbusCodesToPixelFormat);\n-\tsensorFormat = sensor_->getFormat(mbusCodes, size);\n+\tsensorFormat = getSensorFormat(mbusCodes, size);\n \tret = sensor_->setFormat(&sensorFormat);\n \tif (ret)\n \t\treturn ret;\n@@ -208,7 +210,7 @@ StreamConfiguration CIO2Device::generateConfiguration(Size size) const\n \n \t/* Query the sensor static information for closest match. */\n \tstd::vector mbusCodes = utils::map_keys(mbusCodesToPixelFormat);\n-\tV4L2SubdeviceFormat sensorFormat = sensor_->getFormat(mbusCodes, size);\n+\tV4L2SubdeviceFormat sensorFormat = getSensorFormat(mbusCodes, size);\n \tif (!sensorFormat.mbus_code) {\n \t\tLOG(IPU3, Error) << \"Sensor does not support mbus code\";\n \t\treturn {};\n@@ -221,6 +223,91 @@ StreamConfiguration CIO2Device::generateConfiguration(Size size) const\n \treturn cfg;\n }\n \n+/**\n+ * \\brief Retrieve the best sensor format for a desired output\n+ * \\param[in] mbusCodes The list of acceptable media bus codes\n+ * \\param[in] size The desired size\n+ *\n+ * Media bus codes are selected from \\a mbusCodes, which lists all acceptable\n+ * codes in decreasing order of preference. Media bus codes supported by the\n+ * sensor but not listed in \\a mbusCodes are ignored. If none of the desired\n+ * codes is supported, it returns an error.\n+ *\n+ * \\a size indicates the desired size at the output of the sensor. This method\n+ * selects the best media bus code and size supported by the sensor according\n+ * to the following criteria.\n+ *\n+ * - The desired \\a size shall fit in the sensor output size to avoid the need\n+ * to up-scale.\n+ * - The sensor output size shall match the desired aspect ratio to avoid the\n+ * need to crop the field of view.\n+ * - The sensor output size shall be as small as possible to lower the required\n+ * bandwidth.\n+ * - The desired \\a size shall be supported by one of the media bus code listed\n+ * in \\a mbusCodes.\n+ *\n+ * When multiple media bus codes can produce the same size, the code at the\n+ * lowest position in \\a mbusCodes is selected.\n+ *\n+ * The use of this method is optional, as the above criteria may not match the\n+ * needs of all pipeline handlers. Pipeline handlers may implement custom\n+ * sensor format selection when needed.\n+ *\n+ * The returned sensor output format is guaranteed to be acceptable by the\n+ * setFormat() method without any modification.\n+ *\n+ * \\return The best sensor output format matching the desired media bus codes\n+ * and size on success, or an empty format otherwise.\n+ */\n+V4L2SubdeviceFormat CIO2Device::getSensorFormat(const std::vector &mbusCodes,\n+\t\t\t\t\t\tconst Size &size) const\n+{\n+\tunsigned int desiredArea = size.width * size.height;\n+\tunsigned int bestArea = UINT_MAX;\n+\tfloat desiredRatio = static_cast(size.width) / size.height;\n+\tfloat bestRatio = FLT_MAX;\n+\tSize bestSize;\n+\tuint32_t bestCode = 0;\n+\n+\tfor (unsigned int code : mbusCodes) {\n+\t\tconst auto sizes = sensor_->sizes(code);\n+\t\tif (!sizes.size())\n+\t\t\tcontinue;\n+\n+\t\tfor (const Size &sz : sizes) {\n+\t\t\tif (sz.width < size.width || sz.height < size.height)\n+\t\t\t\tcontinue;\n+\n+\t\t\tfloat ratio = static_cast(sz.width) / sz.height;\n+\t\t\tfloat ratioDiff = fabsf(ratio - desiredRatio);\n+\t\t\tunsigned int area = sz.width * sz.height;\n+\t\t\tunsigned int areaDiff = area - desiredArea;\n+\n+\t\t\tif (ratioDiff > bestRatio)\n+\t\t\t\tcontinue;\n+\n+\t\t\tif (ratioDiff < bestRatio || areaDiff < bestArea) {\n+\t\t\t\tbestRatio = ratioDiff;\n+\t\t\t\tbestArea = areaDiff;\n+\t\t\t\tbestSize = sz;\n+\t\t\t\tbestCode = code;\n+\t\t\t}\n+\t\t}\n+\t}\n+\n+\tif (bestSize.isNull()) {\n+\t\tLOG(IPU3, Debug) << \"No supported format or size found\";\n+\t\treturn {};\n+\t}\n+\n+\tV4L2SubdeviceFormat format{\n+\t\t.mbus_code = bestCode,\n+\t\t.size = bestSize,\n+\t};\n+\n+\treturn format;\n+}\n+\n int CIO2Device::exportBuffers(unsigned int count,\n \t\t\t std::vector> *buffers)\n {\ndiff --git a/src/libcamera/pipeline/ipu3/cio2.h b/src/libcamera/pipeline/ipu3/cio2.h\nindex f28e9f1d..da024d45 100644\n--- a/src/libcamera/pipeline/ipu3/cio2.h\n+++ b/src/libcamera/pipeline/ipu3/cio2.h\n@@ -45,6 +45,9 @@ public:\n \tint exportBuffers(unsigned int count,\n \t\t\t std::vector> *buffers);\n \n+\tV4L2SubdeviceFormat getSensorFormat(const std::vector &mbusCodes,\n+\t\t\t\t\t const Size &size) const;\n+\n \tint start();\n \tint stop();\n \n","prefixes":["libcamera-devel","2/4"]}