[{"id":34853,"web_url":"https://patchwork.libcamera.org/comment/34853/","msgid":"","date":"2025-07-11T06:36:39","subject":"Re: [PATCH v9 00/10] Enable raw streams with software ISP","submitter":{"id":232,"url":"https://patchwork.libcamera.org/api/people/232/","name":"Umang Jain","email":"uajain@igalia.com"},"content":"Hi Milan,\n\nOn Mon, Jul 07, 2025 at 05:58:45PM +0200, Milan Zamazal wrote:\n> This makes raw streams working again in ‘simple’ pipeline when software\n> ISP is enabled for the given device. At most one raw stream and one\n> processed stream (possibly both at once) are supported.\n> \n> An example ‘cam’ invocation requesting a raw stream rather than a debayered stream:\n> \n> cam -c1 -C8 -s role=raw,width=1920,height=1080 -Ffile#.raw\n> \n> Or for both raw and processed streams:\n> \n> cam -c1 -C8 -Ffile# \\\n> -s role=viewfinder,width=1920,height=1080,pixelformat=RGB888 \\\n> -s role=raw,width=3280,height=2464,pixelformat=SRGGB8\n> \n\nI am still working through the series, but I think this series has been\nvery reliant on the roles passed, whereas it's completely normal that\napplication can request empty CameraConfiguration and add desired\nconfiguration by addConfiguration(). In this case, it will completely\nbypass the roles.\n\n> When only a raw stream is requested, there are no exposure/gain\n> adjustments applied. This could be improved in future, once software\n> ISP gets a mechanism to gather image statistics without processing and\n> using them to make the adjustments, or once manual exposure controls are\n> added to software ISP. In the meantime, exposure must be changed\n> externally.\n> \n> Tested-by: Kieran Bingham \n> Tested-by: Robert Mader\n> \n> Changes in v9:\n> - Fix of calling a wrong output buffer allocator when both raw and\n> processed streams are used.\n> \n> Changes in v8:\n> - A missing `status = Adjusted' added to\n> SimpleCameraConfiguration::validate.\n> - Code comments regarding raw colour space for raw requested roles\n> added.\n> - Dropped raw format helpers.\n> \n> Changes in v7:\n> - Rebased on current master.\n> \n> Changes in v6:\n> - An unnecessary copy of formats avoided.\n> - rawRequested_ and processedrequested_ set to false when there are no\n> roles.\n> - rawRequested_ and processedrequested_ updated in\n> SimpleCameraConfiguration::validate().\n> \n> Changes in v5:\n> - Possible temporary segfault in the patch adding plain output\n> configurations avoided.\n> - PixelFormatInfo::isRaw() helper added.\n> - SimplePipelineHandler::setUpFormatSizes replaced with a lambda\n> function.\n> - SimpleCameraData::{rawRequested_,processedRequested_} are set in\n> SimpleCameraConfiguration first and copied to SimpleCameraData only\n> after successful configure().\n> \n> Changes in v4:\n> - Broken range pruning due to passing a value rather than a reference\n> fixed.\n> - New common function isFormatRaw introduced.\n> - The patch assigning colour spaces in the simple pipeline, previously\n> posted separately, included in this series, as the first patch. It\n> can still be handled separately; in any case the rest sort of depends\n> on it.\n> - Setting metadataRequired to false where needed to prevent freezes and\n> assertion errors; related to metadata reporting support merged to\n> master since v3.\n> \n> Changes in v3:\n> - Significantly reworked, with both functional and clarity improvements.\n> The level of guesswork and confusion is hopefully reduced enough now\n> to drop the RFC prefix.\n> - The number of streams is set to 2 only with software ISP.\n> - SimpleCameraData::pipeConfig_ nullptr check patch dropped.\n> - PPM/raw file output patch dropped from this series. Let’s handle this\n> separately as the patch series is already complex enough.\n> \n> Changes in v2:\n> - Completely reworked.\n> - Extended to be able to produce a raw stream together with a processed\n> stream.\n> \n> Milan Zamazal (10):\n> libcamera: software_isp: Assign colour spaces in configurations\n> libcamera: simple: Set the number of software ISP streams to 2\n> libcamera: simple: Don't use raw output formats with conversions\n> libcamera: simple: Add plain output configurations\n> libcamera: simple: Identify requested stream roles\n> libcamera: simple: Consider raw output configurations\n> libcamera: simple: Validate raw stream configurations\n> libcamera: simple: Don't enforce conversion with an added raw stream\n> libcamera: simple: Require metadata only when software ISP is used\n> libcamera: simple: Make raw streams working\n> \n> src/libcamera/pipeline/simple/simple.cpp | 293 ++++++++++++++++++-----\n> 1 file changed, 230 insertions(+), 63 deletions(-)\n> \n> -- \n> 2.50.0\n>","headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id 9923EBE175\n\tfor ;\n\tFri, 11 Jul 2025 06:36:42 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id DC79368F09;\n\tFri, 11 Jul 2025 08:36:41 +0200 (CEST)","from fanzine2.igalia.com (fanzine2.igalia.com [213.97.179.56])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id 95A6261517\n\tfor ;\n\tFri, 11 Jul 2025 08:36:40 +0200 (CEST)","from [49.43.35.133] (helo=uajain)\n\tby fanzine2.igalia.com with esmtpsa \n\t(Cipher TLS1.3:ECDHE_SECP256R1__RSA_PSS_RSAE_SHA256__AES_256_GCM:256)\n\t(Exim) id 1ua7N9-00FGAa-7b; Fri, 11 Jul 2025 08:36:39 +0200"],"Authentication-Results":"lancelot.ideasonboard.com;\n\tdkim=fail reason=\"signature verification failed\" (2048-bit key;\n\tunprotected) header.d=igalia.com header.i=@igalia.com\n\theader.b=\"Oo6bI816\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=igalia.com;\n\ts=20170329;\n\th=In-Reply-To:Content-Transfer-Encoding:Content-Type:MIME-Version\n\t:References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To:Content-ID:\n\tContent-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc\n\t:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe:\n\tList-Post:List-Owner:List-Archive;\n\tbh=WCVabv0dWkWANmfMeRfWSDyEdnId6+37jIj3NBneyJk=;\n\tb=Oo6bI816bLMnUF5GPk1ZLjU8MI\n\ta4Fn0rzP/DHpq9PVphipPUBBpXxOgh9NoMuj/HDbSw1GLHW9SvwZF0gWupkwy+5UI+8KzbqfMH9B3\n\tmB078p9TEdUwVFN90vHha2uuVS6jQjEitHhNE9W9TfVUGqNDVkhOhmrQeXltjDvov+YGmQ0yil/sv\n\tHwjgm+NCIFQAfMS8/EqmMHOIcu83fqsnPuVBc8p+2Fae/6wpgTLWvJm+pKnD+6FXdEkUn4sdQlNW+\n\tcX91QQNUeztmrml4JVbvvTtfnYxRodKDZIQoSsP0V2t0cXrYNudCUhPM1f6wshY+q8d6AdPW9b0Mv\n\tckLiDkSQ==;","Date":"Fri, 11 Jul 2025 12:06:39 +0530","From":"Umang Jain ","To":"Milan Zamazal ","Cc":"libcamera-devel@lists.libcamera.org, Laurent Pinchart\n\t, Kieran Bingham\n\t, =?utf-8?q?Barnab=C3=A1s_P=C5=91cze?=\n\t, Paul Elder\n\t, Robert Mader ","Subject":"Re: [PATCH v9 00/10] Enable raw streams with software ISP","Message-ID":"","References":"<20250707155856.33436-1-mzamazal@redhat.com>","MIME-Version":"1.0","Content-Type":"text/plain; charset=utf-8","Content-Disposition":"inline","Content-Transfer-Encoding":"8bit","In-Reply-To":"<20250707155856.33436-1-mzamazal@redhat.com>","User-Agent":"NeoMutt/20250510-dirty","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "}},{"id":34862,"web_url":"https://patchwork.libcamera.org/comment/34862/","msgid":"<855xfyd9yy.fsf@mzamazal-thinkpadp1gen7.tpbc.csb>","date":"2025-07-11T15:27:01","subject":"Re: [PATCH v9 00/10] Enable raw streams with software ISP","submitter":{"id":177,"url":"https://patchwork.libcamera.org/api/people/177/","name":"Milan Zamazal","email":"mzamazal@redhat.com"},"content":"Hi Umang,\n\nUmang Jain writes:\n\n> Hi Milan,\n>\n> On Mon, Jul 07, 2025 at 05:58:45PM +0200, Milan Zamazal wrote:\n>> This makes raw streams working again in ‘simple’ pipeline when software\n>> ISP is enabled for the given device. At most one raw stream and one\n>> processed stream (possibly both at once) are supported.\n>> \n>> An example ‘cam’ invocation requesting a raw stream rather than a debayered stream:\n>> \n>> cam -c1 -C8 -s role=raw,width=1920,height=1080 -Ffile#.raw\n>> \n>> Or for both raw and processed streams:\n>> \n>> cam -c1 -C8 -Ffile# \\\n>> -s role=viewfinder,width=1920,height=1080,pixelformat=RGB888 \\\n>> -s role=raw,width=3280,height=2464,pixelformat=SRGGB8\n>> \n>\n> I am still working through the series, but I think this series has been\n> very reliant on the roles passed, whereas it's completely normal that\n> application can request empty CameraConfiguration and add desired\n> configuration by addConfiguration(). In this case, it will completely\n> bypass the roles.\n\nI think this can be remedied easily as discussed in \"Identify requested\nstream roles\" patch review.\n\n>> When only a raw stream is requested, there are no exposure/gain\n>> adjustments applied. This could be improved in future, once software\n>> ISP gets a mechanism to gather image statistics without processing and\n>> using them to make the adjustments, or once manual exposure controls are\n>> added to software ISP. In the meantime, exposure must be changed\n>> externally.\n>> \n>> Tested-by: Kieran Bingham \n>> Tested-by: Robert Mader\n>> \n>> Changes in v9:\n>> - Fix of calling a wrong output buffer allocator when both raw and\n>> processed streams are used.\n>> \n>> Changes in v8:\n>> - A missing `status = Adjusted' added to\n>> SimpleCameraConfiguration::validate.\n>> - Code comments regarding raw colour space for raw requested roles\n>> added.\n>> - Dropped raw format helpers.\n>> \n>> Changes in v7:\n>> - Rebased on current master.\n>> \n>> Changes in v6:\n>> - An unnecessary copy of formats avoided.\n>> - rawRequested_ and processedrequested_ set to false when there are no\n>> roles.\n>> - rawRequested_ and processedrequested_ updated in\n>> SimpleCameraConfiguration::validate().\n>> \n>> Changes in v5:\n>> - Possible temporary segfault in the patch adding plain output\n>> configurations avoided.\n>> - PixelFormatInfo::isRaw() helper added.\n>> - SimplePipelineHandler::setUpFormatSizes replaced with a lambda\n>> function.\n>> - SimpleCameraData::{rawRequested_,processedRequested_} are set in\n>> SimpleCameraConfiguration first and copied to SimpleCameraData only\n>> after successful configure().\n>> \n>> Changes in v4:\n>> - Broken range pruning due to passing a value rather than a reference\n>> fixed.\n>> - New common function isFormatRaw introduced.\n>> - The patch assigning colour spaces in the simple pipeline, previously\n>> posted separately, included in this series, as the first patch. It\n>> can still be handled separately; in any case the rest sort of depends\n>> on it.\n>> - Setting metadataRequired to false where needed to prevent freezes and\n>> assertion errors; related to metadata reporting support merged to\n>> master since v3.\n>> \n>> Changes in v3:\n>> - Significantly reworked, with both functional and clarity improvements.\n>> The level of guesswork and confusion is hopefully reduced enough now\n>> to drop the RFC prefix.\n>> - The number of streams is set to 2 only with software ISP.\n>> - SimpleCameraData::pipeConfig_ nullptr check patch dropped.\n>> - PPM/raw file output patch dropped from this series. Let’s handle this\n>> separately as the patch series is already complex enough.\n>> \n>> Changes in v2:\n>> - Completely reworked.\n>> - Extended to be able to produce a raw stream together with a processed\n>> stream.\n>> \n>> Milan Zamazal (10):\n>> libcamera: software_isp: Assign colour spaces in configurations\n>> libcamera: simple: Set the number of software ISP streams to 2\n>> libcamera: simple: Don't use raw output formats with conversions\n>> libcamera: simple: Add plain output configurations\n>> libcamera: simple: Identify requested stream roles\n>> libcamera: simple: Consider raw output configurations\n>> libcamera: simple: Validate raw stream configurations\n>> libcamera: simple: Don't enforce conversion with an added raw stream\n>> libcamera: simple: Require metadata only when software ISP is used\n>> libcamera: simple: Make raw streams working\n>> \n>> src/libcamera/pipeline/simple/simple.cpp | 293 ++++++++++++++++++-----\n>> 1 file changed, 230 insertions(+), 63 deletions(-)\n>> \n>> -- \n>> 2.50.0\n>>","headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id C01D3BE175\n\tfor ;\n\tFri, 11 Jul 2025 15:27:08 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id 7892368F15;\n\tFri, 11 Jul 2025 17:27:08 +0200 (CEST)","from us-smtp-delivery-124.mimecast.com\n\t(us-smtp-delivery-124.mimecast.com [170.10.133.124])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id 3121868E30\n\tfor ;\n\tFri, 11 Jul 2025 17:27:07 +0200 (CEST)","from mail-ed1-f70.google.com (mail-ed1-f70.google.com\n\t[209.85.208.70]) by relay.mimecast.com with ESMTP with STARTTLS\n\t(version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id\n\tus-mta-20-9glkTUEeNZ211KA9q0k3Ag-1; Fri, 11 Jul 2025 11:27:04 -0400","by mail-ed1-f70.google.com with SMTP id\n\t4fb4d7f45d1cf-6069f1c97b3so1861126a12.2\n\tfor ;\n\tFri, 11 Jul 2025 08:27:04 -0700 (PDT)","from mzamazal-thinkpadp1gen7.tpbc.csb\n\t(ip-77-48-47-2.net.vodafone.cz. [77.48.47.2])\n\tby smtp.gmail.com with ESMTPSA id\n\t4fb4d7f45d1cf-611c935d2eesm2325800a12.0.2025.07.11.08.27.01\n\t(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n\tFri, 11 Jul 2025 08:27:02 -0700 (PDT)"],"Authentication-Results":"lancelot.ideasonboard.com; dkim=pass (1024-bit key;\n\tunprotected) header.d=redhat.com header.i=@redhat.com\n\theader.b=\"SkimPXCA\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;\n\ts=mimecast20190719; t=1752247626;\n\th=from:from:reply-to:subject:subject:date:date:message-id:message-id:\n\tto:to:cc:cc:mime-version:mime-version:content-type:content-type:\n\tcontent-transfer-encoding:content-transfer-encoding:\n\tin-reply-to:in-reply-to:references:references;\n\tbh=scVHCcTyHt5el0Ax/jD3lWaByTERq+8x8rRUsLozugU=;\n\tb=SkimPXCArPavNoCW6u9p69zne80vTNwwx7ofa/MPuYyaH194RXJR+l3r/qQAUtramLVkLz\n\tvNyhXfPhtgEfnadGjfW214nhlOFtwsNJgREQJ5UrPi/l8a78+klf3RgMSDBGELtT9MMKbi\n\tRw2+dZKAXTyhRLQZsfBCTJI9uL2osKs=","X-MC-Unique":"9glkTUEeNZ211KA9q0k3Ag-1","X-Mimecast-MFC-AGG-ID":"9glkTUEeNZ211KA9q0k3Ag_1752247623","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20230601; t=1752247623; x=1752852423;\n\th=content-transfer-encoding:mime-version:user-agent:message-id:date\n\t:references:in-reply-to:subject:cc:to:from:x-gm-message-state:from\n\t:to:cc:subject:date:message-id:reply-to;\n\tbh=scVHCcTyHt5el0Ax/jD3lWaByTERq+8x8rRUsLozugU=;\n\tb=S5K3CWzBlyr41t3061DDgJQCATT4RlvvgqGpwMsUrkH4giAV7fqLLmZHhgrnslxXeA\n\tkpou71kDi2poPtA9Qiq5kpDvR2usp3CUXxO2D8eleD3v8K5w0K9XUZeroaFzMZNNUjmN\n\tc4f+8spXiTxmXQRJzKnSgCQQ7qufcv7n9FRF/yrX0lHiLmWXlMocoPZGpZ+1OC4Q2Ute\n\ttcwe7AqtIwZ7+EDm9BuSa7FVESYw39QdRAZhrDlc6OhSWC3XySX5X5hjOGbjymdxgiQ2\n\tdwbOieFbD1sVcdVnzW4n1tuegjEyAdwD8AEYqAPQyFXrB07kfCtGiBIccype+jDp+Fph\n\t0WaQ==","X-Gm-Message-State":"AOJu0Yy0O7KA/Y0iMpcIZHY2i8WCluYSX0McV67aiYLvUDCdVhNhlJ/o\n\tuUrwnbRkJs6M6nC+4pmtgQ6y4B4C6U1PKwajtT7umh4o/FsWqZB/ZHswgHYmcJCczlcyL46SxTJ\n\tqFvlLJSRBm7XSims2UcDs+THfdhacWFgg0nyM0QA2E79CuSzWR4XkNc4ihj97h8d0HwJTMGngWB\n\tI=","X-Gm-Gg":"ASbGnctxtIqCFYyCFaz8GgOQlNFbKKJ8Ol1kGG8DyNgRSCD1yH0kyB14fVNkPcTS1U0\n\tHbD5Y64KJRQTWCbJelNLQidHFr6Pno5fQxlROM3drZgqq+C1vGEm1AlOW7s6d9XhLVd+2Z5ZaPB\n\tYiyoNnhOGj0LQ6bSoXKXhcURnwX+I00IB2ID09xfrP7NOf8RcWzClIhx+sjCrka7gphYnCieQXM\n\tSYc3CfdJdJD7gCfaaYDh1XADCMs1mgWEx2hegcKjRK++4/kG2STwzsjgEgT8CNzScq9Mz3AlZAf\n\tPAWFtZzXP4sN9Vyt/g26QFf9yspZvZVDtvucx7BHjLpRZeJSf8wG7qt59jAuroMBOsp8+UXW9gY\n\tjEKmdrQZwyXPQL9Iv","X-Received":["by 2002:aa7:cf83:0:b0:60e:e4b:b8e1 with SMTP id\n\t4fb4d7f45d1cf-611e84ff13dmr3059019a12.34.1752247623349; \n\tFri, 11 Jul 2025 08:27:03 -0700 (PDT)","by 2002:aa7:cf83:0:b0:60e:e4b:b8e1 with SMTP id\n\t4fb4d7f45d1cf-611e84ff13dmr3058992a12.34.1752247622918; \n\tFri, 11 Jul 2025 08:27:02 -0700 (PDT)"],"X-Google-Smtp-Source":"AGHT+IHbJh0YM4MVeo6FKEbAJJsP60qxfkjsyfFJwNg/0a1dYDngYDJ18yc7rI/2qkQPsOysIQkufw==","From":"Milan Zamazal ","To":"Umang Jain ","Cc":"libcamera-devel@lists.libcamera.org, Laurent Pinchart\n\t,\n\tKieran Bingham , =?utf-8?q?Barnab?=\n\t=?utf-8?b?w6FzIFDFkWN6ZQ==?=\n\t, Paul Elder\n\t, Robert Mader ","Subject":"Re: [PATCH v9 00/10] Enable raw streams with software ISP","In-Reply-To":"\n\t(Umang Jain's message of \"Fri, 11 Jul 2025 12:06:39 +0530\")","References":"<20250707155856.33436-1-mzamazal@redhat.com>\n\t","Date":"Fri, 11 Jul 2025 17:27:01 +0200","Message-ID":"<855xfyd9yy.fsf@mzamazal-thinkpadp1gen7.tpbc.csb>","User-Agent":"Gnus/5.13 (Gnus v5.13)","MIME-Version":"1.0","X-Mimecast-Spam-Score":"0","X-Mimecast-MFC-PROC-ID":"h17B9wplzrz1ftSEsCTAVVh43K_ego2ijYq4WTQ2ddo_1752247623","X-Mimecast-Originator":"redhat.com","Content-Type":"text/plain; charset=utf-8","Content-Transfer-Encoding":"quoted-printable","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "}}]