{"id":18247,"url":"https://patchwork.libcamera.org/api/patches/18247/?format=json","web_url":"https://patchwork.libcamera.org/patch/18247/","project":{"id":1,"url":"https://patchwork.libcamera.org/api/projects/1/?format=json","name":"libcamera","link_name":"libcamera","list_id":"libcamera_core","list_email":"libcamera-devel@lists.libcamera.org","web_url":"","scm_url":"","webscm_url":""},"msgid":"<20230203094424.25243-3-naush@raspberrypi.com>","date":"2023-02-03T09:44:18","name":"[libcamera-devel,v1,2/8] pipeline: raspberrypi: Handle MandatoryStream hints for Unicam Image","commit_ref":null,"pull_url":null,"state":"new","archived":false,"hash":"b9a5c5077698fad972d4b9b88cff1b38edf83fb6","submitter":{"id":34,"url":"https://patchwork.libcamera.org/api/people/34/?format=json","name":"Naushir Patuck","email":"naush@raspberrypi.com"},"delegate":null,"mbox":"https://patchwork.libcamera.org/patch/18247/mbox/","series":[{"id":3739,"url":"https://patchwork.libcamera.org/api/series/3739/?format=json","web_url":"https://patchwork.libcamera.org/project/libcamera/list/?series=3739","date":"2023-02-03T09:44:16","name":"Stream hints","version":1,"mbox":"https://patchwork.libcamera.org/series/3739/mbox/"}],"comments":"https://patchwork.libcamera.org/api/patches/18247/comments/","check":"pending","checks":"https://patchwork.libcamera.org/api/patches/18247/checks/","tags":{},"headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id DA0B7C323E\n\tfor ;\n\tFri, 3 Feb 2023 09:44:31 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id D769A625EA;\n\tFri, 3 Feb 2023 10:44:30 +0100 (CET)","from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com\n\t[IPv6:2a00:1450:4864:20::42e])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id 1BE38625E8\n\tfor ;\n\tFri, 3 Feb 2023 10:44:29 +0100 (CET)","by mail-wr1-x42e.google.com with SMTP id d14so4088636wrr.9\n\tfor ;\n\tFri, 03 Feb 2023 01:44:29 -0800 (PST)","from localhost.localdomain ([93.93.133.154])\n\tby smtp.gmail.com with ESMTPSA id\n\tf17-20020a5d50d1000000b002bfe266d710sm1562503wrt.90.2023.02.03.01.44.27\n\t(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n\tFri, 03 Feb 2023 01:44:28 -0800 (PST)"],"DKIM-Signature":["v=1; a=rsa-sha256; c=relaxed/simple; d=libcamera.org;\n\ts=mail; t=1675417471;\n\tbh=WsKEAbgG9IiE5tFzEqPV+5BgzO8xIyNo52sfMFQqOyo=;\n\th=To:Date:In-Reply-To:References:Subject:List-Id:List-Unsubscribe:\n\tList-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:\n\tFrom;\n\tb=iSaMcTGfwx4Gommcjq+rij+YagSCelrPS88uJYVaNIiVRlhdgCHGVv0C1USyKzml+\n\tU+s0EYc+CpllvawJybYyeQXOOOefftOR+Srr4aEfLODU9wuv24oVMRoaku0v1NUQ6G\n\trGUI2BUQ8bGm9p2AmCpIp6snP6UPOVYVFRqXveFWEMiRtD1Y1/VF1YtSpIHRE4jRk1\n\tUlLKYZZ8+PpMA3WDx6OwqH3LCTIesI5mg6S++Z/TttSrwpiGChvdnHZ7nMbDRzHHay\n\t8deJ1Ts3LiKwj5MP2HUVbhxSR5XqNMG+C20i0lEo9CihTPZVVOfiem5N8+Lgr2eDKO\n\tgXTtWB3rxD7sQ==","v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=raspberrypi.com; s=google;\n\th=content-transfer-encoding:mime-version:references:in-reply-to\n\t:message-id:date:subject:cc:to:from:from:to:cc:subject:date\n\t:message-id:reply-to;\n\tbh=xsXDGZ71N+GwEVQMLu8d8M3IAh85egvxBwrqphOJo0g=;\n\tb=cU6m2sJfTCx45df1eJFGTyXv9Ua+NnNCv5PsX+amdOCtiwK7pnlkhU17W9XcAv4Tp2\n\tyVDfDnOtunuAge6Wpm4+lwcEhKLDrgDq4W9GP+2QSweSqo9b64AFdynv2/HIcY7T+Y6j\n\tn9sLsiIOVdHJKYLhpb+4GSvLEVwKGRgSs3D9l/pApQwEfvXcnL+R3Si2k0t8jO/qLgJR\n\tmSBtzsenepFZB5waLX5y0yZxqDS/WfTnfj9wfdNVYAj2hfG9gsJbFGbZdEcn+MIGMJKG\n\tC8MbC36q9c50zRF3vGhK0o8b9ALxkO1Hn5sKe1xaxt4WZ7ilQn0D9wQaJE+8eLrbH3Gn\n\t+2Bg=="],"Authentication-Results":"lancelot.ideasonboard.com; dkim=pass (2048-bit key; \n\tunprotected) header.d=raspberrypi.com\n\theader.i=@raspberrypi.com\n\theader.b=\"cU6m2sJf\"; dkim-atps=neutral","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20210112;\n\th=content-transfer-encoding:mime-version:references:in-reply-to\n\t:message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc\n\t:subject:date:message-id:reply-to;\n\tbh=xsXDGZ71N+GwEVQMLu8d8M3IAh85egvxBwrqphOJo0g=;\n\tb=0LBEXaC2ICmpMEFKZn0k5hVPRcZ53ARXOuQiOOTJgJu/0sHN6Oz9ZJNPlNJi3+aqLK\n\tXBdfRZUg8tyX5+ulFSUv3bx5yuSU9H88sI9v36bqavJfcvhgnxle7QiaoMbZkHJkQS7f\n\trR+7r73CPKh7OMgIumrRRqcAHSxcq0QwRxCycvr0aWQcfKPViI3/uOhP+Giy3f3rrT5i\n\tow3DZXwx/w9I6RvYRxPyIU0toAV/JWlItpuV7JnyHRs7VnFClKPlNk0nGYaeJJoXoRhM\n\tHOYLhhSi9E4ISLs5lKmNDrw/X2q/1evRA3NONFRmcZZvRc3Scnug+r/fjX6FZpnRBAy+\n\tD7mw==","X-Gm-Message-State":"AO0yUKUjyDBy1XDSS9bT94EgHozaHxCCylgF3xmHL45BKZC5k7HjHssd\n\twMR1hCg7nMGUBBDtrvLYog+OvPyS5u3fOPa+v1Na4A==","X-Google-Smtp-Source":"AK7set9qm4FtxfCgwu6JeJaCTvTCOQV1OwSfHuj70zaAqhYxNjyD4f7wqmm4gQZtZZUeG1mwobrNwg==","X-Received":"by 2002:a5d:6d05:0:b0:2bf:dd84:adf6 with SMTP id\n\te5-20020a5d6d05000000b002bfdd84adf6mr10270074wrq.60.1675417468543; \n\tFri, 03 Feb 2023 01:44:28 -0800 (PST)","To":"libcamera-devel@lists.libcamera.org","Date":"Fri, 3 Feb 2023 09:44:18 +0000","Message-Id":"<20230203094424.25243-3-naush@raspberrypi.com>","X-Mailer":"git-send-email 2.25.1","In-Reply-To":"<20230203094424.25243-1-naush@raspberrypi.com>","References":"<20230203094424.25243-1-naush@raspberrypi.com>","MIME-Version":"1.0","Content-Transfer-Encoding":"8bit","Subject":"[libcamera-devel] [PATCH v1 2/8] pipeline: raspberrypi: Handle\n\tMandatoryStream hints for Unicam Image","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","From":"Naushir Patuck via libcamera-devel\n\t","Reply-To":"Naushir Patuck ","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "},"content":"Look for MandatoryStream flag in the hints field of the Unicam Image\nStreamConfiguration structure. If this flag is set, it guarantees that the\napplication will provide buffers for Unicam Image, so override the\nminUnicamBuffers and minTotalUnicamBuffers config parameters in the following\nway:\n\n- If startup drop frames are required, allocate at least 1 internal buffer.\n- If no startup drop frames are required, do not allocate any internal buffers.\n\nAll other buffer allocations remain unchanged.\n\nSigned-off-by: Naushir Patuck \n---\n .../pipeline/raspberrypi/raspberrypi.cpp | 34 +++++++++++++++----\n 1 file changed, 27 insertions(+), 7 deletions(-)","diff":"diff --git a/src/libcamera/pipeline/raspberrypi/raspberrypi.cpp b/src/libcamera/pipeline/raspberrypi/raspberrypi.cpp\nindex d752911ddfff..7d786fe839f7 100644\n--- a/src/libcamera/pipeline/raspberrypi/raspberrypi.cpp\n+++ b/src/libcamera/pipeline/raspberrypi/raspberrypi.cpp\n@@ -1520,12 +1520,33 @@ int PipelineHandlerRPi::queueAllBuffers(Camera *camera)\n int PipelineHandlerRPi::prepareBuffers(Camera *camera)\n {\n \tRPiCameraData *data = cameraData(camera);\n+\tunsigned int minUnicamBuffers = data->config_.minUnicamBuffers;\n+\tunsigned int minTotalUnicamBuffers = data->config_.minTotalUnicamBuffers;\n \tunsigned int numRawBuffers = 0;\n \tint ret;\n \n \tfor (Stream *s : camera->streams()) {\n-\t\tif (isRaw(s->configuration().pixelFormat)) {\n+\t\tif (s == &data->unicam_[Unicam::Image]) {\n \t\t\tnumRawBuffers = s->configuration().bufferCount;\n+\t\t\t/*\n+\t\t\t * If the application provides a guarantees that Unicam\n+\t\t\t * image buffers will always be provided for the RAW stream\n+\t\t\t * in a Request, we need:\n+\t\t\t * - at least 1 internal Unicam buffer to handle startup frame drops,\n+\t\t\t * - no internal Unicam buffers if there are no startup frame drops.\n+\t\t\t */\n+\t\t\tif (s->configuration().hints &\n+\t\t\t StreamConfiguration::Hint::MandatoryStream) {\n+\t\t\t\tif (data->dropFrameCount_) {\n+\t\t\t\t\tminUnicamBuffers = std::max(1u, minUnicamBuffers);\n+\t\t\t\t\tminTotalUnicamBuffers =\n+\t\t\t\t\t\tstd::max(minUnicamBuffers, minTotalUnicamBuffers);\n+\t\t\t\t} else {\n+\t\t\t\t\tminUnicamBuffers = 0;\n+\t\t\t\t\tminTotalUnicamBuffers = 0;\n+\t\t\t\t}\n+\t\t\t}\n+\n \t\t\tbreak;\n \t\t}\n \t}\n@@ -1537,7 +1558,6 @@ int PipelineHandlerRPi::prepareBuffers(Camera *camera)\n \t\t * For Unicam, allocate a minimum number of buffers for internal\n \t\t * use as we want to avoid any frame drops.\n \t\t */\n-\t\tconst unsigned int minBuffers = data->config_.minTotalUnicamBuffers;\n \t\tif (stream == &data->unicam_[Unicam::Image]) {\n \t\t\t/*\n \t\t\t * If an application has configured a RAW stream, allocate\n@@ -1545,8 +1565,8 @@ int PipelineHandlerRPi::prepareBuffers(Camera *camera)\n \t\t\t * we have at least minUnicamBuffers of internal buffers\n \t\t\t * to use to minimise frame drops.\n \t\t\t */\n-\t\t\tnumBuffers = std::max(data->config_.minUnicamBuffers,\n-\t\t\t\t\t\t minBuffers - numRawBuffers);\n+\t\t\tnumBuffers = std::max(minUnicamBuffers,\n+\t\t\t\t\t\t minTotalUnicamBuffers - numRawBuffers);\n \t\t} else if (stream == &data->isp_[Isp::Input]) {\n \t\t\t/*\n \t\t\t * ISP input buffers are imported from Unicam, so follow\n@@ -1554,15 +1574,15 @@ int PipelineHandlerRPi::prepareBuffers(Camera *camera)\n \t\t\t * available.\n \t\t\t */\n \t\t\tnumBuffers = numRawBuffers +\n-\t\t\t\t std::max(data->config_.minUnicamBuffers,\n-\t\t\t\t\t\t minBuffers - numRawBuffers);\n+\t\t\t\t std::max(minUnicamBuffers,\n+\t\t\t\t\t\t minTotalUnicamBuffers - numRawBuffers);\n \n \t\t} else if (stream == &data->unicam_[Unicam::Embedded]) {\n \t\t\t/*\n \t\t\t * Embedded data buffers are (currently) for internal use,\n \t\t\t * so allocate the minimum required to avoid frame drops.\n \t\t\t */\n-\t\t\tnumBuffers = minBuffers;\n+\t\t\tnumBuffers = data->config_.minTotalUnicamBuffers;\n \t\t} else {\n \t\t\t/*\n \t\t\t * Since the ISP runs synchronous with the IPA and requests,\n","prefixes":["libcamera-devel","v1","2/8"]}