{"id":23058,"url":"https://patchwork.libcamera.org/api/covers/23058/?format=json","web_url":"https://patchwork.libcamera.org/cover/23058/","project":{"id":1,"url":"https://patchwork.libcamera.org/api/projects/1/?format=json","name":"libcamera","link_name":"libcamera","list_id":"libcamera_core","list_email":"libcamera-devel@lists.libcamera.org","web_url":"","scm_url":"","webscm_url":""},"msgid":"<20250327185945.159481-1-mzamazal@redhat.com>","date":"2025-03-27T18:59:38","name":"[v6,0/6] ipa: simple: Introduce metadata reporting","submitter":{"id":177,"url":"https://patchwork.libcamera.org/api/people/177/?format=json","name":"Milan Zamazal","email":"mzamazal@redhat.com"},"mbox":"https://patchwork.libcamera.org/cover/23058/mbox/","series":[{"id":5087,"url":"https://patchwork.libcamera.org/api/series/5087/?format=json","web_url":"https://patchwork.libcamera.org/project/libcamera/list/?series=5087","date":"2025-03-27T18:59:38","name":"ipa: simple: Introduce metadata reporting","version":6,"mbox":"https://patchwork.libcamera.org/series/5087/mbox/"}],"comments":"https://patchwork.libcamera.org/api/covers/23058/comments/","headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id DD775C323E\n\tfor ;\n\tThu, 27 Mar 2025 18:59:58 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id 1709B68971;\n\tThu, 27 Mar 2025 19:59:58 +0100 (CET)","from us-smtp-delivery-124.mimecast.com\n\t(us-smtp-delivery-124.mimecast.com [170.10.133.124])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id E5A2768947\n\tfor ;\n\tThu, 27 Mar 2025 19:59:55 +0100 (CET)","from mx-prod-mc-04.mail-002.prod.us-west-2.aws.redhat.com\n\t(ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63])\n\tby relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3,\n\tcipher=TLS_AES_256_GCM_SHA384) id us-mta-202-S5Oxp0o1NZutaTZeM7uSNg-1;\n\tThu, 27 Mar 2025 14:59:53 -0400","from mx-prod-int-01.mail-002.prod.us-west-2.aws.redhat.com\n\t(mx-prod-int-01.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.4])\n\t(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n\tkey-exchange X25519 server-signature RSA-PSS (2048 bits)\n\tserver-digest SHA256) (No client certificate requested)\n\tby mx-prod-mc-04.mail-002.prod.us-west-2.aws.redhat.com (Postfix)\n\twith ESMTPS id 0332518EBE91; Thu, 27 Mar 2025 18:59:51 +0000 (UTC)","from mzamazal-thinkpadp1gen7.tpbc.com (unknown [10.45.224.17])\n\tby mx-prod-int-01.mail-002.prod.us-west-2.aws.redhat.com (Postfix)\n\twith ESMTP id 950603001D12; Thu, 27 Mar 2025 18:59:49 +0000 (UTC)"],"Authentication-Results":"lancelot.ideasonboard.com; dkim=pass (1024-bit key;\n\tunprotected) header.d=redhat.com header.i=@redhat.com\n\theader.b=\"ZfYvk55s\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;\n\ts=mimecast20190719; t=1743101994;\n\th=from:from:reply-to:subject:subject:date:date:message-id:message-id:\n\tto:to:cc:cc:mime-version:mime-version:content-type:content-type:\n\tcontent-transfer-encoding:content-transfer-encoding;\n\tbh=cvfkm9arfdSdGG8pyHZiwOpIKxe+wLaXPhW9Il5l28w=;\n\tb=ZfYvk55satLxkT9BQ2D6bLiYK8klYKgcvQW8KH4HNlRrrObW3+YaLEiFzfI6bGgPsEhuQj\n\tRRdZvWI+mSZieRIO/mzz6rPwvsbh5QgtAD1XW9FOCX13Lc//NRmsOUz0A9X9Oe6MTJHxFf\n\tn+Ope0iEh+WpTChBkdamONCYLolSEvM=","X-MC-Unique":"S5Oxp0o1NZutaTZeM7uSNg-1","X-Mimecast-MFC-AGG-ID":"S5Oxp0o1NZutaTZeM7uSNg_1743101991","From":"Milan Zamazal ","To":"libcamera-devel@lists.libcamera.org","Cc":"Milan Zamazal ,\n\tLaurent Pinchart ,\n\tKieran Bingham ","Subject":"[PATCH v6 0/6] ipa: simple: Introduce metadata reporting","Date":"Thu, 27 Mar 2025 19:59:38 +0100","Message-ID":"<20250327185945.159481-1-mzamazal@redhat.com>","MIME-Version":"1.0","X-Scanned-By":"MIMEDefang 3.4.1 on 10.30.177.4","X-Mimecast-Spam-Score":"0","X-Mimecast-MFC-PROC-ID":"v2Nk46SJpxLljU5pTBm2NpMzL_fsLeZzSUYbnsy4RxM_1743101991","X-Mimecast-Originator":"redhat.com","Content-Type":"text/plain; charset=UTF-8","Content-Transfer-Encoding":"8bit","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "},"content":"Provide metadata reporting for the software ISP. This means reporting\nmetadata itself from software ISP and adding relevant values to the\nmetadata.\n\nRunning ‘cam’ with --metadata now produces something like the following:\n\n SensorBlackLevels = [ 4096, 4096, 4096, 4096 ]\n ColourGains = [ 0.001153, 0.001145 ]\n ExposureTime = 66578\n AnalogueGain = 10.666667\n SensorTimestamp = 5466162537000\n\nChanges in v6:\n- Frame info is always added for requests, whether software ISP is used\n or not.\n- SimpleCameraData::completeRequest method merged into\n tryCompleteRequest + related arrangements regarding the metadata\n check.\n- Constructor added to SimpleFrameInfo and used as suggested by Laurent.\n\nChanges in v5:\n- Updated for current master.\n\nChanges in v4:\n- SimpleCameraData::completeRequest just returns if frame info is not\n found.\n- SimpleCameraData::completeRequest split to completeRequest and\n tryCompleteRequest and checkCompleted argument removed.\n- SoftwareIsp::saveMetadata replaced by a lambda function.\n- blackLevels array initialization reflowed to 72 columns.\n- exposureTime converted to the right unit.\n- maybe_unused removed from a used argument.\n- Metadata is taken from frame contexts rather than from active states.\n\nChanges in v3:\n- Don't use dynamic allocation for SimpleFrames entries.\n- A tentative patch to add exposure/gain to metadata.\n\nChanges in v2:\n- Taken over from Kieran.\n- Updated for master.\n- Black level is reported as uint16_t, according to the control\n documentation.\n- Contrast value is reported in metadata.\n- The metadata used to proces the image is reported rather than the\n metadata determined from the image.\n- Metadata is reported using a new signal rather than (ab)using\n setIspParams; this change is less or more needed due to changed simple\n IPA structure since v1.\n- Frame -> request mapping is introduced to make sure the metadata is\n assigned to the right request.\n\nKieran Bingham (3):\n ipa: simple: softisp: Extend to pass metadata\n ipa: simple: Report the ColourGains in metadata\n ipa: simple: Report black levels in metadata\n\nMilan Zamazal (3):\n libcamera: software_isp: Track frames and requests\n ipa: simple: Report contrast in metadata\n ipa: simple: Report exposure in metadata\n\n .../internal/software_isp/software_isp.h | 2 +\n include/libcamera/ipa/soft.mojom | 4 +-\n src/ipa/simple/algorithms/agc.cpp | 11 ++-\n src/ipa/simple/algorithms/awb.cpp | 21 +++-\n src/ipa/simple/algorithms/awb.h | 6 +-\n src/ipa/simple/algorithms/blc.cpp | 11 ++-\n src/ipa/simple/algorithms/lut.cpp | 15 ++-\n src/ipa/simple/algorithms/lut.h | 5 +\n src/ipa/simple/ipa_context.h | 11 ++-\n src/ipa/simple/soft_simple.cpp | 24 +++--\n src/libcamera/pipeline/simple/simple.cpp | 96 ++++++++++++++++++-\n src/libcamera/software_isp/software_isp.cpp | 29 ++++--\n 12 files changed, 207 insertions(+), 28 deletions(-)"}