[{"id":28683,"web_url":"https://patchwork.libcamera.org/comment/28683/","msgid":"<87r0hclhv5.fsf@redhat.com>","date":"2024-02-16T12:21:34","subject":"Re: [PATCH v3 16/16] libcamera: Add \"Software ISP benchmarking\"\n\tdocumentation","submitter":{"id":177,"url":"https://patchwork.libcamera.org/api/people/177/","name":"Milan Zamazal","email":"mzamazal@redhat.com"},"content":"Hans de Goede writes:\n\n> Add a \"Software ISP benchmarking\" documentation section which describes\n> the performance/power consumption measurements used during\n> the Software ISP's development.\n>\n> Signed-off-by: Hans de Goede \n> ---\n> Documentation/index.rst | 1 +\n> Documentation/meson.build | 1 +\n> Documentation/software-isp-benchmarking.rst | 82 +++++++++++++++++++++\n> 3 files changed, 84 insertions(+)\n> create mode 100644 Documentation/software-isp-benchmarking.rst\n>\n> diff --git a/Documentation/index.rst b/Documentation/index.rst\n> index 63fac72d..5442ae75 100644\n> --- a/Documentation/index.rst\n> +++ b/Documentation/index.rst\n> @@ -24,3 +24,4 @@\n> Lens driver requirements \n> Python Bindings \n> Camera Sensor Model \n> + SoftwareISP Benchmarking \n> diff --git a/Documentation/meson.build b/Documentation/meson.build\n> index 7a58fec8..3872e0a8 100644\n> --- a/Documentation/meson.build\n> +++ b/Documentation/meson.build\n> @@ -80,6 +80,7 @@ if sphinx.found()\n> 'lens_driver_requirements.rst',\n> 'python-bindings.rst',\n> 'sensor_driver_requirements.rst',\n> + 'software-isp-benchmarking.rst',\n> '../README.rst',\n> ]\n> \n> diff --git a/Documentation/software-isp-benchmarking.rst b/Documentation/software-isp-benchmarking.rst\n> new file mode 100644\n> index 00000000..321db138\n> --- /dev/null\n> +++ b/Documentation/software-isp-benchmarking.rst\n> @@ -0,0 +1,82 @@\n> +.. SPDX-License-Identifier: CC-BY-SA-4.0\n> +\n> +.. _software-isp-benchmarking:\n> +\n> +Software ISP benchmarking\n> +=========================\n> +\n> +The Software ISP is particularly sensitive to performance regressions\n> +therefore it is a good idea to always benchmark the Software ISP\n> +before and after making changes to it and ensure that there are\n> +no performance regressions.\n> +\n> +DebayerCpu class builtin benchmark\n> +----------------------------------\n> +\n> +The DebayerCpu class has a builtin benchmark. This benchmark\n> +measures the time spend on processing (collecting statistics\n\nspend -> spent\n\n> +and debayering) only, it does not measure the time spent on\n> +capturing or outputting the frames.\n> +\n> +The builtin benchmark always runs. So this can be used by simply\n> +running \"cam\" or \"qcam\" with a pipeline using the Software ISP.\n> +\n> +When it runs it will skip measuring the first 30 frames to\n> +allow the caches and the CPU temperature (turbo-ing) to warm-up\n> +and then it measures 30 fps and shows the total and per frame\n> +processing time using an info level log message:\n> +\n> +.. code-block::\n> +\n> + INFO Debayer debayer_cpu.cpp:907 Processed 30 frames in 244317us, 8143 us/frame\n> +\n> +To get stable measurements it is advised to disable any other processes which\n\nwhich -> that ? (native speakers: please clarify)\n\n> +may cause significant CPU usage (e.g. disable wifi, bluetooth and browsers).\n> +When possible it is also advisable to disable CPU turbo-ing and\n> +frequency-scaling.\n> +\n> +For example when benchmarking on a Lenovo ThinkPad X1 Yoga Gen 8, with\n> +the charger plugged in, the CPU can be fixed to run at 2 GHz using:\n> +\n> +.. code-block::\n> +\n> + sudo x86_energy_perf_policy --turbo-enable 0\n> + sudo cpupower frequency-set -d 2GHz -u 2GHz\n> +\n> +with these settings the builtin bench reports a processing time of ~7.8ms/frame\n> +on this laptop for FHD SGRBG10 (unpacked) bayer data.\n> +\n> +Measuring power consumption\n> +---------------------------\n> +\n> +Since the Software ISP is often used on mobile devices it is also\n> +important to measure power consumption and ensure that that does\n> +not regress.\n> +\n> +For example to measure power consumption on a Lenovo ThinkPad X1 Yoga Gen 8\n> +it needs to be running on battery and it should be configured with its\n> +platform-profile (/sys/firmware/acpi/platform_profile) set to balanced and\n> +with its default turbo and frequency-scaling behavior to match real world usage.\n> +\n> +Then start qcam to capture a FHD picture at 30 fps and position the qcam window\n> +so that it is fully visible. After this run the following command to monitor\n> +the power consumption:\n> +\n> +.. code-block::\n> +\n> + watch -n 10 cat /sys/class/power_supply/BAT0/power_now /sys/class/hwmon/hwmon6/fan?_input\n> +\n> +Note this not only measures the power consumption in ųW it also monitors\n\nųW -> µW\n\n> +the speed of this laptop's 2 fans. This is important because depending on\n> +the ambient temperature the 2 fans may spin up while testing and this\n> +will cause an additional power consumption of approx. 0.5W messing up\n\nI believe units should be separated from numbers, i.e. 0.5W -> 0.5 W (the same\nbelow).\n\n> +the measurement.\n> +\n> +After starting qcam + the watch command let the laptop sit without using\n> +it for 2 minutes for the readings to stabilize. Then check that the fans\n> +have not turned on and manually take a couple of consecutive power readings\n> +and avarage these.\n\navarage -> average\n\n> +\n> +On the example Lenovo ThinkPad X1 Yoga Gen 8 laptop this results in\n> +a measured power consumption of approx. 13W while running qcam versus\n> +approx. 4-5W while setting idle with its OLED panel on.\n\nThis poor man's method of measurement is probably good enough with the advantage\nof being quite universally applicable. I still wonder whether modern hardware +\nOS provide better means to get numbers about the power consumption.","headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id 70F04BDE17\n\tfor ;\n\tFri, 16 Feb 2024 12:21:43 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id C0AFC62801;\n\tFri, 16 Feb 2024 13:21:42 +0100 (CET)","from us-smtp-delivery-124.mimecast.com\n\t(us-smtp-delivery-124.mimecast.com [170.10.129.124])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id 8171261CAE\n\tfor ;\n\tFri, 16 Feb 2024 13:21:40 +0100 (CET)","from mail-ej1-f70.google.com (mail-ej1-f70.google.com\n\t[209.85.218.70]) by relay.mimecast.com with ESMTP with STARTTLS\n\t(version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id\n\tus-mta-651-fNu1bAuLPc62ajv7rAhzoQ-1; Fri, 16 Feb 2024 07:21:37 -0500","by mail-ej1-f70.google.com with SMTP id\n\ta640c23a62f3a-a2b068401b4so234639266b.1\n\tfor ;\n\tFri, 16 Feb 2024 04:21:37 -0800 (PST)","from nuthatch (ip-77-48-47-2.net.vodafone.cz. [77.48.47.2])\n\tby smtp.gmail.com with ESMTPSA id\n\tlj8-20020a170907188800b00a35cf6727c1sm1494372ejc.105.2024.02.16.04.21.35\n\t(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n\tFri, 16 Feb 2024 04:21:35 -0800 (PST)"],"Authentication-Results":"lancelot.ideasonboard.com;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=redhat.com header.i=@redhat.com\n\theader.b=\"ewfGt+Nx\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;\n\ts=mimecast20190719; t=1708086099;\n\th=from:from:reply-to:subject:subject:date:date:message-id:message-id:\n\tto:to:cc:cc:mime-version:mime-version:content-type:content-type:\n\tcontent-transfer-encoding:content-transfer-encoding:\n\tin-reply-to:in-reply-to:references:references;\n\tbh=L4I6zOXgKZJurMqkSrhw/Q47cKIR+f+rpHdQ+mzUFyg=;\n\tb=ewfGt+NxpHvqImBQmnQaXaqPIlM98dCBfVN78C6PMFDGKIRaZ993KDI5shp6qqtlIFmQvW\n\ta7fFiS4ZnQzDlUnKxi/1JCDxihSEpOJK7cZ2U9/cY08nOGSuzVCzjzLPauokzfRdlSjHLS\n\tJ6H9sKCs6k2NckymlZAgG2yLxdPHX+k=","X-MC-Unique":"fNu1bAuLPc62ajv7rAhzoQ-1","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20230601; t=1708086096; x=1708690896;\n\th=content-transfer-encoding:mime-version:user-agent:message-id:date\n\t:references:in-reply-to:subject:cc:to:from:x-gm-message-state:from\n\t:to:cc:subject:date:message-id:reply-to;\n\tbh=HCA8x+DjvVbFdhUi+zgVGVH1pxGqKPkDDQyPTrFeiYU=;\n\tb=P7i1qJ2kZDOyzDMrU6f0wo7Ly3LekvFRkNcNBwVvJKSqrQvCVJEA9vdR2PoaiK74+2\n\tJDdtS/37/cP6+al2a6kkyYTXa+Y062fM4bDJuaqbyPGi0motT1/V3Kl1YhEhXZRV/Zis\n\tDsf9w2LlhwDmSl33D/rZusDME3eSjV3so9cl+qp5cNMuDh0mC5T8nL/OGQ81gzU5tlk+\n\tP6yNPfR990cfAivdE5D4MSCsJ4KZtA7ipojIjhB0J57OS/E+Ek84JSBiWPUI6RbVf0og\n\tsD6oNMCi1f0t+YI96sIMELIi4sBmA9A4XGfs74Ifw92axwZ7pqkYUEA+nkEBjZcBmw8N\n\tbWKg==","X-Gm-Message-State":"AOJu0YxoBJ4UudBMLJO7w5sOfVC9ed8fP0XROQebwyuRs7i8c7UDCuLK\n\tGv1exbtv7e4ZisNGDk++yv5MCKfrtO/GMNTd8PN4ShR3ii+JAUvWw3HKnW1oC+FNHUYDxxgtxpZ\n\tpvs4dvvscorQzForszJUNFKL7TpuUWxgDjEV9F1sntLnGjHQIa6aRUTthVvo2H76O1bAPDAQ=","X-Received":["by 2002:a17:907:7243:b0:a38:567a:6574 with SMTP id\n\tds3-20020a170907724300b00a38567a6574mr8162238ejc.5.1708086096504; \n\tFri, 16 Feb 2024 04:21:36 -0800 (PST)","by 2002:a17:907:7243:b0:a38:567a:6574 with SMTP id\n\tds3-20020a170907724300b00a38567a6574mr8162215ejc.5.1708086096005; \n\tFri, 16 Feb 2024 04:21:36 -0800 (PST)"],"X-Google-Smtp-Source":"AGHT+IG4uzhXaoi0YBSSmwndUb7VN/rK6jDHAuiEqiVtKz8zWy37p5ulp9offz96OtjZb6p7+TNLgQ==","From":"Milan Zamazal ","To":"Hans de Goede ","Subject":"Re: [PATCH v3 16/16] libcamera: Add \"Software ISP benchmarking\"\n\tdocumentation","In-Reply-To":"<20240214170122.60754-17-hdegoede@redhat.com> (Hans de Goede's\n\tmessage of \"Wed, 14 Feb 2024 18:01:20 +0100\")","References":"<20240214170122.60754-1-hdegoede@redhat.com>\n\t<20240214170122.60754-17-hdegoede@redhat.com>","Date":"Fri, 16 Feb 2024 13:21:34 +0100","Message-ID":"<87r0hclhv5.fsf@redhat.com>","User-Agent":"Gnus/5.13 (Gnus v5.13)","MIME-Version":"1.0","X-Mimecast-Spam-Score":"0","X-Mimecast-Originator":"redhat.com","Content-Type":"text/plain; charset=utf-8","Content-Transfer-Encoding":"quoted-printable","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Cc":"Bryan O'Donoghue ,\n\tlibcamera-devel@lists.libcamera.org, Maxime Ripard , \n\tPavel Machek ","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "}},{"id":28761,"web_url":"https://patchwork.libcamera.org/comment/28761/","msgid":"<742e8f2a-e8c2-4b58-ad1a-94db12972621@redhat.com>","date":"2024-02-27T13:52:27","subject":"Re: [PATCH v3 16/16] libcamera: Add \"Software ISP benchmarking\"\n\tdocumentation","submitter":{"id":102,"url":"https://patchwork.libcamera.org/api/people/102/","name":"Hans de Goede","email":"hdegoede@redhat.com"},"content":"Hi,\n\nOn 2/16/24 13:21, Milan Zamazal wrote:\n> Hans de Goede writes:\n> \n>> Add a \"Software ISP benchmarking\" documentation section which describes\n>> the performance/power consumption measurements used during\n>> the Software ISP's development.\n>>\n>> Signed-off-by: Hans de Goede \n>> ---\n>> Documentation/index.rst | 1 +\n>> Documentation/meson.build | 1 +\n>> Documentation/software-isp-benchmarking.rst | 82 +++++++++++++++++++++\n>> 3 files changed, 84 insertions(+)\n>> create mode 100644 Documentation/software-isp-benchmarking.rst\n>>\n>> diff --git a/Documentation/index.rst b/Documentation/index.rst\n>> index 63fac72d..5442ae75 100644\n>> --- a/Documentation/index.rst\n>> +++ b/Documentation/index.rst\n>> @@ -24,3 +24,4 @@\n>> Lens driver requirements \n>> Python Bindings \n>> Camera Sensor Model \n>> + SoftwareISP Benchmarking \n>> diff --git a/Documentation/meson.build b/Documentation/meson.build\n>> index 7a58fec8..3872e0a8 100644\n>> --- a/Documentation/meson.build\n>> +++ b/Documentation/meson.build\n>> @@ -80,6 +80,7 @@ if sphinx.found()\n>> 'lens_driver_requirements.rst',\n>> 'python-bindings.rst',\n>> 'sensor_driver_requirements.rst',\n>> + 'software-isp-benchmarking.rst',\n>> '../README.rst',\n>> ]\n>> \n>> diff --git a/Documentation/software-isp-benchmarking.rst b/Documentation/software-isp-benchmarking.rst\n>> new file mode 100644\n>> index 00000000..321db138\n>> --- /dev/null\n>> +++ b/Documentation/software-isp-benchmarking.rst\n>> @@ -0,0 +1,82 @@\n>> +.. SPDX-License-Identifier: CC-BY-SA-4.0\n>> +\n>> +.. _software-isp-benchmarking:\n>> +\n>> +Software ISP benchmarking\n>> +=========================\n>> +\n>> +The Software ISP is particularly sensitive to performance regressions\n>> +therefore it is a good idea to always benchmark the Software ISP\n>> +before and after making changes to it and ensure that there are\n>> +no performance regressions.\n>> +\n>> +DebayerCpu class builtin benchmark\n>> +----------------------------------\n>> +\n>> +The DebayerCpu class has a builtin benchmark. This benchmark\n>> +measures the time spend on processing (collecting statistics\n> \n> spend -> spent\n> \n>> +and debayering) only, it does not measure the time spent on\n>> +capturing or outputting the frames.\n>> +\n>> +The builtin benchmark always runs. So this can be used by simply\n>> +running \"cam\" or \"qcam\" with a pipeline using the Software ISP.\n>> +\n>> +When it runs it will skip measuring the first 30 frames to\n>> +allow the caches and the CPU temperature (turbo-ing) to warm-up\n>> +and then it measures 30 fps and shows the total and per frame\n>> +processing time using an info level log message:\n>> +\n>> +.. code-block::\n>> +\n>> + INFO Debayer debayer_cpu.cpp:907 Processed 30 frames in 244317us, 8143 us/frame\n>> +\n>> +To get stable measurements it is advised to disable any other processes which\n> \n> which -> that ? (native speakers: please clarify)\n\nI've kept this as which for now. Thank you for all the other remarks\nI have fixed these all in my personal tree.\n\nRegards,\n\nHans\n\n\n\n\n> \n>> +may cause significant CPU usage (e.g. disable wifi, bluetooth and browsers).\n>> +When possible it is also advisable to disable CPU turbo-ing and\n>> +frequency-scaling.\n>> +\n>> +For example when benchmarking on a Lenovo ThinkPad X1 Yoga Gen 8, with\n>> +the charger plugged in, the CPU can be fixed to run at 2 GHz using:\n>> +\n>> +.. code-block::\n>> +\n>> + sudo x86_energy_perf_policy --turbo-enable 0\n>> + sudo cpupower frequency-set -d 2GHz -u 2GHz\n>> +\n>> +with these settings the builtin bench reports a processing time of ~7.8ms/frame\n>> +on this laptop for FHD SGRBG10 (unpacked) bayer data.\n>> +\n>> +Measuring power consumption\n>> +---------------------------\n>> +\n>> +Since the Software ISP is often used on mobile devices it is also\n>> +important to measure power consumption and ensure that that does\n>> +not regress.\n>> +\n>> +For example to measure power consumption on a Lenovo ThinkPad X1 Yoga Gen 8\n>> +it needs to be running on battery and it should be configured with its\n>> +platform-profile (/sys/firmware/acpi/platform_profile) set to balanced and\n>> +with its default turbo and frequency-scaling behavior to match real world usage.\n>> +\n>> +Then start qcam to capture a FHD picture at 30 fps and position the qcam window\n>> +so that it is fully visible. After this run the following command to monitor\n>> +the power consumption:\n>> +\n>> +.. code-block::\n>> +\n>> + watch -n 10 cat /sys/class/power_supply/BAT0/power_now /sys/class/hwmon/hwmon6/fan?_input\n>> +\n>> +Note this not only measures the power consumption in ųW it also monitors\n> \n> ųW -> µW\n> \n>> +the speed of this laptop's 2 fans. This is important because depending on\n>> +the ambient temperature the 2 fans may spin up while testing and this\n>> +will cause an additional power consumption of approx. 0.5W messing up\n> \n> I believe units should be separated from numbers, i.e. 0.5W -> 0.5 W (the same\n> below).\n> \n>> +the measurement.\n>> +\n>> +After starting qcam + the watch command let the laptop sit without using\n>> +it for 2 minutes for the readings to stabilize. Then check that the fans\n>> +have not turned on and manually take a couple of consecutive power readings\n>> +and avarage these.\n> \n> avarage -> average\n> \n>> +\n>> +On the example Lenovo ThinkPad X1 Yoga Gen 8 laptop this results in\n>> +a measured power consumption of approx. 13W while running qcam versus\n>> +approx. 4-5W while setting idle with its OLED panel on.\n> \n> This poor man's method of measurement is probably good enough with the advantage\n> of being quite universally applicable. I still wonder whether modern hardware +\n> OS provide better means to get numbers about the power consumption.\n>","headers":{"Return-Path":"","X-Original-To":"parsemail@patchwork.libcamera.org","Delivered-To":"parsemail@patchwork.libcamera.org","Received":["from lancelot.ideasonboard.com (lancelot.ideasonboard.com\n\t[92.243.16.209])\n\tby patchwork.libcamera.org (Postfix) with ESMTPS id 94967BD80A\n\tfor ;\n\tTue, 27 Feb 2024 13:52:34 +0000 (UTC)","from lancelot.ideasonboard.com (localhost [IPv6:::1])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTP id 534816286F;\n\tTue, 27 Feb 2024 14:52:34 +0100 (CET)","from us-smtp-delivery-124.mimecast.com\n\t(us-smtp-delivery-124.mimecast.com [170.10.129.124])\n\tby lancelot.ideasonboard.com (Postfix) with ESMTPS id 4DD2862864\n\tfor ;\n\tTue, 27 Feb 2024 14:52:33 +0100 (CET)","from mail-ed1-f69.google.com (mail-ed1-f69.google.com\n\t[209.85.208.69]) by relay.mimecast.com with ESMTP with STARTTLS\n\t(version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id\n\tus-mta-507-hT0eW4-CPxmJlOCHDg6s1w-1; Tue, 27 Feb 2024 08:52:30 -0500","by mail-ed1-f69.google.com with SMTP id\n\t4fb4d7f45d1cf-5661bbe306dso1541963a12.1\n\tfor ;\n\tTue, 27 Feb 2024 05:52:30 -0800 (PST)","from ?IPV6:2001:1c00:c32:7800:5bfa:a036:83f0:f9ec?\n\t(2001-1c00-0c32-7800-5bfa-a036-83f0-f9ec.cable.dynamic.v6.ziggo.nl.\n\t[2001:1c00:c32:7800:5bfa:a036:83f0:f9ec])\n\tby smtp.gmail.com with ESMTPSA id\n\tc5-20020a056402100500b005656816d622sm781421edu.11.2024.02.27.05.52.28\n\t(version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);\n\tTue, 27 Feb 2024 05:52:28 -0800 (PST)"],"Authentication-Results":"lancelot.ideasonboard.com;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=redhat.com header.i=@redhat.com\n\theader.b=\"jCtG2D0N\"; dkim-atps=neutral","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;\n\ts=mimecast20190719; t=1709041952;\n\th=from:from:reply-to:subject:subject:date:date:message-id:message-id:\n\tto:to:cc:cc:mime-version:mime-version:content-type:content-type:\n\tcontent-transfer-encoding:content-transfer-encoding:\n\tin-reply-to:in-reply-to:references:references;\n\tbh=iV8tC28eLf21bEk68/q743Pcvmc821QpiFFnqRipP2A=;\n\tb=jCtG2D0N1XrXyolTlyzdA8re9FrBN4q/QQZWkGBhznuYogIcVkvhVs3WelnD/XgphdXQP1\n\tmtbBXoib1Y8kFYV0B8Ob8FxM8cpEdritpecKtIsRjZw2MtHM9eI8v1Tl+m9a7lohNtyDVM\n\tcbRgxLQU9UtN164CuNMHX0VjRUXUSEM=","X-MC-Unique":"hT0eW4-CPxmJlOCHDg6s1w-1","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20230601; t=1709041949; x=1709646749;\n\th=content-transfer-encoding:in-reply-to:from:references:cc:to\n\t:content-language:subject:user-agent:mime-version:date:message-id\n\t:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;\n\tbh=iV8tC28eLf21bEk68/q743Pcvmc821QpiFFnqRipP2A=;\n\tb=XGH93djZztUnMmSIVSnETFHTQijf5NESd+dJZShZzqQUpx9uqaoS58hfqLCC3qBk+h\n\tcB9FwhhySbjlhd7BDGDc1OTcLcElDzRYXh88F3J2AxmhHW/NEx8meKCrP5TDVwU9a1+N\n\tdoKTWve1wt3FZB8wy0FekzAzqaONFVV6V4RW+76oOud464XqLbPKnEHZf3lsGXQK8H/A\n\tM+UTHauM9MS0o/n58jtGJI+ngUdwkDko+WJdxGjrZN6c+hsyYx5BPJf0jcsgJ1NQWBYd\n\tK3IT7r5fEy/9ER1/O52uD2dHbPJzvAVfOGWuIdCAKxyR32Ueu0SPmiXhbdouk67R+K84\n\tn9iQ==","X-Gm-Message-State":"AOJu0YxWGV6BTMVAs/FzfQllkWz2Qz+2YdDJJioKYJt3Kk/vBCozgaPv\n\tIsYm7/as0+H7j99I5oOAIFEbHas1aRigZGVhz/alLuHut74eaDXPMU6vFRWcrmg3aI23kFVjNbv\n\tv8XzkJnfm2u+t0xhdOkZ9IeawwnpmQIfZRz74O+YCC8j+dgp7oEfMi6y+BvjGUPlfwb1iGy/f/Z\n\tWCFOg=","X-Received":["by 2002:aa7:d490:0:b0:566:1319:8af6 with SMTP id\n\tb16-20020aa7d490000000b0056613198af6mr3964935edr.1.1709041949353; \n\tTue, 27 Feb 2024 05:52:29 -0800 (PST)","by 2002:aa7:d490:0:b0:566:1319:8af6 with SMTP id\n\tb16-20020aa7d490000000b0056613198af6mr3964920edr.1.1709041949032; \n\tTue, 27 Feb 2024 05:52:29 -0800 (PST)"],"X-Google-Smtp-Source":"AGHT+IF3E/qW2U4MLkPo+/gyXkXnbcM9tow73lsT7NQADbsfkTNIh7MTFpLP+YRoFrC1g9YtDwXPNw==","Message-ID":"<742e8f2a-e8c2-4b58-ad1a-94db12972621@redhat.com>","Date":"Tue, 27 Feb 2024 14:52:27 +0100","MIME-Version":"1.0","User-Agent":"Mozilla Thunderbird","Subject":"Re: [PATCH v3 16/16] libcamera: Add \"Software ISP benchmarking\"\n\tdocumentation","To":"Milan Zamazal ","References":"<20240214170122.60754-1-hdegoede@redhat.com>\n\t<20240214170122.60754-17-hdegoede@redhat.com>\n\t<87r0hclhv5.fsf@redhat.com>","From":"Hans de Goede ","In-Reply-To":"<87r0hclhv5.fsf@redhat.com>","X-Mimecast-Spam-Score":"0","X-Mimecast-Originator":"redhat.com","Content-Language":"en-US, nl","Content-Type":"text/plain; charset=UTF-8","Content-Transfer-Encoding":"8bit","X-BeenThere":"libcamera-devel@lists.libcamera.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Cc":"Bryan O'Donoghue ,\n\tlibcamera-devel@lists.libcamera.org, Maxime Ripard , \n\tPavel Machek ","Errors-To":"libcamera-devel-bounces@lists.libcamera.org","Sender":"\"libcamera-devel\" "}}]