From patchwork Fri Mar 20 08:50:26 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Show Liu X-Patchwork-Id: 3220 Return-Path: Received: from mail-pf1-x431.google.com (mail-pf1-x431.google.com [IPv6:2607:f8b0:4864:20::431]) by lancelot.ideasonboard.com (Postfix) with ESMTPS id 28B486041A for ; Fri, 20 Mar 2020 09:59:04 +0100 (CET) Received: by mail-pf1-x431.google.com with SMTP id b72so2881808pfb.11 for ; Fri, 20 Mar 2020 01:59:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=07c6gIvO+bNwxSGE/qH6BUspeGwCMvIK6Mqk0pOSdFY=; b=i3vI5wIrKLOjJ/jE0ztGEu0egUmPe1ZEhWO+CU9yolQG6p8FelGs/OIuRECsDS4XxL aW2bKMvpoWS1arglnfyP6v2W5LrIRx7KOVPahxopFB3naXCkTur579vYLl8dqeMWvrIM MzcBrlbCmnpT1QCQkDnihJbjkwr5YC3rPTX8BnsMTXO+jfwE/y9VeNydhwqR2qjud0mj 13se7UGqX4cvL9dDpFn+9WnZx1xEw5XlQUKKpVi/xKbr9LtmSWp1vw9ODNydSFl9ogzH e8oWGvy+6Bu21+r9z4ENZ+GhGOljPJXAroRiHdDQoaimUED52NSBp5KF6yZ/EsuJ1Lsp xW1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=07c6gIvO+bNwxSGE/qH6BUspeGwCMvIK6Mqk0pOSdFY=; b=m4y9ly7imU+loZpr95lW60JrLutgMhpj6n8vMIrn7K4j8HaEAsFrz5LHOPKZyvN1ZY 0zU3sDLc9VRbDcbf0ll3yxnOhM8J6690xkNZlVURgwH6QC7wM6rEZNeZFUJHX9qvQ8IE rMeBrmpBYWTcv9ECly0TVL7ydip/MidbgbMDaFq6O6V4kduXTFj8LhSctAkX0W1ZT9FF jwBL76e92k9DAmWOGQ9bEEJ4RnCQV4EAmVAWAPUO8TD0vmOB2U7lKphTWdY7JrrXSb7l eU11U3o6tH8Y+wGjds/sq8owxP8HpTiRvGfI6ubs7SCha1ZkGd7cavTia0UkX9xbHbU/ rGgw== X-Gm-Message-State: ANhLgQ0/iBGd5z8eX+ySfgRt1ub7znSjJkpyJs3aY7joO96LB7Br9RjC Q5NVvLKEdNoNCpwPnNgYwKo+kti92LkLiQ== X-Google-Smtp-Source: ADFU+vuefnYsgwDG93OnKStOp3UUI5rcUtN9OTcP1U/+S5YisFAl7/iSjnUKibishrFVjKuBnIwWqQ== X-Received: by 2002:a63:925d:: with SMTP id s29mr43117pgn.176.1584694743058; Fri, 20 Mar 2020 01:59:03 -0700 (PDT) Received: from localhost.localdomain (211-20-20-223.HINET-IP.hinet.net. [211.20.20.223]) by smtp.gmail.com with ESMTPSA id 26sm4604653pfp.130.2020.03.20.01.59.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 20 Mar 2020 01:59:02 -0700 (PDT) From: Show Liu To: libcamera-devel@lists.libcamera.org Date: Fri, 20 Mar 2020 16:50:26 +0800 Message-Id: <20200320085029.17875-1-show.liu@linaro.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Subject: [libcamera-devel] [RFC] [PATCH 0/3] Add an option to enable rendering YUV frame by OpenGL shader X-BeenThere: libcamera-devel@lists.libcamera.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2020 08:59:05 -0000 Hi all, I would like to share my adventure on qcam. I added an option to enable rendering YUV frame by OpenGL shader for qcam. Honestly, it's still in progress, and only support NV12 format at present. However the improvement is obviously. I logged the messages below when qcam running. https://pastebin.linaro.org/view/20d91f21 In 1280x800 mode: format convert by CPU is around ~4 fps, rendering by GPU up to ~30.0 fps In 1920x1080 mode: format convert by CPU is around ~2 fps, rendering by GPU still up to ~30.0 fps The improvement still in progress, including more YUV formats support ... etc. And some parts I added are not in good shape, I am trying to make it better. So I appreciate any review conments and suggestion. It's also available on below. https://github.com/showliu/libcamera/commits/qcam_opengl_hack2 I tested with kernel 5.5rc5 + Panfrost GPU driver on Rock Pi 4B platform. Show Liu (3): qcam: Added statusbar to show the camera stream configuration qcam: Added opengl widget class for qcam qcam: added an option to enable rendering via OpenGL shader src/qcam/glwidget.cpp | 213 +++++++++++++++++++++++++++++++++++++++ src/qcam/glwidget.h | 76 ++++++++++++++ src/qcam/main.cpp | 2 + src/qcam/main_window.cpp | 36 ++++++- src/qcam/main_window.h | 3 + src/qcam/meson.build | 4 +- 6 files changed, 330 insertions(+), 4 deletions(-) create mode 100644 src/qcam/glwidget.cpp create mode 100644 src/qcam/glwidget.h