IS&T International Symposium on Electronic Imaging最新文献

Egocentric Boundaries on Distinguishing Colliding and Non-Colliding Pedestrians while Walking in a Virtual Environment. 在虚拟环境中行走时，区分碰撞和非碰撞行人的自我中心界限。

IS&T International Symposium on Electronic Imaging Pub Date : 2024-01-01 DOI: 10.2352/EI.2024.36.11.HVEI-214

Alex D Hwang, Jaehyun Jung, Alex Bowers, Eli Peli

引用次数: 0

34th Annual Stereoscopic Displays and Applications Conference - Introduction 第三十四届立体显示及应用年会简介

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.2.sda-b02

Andrew J. Woods, Nicolas S. Holliman, Takashi Kawai, Bjorn Sommer

引用次数: 0

Wearable multispectral imaging and telemetry at edge 边缘可穿戴多光谱成像和遥测技术

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.7.image-278

Yang Cai, Mel Siegel

引用次数: 0

Stereoscopic Displays and Applications XXXIV Conference Overview and Papers Program 立体显示和应用第三十四届会议概述和论文程序

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.2.sda-a02

引用次数: 0

Improving the performance of web-streaming by super-resolution upscaling techniques 通过超分辨率升级技术提高网络流媒体的性能

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.3.mobmu-351

Yuriy Reznik, Nabajeet Barman

{"title":"Improving the performance of web-streaming by super-resolution upscaling techniques","authors":"Yuriy Reznik, Nabajeet Barman","doi":"10.2352/ei.2023.35.3.mobmu-351","DOIUrl":"https://doi.org/10.2352/ei.2023.35.3.mobmu-351","url":null,"abstract":"In recent years, we have seen significant progress in advanced image upscaling techniques, sometimes called super-resolution, ML-based, or AI-based upscaling. Such algorithms are now available not only in form of specialized software but also in drivers and SDKs supplied with modern graphics cards. Upscaling functions in NVIDIA Maxine SDK is one of the recent examples. However, to take advantage of this functionality in video streaming applications, one needs to (a) quantify the impacts of super-resolution techniques on the perceived visual quality, (b) implement video rendering incorporating super-resolution upscaling techniques, and (c) implement new bitrate+resolution adaptation algorithms in streaming players, enabling such players to deliver better quality of experience or better efficiency (e.g. reduce bandwidth usage) or both. Towards this end, in this paper, we propose several techniques that may be helpful to the implementation community. First, we offer a model quantifying the impacts of super resolution upscaling on the perceived quality. Our model is based on the Westerink-Roufs model connecting the true resolution of images/videos to perceived quality, with several additional parameters added, allowing its tuning to specific implementations of super-resolution techniques. We verify this model by using several recent datasets including MOS scores measured for several conventional up-scaling and super-resolution algorithms. Then, we propose an improved adaptation logic for video streaming players, considering video bitrates, encoded video resolutions, player size, and the upscaling method. This improved logic relies on our modified Westerink-Roufs model to predict perceived quality and suggests choices of renditions that would deliver the best quality for given display and upscaling method characteristics. Finally, we study the impacts of the proposed techniques and show that they can deliver practically appreciable results in terms of the expected QoE improvements and bandwidth savings.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135693966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

LECA: A learned approach for efficient cover-agnostic watermarking LECA:一种有效的覆盖不可知水印的学习方法

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.4.mwsf-376

Xiyang Luo, Michael Goebel, Elnaz Barshan, Feng Yang

引用次数: 0

Optimization of ISP parameters for low light conditions using a non-linear reference based approach 基于非线性参考的弱光条件下ISP参数优化方法

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.8.iqsp-314

Shubham Ravindra Alai, Radhesh Bhat

{"title":"Optimization of ISP parameters for low light conditions using a non-linear reference based approach","authors":"Shubham Ravindra Alai, Radhesh Bhat","doi":"10.2352/ei.2023.35.8.iqsp-314","DOIUrl":"https://doi.org/10.2352/ei.2023.35.8.iqsp-314","url":null,"abstract":"An image signal processor (ISP) transforms a sensor's raw image into a RGB image for use in computer or human vision applications. ISP is composed of various functional blocks and each block contributes uniquely to make the image best suitable for the target application. Whereas, each block consists of several hyperparameters and each hyperparameter needs to be tuned (usually done manually by experts in an iterative manner) to achieve the target image quality. The tuning becomes challenging and increasingly iterative especially in low to very low light conditions where the amount of details preserved by the sensor is limited and ISP parameters have to be tuned to balance the amount of details recovered, noise, sharpness, contrast etc. To extract maximum information out of the image, usually it is required to increase the ISO gain which eventually impacts the noise and color accuracy. Also, the number of ISP parameters that need to be tuned are huge and it becomes impractical to consider all of them in such low light conditions to arrive at the best possible settings. To tackle challenges in manual tuning, especially for low light conditions we have implemented an automatic hyperparameter optimization model that can tune the low lux images so that they are perceptually equivalent to high-lux images. The experiments for IQ validation are carried out under challenging low light conditions and scenarios using Qualcomm’s Spectra ISP simulator with a 13MP OV sensor, and the performance of automatic tuned IQ is compared with manual tuned IQ for human vision use-cases. With experimental results, we have proved that with the help of evolutionary algorithms and local optimization it is possible to optimize the ISP parameters such that without using any of the KPI metrics still low-lux image/ image captured with different ISP (test image) can perceptually be improved that are equivalent to high-lux or well-tuned (reference) image.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

High Performance Computing for Imaging 2023 Overview and Papers Program 高性能计算成像2023概述和论文计划

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.11.hpci-a11

引用次数: 0

Imaging and Multimedia Analytics at the Edge 2023 Conference Overview and Papers Program 影像和多媒体分析在边缘2023会议概述和论文计划

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.7.image-a07

引用次数: 0

Imaging Sensors and Systems 2023 Conference Overview and Papers Program 成像传感器和系统2023会议综述和论文计划

IS&T International Symposium on Electronic Imaging Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.6.iss-a06

{"title":"Imaging Sensors and Systems 2023 Conference Overview and Papers Program","authors":"","doi":"10.2352/ei.2023.35.6.iss-a06","DOIUrl":"https://doi.org/10.2352/ei.2023.35.6.iss-a06","url":null,"abstract":"Abstract Solid state optical sensors and solid state cameras have established themselves as the imaging systems of choice for many demanding professional applications such as automotive, space, medical, scientific and industrial applications. The advantages of low-power, low-noise, high-resolution, high-geometric fidelity, broad spectral sensitivity, and extremely high quantum efficiency have led to a number of revolutionary uses. ISS focuses on image sensing for consumer, industrial, medical, and scientific applications, as well as embedded image processing, and pipeline tuning for these camera systems. This conference will serve to bring together researchers, scientists, and engineers working in these fields, and provides the opportunity for quick publication of their work. Topics can include, but are not limited to, research and applications in image sensors and detectors, camera/sensor characterization, ISP pipelines and tuning, image artifact correction and removal, image reconstruction, color calibration, image enhancement, HDR imaging, light-field imaging, multi-frame processing, computational photography, 3D imaging, 360/cinematic VR cameras, camera image quality evaluation and metrics, novel imaging applications, imaging system design, and deep learning applications in imaging.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0