arXiv subjects

Katja Kossira

Publications and source records attributed to Katja Kossira.

6 recordsLinked to original sources

arXiv2026

Disparity Estimation of Planar Reflective Surfaces Using Specular Reflections From a Single Light Source

Multi-camera imaging and camera arrays have become ubiquitous in many applications, such as autonomous driving, robot control, or virtual reality, and accurate disparity maps of objects and their environment are essential for reliable operation. Despite recent advances in neural networks, correctly estimating the disparity of flat and textureless objects remains challenging. In particular, we consider a scenario defined by flat, textureless surfaces illuminated by a single fixed light source, resulting in one dominant specular reflection visible on the object surface. Under these conditions, reliable geometric and photometric cues are missing, and the specular reflection often causes mispredictions, especially when using conventional methods that rely on texture information to match corresponding pixels. To address this issue, the novel Specular Reflection Disparity Estimation SRDE algorithm is introduced, which is specifically designed for the constrained scenario of planar, textureless objects and single-source illumination. Unlike conventional stereo matching methods, SRDE ignores texture and instead leverages the geometric properties of specular reflections by incorporating the position information of the reflective region, the light source, and the camera setup. We show that SRDE outperforms existing methods by a notable margin, achieving more than a 52% improvement in End Point Error on synthetic images. Further tests demonstrate superior performance on real-world data. Furthermore, we integrate SRDE into existing neural disparity estimation pipelines by selectively replacing predictions in specular regions without modifying the backbone model. This hybrid strategy enables additional performance gains without requiring network retraining.

eess.IV↗

arXiv2026

Hierarchical Filter Band Selection for Multispectral Object Classification

Multispectral camera arrays capture image data in various spectral bands, enabling image acquisition beyond human perception. These systems are widely used in medical, agricultural, environmental, and remote sensing applications. However, not all recorded bands are needed for classification tasks, thus reducing them can lower hardware complexity and cost. The conditional filter band selection algorithm addresses this by selecting low-noise, non-redundant bands to minimize the number of filters and cameras. This paper improves the approach by introducing a second classification stage that estimates object material in addition to the object label. This information is merged by a decision-tree based band selection strategy. The proposed method achieves a 28.9% relative reduction in classification error on the SMM50 dataset compared to the state-of-the-art. Moreover, for the same classification accuracy, the required number of cameras is reduced from 7 to 4, demonstrating that the proposed approach improves performance while significantly lowering hardware requirements.

eess.IV↗

arXiv2026

Towards Object Segmentation Mask Selection Using Specular Reflections

Specular reflections pose a significant challenge for object segmentation, as their sharp intensity transitions often mislead both conventional algorithms and deep learning based methods. However, as the specular reflection must lie on the surface of the object, this fact can be exploited to improve the segmentation masks. By identifying the largest region containing the reflection as the object, we derive a more accurate object mask without requiring specialized training data or model adaption. We evaluate our method on both synthetic and real world images and compare it against established and state-of-the-art techniques including Otsu thresholding, YOLO, and SAM2. Compared to the best performing baseline SAM2, our approach achieves up to 26.7% improvement in IoU, 22.3% in DSC, and 9.7% in pixel accuracy. Qualitative evaluations on real world images further confirm the robustness and generalizability of the proposed approach.

eess.IV↗

arXiv2026

Multispectral Household Plastic Classification for Recycling Using a Camera Array

Plastic pollution has become a persistent problem in natural ecosystems. Driven by insufficient waste management, limited recycling efficiency, and high costs for recycling, plastic waste in the environment poses significant ecological and health risks. Recycling requires accurate identification of polymer types, but existing optical sorting systems often struggle to distinguish common household plastics. In this work, we present a novel classification approach based on a multispectral imaging system consisting of nine cameras equipped with near-infrared bandpass filters. The system is designed to discriminate the seven most common household plastics. From the resulting multispectral images, we extract the spectral fingerprints and derive features such as intensity differences between specific wavelength pairs and their slopes, as well as false-color image representations. A dedicated preprocessing pipeline aligns and normalizes the data before classification. We recorded a multispectral household plastic database (https://github.com/FAU-LMS/MHPM) and trained four different classifiers Gradient Boosting, Extreme Gradient Boosting, Light Gradient Boosting Machine, and CatBoost. The best-performing model achieves a classification accuracy of 86.7%. The computational runtime is 2.603 μs per pixel, enabling efficient processing of high-resolution images. The entire setup is built from off-the-shelf hardware components, which makes replication straightforward and allows direct integration into industrial sorting pipelines.

eess.IV↗

arXiv2024

Inter-Camera Color Correction for Multispectral Imaging with Camera Arrays Using a Consensus Image

This paper introduces a novel method for inter-camera color calibration for multispectral imaging with camera arrays using a consensus image. Capturing images using multispectral camera arrays has gained importance in medical, agricultural, and environmental processes. Due to fabrication differences, noise, or device altering, varying pixel sensitivities occur, influencing classification processes. Therefore, color calibration between the cameras is necessary. In existing methods, one of the camera images is chosen and considered as a reference, ignoring the color information of all other recordings. Our new approach does not just take one image as reference, but uses statistical information such as the location parameter to generate a consensus image as basis for calibration. This way, we managed to improve the PSNR values for the linear regression color correction algorithm by 1.15 dB and the improved color difference (iCID) values by 2.81.

eess.IV↗

arXiv2024

Conditional Optimal Filter Selection for Multispectral Object Classification

Capturing images using multispectral camera arrays has gained importance in medical, agricultural and environmental processes. However, using all available spectral bands is infeasible and produces much data, while only a fraction is needed for a given task. Nearby bands may contain similar information, therefore redundant spectral bands should not be considered in the evaluation process to keep complexity and the data load low. In current methods, a restricted and pre-determined number of spectral bands is selected. Our approach improves this procedure by including preset conditions such as noise or the bandwidth of available filters, minimizing spectral redundancy. Furthermore, a minimal filter selection can be conducted, keeping the hardware setup at low costs, while still obtaining all important spectral information. In comparison to the fast binary search filter band selection method, we managed to reduce the amount of misclassified objects of the SMM dataset from 318 to 124 using a random forest classifier.

eess.IV↗