arXiv ScienceSearch

arXiv subjects

Kousik Dasgupta

Publications and source records attributed to Kousik Dasgupta.

4 recordsLinked to original sources

Explainable and Resource-Efficient Spatial Reasoning in Multimodal LLMs for Decision-Critical Applications

As Multimodal Large Language Models (MLLMs) are increasingly deployed in decision-critical pipelines such as robotics, embodied AI, and safety monitoring, the opacity of their spatial judgments limits operator trust and auditability. MLLMs demonstrate strong reasoning but often struggle with fine-grained spatial understanding and object hallucination. Prior work, ByDeWay, introduced Layered-Depth-Based Prompting (LDP), a training-free framework that mitigates hallucinations by structuring prompts using monocular depth estimation. However, coarse depth layering falls short in resolving object-to-object spatial relationships within the same geometric plane, such as projective ("left of", "above") and topological ("inside", "touching") relations. We propose ByDeWay-V2, which integrates explicit spatial relational context alongside depth cues, expressed as human-readable predicates that serve as auditable evidence for downstream decision support. Using an open-vocabulary object detector (YOLO-World-L), our framework computes pairwise geometric relations between detected objects and injects them as structured spatial predicates into the MLLM prompt, bridging 3D scene depth and 2D spatial semantics without any training. We evaluate ByDeWay-V2 on the Visual Spatial Reasoning (VSR) and BLINK benchmarks across multiple MLLMs, with hallucination grounding assessed via POPE. On the BLINK spatial subset, ByDeWay-V2 achieves a 46 percent relative F1 improvement over LDP for Qwen2.5-VL, and recovers BLIP-Base's spatial reasoning on VSR from near-random performance to a competitive F1 of 0.53. Our lightest configuration operates under a strict 40-token context budget on CPU, showing the framework's suitability for resource-constrained, real-time decision-support settings.

cs.CV

Refracted Light Interaction in Turbulent Bubbling Water (RLITBW): A Macroscopic Fluid-Optic Entropy Source

The demand for high quality, unpredictable random numbers is a fundamental requirement in cryptography, stochastic simulation, and optimization. While pseudo-random number generators (PRNGs) are computationally efficient, their deterministic nature limits their suitability for security-critical applications. True random number generators (TRNGs), although physically grounded, often rely on expensive quantum or tightly controlled electronic phenomena. This paper introduces a low-cost, macroscopic TRNG based on Refracted Light Interaction in Turbulent Bubbling Water (RLITBW). The proposed system exploits compound classical chaos arising from multiphase fluid dynamics and time-varying optical refraction. A physical-mathematical model is developed to describe the cascade of non-linear processes from stochastic bubble nucleation and turbulent ascent to chaotic optical path scrambling that collectively amplify microscopic uncertainties into measurable entropy.The raw optical signal is digitized and processed using a provably secure entropy-conditioning pipeline based on Toeplitz universal hashing, followed by deterministic cryptographic expansion. The chaotic nature of the physical source is empirically validated using phase-space reconstruction, Lyapunov exponent estimation, autocorrelation analysis, and entropy metrics. The conditioned output successfully passes the full NIST SP 800-22 statistical test suite and nonlinear dynamical measures including Lyapunov exponents and sample entropy. Beyond statistical validation, the generated randomness is applied to population-based optimization algorithms, demonstrating practical usability as a replacement for conventional PRNGs. Finally, deployment architectures and scalability considerations are discussed, positioning RLITBW as an accessible, reproducible, and economically viable entropy source for real-world systems.

cs.ET

ByDeWay: Boost Your multimodal LLM with DEpth prompting in a Training-Free Way

We introduce ByDeWay, a training-free framework designed to enhance the performance of Multimodal Large Language Models (MLLMs). ByDeWay uses a novel prompting strategy called Layered-Depth-Based Prompting (LDP), which improves spatial reasoning and grounding without modifying any model parameters. It segments the scene into closest, mid-range, and farthest layers using monocular depth estimation, then generates region-specific captions with a grounded vision-language model. These structured, depth-aware captions are appended to the image-question prompt, enriching it with spatial context. This guides MLLMs to produce more grounded and less hallucinated responses. Our method is lightweight, modular, and compatible with black-box MLLMs. Experiments on hallucination-sensitive (POPE) and reasoning-intensive (GQA) benchmarks show consistent improvements across multiple MLLMs, validating the effectiveness of depth-aware prompting in a zero-training setting.

cs.CV

Offline Extraction of Indic Regional Language from Natural Scene Image using Text Segmentation and Deep Convolutional Sequence

Regional language extraction from a natural scene image is always a challenging proposition due to its dependence on the text information extracted from Image. Text Extraction on the other hand varies on different lighting condition, arbitrary orientation, inadequate text information, heavy background influence over text and change of text appearance. This paper presents a novel unified method for tackling the above challenges. The proposed work uses an image correction and segmentation technique on the existing Text Detection Pipeline an Efficient and Accurate Scene Text Detector (EAST). EAST uses standard PVAnet architecture to select features and non maximal suppression to detect text from image. Text recognition is done using combined architecture of MaxOut convolution neural network (CNN) and Bidirectional long short term memory (LSTM) network. After recognizing text using the Deep Learning based approach, the native Languages are translated to English and tokenized using standard Text Tokenizers. The tokens that very likely represent a location is used to find the Global Positioning System (GPS) coordinates of the location and subsequently the regional languages spoken in that location is extracted. The proposed method is tested on a self generated dataset collected from Government of India dataset and experimented on Standard Dataset to evaluate the performance of the proposed technique. Comparative study with a few state-of-the-art methods on text detection, recognition and extraction of regional language from images shows that the proposed method outperforms the existing methods.

cs.CV