arXiv subjects

Qiang Sun

Publications and source records attributed to Qiang Sun.

At least 55 records · Page 3Linked to original sources

arXiv2025

EIR: Enhanced Image Representations for Medical Report Generation

Generating medical reports from chest X-ray images is a critical and time-consuming task for radiologists, especially in emergencies. To alleviate the stress on radiologists and reduce the risk of misdiagnosis, numerous research efforts have been dedicated to automatic medical report generation in recent years. Most recent studies have developed methods that represent images by utilizing various medical metadata, such as the clinical document history of the current patient and the medical graphs constructed from retrieved reports of other similar patients. However, all existing methods integrate additional metadata representations with visual representations through a simple "Add and LayerNorm" operation, which suffers from the information asymmetry problem due to the distinct distributions between them. In addition, chest X-ray images are usually represented using pre-trained models based on natural domain images, which exhibit an obvious domain gap between general and medical domain images. To this end, we propose a novel approach called Enhanced Image Representations (EIR) for generating accurate chest X-ray reports. We utilize cross-modal transformers to fuse metadata representations with image representations, thereby effectively addressing the information asymmetry problem between them, and we leverage medical domain pre-trained models to encode medical images, effectively bridging the domain gap for image representation. Experimental results on the widely used MIMIC and Open-I datasets demonstrate the effectiveness of our proposed method.

eess.IV↗

arXiv2025

C3-OWD: A Curriculum Cross-modal Contrastive Learning Framework for Open-World Detection

Object detection has advanced significantly in the closed-set setting, but real-world deployment remains limited by two challenges: poor generalization to unseen categories and insufficient robustness under adverse conditions. Prior research has explored these issues separately: visible-infrared detection improves robustness but lacks generalization, while open-world detection leverages vision-language alignment strategy for category diversity but struggles under extreme environments. This trade-off leaves robustness and diversity difficult to achieve simultaneously. To mitigate these issues, we propose \textbf{C3-OWD}, a curriculum cross-modal contrastive learning framework that unifies both strengths. Stage~1 enhances robustness by pretraining with RGBT data, while Stage~2 improves generalization via vision-language alignment. To prevent catastrophic forgetting between two stages, we introduce an Exponential Moving Average (EMA) mechanism that theoretically guarantees preservation of pre-stage performance with bounded parameter lag and function consistency. Experiments on FLIR, OV-COCO, and OV-LVIS demonstrate the effectiveness of our approach: C3-OWD achieves $80.1$ AP$^{50}$ on FLIR, $48.6$ AP$^{50}_{\text{Novel}}$ on OV-COCO, and $35.7$ mAP$_r$ on OV-LVIS, establishing competitive performance across both robustness and diversity evaluations. Code available at: https://github.com/justin-herry/C3-OWD.git.

cs.CV↗

arXiv2025

Nitrogen-Vacancy Emission from Nanodiamond: Size, Depth, and Surroundings

The negatively charged nitrogen-vacancy (NV) center in diamond is a leading solid-state quantum emitter, offering spin-photon interfaces over a wide temperature range with applications from electromagnetic sensing to bioimaging. While NV centers in bulk diamond are well understood, embedding them in nanodiamond (ND) introduces complexities from size, NV location, and NV polarizations. NVs in ND show altered fluorescence properties including longer lifetimes, lower quantum efficiency, and higher sensitivity to dielectric surroundings, which arise from radiative suppression, surface-induced non-radiative decay, and escape inefficiency at the diamond-background interface. Prior models typically addressed isolated aspects, such as dielectric contrast or surface quenching, without integrating full quantum-optical NV behavior with classical electrodynamics. We present a hybrid framework coupling rigorous electromagnetic simulations with a quantum-optical NV model including phonon sideband dynamics. NV emission is found to depend strongly on ND size, NV position, and surrounding refractive index. Our results explain observations such as shallow NVs in water-coated ND appearing brighter than deeper ones in air. This integrated model provides a unified framework for realistic NV in ND emission scenarios and informs the design of efficient NV-based sensors and quantum devices, advancing understanding of quantum emitter photophysics in nanoscale crystals.

physics.optics↗

arXiv2025

A fluorescent color center in meteoritic Lonsdaleite

Lonsdaleite -- hexagonal diamond -- has only recently been proposed as a wide-bandgap host capable of supporting optically active point defects, but no such centres have yet been observed. Here we provide the first experimental evidence that lonsdaleite does in fact host photoluminescent color centres. In meteoritic lonsdaleite grains from the ureilite NWA7983, we identify a new defect, RU1, which exhibits bright and stable emission across 550-800 nm, with optimal blue excitation (~455 nm) and a peak at ~700 nm. Time-resolved photoluminescence reveals an excited-state lifetime of 14 ns with no detectable blinking, bleaching, or charge conversion. From the excitation-emission energetics we infer an unresolved zero-phonon line near 550 nm. Correlative electron microscopy confirms the lonsdaleite host lattice, and compositional analysis suggests N, Si, or Ni as plausible defect constituents. These results suggest lonsdaleite could become a new quantum-grade crystalline platform and indicate that hexagonal-diamond color centres may form a new and unexplored family of solid-state quantum emitters.

cond-mat.mes-hall↗

arXiv2025

PCA++: How Uniformity Induces Robustness to Background Noise in Contrastive Learning

High-dimensional data often contain low-dimensional signals obscured by structured background noise, which limits the effectiveness of standard PCA. Motivated by contrastive learning, we address the problem of recovering shared signal subspaces from positive pairs, paired observations sharing the same signal but differing in background. Our baseline, PCA+, uses alignment-only contrastive learning and succeeds when background variation is mild, but fails under strong noise or high-dimensional regimes. To address this, we introduce PCA++, a hard uniformity-constrained contrastive PCA that enforces identity covariance on projected features. PCA++ has a closed-form solution via a generalized eigenproblem, remains stable in high dimensions, and provably regularizes against background interference. We provide exact high-dimensional asymptotics in both fixed-aspect-ratio and growing-spike regimes, showing uniformity's role in robust signal recovery. Empirically, PCA++ outperforms standard PCA and alignment-only PCA+ on simulations, corrupted-MNIST, and single-cell transcriptomics, reliably recovering condition-invariant structure. More broadly, we clarify uniformity's role in contrastive learning, showing that explicit feature dispersion defends against structured noise and enhances robustness.

stat.ML↗

arXiv2025

Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks

Lipschitz continuity characterizes the worst-case sensitivity of neural networks to small input perturbations; yet its dynamics (i.e. temporal evolution) during training remains under-explored. We present a rigorous mathematical framework to model the temporal evolution of Lipschitz continuity during training with stochastic gradient descent (SGD). This framework leverages a system of stochastic differential equations (SDEs) to capture both deterministic and stochastic forces. Our theoretical analysis identifies three principal factors driving the evolution: (i) the projection of gradient flows, induced by the optimization dynamics, onto the operator-norm Jacobian of parameter matrices; (ii) the projection of gradient noise, arising from the randomness in mini-batch sampling, onto the operator-norm Jacobian; and (iii) the projection of the gradient noise onto the operator-norm Hessian of parameter matrices. Furthermore, our theoretical framework sheds light on such as how noisy supervision, parameter initialization, batch size, and mini-batch sampling trajectories, among other factors, shape the evolution of the Lipschitz continuity of neural networks. Our experimental results demonstrate strong agreement between the theoretical implications and the observed behaviors.

cs.LG↗

arXiv2025

Nowhere-zero flows on signed supereulerian graphs

In 1983, Bouchet conjectured that every flow-admissible signed graph admits a nowhere-zero 6-flow. We verify this conjecture for the class of flow-admissible signed graphs possessing a spanning even Eulerian subgraph, which includes as a special case all signed graphs with a balanced Hamiltonian circuit. Furthermore, we show that this result is sharp by citing a known infinite family of signed graphs with a balanced Hamiltonian circuit that do not admit a nowhere-zero 5-flow. Our proof relies on a construction that transforms signed graphs whose underlying graph admits a nowhere-zero 4-flow into a signed 3-edge-colorable cubic graph. This transformation has the crucial property of establishing a sign-preserving bijection between the bichromatic cycles of the resulting signed cubic graph and certain Eulerian subgraphs of the original signed graph. As an application of our main result, we also show that Bouchet's conjecture holds for all signed abelian Cayley graphs.

math.CO↗

arXiv2025

Nitrogen-vacancy centre in lonsdaleite: a novel nanoscale sensor?

Hexagonal diamond, often called lonsdaleite, is an exotic allotrope of carbon, predicted to be harder than cubic (conventional) diamond with a wider bandgap. Due to its pure sp$^3$ bonded lattice, it should be expected to host sub-bandgap defect centres (colour centres). Here we perform \textit{ab initio} modeling of nitrogen-vacancy (NV) colour centres in hexagonal diamond nanocrystals; for both the neutral and negatively charged species (NV$^0$ and NV$^-$). We identify three distinct configurations for the NV center: two of which are analogous to NV in diamond, and one which is a configuration that can only exist in the hexagonal form. The diamond-like NV systems comprise three symmetry equivalent centers which reside on the same carbon plane, and one defect that is split across two planes and replaces a carbon-carbon bond. There is an additional NV centre where the N and V each have four nearest neighbour carbon atoms. The presence of this latter configuration would provide an unambiguous determination of the hexagonal nature of lonsdaleite. Quantum chemical analysis show all derivatives to be thermochemically stable, and each with their own unique photophysical properties, spectral profiles, and magneto-optical characteristics. By assuming that the ground state properties of the NV$^-$ in hexagonal diamond are comparable to those of NV$^-$ in cubic diamond, albeit with increased strain, we predict ground state fine structure splitting for two of the centres of 2.74~GHz and 4.56~MHz, compared with 2.87~GHz for cubic diamond. The possibility of optically detected magnetic resonance with NV$^-$ in lonsdaleite would provide a new carbon-based quantum sensing system, and an unambiguous method to resolve outstanding issues around the structure of lonsdaleite as hexagonal diamond.

quant-ph↗

arXiv2025

Enhancing Vector Quantization with Distributional Matching: A Theoretical and Empirical Study

The success of autoregressive models largely depends on the effectiveness of vector quantization, a technique that discretizes continuous features by mapping them to the nearest code vectors within a learnable codebook. Two critical issues in existing vector quantization methods are training instability and codebook collapse. Training instability arises from the gradient discrepancy introduced by the straight-through estimator, especially in the presence of significant quantization errors, while codebook collapse occurs when only a small subset of code vectors are utilized during training. A closer examination of these issues reveals that they are primarily driven by a mismatch between the distributions of the features and code vectors, leading to unrepresentative code vectors and significant data information loss during compression. To address this, we employ the Wasserstein distance to align these two distributions, achieving near 100\% codebook utilization and significantly reducing the quantization error. Both empirical and theoretical analyses validate the effectiveness of the proposed approach.

cs.CV↗

arXiv2025

Quantifying the advantage of quantum correlation microscopy using arrays of single-photon detectors

Quantum correlation microscopy is an emerging technique for improving optical resolution. By taking advantage of the quantum statistics from single-photon fluorophores, more information about the emitters (including number and location) is obtained compared with classical microscopy. Although it is known that the resolution can be improved by increasing detector numbers, as well as using quantum correlation, the quantitative relationship between these two approaches is not immediately clear. Here we explore widefield quantum correlation microscopy using arrays of single-photon detectors. We explicitly compare the use of $N$ detectors used in photon counting mode vs $N/2$ detectors used to measure quantum correlations. i.e., where there are $N/2$ Hanbury Brown and Twiss systems, using the same $N$ detectors, on randomly generated two-emitter systems. We find regimes where $N/2$ Hanbury Brown and Twiss detectors provide improved localisation compared to $N$ photon counting detectors, as a function of emitter position and number of photons sampled.

physics.optics↗

arXiv2025

BridgeIV: Bridging Customized Image and Video Generation through Test-Time Autoregressive Identity Propagation

Both zero-shot and tuning-based customized text-to-image (CT2I) generation have made significant progress for storytelling content creation. In contrast, research on customized text-to-video (CT2V) generation remains relatively limited. Existing zero-shot CT2V methods suffer from poor generalization, while another line of work directly combining tuning-based T2I models with temporal motion modules often leads to the loss of structural and texture information. To bridge this gap, we propose an autoregressive structure and texture propagation module (STPM), which extracts key structural and texture features from the reference subject and injects them autoregressively into each video frame to enhance consistency. Additionally, we introduce a test-time reward optimization (TTRO) method to further refine fine-grained details. Quantitative and qualitative experiments validate the effectiveness of STPM and TTRO, demonstrating improvements of 7.8 and 13.1 in CLIP-I and DINO consistency metrics over the baseline, respectively.

cs.CV↗

arXiv2025

DocSpiral: A Platform for Integrated Assistive Document Annotation through Human-in-the-Spiral

Acquiring structured data from domain-specific, image-based documents such as scanned reports is crucial for many downstream tasks but remains challenging due to document variability. Many of these documents exist as images rather than as machine-readable text, which requires human annotation to train automated extraction systems. We present DocSpiral, the first Human-in-the-Spiral assistive document annotation platform, designed to address the challenge of extracting structured information from domain-specific, image-based document collections. Our spiral design establishes an iterative cycle in which human annotations train models that progressively require less manual intervention. DocSpiral integrates document format normalization, comprehensive annotation interfaces, evaluation metrics dashboard, and API endpoints for the development of AI / ML models into a unified workflow. Experiments demonstrate that our framework reduces annotation time by at least 41\% while showing consistent performance gains across three iterations during model training. By making this annotation platform freely accessible, we aim to lower barriers to AI/ML models development in document processing, facilitating the adoption of large language models in image-based, document-intensive fields such as geoscience and healthcare. The system is freely available at: https://app.ai4wa.com. The demonstration video is available: https://app.ai4wa.com/docs/docspiral/demo.

cs.SE↗

arXiv2025

SymbioticRAG: Enhancing Document Intelligence Through Human-LLM Symbiotic Collaboration

We present \textbf{SymbioticRAG}, a novel framework that fundamentally reimagines Retrieval-Augmented Generation~(RAG) systems by establishing a bidirectional learning relationship between humans and machines. Our approach addresses two critical challenges in current RAG systems: the inherently human-centered nature of relevance determination and users' progression from "unconscious incompetence" in query formulation. SymbioticRAG introduces a two-tier solution where Level 1 enables direct human curation of retrieved content through interactive source document exploration, while Level 2 aims to build personalized retrieval models based on captured user interactions. We implement Level 1 through three key components: (1)~a comprehensive document processing pipeline with specialized models for layout detection, OCR, and extraction of tables, formulas, and figures; (2)~an extensible retriever module supporting multiple retrieval strategies; and (3)~an interactive interface that facilitates both user engagement and interaction data logging. We experiment Level 2 implementation via a retriever strategy incorporated LLM summarized user intention from user interaction logs. To maintain high-quality data preparation, we develop a human-on-the-loop validation interface that improves pipeline output while advancing research in specialized extraction tasks. Evaluation across three scenarios (literature review, geological exploration, and education) demonstrates significant improvements in retrieval relevance and user satisfaction compared to traditional RAG approaches. To facilitate broader research and further advancement of SymbioticRAG Level 2 implementation, we will make our system openly accessible to the research community.

cs.IR↗

arXiv2025

Bernstein's inequalities for general Markov chains

We establish Bernstein's inequalities for functions of general (general-state-space and possibly non-reversible) Markov chains. These inequalities achieve sharp variance proxies and encompass the classical Bernstein inequality for independent random variables as special cases. The key analysis lies in bounding the operator norm of a perturbed Markov transition kernel by the exponential of sum of two convex functions. One coincides with what delivers the classical Bernstein inequality, and the other reflects the influence of the Markov dependence. A convex analysis on these two functions then derives our Bernstein inequalities. As applications, we apply our Bernstein inequalities to the Markov chain Monte Carlo integral estimation problem and the robust mean estimation problem with Markov-dependent samples, and achieve tight deviation bounds that previous inequalities can not.

math.ST↗

arXiv2025

Generative Market Equilibrium Models with Stable Adversarial Learning via Reinforcement

We present a general computational framework for solving continuous-time financial market equilibria under minimal modeling assumptions while incorporating realistic financial frictions, such as trading costs, and supporting multiple interacting agents. Inspired by generative adversarial networks (GANs), our approach employs a novel generative deep reinforcement learning framework with a decoupling feedback system embedded in the adversarial training loop, which we term as the \emph{reinforcement link}. This architecture stabilizes the training dynamics by incorporating feedback from the discriminator. Our theoretically guided feedback mechanism enables the decoupling of the equilibrium system, overcoming challenges that hinder conventional numerical algorithms. Experimentally, our algorithm not only learns but also provides testable predictions on how asset returns and volatilities emerge from the endogenous trading behavior of market participants, where traditional analytical methods fall short. The design of our model is further supported by an approximation guarantee.

q-fin.MF↗

arXiv2025

Cross-Modal Few-Shot Learning: a Generative Transfer Learning Framework

Most existing studies on few-shot learning focus on unimodal settings, where models are trained to generalize to unseen data using a limited amount of labeled examples from a single modality. However, real-world data are inherently multi-modal, and such unimodal approaches limit the practical applications of few-shot learning. To bridge this gap, this paper introduces the Cross-modal Few-Shot Learning (CFSL) task, which aims to recognize instances across multiple modalities while relying on scarce labeled data. This task presents unique challenges compared to classical few-shot learning arising from the distinct visual attributes and structural disparities inherent to each modality. To tackle these challenges, we propose a Generative Transfer Learning (GTL) framework by simulating how humans abstract and generalize concepts. Specifically, the GTL jointly estimates the latent shared concept across modalities and the in-modality disturbance through a generative structure. Establishing the relationship between latent concepts and visual content among abundant unimodal data enables GTL to effectively transfer knowledge from unimodal to novel multimodal data, as humans did. Comprehensive experiments demonstrate that the GTL achieves state-of-the-art performance across seven multi-modal datasets across RGB-Sketch, RGB-Infrared, and RGB-Depth.

cs.CV↗

arXiv2025

Data-Driven Neural Estimation of Indirect Rate-Distortion Function

The rate-distortion function (RDF) has long been an information-theoretic benchmark for data compression. As its natural extension, the indirect rate-distortion function (iRDF) corresponds to the scenario where the encoder can only access an observation correlated with the source, rather than the source itself. Such scenario is also relevant for modern applications like remote sensing and goal-oriented communication. The iRDF can be reduced into a standard RDF with the distortion measure replaced by its conditional expectation conditioned upon the observation. This reduction, however, leads to a non-trivial challenge when one needs to estimate the iRDF given datasets only, because without statistical knowledge of the joint probability distribution between the source and its observation, the conditional expectation cannot be evaluated. To tackle this challenge, starting from the well known fact that conditional expectation is the minimum mean-squared error estimator and exploiting a Markovian relationship, we identify a functional equivalence between the reduced distortion measure in the iRDF and the solution of a quadratic loss minimization problem, which can be efficiently approximated by neural network approach. We proceed to reformulate the iRDF as a variational problem corresponding to the Lagrangian representation of the iRDF curve, and propose a neural network based approximate solution, integrating the aforementioned distortion measure estimator. Asymptotic analysis guarantees consistency of the solution, and numerical experimental results demonstrate the accuracy and effectiveness of the algorithm.

cs.IT↗

arXiv2025

Lifelong Learning with Task-Specific Adaptation: Addressing the Stability-Plasticity Dilemma

Lifelong learning (LL) aims to continuously acquire new knowledge while retaining previously learned knowledge. A central challenge in LL is the stability-plasticity dilemma, which requires models to balance the preservation of previous knowledge (stability) with the ability to learn new tasks (plasticity). While parameter-efficient fine-tuning (PEFT) has been widely adopted in large language models, its application to lifelong learning remains underexplored. To bridge this gap, this paper proposes AdaLL, an adapter-based framework designed to address the dilemma through a simple, universal, and effective strategy. AdaLL co-trains the backbone network and adapters under regularization constraints, enabling the backbone to capture task-invariant features while allowing the adapters to specialize in task-specific information. Unlike methods that freeze the backbone network, AdaLL incrementally enhances the backbone's capabilities across tasks while minimizing interference through backbone regularization. This architectural design significantly improves both stability and plasticity, effectively eliminating the stability-plasticity dilemma. Extensive experiments demonstrate that AdaLL consistently outperforms existing methods across various configurations, including dataset choices, task sequences, and task scales.

cs.LG↗