arXiv ScienceSearch

arXiv subjects

Hanqing Zhang

Publications and source records attributed to Hanqing Zhang.

At least 19 recordsLinked to original sources

InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection

Multimodal object detection proves effective in remote sensing, especially the RGB-Infrared paradigm. The parallel feature extractors provide rich multimodal information for robust detection, yet introduce substantial channel redundancy and computational overhead. Existing pruning methods can reduce channel redundancy, but they are designed for unimodal backbones, overlooking cross-modal interactions and dynamic scene-wise redundancy. In this paper, we propose InterPruner, the first interactive structured channel pruning framework for RGB-infrared object detectors. Specifically, we first derive a Taylor-Implicit Criterion(TIC) to quantify channel importance via high-order Taylor expansion and the implicit function theorem. Then, a Modality Interaction Redundancy Analyzer (MIRA) identifies redundant channels via mutual compensability assessment. Finally, a Scene-Prior Channel Anchor (SPCA) uses language priors as semantic anchors to measure channel-scene relevance for dynamic channel importance estimation. Cross-modality channel pruning for RGB-Infrared detection is yet unexplored. Extensive experiments on RGB-infrared object detection dataset demonstrate that InterPruner maintains high performance with negligible degradation. Specifically, it even achieves a 0.6% mAP increase on the FLIR dataset when pruning 50% of the channels. Code will be available on GitHub to facilitate future work.

cs.CV

Physics-Informed Feature Fusion and Structural Metadata Integration for Transferable Post-Earthquake Damage Classification: Experimental Evaluation and Community-Recovery Implications

Earthquake-induced structural damage assessment remains a key challenge for population-based Structural Health Monitoring (PBSHM), where damage representations must generalize across heterogeneous buildings. Existing vibration-based methods often rely on structure-specific damage-sensitive features (DSFs) and uniform drift thresholds, limiting transferability. This study proposes a physics-informed feature fusion and structural metadata integration framework for post-earthquake damage classification and resilience-oriented assessment. A nonlinear simulation dataset is generated for building populations with varied geometrical and material properties under multiple earthquake scenarios. To obtain consistent labels, damage states are defined through nonlinear pushover analysis and capacity-based thresholds rather than fixed drift limits. Using sparse ground and roof acceleration measurements, physics-informed DSFs are compared with Catch22 and MiniRocket representations under group-wise cross-structure validation with multiple machine-learning classifiers. Results show that physics-informed DSFs outperform generic time-series representations under sparse sensing. Structural metadata further improves robustness by providing context for interpreting response-based DSFs. Modal information offers limited gains in simulations but substantially improves out-of-distribution shaking-table validation, helping bridge simulation-experiment discrepancies.

eess.SP

High-Precision Hybrid FA-PSO Based Inversion of Building Material Parameters for Fundamental Wireless Performance Evaluation

In this paper, we propose an inversion method based on the firefly particle swarm optimization (FA-PSO) algorithm to estimate the permittivity, conductivity, and thickness of building materials using the free-space method. To improve convergence efficiency and robustness, an adaptive firefly algorithm (FA) is employed to systematically optimize the hyperparameters of the particle swarm optimization (PSO). By optimizing the parameters of the Gaussian distribution used for population initialization, the accuracy of parameter estimation is gradually improved. Furthermore, we derive the Cramer-Rao lower bound (CRLB) for the permittivity, conductivity, and thickness under a complex Gaussian noise model, which serves as a theoretical benchmark for evaluating the estimation accuracy of the FA-PSO algorithm. Numerical results indicate that for relatively thin materials, the estimation accuracy of the proposed method approaches this theoretical lower bound, confirming the effectiveness of the inversion framework. This study accurately extracts the electromagnetic properties of building materials, providing strong support for evaluating their wireless performance.

cs.NI

Complex Permittivity Extraction of Polymer Materials Using Gradient-Enhanced NSGA-II Algorithm

This paper presents gradient-enhanced non-dominated sorting genetic algorithm II (G-NSGA-II) to address the challenges of local optima and solution non-uniqueness in the complex permittivity extraction problem for the first time. This adaptive hybrid algorithm integrates the global exploration capability of NSGA-II with gradient-based local refinement, triggered by a population-stagnation detection mechanism. Furthermore, multi-dimensional constraints are incorporated by jointly optimizing transmission and reflection coefficients across multiple sample thicknesses. Experimental validation conducted on six typical polymers in the 20--40 GHz band demonstrates that the retrieved relative permittivity and thicknesses are in high agreement with literature values and physical measurements. Compared to standard heuristic and gradient-based algorithms, the proposed G-NSGA-II reduces the number of generations required for convergence by approximately 50\%. This significant improvement in speed, combined with enhanced robustness, provides a highly reliable and efficient solution for broadband dielectric characterization in architectural and electromagnetic engineering. The simple measurement method and the proposed efficient algorithm allow for a rapid evalutaion of wireless performance within indoor environments. This approach serves as a valuable tool for optimizing existing wireless layouts and improving network performance.

cs.CE

Edge-aware GAT-based protein binding site prediction

Accurate identification of protein binding sites is crucial for understanding biomolecular interaction mechanisms and for the rational design of drug targets. Traditional predictive methods often struggle to balance prediction accuracy with computational efficiency when capturing complex spatial conformations. To address this challenge, we propose an Edge-aware Graph Attention Network (Edge-aware GAT) model for the fine-grained prediction of binding sites across various biomolecules, including proteins, DNA/RNA, ions, ligands, and lipids. Our method constructs atom-level graphs and integrates multidimensional structural features, including geometric descriptors, DSSP-derived secondary structure, and relative solvent accessibility (RSA), to generate spatially aware embedding vectors. By incorporating interatomic distances and directional vectors as edge features within the attention mechanism, the model significantly enhances its representation capacity. On benchmark datasets, our model achieves an ROC-AUC of 0.93 for protein-protein binding site prediction, outperforming several state-of-the-art methods. The use of directional tensor propagation and residue-level attention pooling further improves both binding site localization and the capture of local structural details. Visualizations using PyMOL confirm the model's practical utility and interpretability. To facilitate community access and application, we have deployed a publicly accessible web server at http://119.45.201.89:5000/. In summary, our approach offers a novel and efficient solution that balances prediction accuracy, generalization, and interpretability for identifying functional sites in proteins.

cs.LG

Data-Driven Model Reduction by Moment Matching for Linear and Nonlinear Parametric Systems

Theory and methods to obtain parametric reduced-order models by moment matching are presented. The definition of the parametric moment is introduced, and methods (model-based and data-driven) for the approximation of the parametric moment of linear and nonlinear parametric systems are proposed. These approximations are exploited to construct families of parametric reduced-order models that match the approximate parametric moment of the system to be reduced and preserve key system properties such as asymptotic stability and dissipativity. The use of the model reduction methods is illustrated by means of a parametric benchmark model for the linear case and a large-scale wind farm model for the nonlinear case. In the illustration, a comparison of the proposed approximation methods is drawn and their advantages/disadvantages are discussed.

eess.SY

Bi-DCSpell: A Bi-directional Detector-Corrector Interactive Framework for Chinese Spelling Check

Chinese Spelling Check (CSC) aims to detect and correct potentially misspelled characters in Chinese sentences. Naturally, it involves the detection and correction subtasks, which interact with each other dynamically. Such interactions are bi-directional, i.e., the detection result would help reduce the risk of over-correction and under-correction while the knowledge learnt from correction would help prevent false detection. Current CSC approaches are of two types: correction-only or single-directional detection-to-correction interactive frameworks. Nonetheless, they overlook the bi-directional interactions between detection and correction. This paper aims to fill the gap by proposing a Bi-directional Detector-Corrector framework for CSC (Bi-DCSpell). Notably, Bi-DCSpell contains separate detection and correction encoders, followed by a novel interactive learning module facilitating bi-directional feature interactions between detection and correction to improve each other's representation learning. Extensive experimental results demonstrate a robust correction performance of Bi-DCSpell on widely used benchmarking datasets while possessing a satisfactory detection ability.

cs.CL

LLM-Oriented Retrieval Tuner

Dense Retrieval (DR) is now considered as a promising tool to enhance the memorization capacity of Large Language Models (LLM) such as GPT3 and GPT-4 by incorporating external memories. However, due to the paradigm discrepancy between text generation of LLM and DR, it is still an open challenge to integrate the retrieval and generation tasks in a shared LLM. In this paper, we propose an efficient LLM-Oriented Retrieval Tuner, namely LMORT, which decouples DR capacity from base LLM and non-invasively coordinates the optimally aligned and uniform layers of the LLM towards a unified DR space, achieving an efficient and effective DR without tuning the LLM itself. The extensive experiments on six BEIR datasets show that our approach could achieve competitive zero-shot retrieval performance compared to a range of strong DR models while maintaining the generation ability of LLM.

cs.CL

Enhanced Eye Diagram Estimation Method for Nonlinear Systems With Input Jitter

An enhanced multiple-edge response (MER) based eye diagram estimation method is proposed to evaluate the performance of nonlinear systems with input jitter. Compared with existing MER-based methods which only took into account the bit effect, the proposed method first determines both orders of bit effect and jitter effect. These decided orders can affirm the necessary MERs. Subsequently, the proposed method figures out the minimal number of sampling points so that the necessary MERs can be recovered quickly based on the Nyquist theory and can be used to create eye diagrams. Lastly, the eye diagrams and their parameters are compared with those generated by traditional transient simulation and an existing MER-based method which introduces input jitter through a convolution process. The result indicates that this enhanced method is more accurate than the existing MER-based method.

eess.SP

Controllable Text Generation with Residual Memory Transformer

Large-scale Causal Language Models (CLMs), e.g., GPT3 and ChatGPT, have brought great success in text generation. However, it is still an open challenge to control the generation process of CLM while balancing flexibility, control granularity, and generation efficiency. In this paper, we provide a new alternative for controllable text generation (CTG), by designing a non-intrusive, lightweight control plugin to accompany the generation of CLM at arbitrary time steps. The proposed control plugin, namely Residual Memory Transformer (RMT), has an encoder-decoder setup, which can accept any types of control conditions and cooperate with CLM through a residual learning paradigm, to achieve a more flexible, general, and efficient CTG. Extensive experiments are carried out on various control tasks, in the form of both automatic and human evaluations. The results show the superiority of RMT over a range of state-of-the-art approaches, proving the effectiveness and versatility of our approach.

cs.CL

DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation

Prompt learning with immensely large Casual Language Models (CLMs) has been shown promising for attribute-controllable text generation (CTG). However, vanilla prompt tuning tends to imitate training corpus characteristics beyond the control attributes, resulting in a poor generalization ability. Moreover, it is less able to capture the relationship between different attributes, further limiting the control performance. In this paper, we propose a new CTG approach, namely DisCup, which incorporates the attribute knowledge of discriminator to optimize the control-prompts, steering a frozen CLM to produce attribute-specific texts. Specifically, the frozen CLM model, capable of producing multitudinous texts, is first used to generate the next-token candidates based on the context, so as to ensure the diversity of tokens to be predicted. Then, we leverage an attribute-discriminator to select desired/undesired tokens from those candidates, providing the inter-attribute knowledge. Finally, we bridge the above two traits by an unlikelihood objective for prompt-tuning. Extensive experimental results show that DisCup can achieve a new state-of-the-art control performance while maintaining an efficient and high-quality text generation, only relying on around 10 virtual tokens.

cs.CL

A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models

Controllable Text Generation (CTG) is emerging area in the field of natural language generation (NLG). It is regarded as crucial for the development of advanced text generation technologies that better meet the specific constraints in practical applications. In recent years, methods using large-scale pre-trained language models (PLMs), in particular the widely used transformer-based PLMs, have become a new paradigm of NLG, allowing generation of more diverse and fluent text. However, due to the limited level of interpretability of deep neural networks, the controllability of these methods need to be guaranteed. To this end, controllable text generation using transformer-based PLMs has become a rapidly growing yet challenging new research hotspot. A diverse range of approaches have emerged in the recent 3-4 years, targeting different CTG tasks that require different types of controlled constraints. In this paper, we present a systematic critical review on the common tasks, main approaches, and evaluation methods in this area. Finally, we discuss the challenges that the field is facing, and put forward various promising future directions. To the best of our knowledge, this is the first survey paper to summarize the state-of-the-art CTG techniques from the perspective of Transformer-based PLMs. We hope it can help researchers and practitioners in the related fields to quickly track the academic and technological frontier, providing them with a landscape of the area and a roadmap for future research.

cs.CL

Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese

Although pre-trained models (PLMs) have achieved remarkable improvements in a wide range of NLP tasks, they are expensive in terms of time and resources. This calls for the study of training more efficient models with less computation but still ensures impressive performance. Instead of pursuing a larger scale, we are committed to developing lightweight yet more powerful models trained with equal or less computation and friendly to rapid deployment. This technical report releases our pre-trained model called Mengzi, which stands for a family of discriminative, generative, domain-specific, and multimodal pre-trained model variants, capable of a wide range of language and vision tasks. Compared with public Chinese PLMs, Mengzi is simple but more powerful. Our lightweight model has achieved new state-of-the-art results on the widely-used CLUE benchmark with our optimized pre-training and fine-tuning techniques. Without modifying the model architecture, our model can be easily employed as an alternative to existing PLMs. Our sources are available at https://github.com/Langboat/Mengzi.

cs.CL

Object Plane Detection and Phase Retrieval from Single-Shot Holograms using Multi-Wavelength In-Line Holograph

Phase retrieval and the twin-image problem in digital in-line holographic microscopy can be resolved by iterative reconstruction routines. However, recovering the phase properties of an object in a hologram needs an object plane to be chosen correctly for reconstruction. In this work, we present a novel multi-wavelength Gerchberg-Saxton algorithm to determine the object plane using single-shot holograms recorded with multiple wavelengths in an in-line holographic microscope. For micro-sized objects, we verify the object positioning capabilities of the method for various shapes and derive the phase information using synthetic and experimental data. Experimentally, we built a compact digital in-line holographic microscopy setup around a standard optical microscope with a regular RGB-CCD camera and acquire holograms of micro-spheres, E. coli and red blood cells, that are illuminated using three lasers operating at 491 nm, 532 nm and 633 nm, respectively. We demonstrate that our method provides accurate object plane detection and phase retrieval under noisy conditions, e.g., using low-contrast holograms without background normalization. This method allows for automatic positioning and phase retrieval suitable for holographic particle velocimetry, and object tracking in biophysical or colloidal research.

physics.optics

ToxTrac: a fast and robust software for tracking organisms

1. Behavioral analysis based on video recording is becoming increasingly popular within research fields such as; ecology, medicine, ecotoxicology, and toxicology. However, the programs available to analyze the data, which are; free of cost, user-friendly, versatile, robust, fast and provide reliable statistics for different organisms (invertebrates, vertebrates and mammals) are significantly limited. 2. We present an automated open-source executable software (ToxTrac) for image-based tracking that can simultaneously handle several organisms monitored in a laboratory environment. We compare the performance of ToxTrac with current accessible programs on the web. 3. The main advantages of ToxTrac are: i) no specific knowledge of the geometry of the tracked bodies is needed; ii) processing speed, ToxTrac can operate at a rate >25 frames per second in HD videos using modern desktop computers; iii) simultaneous tracking of multiple organisms in multiple arenas; iv) integrated distortion correction and camera calibration; v) robust against false positives; vi) preservation of individual identification if crossing occurs; vii) useful statistics and heat maps in real scale are exported in: image, text and excel formats. 4. ToxTrac can be used for high speed tracking of insects, fish, rodents or other species, and provides useful locomotor information. We suggest using ToxTrac for future studies of animal behavior independent of research area. Download ToxTrac here: https://toxtrac.sourceforge.io

cs.CV

A step-by-step guide to reduce spatial coherence of laser light using a rotating ground glass diffuser

Wide field-of-view imaging of fast processes in a microscope requires high light intensities motivating the use of lasers as light sources. However, due to their long spatial coherence length lasers are inappropriate for such applications as they produce coherent noise and parasitic reflections, such as speckle, degrading image quality. Therefore, we provide a step-by-step guide for constructing a speckle-free and high contrast laser illumination setup using a rotating ground glass diffuser driven by a stepper motor. The setup is easy to build, cheap and allows a significant light throughput of 48 %, which is 40 % higher in comparison to a single lens collector commonly used in reported setups. This is achieved by using only one objective to collect the scattered light from the ground glass diffuser. We validate the stability and performance of our setup in terms of image quality, motor-induced vibrations and light throughput. To highlight the latter, we record Brownian motion of micro-particles using a 100x oil immersion objective and a high-speed camera operating at 2 000 Hz with a laser output power of only 22 mW. Moreover, by reducing the objective magnification to 50x sampling rates up to 10 000 Hz are realized. To help readers with basic or advanced optics knowledge realizing this setup we provide; a full component list, 3D-printing CAD files, setup protocol, and the code for running the stepper motor.

physics.ins-det

UmUTracker: A versatile MATLAB program for automated particle tracking of 2D light microscopy or 3D digital holography data

We present a versatile and fast MATLAB program (UmUTracker) that automatically detects and tracks particles by analyzing video sequences acquired by either light microscopy or digital in-line holographic microscopy. Our program detects the 2D lateral positions of particles with an algorithm based on the isosceles triangle transform, and reconstructs their 3D axial positions by a fast implementation of the Rayleigh-Sommerfeld model using a radial intensity profile. To validate the accuracy and performance of our program, we first track the 2D position of polystyrene particles using bright field and digital holographic microscopy. Second, we determine the 3D particle position by analyzing synthetic and experimentally acquired holograms. Finally, to highlight the full program features, we profile the microfluidic flow in a 100 micrometer high flow chamber. This result agrees with computational fluid dynamic simulations. On a regular desktop computer UmUTracker can detect, analyze, and track multiple particles at 5 frames per second for a template size of 201 x 201 in a 1024 x 1024 image. To enhance usability and to make it easy to implement new functions we used object-oriented programming. UmUTracker is suitable for studies related to: particle dynamics, cell localization, colloids and microfluidic flow measurement.

cs.CV

A robust particle detection algorithm based on symmetry

Particle tracking is common in many biophysical, ecological, and micro-fluidic applications. Reliable tracking information is heavily dependent on of the system under study and algorithms that correctly determines particle position between images. However, in a real environmental context with the presence of noise including particular or dissolved matter in water, and low and fluctuating light conditions, many algorithms fail to obtain reliable information. We propose a new algorithm, the Circular Symmetry algorithm (C-Sym), for detecting the position of a circular particle with high accuracy and precision in noisy conditions. The algorithm takes advantage of the spatial symmetry of the particle allowing for subpixel accuracy. We compare the proposed algorithm with four different methods using both synthetic and experimental datasets. The results show that C-Sym is the most accurate and precise algorithm when tracking micro-particles in all tested conditions and it has the potential for use in applications including tracking biota in their environment.

cs.CV