arXiv Science⌕ Search

arXiv subjects

Lu Zhang

Publications and source records attributed to Lu Zhang.

At least 253 records · Page 14Linked to original sources
arXiv2023

Revisiting Machine Learning based Test Case Prioritization for Continuous Integration

To alleviate the cost of regression testing in continuous integration (CI), a large number of machine learning-based (ML-based) test case prioritization techniques have been proposed. However, it is yet unknown how they perform under the same experimental setup, because they are evaluated on different datasets with different metrics. To bridge this gap, we conduct the first comprehensive study on these ML-based techniques in this paper. We investigate the performance of 11 representative ML-based prioritization techniques for CI on 11 open-source subjects and obtain a series of findings. For example, the performance of the techniques changes across CI cycles, mainly resulting from the changing amount of training data, instead of code evolution and test removal/addition. Based on the findings, we give some actionable suggestions on enhancing the effectiveness of ML-based techniques, e.g., pretraining a prioritization technique with cross-subject data to get it thoroughly trained and then finetuning it with within-subject data dramatically improves its performance. In particular, the pretrained MART achieves state-of-the-art performance, producing the optimal sequence on 80% subjects, while the existing best technique, the original MART, only produces the optimal sequence on 50% subjects.

cs.SE↗
arXiv2023

Franck-Condon Simulation of Vibrationally-Resolved X-ray Spectra for Diatomic Systems: Validation of Harmonic Approximation and Density Functional Theory

Under the Franck-Condon approximation, we systematically validated the performance of density functional theory (DFT) and the effects of anharmonicity in simulating C/N/O K-edge vibrationally-resolved X-ray spectra of common diatomic molecules. To get ``transparent'' validations, vibronic fine structures of only the lowest 1s excited or ionized state in the X-ray absorption (XAS) or photoelectron (XPS) spectra were investigated. All 6 systems (N$_2$, N$_2^+$; NO, NO$^+$; CO, CO$^+$) were studied within the harmonic oscillator (HO) approximation using DFT with four functionals (BLYP, BP86, B3LYP, M06-2X) for 10 XAS and 4 XPS spectra, and excellent agreement between theoretical and experimental spectra was found in most systems, except O1s XAS of NO, CO, and NO$^+$. We analyzed and established a connection between their complex vibronic structures (many weak oscillating features within a broad peak) and the significant geometrical changes induced by the O1s hole. The three spectra were well reproduced with anharmonic (AH) calculations by using quantum wavepacket dynamics based on potential energy curves (PECs) generated by DFT methods or multiconfigurational levels, highlighting sensitivity to the anharmonic effect and the PEC quality. In other examples of XAS (CO$^+$, C1s and O1s; NO, N1s) corresponding to smaller structural changes, HO and AH approaches lead to similar fine structures, which are dominated by 0-0 and 0-1 transitions. This study highlights the use of DFT with selected functionals for such diatomic calculations due to its easy execution and generally reliable accuracy. Functional dependence in diatomic systems is generally more pronounced than in polyatomic ones. We found that BLYP, BP86, and B3LYP functionals consistently exhibited high accuracy in predicting spectral profiles, bond lengths, and vibrational frequencies, which slightly outperformed M06-2X.

physics.chem-ph↗
arXiv2023

An energy-based discontinuous Galerkin method for the nonlinear Schrödinger equation with wave operator

This work develops an energy-based discontinuous Galerkin (EDG) method for the nonlinear Schrödinger equation with the wave operator. The focus of the study is on the energy-conserving or energy-dissipating behavior of the method with some simple mesh-independent numerical fluxes we designed. We establish error estimates in the energy norm that require careful selection of a test function for the auxiliary equation involving the time derivative of the displacement variable. A critical part of the convergence analysis is to establish the L2 error bounds for the time derivative of the approximation error in the displacement variable by using the equation that determines its mean value. Using a specially chosen test function, we show that one can create a linear system for the time evolution of the unknowns even when dealing with nonlinear properties in the original problem. Extensive numerical experiments are provided to demonstrate the optimal convergence of the scheme in the L2 norm with our choices of the numerical flux.

math.NA↗
arXiv2023

Holistic Evaluation of GPT-4V for Biomedical Imaging

In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain. We assess GPT-4V's performance across 16 medical imaging categories, including radiology, oncology, ophthalmology, pathology, and more. Tasks include modality recognition, anatomy localization, disease diagnosis, report generation, and lesion detection. The extensive experiments provide insights into GPT-4V's strengths and weaknesses. Results show GPT-4V's proficiency in modality and anatomy recognition but difficulty with disease diagnosis and localization. GPT-4V excels at diagnostic report generation, indicating strong image captioning skills. While promising for biomedical imaging AI, GPT-4V requires further enhancement and validation before clinical deployment. We emphasize responsible development and testing for trustworthy integration of biomedical AGI. This rigorous evaluation of GPT-4V on diverse medical images advances understanding of multimodal large language models (LLMs) and guides future work toward impactful healthcare applications.

eess.IV↗
arXiv2023

Video Frame Interpolation with Many-to-many Splatting and Spatial Selective Refinement

In this work, we first propose a fully differentiable Many-to-Many (M2M) splatting framework to interpolate frames efficiently. Given a frame pair, we estimate multiple bidirectional flows to directly forward warp the pixels to the desired time step before fusing overlapping pixels. In doing so, each source pixel renders multiple target pixels and each target pixel can be synthesized from a larger area of visual context, establishing a many-to-many splatting scheme with robustness to undesirable artifacts. For each input frame pair, M2M has a minuscule computational overhead when interpolating an arbitrary number of in-between frames, hence achieving fast multi-frame interpolation. However, directly warping and fusing pixels in the intensity domain is sensitive to the quality of motion estimation and may suffer from less effective representation capacity. To improve interpolation accuracy, we further extend an M2M++ framework by introducing a flexible Spatial Selective Refinement (SSR) component, which allows for trading computational efficiency for interpolation quality and vice versa. Instead of refining the entire interpolated frame, SSR only processes difficult regions selected under the guidance of an estimated error map, thereby avoiding redundant computation. Evaluation on multiple benchmark datasets shows that our method is able to improve the efficiency while maintaining competitive video interpolation quality, and it can be adjusted to use more or less compute as needed.

cs.CV↗
arXiv2023

PathRL: An End-to-End Path Generation Method for Collision Avoidance via Deep Reinforcement Learning

Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly commands the robot with low-level controls, like linear and angular velocities, which leads to unstable speeds and unsmooth trajectories of the robot during the long-term execution. An alternative method is to train a DRL policy that outputs the navigation path directly. However, two roadblocks arise for training a DRL policy that outputs paths: (1) The action space for potential paths often involves higher dimensions comparing to low-level commands, which increases the difficulties of training; (2) It takes multiple time steps to track a path instead of a single time step, which requires the path to predicate the interactions of the robot w.r.t. the dynamic environment in multiple time steps. This, in turn, amplifies the challenges associated with training. In response to these challenges, we propose PathRL, a novel DRL method that trains the policy to generate the navigation path for the robot. Specifically, we employ specific action space discretization techniques and tailored state space representation methods to address the associated challenges. In our experiments, PathRL achieves better success rates and reduces angular rotation variability compared to other DRL navigation methods, facilitating stable and smooth robot movement. We demonstrate the competitive edge of PathRL in both real-world scenarios and multiple challenging simulation environments.

cs.RO↗
arXiv2023

Properties and Deviations of Random Sums of Densely Dependent Random Variables

A classical problem of statistical inference is the valid specification of a model that can account for the statistical dependencies between observations when the true structure is dense, intractable, or unknown. To address this problem, a new variance identity is presented, which is closely related to the Moulton factor. This identity does not require the specification of an entire covariance structure and instead relies on the choice of two summary constants. Using this result, a weak law of large numbers is also established for additive statistics and common variance estimators under very general conditions of statistical dependence. Furthermore, this paper proves a sharper version of Hoeffding's inequality for symmetric and bounded random variables under these same conditions of statistical dependence. Put otherwise, it is shown that, under relatively mild conditions, finite sample inference is possible in common settings such as linear regression, and even when every outcome variable is statistically dependent with all others. All results are extended to estimating equations. Simulation experiments and an application to climate data are also provided.

math.ST↗
arXiv2023

ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data

Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity pose a huge generalizability challenge to the current methods under massive data volume, mainly because the style and normativity of radiology reports are obviously distinctive among institutions, body regions inspected and radiologists. Recently, the advent of large language models (LLM) offers great potential for recognizing signs of health conditions. To resolve the above problem, we collaborate with the Second Xiangya Hospital in China and propose ChatRadio-Valuer based on the LLM, a tailored model for automatic radiology report generation that learns generalizable representations and provides a basis pattern for model adaptation in sophisticated analysts' cases. Specifically, ChatRadio-Valuer is trained based on the radiology reports from a single institution by means of supervised fine-tuning, and then adapted to disease diagnosis tasks for human multi-system evaluation (i.e., chest, abdomen, muscle-skeleton, head, and maxillofacial $\&$ neck) from six different institutions in clinical-level events. The clinical dataset utilized in this study encompasses a remarkable total of \textbf{332,673} observations. From the comprehensive results on engineering indicators, clinical efficacy and deployment cost metrics, it can be shown that ChatRadio-Valuer consistently outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and GPT-4 et al., in terms of the diseases diagnosis from radiology reports. ChatRadio-Valuer provides an effective avenue to boost model generalization performance and alleviate the annotation workload of experts to enable the promotion of clinical AI applications in radiology reports.

cs.CL↗
arXiv2023

Quantile-based Random Sparse Kaczmarz for Corrupted and Noisy Linear Systems

The randomzied Kaczmarz method, along with its recently developed variants, has become a popular tool for dealing with large-scale linear systems. However, these methods usually fail to converge when the linear systems are affected by heavy corruptions, which are common in many practical applications. In this study, we develop a new variant of the randomzied sparse Kaczmarz method with linear convergence guarantees, by making use of a quantile technique to detect corruptions. Moreover, we incorporate averaged block technique into the proposed method to achieve parallel computation and acceleration. Finally, the proposed algorithms are illustrated to be very efficient through extensive numerical experiments.

math.OC↗
arXiv2023

Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale realistic data collection and costly model training; and ii. the intrinsic limitations in the traditionally user-defined binary masks on objects with unclear boundaries or transparent texture. In this paper, we propose MagicRemover, a tuning-free method that leverages the powerful diffusion models for text-guided image inpainting. We introduce an attention guidance strategy to constrain the sampling process of diffusion models, enabling the erasing of instructed areas and the restoration of occluded content. We further propose a classifier optimization algorithm to facilitate the denoising stability within less sampling steps. Extensive comparisons are conducted among our MagicRemover and state-of-the-art methods including quantitative evaluation and user study, demonstrating the significant improvement of MagicRemover on high-quality image inpainting. We will release our code at https://github.com/exisas/Magicremover.

cs.CV↗
arXiv2023

Simulation Guided Molecular Design of Hydrofluoroether Solvent for High Energy Batteries

Electrolyte design is critical for enabling next-generation batteries with higher energy densities. Hydrofluoroether (HFE) solvents have drawn a lot of attention as the electrolytes based on HFEs showed great promise to deliver highly desired properties, including high oxidative stability, ionic conductivity, as well as enhanced lithium metal compatibility. However, the structure-dynamics-properties relationships and design principles for high-performance HFE solvents are still poorly understood. Herein, we proposed four novel asymmetric HFE designs by systematically varying polyether and fluorocarbon structural building blocks. By leveraging molecular dynamics (MD) modeling to analyze the solvation structures and predict the properties of the corresponding 1 M lithium bis(fluorosulfonyl)imide (LiTFSI) solutions, we downselected the most promising candidate based on high conductivity, solvation species distribution, and oxidative stability for extensive electrochemical characterizations. The formulated electrolyte demonstrated properties consistent with the predictions from the simulations and showed much-improved capacity retention as well as Coulombic efficiency compared to the baseline electrolytes when cycled in lithium metal cells. This work exemplifies the construction of candidate electrolytes from building block functional moieties to engineer fundamental solvation structures for desired electrolyte properties and guide the discovery and rational design of new solvent materials.

cond-mat.mtrl-sci↗
arXiv2023

StarTrek: Combinatorial Variable Selection with False Discovery Rate Control

Variable selection on the large-scale networks has been extensively studied in the literature. While most of the existing methods are limited to the local functionals especially the graph edges, this paper focuses on selecting the discrete hub structures of the networks. Specifically, we propose an inferential method, called StarTrek filter, to select the hub nodes with degrees larger than a certain thresholding level in the high dimensional graphical models and control the false discovery rate (FDR). Discovering hub nodes in the networks is challenging: there is no straightforward statistic for testing the degree of a node due to the combinatorial structures; complicated dependence in the multiple testing problem is hard to characterize and control. In methodology, the StarTrek filter overcomes this by constructing p-values based on the maximum test statistics via the Gaussian multiplier bootstrap. In theory, we show that the StarTrek filter can control the FDR by providing accurate bounds on the approximation errors of the quantile estimation and addressing the dependence structures among the maximal statistics. To this end, we establish novel Cramér-type comparison bounds for the high dimensional Gaussian random vectors. Comparing to the Gaussian comparison bound via the Kolmogorov distance established by \citet{chernozhukov2014anti}, our Cramér-type comparison bounds establish the relative difference between the distribution functions of two high dimensional Gaussian random vectors. We illustrate the validity of the StarTrek filter in a series of numerical experiments and apply it to the genotype-tissue expression dataset to discover central regulator genes.

stat.ME↗
arXiv2023

OrdinalFix: Fixing Compilation Errors via Shortest-Path CFL Reachability

The development of correct and efficient software can be hindered by compilation errors, which must be fixed to ensure the code's syntactic correctness and program language constraints. Neural network-based approaches have been used to tackle this problem, but they lack guarantees of output correctness and can require an unlimited number of modifications. Fixing compilation errors within a given number of modifications is a challenging task. We demonstrate that finding the minimum number of modifications to fix a compilation error is NP-hard. To address compilation error fixing problem, we propose OrdinalFix, a complete algorithm based on shortest-path CFL (context-free language) reachability with attribute checking that is guaranteed to output a program with the minimum number of modifications required. Specifically, OrdinalFix searches possible fixes from the smallest to the largest number of modifications. By incorporating merged attribute checking to enhance efficiency, the time complexity of OrdinalFix is acceptable for application. We evaluate OrdinalFix on two datasets and demonstrate its ability to fix compilation errors within reasonable time limit. Comparing with existing approaches, OrdinalFix achieves a success rate of 83.5%, surpassing all existing approaches (71.7%).

cs.SE↗
arXiv2023

MARC: Multipolicy and Risk-aware Contingency Planning for Autonomous Driving

Generating safe and non-conservative behaviors in dense, dynamic environments remains challenging for automated vehicles due to the stochastic nature of traffic participants' behaviors and their implicit interaction with the ego vehicle. This paper presents a novel planning framework, Multipolicy And Risk-aware Contingency planning (MARC), that systematically addresses these challenges by enhancing the multipolicy-based pipelines from both behavior and motion planning aspects. Specifically, MARC realizes a critical scenario set that reflects multiple possible futures conditioned on each semantic-level ego policy. Then, the generated policy-conditioned scenarios are further formulated into a tree-structured representation with a dynamic branchpoint based on the scene-level divergence. Moreover, to generate diverse driving maneuvers, we introduce risk-aware contingency planning, a bi-level optimization algorithm that simultaneously considers multiple future scenarios and user-defined risk tolerance levels. Owing to the more unified combination of behavior and motion planning layers, our framework achieves efficient decision-making and human-like driving maneuvers. Comprehensive experimental results demonstrate superior performance to other strong baselines in various environments.

cs.RO↗
arXiv2023

On Root Cause Localization and Anomaly Mitigation through Causal Inference

Due to a wide spectrum of applications in the real world, such as security, financial surveillance, and health risk, various deep anomaly detection models have been proposed and achieved state-of-the-art performance. However, besides being effective, in practice, the practitioners would further like to know what causes the abnormal outcome and how to further fix it. In this work, we propose RootCLAM, which aims to achieve Root Cause Localization and Anomaly Mitigation from a causal perspective. Especially, we formulate anomalies caused by external interventions on the normal causal mechanism and aim to locate the abnormal features with external interventions as root causes. After that, we further propose an anomaly mitigation approach that aims to recommend mitigation actions on abnormal features to revert the abnormal outcomes such that the counterfactuals guided by the causal mechanism are normal. Experiments on three datasets show that our approach can locate the root causes and further flip the abnormal labels.

cs.LG↗
arXiv2023

Artificial General Intelligence for Radiation Oncology

The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale.

physics.med-ph↗
arXiv2023

Applications of Conjugate Gradient in Bayesian computation

Conjugate gradient is an efficient algorithm for solving large sparse linear systems. It has been utilized to accelerate the computation in Bayesian analysis for many large-scale problems. This article discusses the applications of conjugate gradient in Bayesian computation, with a focus on sparse regression and spatial analysis. A self-contained introduction of conjugate gradient is provided to facilitate potential applications in a broader range of problems.

stat.ME↗
arXiv2023

True Circular Dichroism in Optically Active Achiral Metasurfaces and Its Relation to Chiral Near-Fields

Optically active achiral metasurfaces offer a promising way to detect chiral molecules based on chiroptic methods. The combination of plasmonic enhanced circular dichroism and reversible optical activity would boost the sensitivity and provide enantiomerselective surfaces while using a single sensing site. In this work, we use metasurfaces containing arrays of U-shaped resonators as a benchmark for analyzing the optical activity of achiral materials. Although the peculiar optical activity of these metasurfaces has 1 been quite well described, we present here an experimental and numerical quantitative determination of the different contributions to the measured optical activity. In particular, it is shown that linear birefringence and retardance contribute, but only marginally, to the apparent circular dichroism of the metasurface associated with the excitation of magnetoelectric modes. We then numerically demonstrate the peculiar near-field properties of the magneto-electric modes and explain how these properties could be reflected in the far-field polarimetric properties in the presence of chiral molecules. This work provides alternatives for the detection scheme of chiral molecules using plasmonic resonators.

physics.app-ph↗