arXiv subjects

Zhe Wang

Publications and source records attributed to Zhe Wang.

At least 199 records · Page 11Linked to original sources

arXiv2025

Learning-Order Autoregressive Models with Application to Molecular Graph Generation

Autoregressive models (ARMs) have become the workhorse for sequence generation tasks, since many problems can be modeled as next-token prediction. While there appears to be a natural ordering for text (i.e., left-to-right), for many data types, such as graphs, the canonical ordering is less obvious. To address this problem, we introduce a variant of ARM that generates high-dimensional data using a probabilistic ordering that is sequentially inferred from data. This model incorporates a trainable probability distribution, referred to as an order-policy, that dynamically decides the autoregressive order in a state-dependent manner. To train the model, we introduce a variational lower bound on the log-likelihood, which we optimize with stochastic gradient estimation. We demonstrate experimentally that our method can learn meaningful autoregressive orderings in image and graph generation. On the challenging domain of molecular graph generation, we achieve state-of-the-art results on the QM9 and ZINC250k benchmarks, evaluated across key metrics for distribution similarity and drug-likeless.

cs.LG↗

arXiv2025

WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blending

Artistic typography aims to stylize input characters with visual effects that are both creative and legible. Traditional approaches rely heavily on manual design, while recent generative models, particularly diffusion-based methods, have enabled automated character stylization. However, existing solutions remain limited in interactivity, lacking support for localized edits, iterative refinement, multi-character composition, and open-ended prompt interpretation. We introduce WordCraft, an interactive artistic typography system that integrates diffusion models to address these limitations. WordCraft features a training-free regional attention mechanism for precise, multi-region generation and a noise blending that supports continuous refinement without compromising visual quality. To support flexible, intent-driven generation, we incorporate a large language model to parse and structure both concrete and abstract user prompts. These components allow our framework to synthesize high-quality, stylized typography across single- and multi-character inputs across multiple languages, supporting diverse user-centered workflows. Our system significantly enhances interactivity in artistic typography synthesis, opening up creative possibilities for artists and designers.

cs.CV↗

arXiv2025

Semantic-guided Masked Mutual Learning for Multi-modal Brain Tumor Segmentation with Arbitrary Missing Modalities

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely degrade the segmentation performance. While incomplete multi-modal learning methods attempt to address this, learning robust and discriminative features from arbitrary missing modalities remains challenging. To address this challenge, we propose a novel Semantic-guided Masked Mutual Learning (SMML) approach to distill robust and discriminative knowledge across diverse missing modality scenarios.Specifically, we propose a novel dual-branch masked mutual learning scheme guided by Hierarchical Consistency Constraints (HCC) to ensure multi-level consistency, thereby enhancing mutual learning in incomplete multi-modal scenarios. The HCC framework comprises a pixel-level constraint that selects and exchanges reliable knowledge to guide the mutual learning process. Additionally, it includes a feature-level constraint that uncovers robust inter-sample and inter-class relational knowledge within the latent feature space. To further enhance multi-modal learning from missing modality data, we integrate a refinement network into each student branch. This network leverages semantic priors from the Segment Anything Model (SAM) to provide supplementary information, effectively complementing the masked mutual learning strategy in capturing auxiliary discriminative knowledge. Extensive experiments on three challenging brain tumor segmentation datasets demonstrate that our method significantly improves performance over state-of-the-art methods in diverse missing modality settings.

stat.ME↗

arXiv2025

Advancing Medical Image Segmentation via Self-supervised Instance-adaptive Prototype Learning

Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current approaches often overlook sample diversity by using a fixed prototype per semantic class and neglect intra-class variation within each input. In this paper, we propose to generate instance-adaptive prototypes for MIS, which integrates a common prototype proposal (CPP) capturing common visual patterns and an instance-specific prototype proposal (IPP) tailored to each input. To further account for the intra-class variation, we propose to guide the IPP generation by re-weighting the intermediate feature map according to their confidence scores. These confidence scores are hierarchically generated using a transformer decoder. Additionally we introduce a novel self-supervised filtering strategy to prioritize the foreground pixels during the training of the transformer decoder. Extensive experiments demonstrate favorable performance of our method.

stat.ME↗

arXiv2025

Cost-effective Instruction Learning for Pathology Vision and Language Analysis

The advent of vision-language models fosters the interactive conversations between AI-enabled models and humans. Yet applying these models into clinics must deal with daunting challenges around large-scale training data, financial, and computational resources. Here we propose a cost-effective instruction learning framework for conversational pathology named as CLOVER. CLOVER only trains a lightweight module and uses instruction tuning while freezing the parameters of the large language model. Instead of using costly GPT-4, we propose well-designed prompts on GPT-3.5 for building generation-based instructions, emphasizing the utility of pathological knowledge derived from the Internet source. To augment the use of instructions, we construct a high-quality set of template-based instructions in the context of digital pathology. From two benchmark datasets, our findings reveal the strength of hybrid-form instructions in the visual question-answer in pathology. Extensive results show the cost-effectiveness of CLOVER in answering both open-ended and closed-ended questions, where CLOVER outperforms strong baselines that possess 37 times more training parameters and use instruction data generated from GPT-4. Through the instruction tuning, CLOVER exhibits robustness of few-shot learning in the external clinical dataset. These findings demonstrate that cost-effective modeling of CLOVER could accelerate the adoption of rapid conversational applications in the landscape of digital pathology.

cs.AI↗

arXiv2025

Diffusion-based Counterfactual Augmentation: Towards Robust and Interpretable Knee Osteoarthritis Grading

Automated grading of Knee Osteoarthritis (KOA) from radiographs is challenged by significant inter-observer variability and the limited robustness of deep learning models, particularly near critical decision boundaries. To address these limitations, this paper proposes a novel framework, Diffusion-based Counterfactual Augmentation (DCA), which enhances model robustness and interpretability by generating targeted counterfactual examples. The method navigates the latent space of a diffusion model using a Stochastic Differential Equation (SDE), governed by balancing a classifier-informed boundary drive with a manifold constraint. The resulting counterfactuals are then used within a self-corrective learning strategy to improve the classifier by focusing on its specific areas of uncertainty. Extensive experiments on the public Osteoarthritis Initiative (OAI) and Multicenter Osteoarthritis Study (MOST) datasets demonstrate that this approach significantly improves classification accuracy across multiple model architectures. Furthermore, the method provides interpretability by visualizing minimal pathological changes and revealing that the learned latent space topology aligns with clinical knowledge of KOA progression. The DCA framework effectively converts model uncertainty into a robust training signal, offering a promising pathway to developing more accurate and trustworthy automated diagnostic systems. Our code is available at https://github.com/ZWang78/DCA.

eess.IV↗

arXiv2025

Quenched invariance principle with a rate for random dynamical systems

In this paper, we consider the quenched invariance principle for random Young towers driven by an ergodic system. In particular, we obtain the Wassertein convergence rate in the quenched invariance principle. As a key ingredient, we derive a new martingale-coboundary decomposition for the random tower map, which provides a good control over sums of squares of the approximating martingale. We apply our results to a class of random dynamical systems that admit a random Young tower, such as independent and identically distributed (i.i.d.) translations of Viana maps, intermittent maps of the interval and small random perturbations of Anosov maps with an ergodic driving system.

math.DS↗

arXiv2025

ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are interdependent. Current models struggle with these intricate directives, and existing benchmarks inadequately evaluate such capabilities. Specifically, they often overlook multi-instruction and chain-instruction complexities, and common consistency metrics are flawed. To address this, we introduce ComplexBench-Edit, a novel benchmark designed to systematically assess model performance on complex, multi-instruction, and chain-dependent image editing tasks. ComplexBench-Edit also features a new vision consistency evaluation method that accurately assesses non-modified regions by excluding edited areas. Furthermore, we propose a simple yet powerful Chain-of-Thought (CoT)-based approach that significantly enhances the ability of existing models to follow complex instructions. Our extensive experiments demonstrate ComplexBench-Edit's efficacy in differentiating model capabilities and highlight the superior performance of our CoT-based method in handling complex edits. The data and code are released at https://github.com/llllly26/ComplexBench-Edit.

cs.CV↗

arXiv2025

Tracking the variation of entanglement Rényi negativity: a quantum Monte Carlo study

Entanglement entropy has been a powerful tool for analyzing phases and criticality in pure ground states via quantum Monte Carlo (QMC). However, mixed-state entanglement, relevant to systems with dissipation, finite temperature, and disjoint regions, remains less explored due to the lack of efficient numerical methods. In this work, we present a practical and easy-to-implement QMC method within the reweight-annealing framework, enabling efficient computation of the entanglement Rényi negativity (RN) by tracking its variation along given parameter paths. This method is scalable, parallelizable, and well-suited for high-dimensional and large-scale simulations. Applying it to diverse scenarios-including 1D and 2D systems, ground and thermal states, and bipartite and tripartite partitions, not only the information of the underlying conformal field theory is achieved, but the role of entanglement in quantum and thermal phase transitions is revealed.

cond-mat.str-el↗

arXiv2025

TurboFuzzLLM: Turbocharging Mutation-based Fuzzing for Effectively Jailbreaking Large Language Models in Practice

Jailbreaking large-language models (LLMs) involves testing their robustness against adversarial prompts and evaluating their ability to withstand prompt attacks that could elicit unauthorized or malicious responses. In this paper, we present TurboFuzzLLM, a mutation-based fuzzing technique for efficiently finding a collection of effective jailbreaking templates that, when combined with harmful questions, can lead a target LLM to produce harmful responses through black-box access via user prompts. We describe the limitations of directly applying existing template-based attacking techniques in practice, and present functional and efficiency-focused upgrades we added to mutation-based fuzzing to generate effective jailbreaking templates automatically. TurboFuzzLLM achieves $\geq$ 95\% attack success rates (ASR) on public datasets for leading LLMs (including GPT-4o \& GPT-4 Turbo), shows impressive generalizability to unseen harmful questions, and helps in improving model defenses to prompt attacks. TurboFuzzLLM is available open source at https://github.com/amazon-science/TurboFuzzLLM.

cs.CR↗

arXiv2025

Breaker: Removing Shortcut Cues with User Clustering for Single-slot Recommendation System

In a single-slot recommendation system, users are only exposed to one item at a time, and the system cannot collect user feedback on multiple items simultaneously. Therefore, only pointwise modeling solutions can be adopted, focusing solely on modeling the likelihood of clicks or conversions for items by users to learn user-item preferences, without the ability to capture the ranking information among different items directly. However, since user-side information is often much more abundant than item-side information, the model can quickly learn the differences in user intrinsic tendencies, which are independent of the items they are exposed to. This can cause these intrinsic tendencies to become a shortcut bias for the model, leading to insufficient mining of the most concerned user-item preferences. To solve this challenge, we introduce the Breaker model. Breaker integrates an auxiliary task of user representation clustering with a multi-tower structure for cluster-specific preference modeling. By clustering user representations, we ensure that users within each cluster exhibit similar characteristics, which increases the complexity of the pointwise recommendation task on the user side. This forces the multi-tower structure with cluster-driven parameter learning to better model user-item preferences, ultimately eliminating shortcut biases related to user intrinsic tendencies. In terms of training, we propose a delayed parameter update mechanism to enhance training stability and convergence, enabling end-to-end joint training of the auxiliary clustering and classification tasks. Both offline and online experiments demonstrate that our method surpasses the baselines. It has already been deployed and is actively serving tens of millions of users daily on Meituan, one of the most popular e-commerce platforms for services.

cs.IR↗

arXiv2025

Attention-Enhanced Prompt Decision Transformers for UAV-Assisted Communications with AoI

Decision Transformer (DT) has recently demonstrated strong generalizability in dynamic resource allocation within unmanned aerial vehicle (UAV) networks, compared to conventional deep reinforcement learning (DRL). However, its performance is hindered due to zero-padding for varying state dimensions, inability to manage long-term energy constraint, and challenges in acquiring expert samples for few-shot fine-tuning in new scenarios. To overcome these limitations, we propose an attention-enhanced prompt Decision Transformer (APDT) framework to optimize trajectory planning and user scheduling, aiming to minimize the average age of information (AoI) under long-term energy constraint in UAV-assisted Internet of Things (IoT) networks. Specifically, we enhance the convenional DT framework by incorporating an attention mechanism to accommodate varying numbers of terrestrial users, introducing a prompt mechanism based on short trajectory demonstrations for rapid adaptation to new scenarios, and designing a token-assisted method to address the UAV's long-term energy constraint. The APDT framework is first pre-trained on offline datasets and then efficiently generalized to new scenarios. Simulations demonstrate that APDT achieves twice faster in terms of convergence rate and reduces average AoI by $8\%$ compared to conventional DT.

eess.SP↗

arXiv2025

PathBench: A comprehensive comparison benchmark for pathology foundation models towards precision oncology

The emergence of pathology foundation models has revolutionized computational histopathology, enabling highly accurate, generalized whole-slide image analysis for improved cancer diagnosis, and prognosis assessment. While these models show remarkable potential across cancer diagnostics and prognostics, their clinical translation faces critical challenges including variability in optimal model across cancer types, potential data leakage in evaluation, and lack of standardized benchmarks. Without rigorous, unbiased evaluation, even the most advanced PFMs risk remaining confined to research settings, delaying their life-saving applications. Existing benchmarking efforts remain limited by narrow cancer-type focus, potential pretraining data overlaps, or incomplete task coverage. We present PathBench, the first comprehensive benchmark addressing these gaps through: multi-center in-hourse datasets spanning common cancers with rigorous leakage prevention, evaluation across the full clinical spectrum from diagnosis to prognosis, and an automated leaderboard system for continuous model assessment. Our framework incorporates large-scale data, enabling objective comparison of PFMs while reflecting real-world clinical complexity. All evaluation data comes from private medical providers, with strict exclusion of any pretraining usage to avoid data leakage risks. We have collected 15,888 WSIs from 8,549 patients across 10 hospitals, encompassing over 64 diagnosis and prognosis tasks. Currently, our evaluation of 19 PFMs shows that Virchow2 and H-Optimus-1 are the most effective models overall. This work provides researchers with a robust platform for model development and offers clinicians actionable insights into PFM performance across diverse clinical scenarios, ultimately accelerating the translation of these transformative technologies into routine pathology practice.

cs.CV↗

arXiv2025

Online Iterative Self-Alignment for Radiology Report Generation

Radiology Report Generation (RRG) is an important research topic for relieving radiologist' heavy workload. Existing RRG models mainly rely on supervised fine-tuning (SFT) based on different model architectures using data pairs of radiological images and corresponding radiologist-annotated reports. Recent research has shifted focus to post-training improvements, aligning RRG model outputs with human preferences using reinforcement learning (RL). However, the limited data coverage of high-quality annotated data poses risks of overfitting and generalization. This paper proposes a novel Online Iterative Self-Alignment (OISA) method for RRG that consists of four stages: self-generation of diverse data, self-evaluation for multi-objective preference data,self-alignment for multi-objective optimization and self-iteration for further improvement. Our approach allows for generating varied reports tailored to specific clinical objectives, enhancing the overall performance of the RRG model iteratively. Unlike existing methods, our frame-work significantly increases data quality and optimizes performance through iterative multi-objective optimization. Experimental results demonstrate that our method surpasses previous approaches, achieving state-of-the-art performance across multiple evaluation metrics.

cs.CV↗

arXiv2025

Evaluating many-body stabilizer Rényi entropy by sampling reduced Pauli strings: singularities, volume law, and nonlocal magic

We present a novel quantum Monte Carlo method for evaluating the $α$-stabilizer Rényi entropy (SRE) for any integer $α\ge 2$. By interpreting $α$-SRE as partition function ratios, we eliminate the sign problem in the imaginary-time path integral by sampling \emph{reduced Pauli strings} within a \emph{reduced configuration space}, which enables efficient classical computations of $α$-SRE and its derivatives to explore magic in previously inaccessible 2D/higher-dimensional systems. We first isolate the free energy part in $2$-SRE, which is a trivial term. Notably, at quantum critical points in 1D/2D transverse field Ising (TFI) models, we reveal nontrivial singularities associated with the \emph{characteristic function} contribution, directly tied to magic. Their interplay leads to complicated behaviors of $2$-SRE, avoiding extrema at critical points generally. In contrast, analyzing the volume-law correction to SRE reveals a discontinuity tied to criticalities, suggesting that it is more informative than the full-state magic. For conformal critical points, we claim it could reflect nonlocal magic residing in correlations. Finally, we verify that $2$-SRE fails to characterize magic in mixed states (e.g. Gibbs states), yielding nonphysical results. This work provides a powerful tool for exploring the roles of magic in large-scale many-body systems, and reveals intrinsic relation between magic and many-body physics.

quant-ph↗

arXiv2025

Bipartite reweight-annealing algorithm of quantum Monte Carlo to extract large-scale data of entanglement entropy and its derivative

We propose a quantum Monte Carlo scheme capable of extracting large-scale data of Rényi entanglement entropy (EE) with high precision and low technical barrier. Instead of directly computing the ratio of two partition functions within different space-time manifolds, we obtain them separately via a reweight-annealing scheme and connect them from the ratio of a reference point. The incremental process can thus be designed along a path of real physical parameters within this framework, and all intermediates are meaningful EEs corresponding to these parameters. In a single simulation, we can obtain many multiples ($\sim βL^d$, d is the space dimension) of EEs, which has been proven to be powerful for determining phase transition points and critical exponents. Additionally, we introduce a formula to calculate the derivative of EE without resorting to numerical differentiation from dense EE data. This formula only requires computing the difference of energies in different space-time manifolds. The calculation of EE and its derivative becomes much cheaper and simpler in our scheme. We then demonstrate the feasibility of using EE and its derivative to find phase transition points, critical exponents, and various phases.

cond-mat.str-el↗

arXiv2025

Connecting Shear Thinning and Dynamic Heterogeneity in Supercooled Liquids by Localized Elasticity

Supercooled liquids exhibit complicated dynamical behaviors: At the microscopic level, the dynamics is heterogeneous spatially, known as dynamic heterogeneity. At the macroscopic level, the shear viscosity $η$ decreases as shear rate $\dotγ$ increases with a power law $η\sim\dotγ^{-λ}$, known as shear thinning. The relation between these two universal dynamical phenomena remains elusive. With simulations of several model liquids in two and three dimensions, we show that they are quantitatively bridged by localized elasticity embodied as transient clusters that elastically respond to shear. Prominent dynamic heterogeneity emerges right after the massive yielding of these clusters, which is initiated by shear transformation zones and facilitated by elasticity-mediated interaction. With this picture, a scaling law relating shear thinning to the characteristic length of dynamic heterogeneity is found.

cond-mat.soft↗

arXiv2025

High-efficiency quantum Monte Carlo algorithm for extracting entanglement entropy in interacting fermion systems

The entanglement entropy probing novel phases and phase transitions numerically via quantum Monte Carlo has made great achievements in large-scale interacting spin/boson systems. In contrast, the numerical exploration in interacting fermion systems is rare, even though fermion systems attract more attentions in condensed matter. The fundamental restrictions is that the computational cost of fermion quantum Monte Carlo ($\sim βN^3$) is much higher than that of spin/boson ($\sim βN$). Here, $N$ is the total number of sites and $β$ is the inverse temperature or projection length. To tackle this problem, we propose a fermionic quantum Monte Carlo algorithm based on the incremental technique along physical parameters, which greatly improves the efficiency of extracting entanglement entropy. We benchmark the developed algorithm by calculating the scaling behavior of the entanglement entropy in a two-dimensional square lattice Hubbard model. The obtained phase diagram including Fermi surface and Goldstone modes validates the correctness of the algorithm. Remarkably, our method shows the high-efficiency with respect to the existing algorithms, while keeping the high computation precision. We proceed to apply this algorithm to explore the scaling behavior of the entanglement entropy and particularly its derivative at Gross-Neveu criticality. Our results elucidate that such critical behavior can be quantified by the correlation length exponent.

cond-mat.stat-mech↗