arXiv subjects

Zhenyu Zhao

Publications and source records attributed to Zhenyu Zhao.

At least 55 records · Page 3Linked to original sources

arXiv2025

Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Bench

Cultural Intelligence (CQ) refers to the ability to understand unfamiliar cultural contexts, a crucial skill for large language models (LLMs) to effectively engage with globally diverse users. Existing studies often focus on explicitly stated cultural norms, but fail to capture the subtle, implicit values that are common in daily conversation. To address this gap, we introduce CQBench, a benchmark specifically designed to assess LLMs' capability to infer implicit cultural values from natural conversational contexts. CQBench consists of multi character conversation based stories using values from the World Value Survey and the GlobalOpinions, with topics including ethical, religious, social, etc. Our automatic dataset construction pipeline integrates rigorous validation procedures (incorporation, consistency, and implicitness checks), achieving a 94.5% human model agreement in the final validation. To leverage CQBench data, we design three tasks of increasing complexity: attitude detection, value selection, and value extraction. These tasks evaluate whether models can detect attitude and recognize values embedded within natural dialogues rather than relying on explicit cultural knowledge. We find that while frontier models like o1 reach human level performance in value selection (0.809 F1), they still fall short in nuanced attitude detection (0.622 F1). Notably, finetuning a smaller LLaMA-3.2-3B on only 500 culturally rich examples improves performance by over 10%, even outperforming o3-mini in some cases. Using CQ-Bench, we provide insights into the current challenges in LLMs' CQ research and suggest practical pathways for enhancing LLMs' cross-cultural reasoning abilities.

cs.CL↗

arXiv2025

LEDiT: Your Length-Extrapolatable Diffusion Transformer without Positional Encoding

Diffusion transformers (DiTs) struggle to generate images at resolutions higher than their training resolutions. The primary obstacle is that the explicit positional encodings(PE), such as RoPE, need extrapolating to unseen positions which degrades performance when the inference resolution differs from training. In this paper, We propose a Length-Extrapolatable Diffusion Transformer~(LEDiT) to overcome this limitation. LEDiT needs no explicit PEs, thereby avoiding PE extrapolation. The key innovation of LEDiT lies in the use of causal attention. We demonstrate that causal attention can implicitly encode global positional information and show that such information facilitates extrapolation. We further introduce a locality enhancement module, which captures fine-grained local information to complement the global coarse-grained position information encoded by causal attention. Experimental results on both conditional and text-to-image generation tasks demonstrate that LEDiT supports up to 4x resolution scaling (e.g., from 256x256 to 512x512), achieving better image quality compared to the state-of-the-art length extrapolation methods. We believe that LEDiT marks a departure from the standard RoPE-based methods and offers a promising insight into length extrapolation. Project page: https://shenzhang2145.github.io/ledit/

cs.CV↗

arXiv2025

Algorithm Adaptation Bias in Recommendation System Online Experiments

Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead decision-making. An underexplored but critical bias is algorithm adaptation effect. This bias arises from the flywheel dynamics among production models, user data, and training pipelines: new models are evaluated on user data whose distributions are shaped by the incumbent system or tested only in a small treatment group. As a result, the measured effect of a new product change in modeling and user experience in this constrained experimental setting can diverge substantially from its true impact in full deployment. In practice, the experiment results often favor the production variant with large traffic while underestimating the performance of the test variant with small traffic, which leads to missing opportunities to launch a true winning arm or underestimating the impact. This paper aims to raise awareness of algorithm adaptation bias, situate it within the broader landscape of RecSys evaluation biases, and motivate discussion of solutions that span experiment design, measurement, and adjustment. We detail the mechanisms of this bias, present empirical evidence from real-world experiments, and discuss potential methods for a more robust online evaluation.

cs.IR↗

arXiv2025

A Local Fourier Extension Method for Function Approximation

This paper proposes a novel localized Fourier extension method for approximating non-periodic functions via domain segmentation. By partitioning the computational domain into subregions with uniform discretization scales, the method achieves spectral accuracy at $\mathcal{O}(M)$ computational complexity. Theoretical error bounds and parameter dependency analyses validate the robustness of the proposed method. The relationship among the key parameters involved is analytically established, accompanied by an optimized parameter selection strategy. Numerical experiments further confirm the effectiveness of the proposed method.

math.NA↗

arXiv2025

Fast numerical derivatives based on multi-interval Fourier extension

We present a computationally efficient algorithm for stable numerical differentiation from noisy, uniformly-sampled data on a bounded interval. The method combines multi-interval Fourier extension approximations with an adaptive domain partitioning strategy: a global precomputation of local Fourier sampling matrices and their thin SVDs is reused throughout a recursive bisection procedure that selects locally-resolved Fourier fits. Each accepted subinterval stores a compact set of Fourier coefficients that are subsequently used to reconstruct the derivative via a precomputed differentiation operator. The stopping criterion balances fitting error and an explicit noise-level bound, and the algorithm automatically refines the partition where the function exhibits rapid oscillations or boundary activity. Numerical experiments demonstrate significant improvements over existing methods, achieving accurate derivative reconstruction for challenging functions. The approach provides a robust framework for ill-posed differentiation problems while maintaining computational efficiency.

math.NA↗

arXiv2025

Miniaturized Chaos-assisted Spectrometer

Computational spectrometers are at the forefront of spectroscopy, promising portable, on-chip, or in-situ spectrum analysis through the integration of advanced computational techniques into optical systems. However, existing computational spectrometer systems have yet to fully exploit optical properties due to imperfect spectral responses, resulting in increased system complexity and compromised performance in resolution, bandwidth, and footprint. In this study, we introduce optical chaos into spectrum manipulation via cavity deformation, leveraging high spatial and spectral complexities to address this challenge. By utilizing a single chaotic cavity, we achieve high diversity in spectra, facilitating channel decorrelation of 10 pm and ensuring optimal reconstruction over 100 nm within an ultra-compact footprint of 20*22 um2 as well as an ultra-low power consumption of 16.5 mW. Our approach not only enables state-of-the-art on-chip spectrometer performance in resolution-bandwidth-footprint metric, but also has the potential to revolutionize the entire computational spectrometer ecosystem.

physics.optics↗

arXiv2025

High computational density nanophotonic media for machine learning inference

Efficient machine learning inference is essential for the rapid adoption of artificial intelligence across various domains.On-chip optical computing has emerged as a transformative solution for accelerating machine learning tasks, owing to its ultra-low power consumption. However, enhancing the computational density of on-chip optical systems remains a significant challenge, primarily due to the difficulties in miniaturizing and integrating key optical interference components.In this work, we harness the potential of fabrication-constrained scattering optical computing within nanophotonic media to address these limitations.Central to our approach is the use of fabrication-aware inverse design techniques, which enable the realization of manufacturable on-chip scattering structures under practical constraints.This results in an ultra-compact optical neural computing architecture with an area of just 64 um2,representing a remarkable three orders of magnitude reduction in footprint compared to traditional optical neural networks. Our prototype, tested on the Iris flower dataset, achieved an experimental accuracy of 86.7%, closely matching the simulation benchmark.This breakthrough showcases a promising pathway toward ultra-dense, energy-efficient optical processors for scalable machine learning inference, significantly reducing both the hardware footprint, latency, and power consumption of next-generation AI applications.

physics.optics↗

arXiv2025

GHz spiking neuromorphic photonic chip with in-situ training

Neuromorphic photonic computing represents a paradigm shift for next-generation machine intelligence, yet critical gaps persist in emulating the brain's event-driven, asynchronous dynamics,a fundamental barrier to unlocking its full potential. Here, we report a milestone advancement of a photonic spiking neural network (PSNN) chip, the first to achieve full-stack brain-inspired computing on a complementary metal oxide semiconductor-compatible silicon platform. The PSNN features transformative innovations of gigahertz-scale nonlinear spiking dynamics,in situ learning capacity with supervised synaptic plasticity, and informative event representations with retina-inspired spike encoding, resolving the long-standing challenges in spatiotemporal data integration and energy-efficient dynamic processing. By leveraging its frame-free, event-driven working manner,the neuromorphic optoelectronic system achieves 80% accuracy on the KTH video recognition dataset while operating at ~100x faster processing speeds than conventional frame-based approaches. This work represents a leap for neuromorphic computing in a scalable photonic platform with low latency and high throughput, paving the way for advanced applications in real-time dynamic vision processing and adaptive decision-making, such as autonomous vehicles and robotic navigation.

physics.optics↗

arXiv2024

Feature-interactive Siamese graph encoder-based image analysis to predict STAS from histopathology images in lung cancer

Spread through air spaces (STAS) is a distinct invasion pattern in lung cancer, crucial for prognosis assessment and guiding surgical decisions. Histopathology is the gold standard for STAS detection, yet traditional methods are subjective, time-consuming, and prone to misdiagnosis, limiting large-scale applications. We present VERN, an image analysis model utilizing a feature-interactive Siamese graph encoder to predict STAS from lung cancer histopathological images. VERN captures spatial topological features with feature sharing and skip connections to enhance model training. Using 1,546 histopathology slides, we built a large single-cohort STAS lung cancer dataset. VERN achieved an AUC of 0.9215 in internal validation and AUCs of 0.8275 and 0.8829 in frozen and paraffin-embedded test sections, respectively, demonstrating clinical-grade performance. Validated on a single-cohort and three external datasets, VERN showed robust predictive performance and generalizability, providing an open platform (http://plr.20210706.xyz:5000/) to enhance STAS diagnosis efficiency and accuracy.

eess.IV↗

arXiv2024

HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Models

Diffusion models have become a mainstream approach for high-resolution image synthesis. However, directly generating higher-resolution images from pretrained diffusion models will encounter unreasonable object duplication and exponentially increase the generation time. In this paper, we discover that object duplication arises from feature duplication in the deep blocks of the U-Net. Concurrently, We pinpoint the extended generation times to self-attention redundancy in U-Net's top blocks. To address these issues, we propose a tuning-free higher-resolution framework named HiDiffusion. Specifically, HiDiffusion contains Resolution-Aware U-Net (RAU-Net) that dynamically adjusts the feature map size to resolve object duplication and engages Modified Shifted Window Multi-head Self-Attention (MSW-MSA) that utilizes optimized window attention to reduce computations. we can integrate HiDiffusion into various pretrained diffusion models to scale image generation resolutions even to 4096x4096 at 1.5-6x the inference speed of previous methods. Extensive experiments demonstrate that our approach can address object duplication and heavy computation issues, achieving state-of-the-art performance on higher-resolution image synthesis tasks.

cs.CV↗

arXiv2024

Opportunities and challenges in the application of large artificial intelligence models in radiology

Influenced by ChatGPT, artificial intelligence (AI) large models have witnessed a global upsurge in large model research and development. As people enjoy the convenience by this AI large model, more and more large models in subdivided fields are gradually being proposed, especially large models in radiology imaging field. This article first introduces the development history of large models, technical details, workflow, working principles of multimodal large models and working principles of video generation large models. Secondly, we summarize the latest research progress of AI large models in radiology education, radiology report generation, applications of unimodal and multimodal radiology. Finally, this paper also summarizes some of the challenges of large AI models in radiology, with the aim of better promoting the rapid revolution in the field of radiography.

cs.CV↗

arXiv2024

Integrating Active Learning in Causal Inference with Interference: A Novel Approach in Online Experiments

In the domain of causal inference research, the prevalent potential outcomes framework, notably the Rubin Causal Model (RCM), often overlooks individual interference and assumes independent treatment effects. This assumption, however, is frequently misaligned with the intricate realities of real-world scenarios, where interference is not merely a possibility but a common occurrence. Our research endeavors to address this discrepancy by focusing on the estimation of direct and spillover treatment effects under two assumptions: (1) network-based interference, where treatments on neighbors within connected networks affect one's outcomes, and (2) non-random treatment assignments influenced by confounders. To improve the efficiency of estimating potentially complex effects functions, we introduce an novel active learning approach: Active Learning in Causal Inference with Interference (ACI). This approach uses Gaussian process to flexibly model the direct and spillover treatment effects as a function of a continuous measure of neighbors' treatment assignment. The ACI framework sequentially identifies the experimental settings that demand further data. It further optimizes the treatment assignments under the network interference structure using genetic algorithms to achieve efficient learning outcome. By applying our method to simulation data and a Tencent game dataset, we demonstrate its feasibility in achieving accurate effects estimations with reduced data requirements. This ACI approach marks a significant advancement in the realm of data efficiency for causal inference, offering a robust and efficient alternative to traditional methodologies, particularly in scenarios characterized by complex interference patterns.

stat.ME↗

arXiv2024

Treatment Effect Estimation Amidst Dynamic Network Interference in Online Gaming Experiments

The evolving landscape of online multiplayer gaming presents unique challenges in assessing the causal impacts of game features. Traditional A/B testing methodologies fall short due to complex player interactions, leading to violations of fundamental assumptions like the Stable Unit Treatment Value Assumption (SUTVA). Unlike traditional social networks with stable and long-term connections, networks in online games are often dynamic and short-lived. Players are temporarily teamed up for the duration of a game, forming transient networks that dissolve once the game ends. This fleeting nature of interactions presents a new challenge compared with running experiments in a stable social network. This study introduces a novel framework for treatment effect estimation in online gaming environments, considering the dynamic and ephemeral network interference that occurs among players. We propose an innovative estimator tailored for scenarios where a completely randomized experimental design is implemented without explicit knowledge of network structures. Notably, our method facilitates post-hoc interference adjustment on experimental data, significantly reducing the complexities and costs associated with intricate experimental designs and randomization strategies. The proposed framework stands out for its ability to accommodate varying levels of interference, thereby yielding more accurate and robust estimations. Through comprehensive simulations set against a variety of interference scenarios, along with empirical validation using real-world data from a mobile gaming environment, we demonstrate the efficacy of our approach. This study represents a pioneering effort in exploring causal inference in user-randomized experiments impacted by dynamic network effects.

stat.AP↗

arXiv2024

Electrochemical Removal of HF from Carbonate-based $LiPF_6$-containing Li-ion Battery Electrolytes

Due to the hydrolytic instability of $LiPF_6$ in carbonate-based solvents, HF is a typical impurity in Li-ion battery electrolytes. HF significantly influences the performance of Li-ion batteries, for example by impacting the formation of the solid electrolyte interphase at the anode and by affecting transition metal dissolution at the cathode. Additionally, HF complicates studying fundamental interfacial electrochemistry of Li-ion battery electrolytes, such as direct anion reduction, because it is electrocatalytically relatively unstable, resulting in LiF passivation layers. Methods to selectively remove ppm levels of HF from $LiPF_6$-containing carbonate-based electrolytes are limited. We introduce and benchmark a simple yet efficient electrochemical in situ method to selectively remove ppm amounts of HF from $LiPF_6$-containing carbonate-based electrolytes. The basic idea is the application of a suitable potential to a high surface-area metallic electrode upon which only HF reacts (electrocatalytically) while all other electrolyte components are unaffected under the respective conditions.

cond-mat.mtrl-sci↗

arXiv2023

Spectral approximation of $ψ$-fractional differential equation based on mapped Jacobi functions

Fractional calculus with respect to function $ψ$, also named as $ψ$-fractional calculus, generalizes the Hadamard and the Riemann-Liouville fractional calculi, which causes challenge in numerical treatment. In this paper we study spectral-type methods using mapped Jacobi functions (MJFs) as basis functions and obtain efficient algorithms to solve $ψ$-fractional differential equations. In particular, we setup the Petrov-Galerkin spectral method and spectral collocation method for initial and boundary value problems involving $ψ$-fractional derivatives. We develop basic approximation theory for the MJFs and conduct the error estimates of the derived methods. We also establish a recurrence relation to evaluate the collocation differentiation matrix for implementing the spectral collocation algorithm. Numerical examples confirm the theoretical results and demonstrate the effectiveness of the spectral and collocation methods.

math.NA↗

arXiv2023

Measurement of the effective weak mixing angle at the CEPC

We present a study of the measurement of the effective weak mixing angle parameter ($\sin^2θ^{\ell}_\text{eff}$) at the Circular Electron Positron Collider (CEPC). As a fundamental physics parameter, $\sin^2θ^{\ell}_\text{eff}$ plays a key role not only in the global test of the standard model electroweak sector, but also in constraining the potential beyond standard model new physics at high energy frontier. CEPC proposes a two year running period around the Z boson mass pole at high instataneous luminosity, providing a large data sample with $4\times 10^{12}$ $Z$ candidates generated in total. It allows a high precision measurement of $\sin^2θ^{\ell}_\text{eff}$ both in the lepton and quark final states, of which the uncertainty can be one order of magnitude lower than any previous measurement at the LEP, SLC, Tevatron and LHC. It will not only improve the overall precision of the $\sin^2θ^\ell_\text{eff}$ experimental determination to be comparable to the preicision of the theoretical calculation with two-loop radiative corrections, but also provide direct comparisons between different final states. In this paper, we also study the measurement of $\sin^2θ^{\ell}_\text{eff}$ at high mass region. With one month data taken, the precision of $\sin^2θ^{\ell}_\text{eff}$ measured at 130 GeV from $b$ quark final state is 0.00010, which will be an important experimental observation on the energy-running effect of $\sin^2θ^{\ell}_\text{eff}$.

hep-ex↗

arXiv2023

Miniaturized Computational Photonic Molecule Spectrometer

Miniaturized spectrometry system is playing an essential role for materials analysis in the development of in-situ or portable sensing platforms across research and industry. However, there unavoidably exists trade-offs between the resolution and operation bandwidth as the device scale down. Here, we report an extreme miniaturized computational photonic molecule (PM) spectrometer utilizing the diverse spectral characteristics and mode-hybridization effect of split eigenfrequencies and super-modes, which effectively eliminates the inherent periodicity and expands operation bandwidth with ultra-high spectral resolution. These results of dynamic control of the frequency, amplitude, and phase of photons in the photonic multi-atomic systems, pave the way to the development of benchtop sensing platforms for applications previously unfeasible due to resolution-bandwidth-footprint limitations, such as in gas sensing or nanoscale biomedical sensing.

physics.optics↗

arXiv2023

Microdisk modulator-assisted optical nonlinear activation functions for photonic neural networks

On-chip implementation of optical nonlinear activation functions (NAFs) is essential for realizing large-scale photonic neural chips. To implement different neural processing and machine learning tasks with optimal performances, different NAFs are explored with the use of different devices. From the perspective of on-chip integration and reconfigurability of photonic neural network (PNN), it is highly preferred that a single compact device can fulfill multiple NAFs. Here, we propose and experimentally demonstrate a compact high-speed microdisk modulator to realize multiple NAFs. The fabricated microdisk modulator has an add-drop configuration in which a lateral PN junction is incorporated for tuning. Based on high-speed nonlinear electrical-optical (E-O) effect, multiple NAFs are realized by electrically controlling free-carrier injection. Thanks to its strong optical confinement of the disk cavity, all-optical thermo-optic (TO) nonlinear effect can also be leveraged to realize other four different NAFs, which is difficult to be realized with the use of electrical-optical effect. With the use of the realized nonlinear activation function, a convolutional neural network (CNN) is studied to perform handwritten digit classification task, and an accuracy as large as 98% is demonstrated, which verifies the effectiveness of the use of the high-speed microdisk modulator to realize the NAFs. Thanks to its compact footprint and strong electrical-optical or all-optical effects, the microdisk modulator features multiple NAFs, which could serve as a flexible nonlinear unit for large-scale PNNs.

physics.optics↗