arXiv Science⌕ Search

arXiv subjects

Feng Wang

Publications and source records attributed to Feng Wang.

At least 73 records · Page 4Linked to original sources

Beam Test Characterization of Silicon Microstrip Detector Flight-Model Ladders for the AMS-02 Upgrade

The AMS-02 experiment plans to install a new silicon microstrip tracker layer (Layer-0) on top of the existing detector, increasing the cosmic-ray acceptance by a factor of 3. Layer-0 employs a design in which multiple silicon microstrip detectors (SSDs) are connected in series to form long detector ladders. We present a detailed performance study of the flight-model ladders using a 350~GeV mixed hadron beam at the CERN SPS. The study focuses on the following aspects: (i) the performance of ladders with different numbers of SSDs, for which the intrinsic spatial resolution at normal incidence varies from $9.5~μ\mathrm{m}$ to $11.4~μ\mathrm{m}$ for ladders composed of 8 to 12 SSDs; (ii) the response consistency for particles impacting on the \emph{Head} and \emph{Tail} regions of the ladder; and (iii) the dependence of the detector performance on the particle incidence angle.

physics.ins-det↗

Observation of two-component exciton condensates in an excitonic insulator

Macroscopic quantum coherence emerges when bosons condense into a Bose-Einstein condensate (BEC). First observed as a single-component superfluid in helium, BECs later emerged in ultracold atomic gases at nanokelvin temperatures as weakly interacting quantum fluids, which can also host multicomponent spinor condensates with rich internal degrees of freedom. Excitons provide a promising solid-state platform for BECs that can combine strong interactions, electrical tunability, high transition temperatures, and multicomponent order. Yet, conclusive evidence for condensation has remained elusive. Here, we report evidence of two-component exciton BECs in MoSe2/hBN/WSe2 electron-hole bilayers by directly probing the spin susceptibility of constituent electrons and holes. This heterostructure hosts equilibrium exciton fluids with four spin-valley flavors. Using magneto-optical spectroscopy in a dilution refrigerator, we reveal three exciton condensate phases with distinct flavor polarizations. At zero magnetic field, the many-body ground state is a coherent superposition of two simultaneously condensed intravalley exciton flavors. Under a magnetic field, the intravalley exciton condensate first switches to a two-component intervalley exciton condensate via a first-order quantum phase transition at a weak critical field, and then turns into a fully-polarized single-component condensate at high fields. The two-component condensates persist up to ~1.8 K. Our results establish van der Waals electron-hole bilayers as a versatile platform for exploring strongly interacting, multicomponent exciton BECs.

cond-mat.mes-hall↗

CSST-PSFNet: A Point Spread Function Reconstruction Model for the CSST Based on Deep Learning

This paper presents CSST-PSFNet, a deep learning method for high-fidelity point spread function (PSF) reconstruction developed for the Chinese Space Station Survey Telescope (CSST). The model integrates a residual neural network, a lightweight Transformer architecture, and a variational latent representation to address key challenges in CSST imaging, including severe PSF undersampling, inter-band variability, and smooth spatial variation across the focal plane. Trained and validated on high-resolution star-PSF pairs generated by the CSST Main Survey Simulator, CSST-PSFNet achieves improved pixel-level accuracy and more precise recovery of shape parameters relevant to weak lensing compared to widely used PSFEx. On both the standard test dataset and a blurred dataset representing the upper bound of expected on-orbit PSF degradation, the model achieves a size residual precision below 0.005 and an ellipticity residual precision below 0.002. A weak-label adaptation experiment further shows that the model can recover PSFEx-level performance when the true PSF is unknown, demonstrating robustness in controlled degradation scenarios and weak-label adaptation experiments. These results indicate that CSST-PSFNet provides a flexible and extensible framework for future on-orbit PSF calibration in large-scale CSST surveys, with potential applications in weak-lensing cosmology and precision astrophysical measurements.

astro-ph.IM↗

From Complex Dynamics to DynFormer: Rethinking Transformers for PDEs

Partial differential equations (PDEs) are fundamental for modeling complex physical systems, yet classical numerical solvers face prohibitive computational costs in high-dimensional and multi-scale regimes. While Transformer-based neural operators have emerged as powerful data-driven alternatives, they conventionally treat all discretized spatial points as uniform, independent tokens. This monolithic approach ignores the intrinsic scale separation of physical fields, applying computationally prohibitive global attention that redundantly mixes smooth large-scale dynamics with high-frequency fluctuations. Rethinking Transformers through the lens of complex dynamics, we propose DynFormer, a novel dynamics-informed neural operator. Rather than applying a uniform attention mechanism across all scales, DynFormer explicitly assigns specialized network modules to distinct physical scales. It leverages a Spectral Embedding to isolate low-frequency modes, enabling a Kronecker-structured attention mechanism to efficiently capture large-scale global interactions with reduced complexity. Concurrently, we introduce a Local-Global-Mixing transformation. This module utilizes nonlinear multiplicative frequency mixing to implicitly reconstruct the small-scale, fast-varying turbulent cascades that are slaved to the macroscopic state, without incurring the cost of global attention. Integrating these modules into a hybrid evolutionary architecture ensures robust long-term temporal stability. Extensive memory-aligned evaluations across four PDE benchmarks demonstrate that DynFormer achieves up to a 95% reduction in relative error compared to state-of-the-art baselines, while significantly reducing GPU memory consumption. Our results establish that embedding first-principles physical dynamics into Transformer architectures yields a highly scalable, theoretically grounded blueprint for PDE surrogate modeling.

cs.LG↗

GNN Based Joint Beamforming Design for Extremely Large-Scale RIS Assisted Near-Field ISAC Systems

This paper investigates an extremely large-scale reconfigurable intelligent surface (XL-RIS) assisted near-field integrated sensing and communication (ISAC) system, where a multi-antenna base station (BS) simultaneously sends unicast data to multiple single-antenna communication users (CUs) and senses multiple targets (TGTs). The BS, CUs and TGTs are \emph{all} assumed to be located in the near-field region of the XL-RIS. We aim to maximize the weighted sum rate (WSR) of all CUs, subject to the sensing beampattern gain constraint for each TGT, the transmit power constraint for the BS, and the unit modulus constraints on the XL-RIS phase shift. First, we develop a fractional programming (FP) based block coordinate descent (BCD) algorithm to obtain a locally optimal solution for such a non-convex joint design problem. Secondly, to address the high-dimensional spatial correlations and scalability of the XL-RIS near-field channels, we propose a customized graph neural network (GNN) scheme to generate the BS transmit beamforming variables and the XL-RIS reflecting coefficient vector for ISAC, where the near-field ISAC system is modeled as a heterogeneous graph comprising XL-RIS/CU/TGT nodes. The proposed GNN scheme can effectively learn the near-field channel state information (CSI) features, in which the message passing mechanism is employed to exchange CSI among these directly connected nodes in the graph. Furthermore, each XL-RIS/CU/TGT node maintains a feature vector for mapping to the BS transmit beamforming variables or the XL-RIS reflecting coefficient vector. Numerical results show that the proposed GNN-based beamforming design scheme achieves a better performance than the existing baselines, in terms of computational efficiency, feasibility, robustness, and the ability of generalization.

cs.IT↗

Detection and classification of astronomical sources with Astro-RetinaNet in crowded stellar fields

Upcoming next-generation sky surveys will detect large number of faint objects with magnitudes larger than 25. When objects are crowded within a limited a field of view, blending becomes unavoidable. Blending leads to the omission of many sources during photometry in these fields, which cause an underestimates of tens of percent in crowded fields, and remains a major challenge for existing source-extraction techniques. Although artificial neural networks had shown promising results in the detection and classification in wide-field surveys, they often fail with severely blended stars. We developed a robust deep learning model, Astro-RetinaNet, based on the Retinanet algorithm to detect and classify blended sources in single-band astronomical images. After training and evaluating the performance of our network on simulated images, we find precision of 0.96, 0.89,0.70, 0.50,0.75 for single star, 2-star, 3-star, 4-star and 5-or-more star blending cases, respectively, with star number density $\sim$22000 stars per $\rm arcmin^2$. We compare our method's detection capability and completeness both on CSST simulated NGC 2298 images and HST observed M31 images. In crowded and non-crowded stellar fields of simulated NGC 2298, our results show that the model can recover $82\%$ and $95\%$ sources respectively at magnitude ($i$ band) of 25, while for SExtractor and Photutils the completeness reduces to $20\%, 59\%$ and $60\%, 88\%$ respectively. In the M31 case, as faint as 27 magnitude ($F814W$) in a crowded field, Astro-RetinaNet detects 2,224 sources, significantly outperforming Photutils and SExtractor by factors of 3.4 and 7.1, respectively.

astro-ph.IM↗

Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More

Since the introduction of Vision Transformer (ViT), patchification has long been regarded as a de facto image tokenization approach for plain visual architectures. By compressing the spatial size of images, this approach can effectively shorten the token sequence and reduce the computational cost of ViT-like plain architectures. In this work, we aim to thoroughly examine the information loss caused by this patchification-based compressive encoding paradigm and how it affects visual understanding. We conduct extensive patch size scaling experiments and excitedly observe an intriguing scaling law in patchification: the models can consistently benefit from decreased patch sizes and attain improved predictive performance, until it reaches the minimum patch size of 1x1, i.e., pixel tokenization. This conclusion is broadly applicable across different vision tasks, various input scales, and diverse architectures such as ViT and the recent Mamba models. Moreover, as a by-product, we discover that with smaller patches, task-specific decoder heads become less critical for dense prediction. In the experiments, we successfully scale up the visual sequence to an exceptional length of 50,176 tokens, achieving a competitive test accuracy of 84.6% with a base-sized model on the ImageNet-1k benchmark. We hope this study can provide insights and theoretical foundations for future works of building non-compressive vision models. Code is available at https://github.com/wangf3014/Patch_Scaling.

cs.CV↗

Photocatalytic methanol dehydrogenation promoted synergistically by atomically dispersed Pd and clustered Pd

Supported metal in the form of single atoms, clusters, and particles can individually or jointly affect the activity of supported heterogeneous catalysts. While the individual contribution of supported metal to the overall activity of supported photocatalysts has been identified, the joint activity of mixed metal species is overlooked because of their different photoelectric properties. Here, atomically dispersed Pd (Pd1) and Pd clusters are loaded onto CdS, serving as oxidation and reduction sites, respectively, for methanol dehydrogenation. The Pd1 substitutes Cd2+, forming hole-trapping states for methanol oxidation and assisting the dispersion of photo-deposited Pd clusters. Therefore, methanol dehydrogenation on CdS with supported Pd1 and Pd clusters exhibits the highest turnover frequency of 1.14 s-1 based on Pd content, and affords H2 and HCHO with a similar apparent quantum yield of 87 +/- 1% at 452 nm under optimized reaction conditions. This work highlights the synergistic catalysis of supported metal for improved photocatalytic activity.

cond-mat.mtrl-sci↗

Intermittent Semi-Working Mask: A New Masking Paradigm for LLMs

Multi-turn dialogues and context-intensive tasks challenge Large Language Models (LLMs) to integrate long histories without sacrificing generation quality. Although prefix LLMs can better exploit historical context via bidirectional attention on prefix tokens, they are rarely used in practice because multi-turn training requires many duplicated triplets, and its bidirectional prefix prevents KV-cache reuse at inference time, driving up high cost and latency. To retain the contextual understanding of prefix mask while preserving the inference-time efficiency of causal mask, we introduce Intermittent Semi-working Mask (ISM), a masking scheme that injects sparse bidirectional attention into the causal backbone. ISM alternates bidirectional attention over query segments with unidirectional attention over answer segments, enabling the synthesis of in-context while preserving global causality. This design eliminates triplet expansion during training and maintains KV-cache reuse during inference, yielding latency comparable to standard causal LLMs. ISM is architecture-agnostic and parameter-free, adding only minimal latency. Across extensive evaluations, ISM outperforms causal baselines not only on multi-turn dialogue, but also on context-intensive tasks like mathematical reasoning.

cs.CL↗

DyMixOp: A Neural Operator Designed from a Complex Dynamics Perspective with Local-Global Mixing for Solving PDEs

A primary challenge in using neural networks to approximate nonlinear dynamical systems governed by partial differential equations (PDEs) lies in recasting these systems into a tractable representation particularly when the dynamics are inherently non-linearizable or require infinite-dimensional spaces for linearization. To address this challenge, we introduce DyMixOp, a novel neural operator framework for PDEs that integrates theoretical insights from complex dynamical systems. Grounded in dynamics-aware priors and inertial manifold theory, DyMixOp projects the original infinite-dimensional PDE dynamics onto a finite-dimensional latent space. This reduction preserves both essential linear structures and dominant nonlinear interactions, thereby establishing a physically interpretable and computationally structured foundation. Central to this approach is the local-global mixing (LGM) transformation, a key architectural innovation inspired by the convective nonlinearity in turbulent flows. By multiplicatively coupling local fine-scale features with global spectral information, LGM effectively captures high-frequency details and complex nonlinear couplings while mitigating the spectral bias that plagues many existing neural operators. The framework is further enhanced by a dynamics-informed architecture that stacks multiple LGM layers in a hybrid configuration, incorporating timescale-adaptive gating and parallel aggregation of intermediate dynamics. This design enables robust approximation of general evolutionary dynamics across diverse physical regimes. Extensive experiments on seven benchmark PDE systems spanning 1D to 3D, elliptic to hyperbolic types demonstrate that DyMixOp achieves state-of-the-art performance on six of them, significantly reducing prediction errors (by up to 94.3% in chaotic regimes) while maintaining computational efficiency and strong scalability.

cs.LG↗

ViT-5: Vision Transformers for The Mid-2020s

This work presents a systematic investigation into modernizing Vision Transformer backbones by leveraging architectural advancements from the past five years. While preserving the canonical Attention-FFN structure, we conduct a component-wise refinement involving normalization, activation functions, positional encoding, gating mechanisms, and learnable tokens. These updates form a new generation of Vision Transformers, which we call ViT-5. Extensive experiments demonstrate that ViT-5 consistently outperforms state-of-the-art plain Vision Transformers across both understanding and generation benchmarks. On ImageNet-1k classification, ViT-5-Base reaches 84.2\% top-1 accuracy under comparable compute, exceeding DeiT-III-Base at 83.8\%. ViT-5 also serves as a stronger backbone for generative modeling: when plugged into an SiT diffusion framework, it achieves 1.84 FID versus 2.06 with a vanilla ViT backbone. Beyond headline metrics, ViT-5 exhibits improved representation learning and favorable spatial reasoning behavior, and transfers reliably across tasks. With a design aligned with contemporary foundation-model practices, ViT-5 offers a simple drop-in upgrade over vanilla ViT for mid-2020s vision backbones.

cs.CV↗

WorldEdit: Towards Open-World Image Editing with a Knowledge-Informed Benchmark

Recent advances in image editing models have demonstrated remarkable capabilities in executing explicit instructions, such as attribute manipulation, style transfer, and pose synthesis. However, these models often face challenges when dealing with implicit editing instructions, which describe the cause of a visual change without explicitly detailing the resulting outcome. These limitations arise because existing models rely on uniform editing strategies that are not equipped to handle the complex world knowledge and reasoning required for implicit instructions. To address this gap, we introduce \textbf{WorldEdit}, a dataset specifically designed to enable world-driven image editing. WorldEdit consists of high-quality editing samples, guided by paraphrased instructions that align with real-world causal logic. Furthermore, we provide \textbf{WorldEdit-Test} for evaluating the existing model's performance on causal editing scenarios. With WorldEdit, we use a two-stage training framework for fine-tuning models like Bagel, integrating with a causal verification reward. Our results show that the proposed dataset and methods significantly narrow the gap with GPT-4o and Nano-Banana, demonstrating competitive performance not only in instruction following but also in knowledge plausibility, where many open-source systems typically struggle.

cs.CV↗

CoPE: Clipped RoPE as A Scalable Free Lunch for Long Context LLMs

Rotary Positional Embedding (RoPE) is a key component of context scaling in Large Language Models (LLMs). While various methods have been proposed to adapt RoPE to longer contexts, their guiding principles generally fall into two categories: (1) out-of-distribution (OOD) mitigation, which scales RoPE frequencies to accommodate unseen positions, and (2) Semantic Modeling, which posits that the attention scores computed with RoPE should always prioritize semantically similar tokens. In this work, we unify these seemingly distinct objectives through a minimalist intervention, namely CoPE: soft clipping lowfrequency components of RoPE. CoPE not only eliminates OOD outliers and refines semantic signals, but also prevents spectral leakage caused by hard clipping. Extensive experiments demonstrate that simply applying our soft clipping strategy to RoPE yields significant performance gains that scale up to 256k context length, validating our theoretical analysis and establishing CoPE as a new state-of-the-art for length generalization. Our code, data, and models are available at https://github.com/hrlics/CoPE.

cs.CL↗

Mitigating Hallucination in Financial Retrieval-Augmented Generation via Fine-Grained Knowledge Verification

In financial Retrieval-Augmented Generation (RAG) systems, models frequently rely on retrieved documents to generate accurate responses due to the time-sensitive nature of the financial domain. While retrieved documents help address knowledge gaps, model-generated responses still suffer from hallucinations that contradict the retrieved information. To mitigate this inconsistency, we propose a Reinforcement Learning framework enhanced with Fine-grained Knowledge Verification (RLFKV). Our method decomposes financial responses into atomic knowledge units and assesses the correctness of each unit to compute the fine-grained faithful reward. This reward offers more precise optimization signals, thereby improving alignment with the retrieved documents. Additionally, to prevent reward hacking (e.g., overly concise replies), we incorporate an informativeness reward that encourages the policy model to retain at least as many knowledge units as the base model. Experiments conducted on the public Financial Data Description (FDD) task and our newly proposed FDD-ANT dataset demonstrate consistent improvements, confirming the effectiveness of our approach.

cs.AI↗

VTok: A Unified Video Tokenizer with Decoupled Spatial-Temporal Latents

This work presents VTok, a unified video tokenization framework that can be used for both generation and understanding tasks. Unlike the leading vision-language systems that tokenize videos through a naive frame-sampling strategy, we propose to decouple the spatial and temporal representations of videos by retaining the spatial features of a single key frame while encoding each subsequent frame into a single residual token, achieving compact yet expressive video tokenization. Our experiments suggest that VTok effectively reduces the complexity of video representation from the product of frame count and per-frame token count to their sum, while the residual tokens sufficiently capture viewpoint and motion changes relative to the key frame. Extensive evaluations demonstrate the efficacy and efficiency of VTok: it achieves notably higher performance on a range of video understanding and text-to-video generation benchmarks compared with baselines using naive tokenization, all with shorter token sequences per video (e.g., 3.4% higher accuracy on our TV-Align benchmark and 1.9% higher VBench score). Remarkably, VTok produces more coherent motion and stronger guidance following in text-to-video generation, owing to its more consistent temporal encoding. We hope VTok can serve as a standardized video tokenization paradigm for future research in video understanding and generation.

cs.CV↗

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane

Rotary Position Embedding (RoPE) is the de facto positional encoding in large language models due to its ability to encode relative positions and support length extrapolation. When adapted to vision transformers, the standard axial formulation decomposes two-dimensional spatial positions into horizontal and vertical components, implicitly restricting positional encoding to axis-aligned directions. We identify this directional constraint as a fundamental limitation of the standard axial 2D RoPE, which hinders the modeling of oblique spatial relationships that naturally exist in natural images. To overcome this limitation, we propose Spiral RoPE, a simple yet effective extension that enables multi-directional positional encoding by partitioning embedding channels into multiple groups associated with uniformly distributed directions. Each group is rotated according to the projection of the patch position onto its corresponding direction, allowing spatial relationships to be encoded beyond the horizontal and vertical axes. Across a wide range of vision tasks including classification, segmentation, and generation, Spiral RoPE consistently improves performance. Qualitative analysis of attention maps further show that Spiral RoPE exhibits more concentrated activations on semantically relevant objects and better respects local object boundaries, highlighting the importance of multi-directional positional encoding in vision transformers.

cs.CV↗

Observation of an exciton crystal in a moiré excitonic insulator

Strong Coulomb interactions can drive electrons to crystallize into a Wigner lattice. Achieving the bosonic analogue - a crystal of excitons - has remained elusive due to their short lifetimes and weaker interactions. Here, we report the observation of a thermodynamically stable exciton crystal in an excitonic insulator coupled to a moiré potential. Using an electron-hole bilayer composed of a monolayer MoSe2 and a WS2/WSe2 moiré superlattice, we construct a tunable extended Bose-Hubbard model with electrical control over exciton and charge doping in thermal equilibrium. Optical spectroscopy reveals spontaneous crystallization of long-lived excitons at one exciton filling per three moiré sites, evidenced by strong Umklapp scattering peaks in the optical spectrum. Exciton transport measurements further show a pronounced exciton resistance peak at the same filling, consistent with suppressed exciton hopping in a crystalline phase. When doped away from net charge neutrality, this moiré electron-hole bilayer can host new correlated insulating phases where dipolar excitonic insulators form on top of the background of a hole Mott insulator or generalized Wigner crystals in the moiré superlattice. These findings establish moiré excitonic insulators as a versatile platform for realizing correlated crystalline phases of bosons and fermions.

cond-mat.mes-hall↗

A Generalist Foundation Model for Total-body PET/CT Enables Diagnostic Reporting and System-wide Metabolic Profiling

Total-body PET/CT enables system-wide molecular imaging, but heterogeneous anatomical and metabolic signals, approximately 2 m axial coverage, and structured radiology semantics challenge existing medical AI models that assume single-modality inputs, localized fields of view, and coarse image-text alignment. We introduce SDF-HOLO (Systemic Dual-stream Fusion Holo Model), a multimodal foundation model for holistic total-body PET/CT, pre-trained on more than 10,000 patients. SDF-HOLO decouples CT and PET representation learning with dual-stream encoders and couples them through a cross-modal interaction module, allowing anatomical context to refine PET aggregation while metabolic saliency guides subtle morphological reasoning. To model long-range dependencies across the body, hierarchical context modeling combines efficient local windows with global attention. To bridge voxels and clinical language, we use anatomical segmentation masks as explicit semantic anchors and perform voxel-mask-text alignment during pre-training. Across tumor segmentation, low-dose lesion detection, and multilingual diagnostic report generation, SDF-HOLO outperforms strong task-specific and clinical-reference baselines while reducing localization errors and hallucinated findings. Beyond focal interpretation, the model enables system-wide metabolic profiling and reveals tumor-associated fingerprints of inter-organ metabolic network interactions, providing a scalable computational foundation for total-body PET/CT diagnostics and system-level precision oncology.

cs.CV↗