arXiv Science⌕ Search

arXiv subjects

Jun He

Publications and source records attributed to Jun He.

At least 73 records · Page 4Linked to original sources

Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation

While text-to-image generation has achieved unprecedented fidelity, the vast majority of existing models function fundamentally as static text-to-pixel decoders. Consequently, they often fail to grasp implicit user intentions. Although emerging unified understanding-generation models have improved intent comprehension, they still struggle to accomplish tasks involving complex knowledge reasoning within a single model. Moreover, constrained by static internal priors, these models remain unable to adapt to the evolving dynamics of the real world. To bridge these gaps, we introduce Mind-Brush, a unified agentic framework that transforms generation into a dynamic, knowledge-driven workflow. Simulating a human-like 'think-research-create' paradigm, Mind-Brush actively retrieves multimodal evidence to ground out-of-distribution concepts and employs reasoning tools to resolve implicit visual constraints. To rigorously evaluate these capabilities, we propose Mind-Bench, a comprehensive benchmark comprising 500 distinct samples spanning real-time news, emerging concepts, and domains such as mathematical and Geo-Reasoning. Extensive experiments demonstrate that Mind-Brush significantly enhances the capabilities of unified models, realizing a zero-to-one capability leap for the Qwen-Image baseline on Mind-Bench, while achieving superior results on established benchmarks like WISE and RISE.

cs.CV↗

ActAvatar: Temporally-Aware Precise Action Control for Talking Avatars

Despite significant advances in talking avatar generation, existing methods face critical challenges: insufficient text-following capability for diverse actions, lack of temporal alignment between actions and audio content, and dependency on additional control signals such as pose skeletons. We present ActAvatar, a framework that achieves phase-level precision in action control through textual guidance by capturing both action semantics and temporal context. Our approach introduces three core innovations: (1) Phase-Aware Cross-Attention (PACA), which decomposes prompts into a global base block and temporally-anchored phase blocks, enabling the model to concentrate on phase-relevant tokens for precise temporal-semantic alignment; (2) Progressive Audio-Visual Alignment, which aligns modality influence with the hierarchical feature learning process-early layers prioritize text for establishing action structure while deeper layers emphasize audio for refining lip movements, preventing modality interference; (3) A two-stage training strategy that first establishes robust audio-visual correspondence on diverse data, then injects action control through fine-tuning on structured annotations, maintaining both audio-visual alignment and the model's text-following capabilities. Extensive experiments demonstrate that ActAvatar significantly outperforms state-of-the-art methods in both action control and visual quality.

cs.CV↗

Large-scale EM Benchmark for Multi-Organelle Instance Segmentation in the Wild

Accurate instance-level segmentation of organelles in electron microscopy (EM) is critical for quantitative analysis of subcellular morphology and inter-organelle interactions. However, current benchmarks, based on small, curated datasets, fail to capture the inherent heterogeneity and large spatial context of in-the-wild EM data, imposing fundamental limitations on current patch-based methods. To address these limitations, we developed a large-scale, multi-source benchmark for multi-organelle instance segmentation, comprising over 100,000 2D EM images across variety cell types and five organelle classes that capture real-world variability. Dataset annotations were generated by our designed connectivity-aware Label Propagation Algorithm (3D LPA) with expert refinement. We further benchmarked several state-of-the-art models, including U-Net, SAM variants, and Mask2Former. Our results show several limitations: current models struggle to generalize across heterogeneous EM data and perform poorly on organelles with global, distributed morphologies (e.g., Endoplasmic Reticulum). These findings underscore the fundamental mismatch between local-context models and the challenge of modeling long-range structural continuity in the presence of real-world variability. The benchmark dataset and labeling tool will be publicly released soon.

cs.CV↗

Precise quantum control of unidirectional field-free molecular orientation

The capability to control molecular rotation for field-free orientation, which arranges molecules in specific spatial directions without external fields, is crucial in physics, chemistry, and quantum information science. However, conventional methods typically lead to transient orientations characterized by periodic directional reversals and necessitate the generation of coherent superpositions across a broad spectrum of rotational states of ultracold molecules. In this work, we develop a theoretical framework for achieving unidirectional field-free orientation by selectively manipulating two specific rotational states of symmetric top molecules. By leveraging the interplay between coherent superpositions and the precise selection of initial states, we demonstrate that both the maximum achievable orientation and its direction can be effectively controlled. To attain the desired two-state orientation, we present a quantum control strategy that utilizes a single control pulse, significantly simplifying the complexities of conventional multistate or multipulse schemes. Numerical simulations validate the effectiveness and feasibility of this approach for methyl iodide (CH$_3$I) molecules, even when accounting for molecular centrifugal distortion.The results highlight the critical roles of initial-state selection and quantum coherence in achieving long-lasting, high unidirectional molecular orientation, opening new directions in stereochemistry, precision spectroscopy, and quantum computing.

quant-ph↗

Proper constituent gluon mass as the final piece to construct hybrid mesons

In this letter, we propose that a proper constituent gluon mass $m_g$=450 MeV can be applied to identify the hybrids composed of quarks and gluons. By investigating the spectra and decay widths of the light hybrids $(q\bar{q}g)$ with $J^P=1^{-+}$, we find the $π_1(1600)$ and $η_1(1855)$ may not be explained as $1^{-+}$ hybrids, simultaneously, and the $η_1(1855)$ observed by BESIII may not be a hybrid. In addition, we predict an existence of a hybrid $η_1(1640)$, which can be verified by searching the $a_1(1260)π$ channel. Moreover, we suggest the $K_1(1270)\bar{K}$ and $K_1(1270)π$ as the golden channels to search for an isospin-0 and an isospin-$\frac{1}{2}$ hybrids, respectively.

hep-ph↗

MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts

Generating realistic 3D cities is fundamental to world models, virtual reality, and game development, where an ideal urban scene must satisfy both stylistic diversity, fine-grained, and controllability. However, existing methods struggle to balance the creative flexibility offered by text-based generation with the object-level editability enabled by explicit structural representations. We introduce MajutsuCity, a natural language-driven and aesthetically adaptive framework for synthesizing structurally consistent and stylistically diverse 3D urban scenes. MajutsuCity represents a city as a composition of controllable layouts, assets, and materials, and operates through a four-stage pipeline. To extend controllability beyond initial generation, we further integrate MajutsuAgent, an interactive language-grounded editing agent} that supports five object-level operations. To support photorealistic and customizable scene synthesis, we also construct MajutsuDataset, a high-quality multimodal dataset} containing 2D semantic layouts and height maps, diverse 3D building assets, and curated PBR materials and skyboxes, each accompanied by detailed annotations. Meanwhile, we develop a practical set of evaluation metrics, covering key dimensions such as structural consistency, scene complexity, material fidelity, and lighting atmosphere. Extensive experiments demonstrate MajutsuCity reduces layout FID by 83.7% compared with CityDreamer and by 20.1% over CityCraft. Our method ranks first across all AQS and RDR scores, outperforming existing methods by a clear margin. These results confirm MajutsuCity as a new state-of-the-art in geometric fidelity, stylistic adaptability, and semantic controllability for 3D city generation. We expect our framework can inspire new avenues of research in 3D city generation. Our project page: https://longhz140516.github.io/MajutsuCity/.

cs.CV↗

DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generation

Recent unified multimodal large language models (MLLMs) have shown impressive capabilities, incorporating chain-of-thought (CoT) reasoning for enhanced text-to-image generation. However, existing approaches remain limited, either treating the model merely as a standalone generator or relying on abstract textual planning. To this end, we propose Draft-as-CoT (DraCo), a novel interleaved reasoning paradigm that fully leverages both textual and visual contents in CoT for better planning and verification. Our method first generates a low-resolution draft image as preview, providing more concrete and structural visual planning and guidance. Then, we employ the model's inherent understanding capability to verify potential semantic misalignments between the draft and input prompt, and performs refinement through selective corrections with super-resolution. In this way, our approach addresses two fundamental challenges: the coarse-grained nature of textual planning and the difficulty in generating rare attribute combinations. To support training, we curate DraCo-240K, aiming to enhance three atomic capabilities spanning general correction, instance manipulation, and layout reorganization. Supported by DraCo-CFG, a specialized classifier-free guidance (CFG) strategy for interleaved reasoning, DraCo achieves a tremendous increase on GenEval (+8%), Imagine-Bench (+0.91), and GenEval++ (+3%), significantly outperforming direct generation and other generation methods empowered by CoT.

cs.CV↗

Huizhou Hadron Spectrometer -- a Proposed High-rate Experimental Setup at the High Intensity Heavy-ion Accelerator Facility

The High-Intensity Heavy-Ion Accelerator Facility (HIAF), currently under construction in Huizhou, Guangdong Province, China, is projected to be completed by 2025. This facility will be capable of producing proton and heavy-ion beams with energies reaching several GeV, thereby offering a versatile platform for advanced fundamental physics research. Key scientific objectives include exploring physics beyond the Standard Model through the search for novel particles and interactions, testing fundamental symmetries, investigating exotic hadronic states such as di-baryons, pentaquark states and multi-strange hypernuclei, conducting precise measurements of hadron and hypernucleus properties, and probing the phase boundary and critical point of nuclear matter. To facilitate these investigations, we propose the development of a dedicated experimental apparatus at HIAF - the Huizhou Hadron Spectrometer (HHaS). This paper presents the conceptual design of HHaS, comprising a solenoid magnet, a five-dimensional silicon pixel tracker, a Low-Gain Avalanche Detector (LGAD) for time-of-flight measurements, and a Cherenkov-scintillation dual-readout electromagnetic calorimeter. The design anticipates an unprecedented event rate of 1-100 MHz, extensive particle acceptance, a track momentum resolution at 1% level, an electromagnetic energy resolution of ~3% @ 1 GeV and multi-particle identification capabilities. Such capabilities position HHaS as a powerful instrument for advancing experimental studies in particle and nuclear physics. The successful realization of HHaS is expected to significantly bolster the development of medium- and high-energy physics research within China.

hep-ex↗

High-Precision Physics Experiments at Huizhou Large-Scale Scientific Facilities

In response to the capabilities presented by the High-Intensity Heavy Ion Accelerator Facility (HIAF) and the Accelerator-Driven Subcritical System (CiADS), as well as the proposed Chinese Advanced Nuclear Physics Research Facility (CNUF), we are assembling a consortium of experts in relevant discipline--both domestically and internationally--to delineate high-precision physics experiments that leverage the state-of-the-art research environment afforded by CNUF. Our focus encompasses six primary domains of inquiry: hadron physics--including endeavors such as the super eta factory and investigations into light hadron structures; muon physics; neutrino physics; neutron physics; the testing of fundamental symmetries; and the exploration of quantum effects within nuclear physics, along with the utilization of vortex accelerators. We aim to foster a well-rounded portfolio of large, medium, and small-scale projects, thus unlocking new scientific avenues and optimizing the potential of the Huizhou large scientific facility. The aspiration for international leadership in scientific research will be a guiding principle in our strategic planning. This initiative will serve as a foundational reference for the Institute of Modern Physics in its strategic planning and goal-setting, ensuring alignment with its developmental objectives while striving to secure a competitive edge in technological advancement. Our ambition is to engage in substantive research within these realms of high-precision physics, to pursue groundbreaking discoveries, and to stimulate progress in China's nuclear physics landscape, positioning Huizhou as a preeminent global hub for advanced nuclear physics research.

hep-ph↗

Quantum versus Classical Descriptions of Spontaneous Emission in Nanophotonic Cavities

Here, we demonstrate that quantum and classical descriptions generally yield different results for the spontaneous emission in nanophotonic cavities. Starting from the quantized single-mode field in a general context of dispersive and lossy cavities, we derive the expression for emission rate enhancement as well as key relevant parameters such as mode volume and quality factor. For general nanophotonic cavities, this ratio of the quantum to the classical description is typically below unity and varies with the material dispersion properties, scattering-to-absorption ratio and morphology of the cavity. Notably, the two descriptions converge for lossless, non-dispersive dielectric cavities and for noble-metal plasmonic cavities with sufficiently low scattering losses.

physics.optics↗

BLINK-Twice: You see, but do you observe? A Reasoning Benchmark on Visual Perception

Recently, Multimodal Large Language Models (MLLMs) have made rapid progress, particularly in enhancing their reasoning capabilities. However, existing reasoning benchmarks still primarily assess language-based reasoning, often treating visual input as replaceable context. To address this gap, we introduce BLINK-Twice, a vision-centric reasoning benchmark grounded in challenging perceptual tasks. Instead of relying on external knowledge, our tasks require models to reason from visual content alone, shifting the focus from language-based to image-grounded reasoning. Compared to prior perception benchmarks, it moves beyond shallow perception ("see") and requires fine-grained observation and analytical reasoning ("observe"). BLINK-Twice integrates three core components: seven types of visual challenges for testing visual reasoning, natural adversarial image pairs that enforce reliance on visual content, and annotated reasoning chains for fine-grained evaluation of the reasoning process rather than final answers alone. We evaluate 20 leading MLLMs, including 12 foundation models and 8 reasoning-enhanced models. BLINK-Twice poses a significant challenge to current models. While existing reasoning strategies in the language space-such as chain-of-thought or self-criticism can improve performance, they often result in unstable and redundant reasoning. We observe that repeated image observation improves performance across models, and active visual interaction, as demonstrated by models like o3, highlights the need for a new paradigm for vision reasoning. The dataset is publicly available at https://github.com/PicoTrex/BLINK-Twice

cs.CV↗

Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesis

Ground-to-aerial image synthesis focuses on generating realistic aerial images from corresponding ground street view images while maintaining consistent content layout, simulating a top-down view. The significant viewpoint difference leads to domain gaps between views, and dense urban scenes limit the visible range of street views, making this cross-view generation task particularly challenging. In this paper, we introduce SkyDiffusion, a novel cross-view generation method for synthesizing aerial images from street view images, utilizing a diffusion model and the Bird's-Eye View (BEV) paradigm. The Curved-BEV method in SkyDiffusion converts street-view images into a BEV perspective, effectively bridging the domain gap, and employs a "multi-to-one" mapping strategy to address occlusion issues in dense urban scenes. Next, SkyDiffusion designed a BEV-guided diffusion model to generate content-consistent and realistic aerial images. Additionally, we introduce a novel dataset, Ground2Aerial-3, designed for diverse ground-to-aerial image synthesis applications, including disaster scene aerial synthesis, low-altitude UAV image synthesis, and historical high-resolution satellite image synthesis tasks. Experimental results demonstrate that SkyDiffusion outperforms state-of-the-art methods on cross-view datasets across natural (CVUSA), suburban (CVACT), urban (VIGOR-Chicago), and various application scenarios (G2A-3), achieving realistic and content-consistent aerial image generation. The code, datasets and more information of this work can be found at https://opendatalab.github.io/skydiffusion/ .

cs.CV↗

UrbanFeel: A Comprehensive Benchmark for Temporal and Perceptual Understanding of City Scenes through Human Perspective

Urban development impacts over half of the global population, making human-centered understanding of its structural and perceptual changes essential for sustainable development. While Multimodal Large Language Models (MLLMs) have shown remarkable capabilities across various domains, existing benchmarks that explore their performance in urban environments remain limited, lacking systematic exploration of temporal evolution and subjective perception of urban environment that aligns with human perception. To address these limitations, we propose UrbanFeel, a comprehensive benchmark designed to evaluate the performance of MLLMs in urban development understanding and subjective environmental perception. UrbanFeel comprises 14.3K carefully constructed visual questions spanning three cognitively progressive dimensions: Static Scene Perception, Temporal Change Understanding, and Subjective Environmental Perception. We collect multi-temporal single-view and panoramic street-view images from 11 representative cities worldwide, and generate high-quality question-answer pairs through a hybrid pipeline of spatial clustering, rule-based generation, model-assisted prompting, and manual annotation. Through extensive evaluation of 20 state-of-the-art MLLMs, we observe that Gemini-2.5 Pro achieves the best overall performance, with its accuracy approaching human expert levels and narrowing the average gap to just 1.5\%. Most models perform well on tasks grounded in scene understanding. In particular, some models even surpass human annotators in pixel-level change detection. However, performance drops notably in tasks requiring temporal reasoning over urban development. Additionally, in the subjective perception dimension, several models reach human-level or even higher consistency in evaluating dimension such as beautiful and safety.

cs.CV↗

OmniSync: Towards Universal Lip Synchronization via Diffusion Transformers

Lip synchronization is the task of aligning a speaker's lip movements in video with corresponding speech audio, and it is essential for creating realistic, expressive video content. However, existing methods often rely on reference frames and masked-frame inpainting, which limit their robustness to identity consistency, pose variations, facial occlusions, and stylized content. In addition, since audio signals provide weaker conditioning than visual cues, lip shape leakage from the original video will affect lip sync quality. In this paper, we present OmniSync, a universal lip synchronization framework for diverse visual scenarios. Our approach introduces a mask-free training paradigm using Diffusion Transformer models for direct frame editing without explicit masks, enabling unlimited-duration inference while maintaining natural facial dynamics and preserving character identity. During inference, we propose a flow-matching-based progressive noise initialization to ensure pose and identity consistency, while allowing precise mouth-region editing. To address the weak conditioning signal of audio, we develop a Dynamic Spatiotemporal Classifier-Free Guidance (DS-CFG) mechanism that adaptively adjusts guidance strength over time and space. We also establish the AIGC-LipSync Benchmark, the first evaluation suite for lip synchronization in diverse AI-generated videos. Extensive experiments demonstrate that OmniSync significantly outperforms prior methods in both visual quality and lip sync accuracy, achieving superior results in both real-world and AI-generated videos.

cs.CV↗

Plasmon-driven Ultrafast and Highly Efficient Saturable Absorption for Ultrashort Pulse Generation Based on 2D V2C

Plasmon-driven ultrafast nonlinearities hold promise for advanced photonics but remain challenging to harness in two-dimensional materials at telecommunication wavelengths. Here, we demonstrate few-layer V2C MXene as a high-performance saturable absorber by leveraging its tailored surface plasmon resonance. Combining transient absorption spectroscopy and first-principles calculations, we unveil a plasmon-driven relaxation mechanism dominated by interfacial high-energy hot electron generation (~100 fs), enabling giant ultrafast nonlinearities. Crucially, at the communication band (1550 nm), V2C exhibits a high saturable absorption coefficient of -1.35 cm/GW. Integrating this into an erbium-doped fiber laser, we generate mode-locked pulses with a duration of 486 fs at 1569 nm, a 39.51 MHz repetition rate, and exceptional stability (92 dB SNR). This work establishes plasmonic MXenes as a paradigm for tailored ultrafast photonic devices.

physics.optics↗

Roles of $\bar{D}^{*}K^{*}$ and $D^*\bar{D}$ molecular states in decay $B^+ \to D^{*+} D^- K^+$

This study investigates the three-body decay process $B^+ \to D^{*+} D^- K^+$, aiming to explore the possible origins of $T^*_{\bar{c}\bar{s}0}(2870)^0$ and $χ_{c1}(3872)$ as intermediate states. Within the molecular state framework, $T^*_{\bar{c}\bar{s}0}(2870)^0$ and $χ_{c1}(3872)$ are considered as possible $\bar{D}^{*}K^{}$ and $D^*\bar{D}$ molecular states, respectively. Using effective Lagrangians, the interaction kernels of the $\bar{D}^{*}K^{*}$ and $D^*\bar{D}$ systems are constructed within the one-boson-exchange model. The corresponding rescattering amplitudes and pole positions are obtained by solving the quasipotential Bethe-Salpeter equation. These amplitudes are incorporated into the decay amplitude of the three-body process, and the $D^-K^+$ and $D^{*+}D^-$ invariant mass spectra are simulated via Monte Carlo methods. To better reproduce the experimental data, additional Breit-Wigner contributions from $T^*_{\bar{c}\bar{s}1}(2900)^0$, $χ_{c1}(4010)$, and $h_c(4300)$ are included. The results show a pronounced enhancement near 2900 MeV in the $D^-K^+$ invariant mass spectrum, strongly supporting the interpretation of $T^*_{\bar{c}\bar{s}0}(2870)^0$ as a $\bar{D}^{*}K^{*}$ molecular state. While the $\bar{D}^{*}K^{*}$ molecular state provides a reasonable contribution to the $D^-K^+$ spectrum, the $D^*\bar{D}$ molecular state yields no significant effect on either the $D^-K^+$ or $D^{*+}D^-$ distributions. This suggests that the observed $χ_{c1}(3872)$ structure around 3872 MeV may not be interpreted as a $D^*\bar{D}$ molecular state.

hep-ph↗

A Novel Nonlinear IP$_3$R State Transition Model and Calcium Oscillation

We present a novel nonlinear state transition model for inositol 1,4,5-trisphosphate receptors (IP$_3$Rs) that incorporates a pre-activated state, as suggested by electron microscopy observations. Our model provides a theoretical framework for the biphasic Ca$^{2+}$ dependence of IP$_3$Rs and accurately reproduces their experimentally observed state distribution under saturating IP$_3$ conditions. By integrating receptor dynamics with cytoplasmic and endoplasmic reticulum (ER) calcium exchange, we simulate IP$_3$R-mediated Ca$^{2+}$ oscillations governed by six key conformational states. A pivotal finding is that IP$_3$ regulates these oscillations in a switch-like manner: once a critical IP$_3$ concentration is reached, the system abruptly transitions to sustained, constant-amplitude oscillations that quickly terminate when the concentration exceeds a secondary threshold. These results underscore the crucial role of the pre-activated state in modulating calcium signaling.

physics.bio-ph↗

Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generation

Recently, GPT-4o has garnered significant attention for its strong performance in image generation, yet open-source models still lag behind. Several studies have explored distilling image data from GPT-4o to enhance open-source models, achieving notable progress. However, a key question remains: given that real-world image datasets already constitute a natural source of high-quality data, why should we use GPT-4o-generated synthetic data? In this work, we identify two key advantages of synthetic images. First, they can complement rare scenarios in real-world datasets, such as surreal fantasy or multi-reference image generation, which frequently occur in user queries. Second, they provide clean and controllable supervision. Real-world data often contains complex background noise and inherent misalignment between text descriptions and image content, whereas synthetic images offer pure backgrounds and long-tailed supervision signals, facilitating more accurate text-to-image alignment. Building on these insights, we introduce Echo-4o-Image, a 180K-scale synthetic dataset generated by GPT-4o, harnessing the power of synthetic image data to address blind spots in real-world coverage. Using this dataset, we fine-tune the unified multimodal generation baseline Bagel to obtain Echo-4o. In addition, we propose two new evaluation benchmarks for a more accurate and challenging assessment of image generation capabilities: GenEval++, which increases instruction complexity to mitigate score saturation, and Imagine-Bench, which focuses on evaluating both the understanding and generation of imaginative content. Echo-4o demonstrates strong performance across standard benchmarks. Moreover, applying Echo-4o-Image to other foundation models (e.g., OmniGen2, BLIP3-o) yields consistent performance gains across multiple metrics, highlighting the datasets strong transferability.

cs.CV↗