arXiv subjects

Yue Hu

Publications and source records attributed to Yue Hu.

At least 145 records · Page 8Linked to original sources

arXiv2025

JotlasNet: Joint Tensor Low-Rank and Attention-based Sparse Unrolling Network for Accelerating Dynamic MRI

Joint low-rank and sparse unrolling networks have shown superior performance in dynamic MRI reconstruction. However, existing works mainly utilized matrix low-rank priors, neglecting the tensor characteristics of dynamic MRI images, and only a global threshold is applied for the sparse constraint to the multi-channel data, limiting the flexibility of the network. Additionally, most of them have inherently complex network structure, with intricate interactions among variables. In this paper, we propose a novel deep unrolling network, JotlasNet, for dynamic MRI reconstruction by jointly utilizing tensor low-rank and attention-based sparse priors. Specifically, we utilize tensor low-rank prior to exploit the structural correlations in high-dimensional data. Convolutional neural networks are used to adaptively learn the low-rank and sparse transform domains. A novel attention-based soft thresholding operator is proposed to assign a unique learnable threshold to each channel of the data in the CNN-learned sparse domain. The network is unrolled from the elaborately designed composite splitting algorithm and thus features a simple yet efficient parallel structure. Extensive experiments on two datasets (OCMR, CMRxRecon) demonstrate the superior performance of JotlasNet in dynamic MRI reconstruction.

cs.CV↗

arXiv2025

Estimate Sonic Mach Number in the Interstellar Medium with Convolutional Neural Network

Understanding the role of turbulence in shaping the interstellar medium (ISM) is crucial for studying star formation, molecular cloud evolution, and cosmic ray propagation. Central to this is the measurement of the sonic Mach number ($M_s$), which quantifies the ratio of turbulent velocity to the sound speed. In this work, we introduce a convolutional neural network (CNN)-based approach for estimating $M_s$ directly from spectroscopic observations. The approach leverages the physical correlation between increasing $M_s$ and the shock-induced small-scale fluctuations that alter the morphological features in intensity, velocity centroid, and velocity channel maps. These maps, derived from 3D magnetohydrodynamic (MHD) turbulence simulations, serve as inputs for the CNN training. By learning the relationship between these structural features and the underlying turbulence properties, CNN can predict $M_s$ under various conditions, including different magnetic fields and levels of observational noise. The median uncertainty of the CNN-predicted $M_s$ ranges from 0.5 to 1.5 depending on the noise level. While intensity maps offer lower uncertainty, channel maps have the advantage of predicting the 3D $M_s$ distribution, which is crucial in estimating 3D magnetic field strength. Our results demonstrate that machine-learning-based tools can effectively characterize complex turbulence properties in the ISM.

astro-ph.GA↗

arXiv2025

Probing Three-Dimensional Magnetic Fields: IV -- Synchrotron Polarization Derivative and Vision Transformer

Measuring the 3D spatial distribution of magnetic fields in the interstellar medium and the intracluster medium is crucial yet challenging. The probing of 3D magnetic field's 3D distribution, including the field plane-of-sky orientation ($ψ$), the magnetic field's inclination angle ($γ$) relative to the line of sight, and magnetization ($\sim$ the inverse Alfvén Mach number $M_A^{-1}$), at different distances from the observer makes the task even more formidable. However, the anisotropy and Faraday decorrelation effect in polarized synchrotron emission offers a unique solution. We show that due to the Faraday decorrelation, only regions up to a certain effective path length along the line of sight contribute to the statistical correlation of the measured polarization. The 3D spatial information can be consequently derived from synchrotron polarization derivatives (SPDs), which are calculated from the difference in synchrotron polarization across two wavelengths. We find that the 3D magnetic field can be estimated from the anisotropy observed in SPD: the elongation direction of the SPD structures probes $ψ$ and the degree of SPD anisotropy, along with its morphological curvature, provides insights into $M_A^{-1}$ and $γ$. To extract these anisotropic features and their correlation with the 3D magnetic field, we propose utilizing a machine learning approach, specifically the Vision Transformer (ViT) architecture, which was exemplified by the success of the ChatGPT. We train the ViT using synthetic synchrotron observations generated from MHD turbulence simulations in sub-Alfvénic and super-Alfvénic conditions. We show that ViT's application to multi-wavelength SPDs can successfully reconstruct the 3D magnetic fields' 3D spatial distribution.

astro-ph.GA↗

arXiv2025

An ab initio dataset of size-dependent effective thermal conductivity for advanced technology transistors

As the size of transistors shrinks and power density increases, thermal simulation has become an indispensable part of the device design procedure. However, existing works for advanced technology transistors use simplified empirical models to calculate effective thermal conductivity in the simulations. In this work, we present a dataset of size-dependent effective thermal conductivity with electron and phonon properties extracted from ab initio computations. Absolute in-plane and cross-plane thermal conductivity data of eight semiconducting materials (Si, Ge, GaN, AlN, 4H-SiC, GaAs, InAs, BAs) and four metallic materials (Al, W, TiN, Ti) with the characteristic length ranging from 5 to 50 nanometers have been provided. Besides the absolute value, normalized effective thermal conductivity is also given, in case it needs to be used with updated bulk thermal conductivity in the future. The dataset presented in this paper are openly available at https://doi.org/10.57760/sciencedb.j00113.00154.

cond-mat.mtrl-sci↗

arXiv2025

Atomic collapse in gapped graphene: lattice and valley effects

We study the atomic collapse phenomenon in $K$ and $K'$ valley of gapped graphene. Bound states induced by Coulomb impurity in the gap turn into atomic collapse resonances as the charge increases beyond the supercritical charge $Z_c$. $Z_c$ increases sublinear with the band gap $Δ$. The atomic collapse resonances result in peaks in the LDOS at the same energies in $K$ and $K'$ valley, but the strong (weak) LDOS peaks in $K$ valley are weak (strong) LDOS peaks in $K'$ valley reminiscent of pseudospin polarization phenomenon. From a spatial LDOS analysis of the atomic collapse resonance states, we assign specific atomic orbitals to the atomic collapse resonances. Remarkably, the two $p$ atomic orbital atomic collapse states are no longer degenerate and splits into two having lobes in different directions in the graphene plane.

cond-mat.mes-hall↗

arXiv2025

Aerial Monocular 3D Object Detection

Drones equipped with cameras can significantly enhance human ability to perceive the world because of their remarkable maneuverability in 3D space. Ironically, object detection for drones has always been conducted in the 2D image space, which fundamentally limits their ability to understand 3D scenes. Furthermore, existing 3D object detection methods developed for autonomous driving cannot be directly applied to drones due to the lack of deformation modeling, which is essential for the distant aerial perspective with sensitive distortion and small objects. To fill the gap, this work proposes a dual-view detection system named DVDET to achieve aerial monocular object detection in both the 2D image space and the 3D physical space. To address the severe view deformation issue, we propose a novel trainable geo-deformable transformation module that can properly warp information from the drone's perspective to the BEV. Compared to the monocular methods for cars, our transformation includes a learnable deformable network for explicitly revising the severe deviation. To address the dataset challenge, we propose a new large-scale simulation dataset named AM3D-Sim, generated by the co-simulation of AirSIM and CARLA, and a new real-world aerial dataset named AM3D-Real, collected by DJI Matrice 300 RTK, in both datasets, high-quality annotations for 3D object detection are provided. Extensive experiments show that i) aerial monocular 3D object detection is feasible; ii) the model pre-trained on the simulation dataset benefits real-world performance, and iii) DVDET also benefits monocular 3D object detection for cars. To encourage more researchers to investigate this area, we will release the dataset and related code in https://github.com/PhyllisH/DVDET.

cs.CV↗

arXiv2025

T2LR-Net: An unrolling network learning transformed tensor low-rank prior for dynamic MR image reconstruction

The tensor low-rank prior has attracted considerable attention in dynamic MR reconstruction. Tensor low-rank methods preserve the inherent high-dimensional structure of data, allowing for improved extraction and utilization of intrinsic low-rank characteristics. However, most current methods are still confined to utilizing low-rank structures either in the image domain or predefined transformed domains. Designing an optimal transformation adaptable to dynamic MRI reconstruction through manual efforts is inherently challenging. In this paper, we propose a deep unrolling network that utilizes the convolutional neural network (CNN) to adaptively learn the transformed domain for leveraging tensor low-rank priors. Under the supervised mechanism, the learning of the tensor low-rank domain is directly guided by the reconstruction accuracy. Specifically, we generalize the traditional t-SVD to a transformed version based on arbitrary high-dimensional unitary transformations and introduce a novel unitary transformed tensor nuclear norm (UTNN). Subsequently, we present a dynamic MRI reconstruction model based on UTNN and devise an efficient iterative optimization algorithm using ADMM, which is finally unfolded into the proposed T2LR-Net. Experiments on two dynamic cardiac MRI datasets demonstrate that T2LR-Net outperforms the state-of-the-art optimization-based and unrolling network-based methods.

eess.IV↗

arXiv2024

Differentiable SVD based on Moore-Penrose Pseudoinverse for Inverse Imaging Problems

Low-rank regularization-based deep unrolling networks have achieved remarkable success in various inverse imaging problems (IIPs). However, the singular value decomposition (SVD) is non-differentiable when duplicated singular values occur, leading to severe numerical instability during training. In this paper, we propose a differentiable SVD based on the Moore-Penrose pseudoinverse to address this issue. To the best of our knowledge, this is the first work to provide a comprehensive analysis of the differentiability of the trivial SVD. Specifically, we show that the non-differentiability of SVD is essentially due to an underdetermined system of linear equations arising in the derivation process. We utilize the Moore-Penrose pseudoinverse to solve the system, thereby proposing a differentiable SVD. A numerical stability analysis in the context of IIPs is provided. Experimental results in color image compressed sensing and dynamic MRI reconstruction show that our proposed differentiable SVD can effectively address the numerical instability issue while ensuring computational precision. Code is available at https://github.com/yhao-z/SVD-inv.

math.NA↗

arXiv2024

Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model

The vision tokens in multimodal large language models usually exhibit significant spatial and temporal redundancy and take up most of the input tokens, which harms their inference efficiency. To solve this problem, some recent works were introduced to drop the unimportant tokens during inference where the importance of each token is decided only by the information in either the vision encoding stage or the prefilling stage. In this paper, we propose Multi-stage Token Dropping (MustDrop) to measure the importance of each token from the whole lifecycle, including the vision encoding stage, prefilling stage, and decoding stage. Concretely, in the visual encoding stage, MustDrop merges spatially adjacent tokens with high similarity, and establishes a key token set to retain the most vision-critical tokens, preventing them from being discarded in later stages. In the prefilling stage, MustDrop further compresses vision tokens by the guidance of text semantics, with a dual-attention filtering strategy. In the decoding stage, an output-aware cache policy is proposed to further reduce the size of the KV cache. By leveraging tailored strategies in the multi-stage process, MustDrop can more precisely recognize the important and redundant tokens, thus achieving an optimal balance between performance and efficiency. For instance, MustDrop reduces about 88.5\% FLOPs on LLaVA with a compression ratio of 92.2\% while maintaining comparable accuracy. Our codes are available at \url{https://github.com/liuting20/MustDrop}.

cs.CV↗

arXiv2024

AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field

3D Gaussian Splatting (3DGS) has recently advanced radiance field reconstruction by offering superior capabilities for novel view synthesis and real-time rendering speed. However, its strategy of blending optimization and adaptive density control might lead to sub-optimal results; it can sometimes yield noisy geometry and blurry artifacts due to prioritizing optimizing large Gaussians at the cost of adequately densifying smaller ones. To address this, we introduce AtomGS, consisting of Atomized Proliferation and Geometry-Guided Optimization. The Atomized Proliferation constrains ellipsoid Gaussians of various sizes into more uniform-sized Atom Gaussians. The strategy enhances the representation of areas with fine features by placing greater emphasis on densification in accordance with scene details. In addition, we proposed a Geometry-Guided Optimization approach that incorporates an Edge-Aware Normal Loss. This optimization method effectively smooths flat surfaces while preserving intricate details. Our evaluation shows that AtomGS outperforms existing state-of-the-art methods in rendering quality. Additionally, it achieves competitive accuracy in geometry reconstruction and offers a significant improvement in training speed over other SDF-based methods. More interactive demos can be found in our website (https://rongliu-leo.github.io/AtomGS/).

cs.CV↗

arXiv2024

Unlocking high hole mobility in diamond over a wide temperature range via efficient shear strain

As a wide bandgap semiconductor, diamond holds both excellent electrical and thermal properties, making it highly promising in the electrical industry. However, its hole mobility is relatively low and dramatically decreases with increasing temperature, which severely limits further applications. Herein, we proposed that the hole mobility can be efficiently enhanced via slight compressive shear strain along the [100] direction, while the improvement via shear strain along the [111] direction is marginal. This impressive distinction is attributed to the deformation potential and the elastic compliance matrix. The shear strain breaks the symmetry of the crystalline structure and lifts the band degeneracy near the valence band edge, resulting in a significant suppression of interband electron-phonon scattering. Moreover, the hole mobility becomes less temperature-dependent due to the decrease of electron scatterings from high-frequency acoustic phonons. Remarkably, the in-plane hole mobility of diamond is increased by approximately 800% at 800 K with a 2% compressive shear strain along the [100] direction. The efficient shear strain strategy can be further extended to other semiconductors with face-centered cubic geometry.

cond-mat.mtrl-sci↗

arXiv2024

Self-Evolving Multi-Agent Collaboration Networks for Software Development

LLM-driven multi-agent collaboration (MAC) systems have demonstrated impressive capabilities in automatic software development at the function level. However, their heavy reliance on human design limits their adaptability to the diverse demands of real-world software development. To address this limitation, we introduce EvoMAC, a novel self-evolving paradigm for MAC networks. Inspired by traditional neural network training, EvoMAC obtains text-based environmental feedback by verifying the MAC network's output against a target proxy and leverages a novel textual backpropagation to update the network. To extend coding capabilities beyond function-level tasks to more challenging software-level development, we further propose rSDE-Bench, a requirement-oriented software development benchmark, which features complex and diverse software requirements along with automatic evaluation of requirement correctness. Our experiments show that: i) The automatic requirement-aware evaluation in rSDE-Bench closely aligns with human evaluations, validating its reliability as a software-level coding benchmark. ii) EvoMAC outperforms previous SOTA methods on both the software-level rSDE-Bench and the function-level HumanEval benchmarks, reflecting its superior coding capabilities. The benchmark can be downloaded at https://yuzhu-cai.github.io/rSDE-Bench/.

cs.SE↗

arXiv2024

Optimized Magnetic Resonance Fingerprinting Using Ziv-Zakai Bound

Magnetic Resonance Fingerprinting (MRF) has emerged as a promising quantitative imaging technique within the field of Magnetic Resonance Imaging (MRI), offers comprehensive insights into tissue properties by simultaneously acquiring multiple tissue parameter maps in a single acquisition. Sequence optimization is crucial for improving the accuracy and efficiency of MRF. In this work, a novel framework for MRF sequence optimization is proposed based on the Ziv-Zakai bound (ZZB). Unlike the Cramér-Rao bound (CRB), which aims to enhance the quality of a single fingerprint signal with deterministic parameters, ZZB provides insights into evaluating the minimum mismatch probability for pairs of fingerprint signals within the specified parameter range in MRF. Specifically, the explicit ZZB is derived to establish a lower bound for the discrimination error in the fingerprint signal matching process within MRF. This bound illuminates the intrinsic limitations of MRF sequences, thereby fostering a deeper understanding of existing sequence performance. Subsequently, an optimal experiment design problem based on ZZB was formulated to ascertain the optimal scheme of acquisition parameters, maximizing discrimination power of MRF between different tissue types. Preliminary numerical experiments show that the optimized ZZB scheme outperforms both the conventional and CRB schemes in terms of the reconstruction accuracy of multiple parameter maps.

eess.IV↗

arXiv2024

Pathfinding pulsar observations with the CVN incorporating the FAST

The importance of Very Long Baseline Interferometry (VLBI) for pulsar research is becoming increasingly prominent and receiving more and more attention. In this paper, we present pathfinding pulsar observation results with the Chinese VLBI Network (CVN) incorporating the Five-hundred-meter Aperture Spherical radio Telescope (FAST). On MJD 60045 (April 11th, 2023), PSRs B0919+06 and B1133+16 were observed with the phase-referencing mode in the L-band using four radio telescopes (FAST, TianMa, Haoping and Nanshan) and correlated with the pulsar binning mode of the distributed FX-style software correlator in Shanghai. After further data processing with the NRAO Astronomical Image Processing System (AIPS), we detected these two pulsars and fitted their current positions with accuracy at the milliarcsecond level. By comparison, our results show significantly better agreement with predicted values based on historical VLBI observations than that with previous timing observations, as pulsar astrometry with the VLBI provides a more direct and model-independent method for accurately obtaining related parameters.

astro-ph.HE↗

arXiv2024

Ab Initio Device-Driven Screening of Sub-1-nm Thickness Oxide Semiconductors for Future CMOS Technology Nodes

Ultrathin oxide semiconductors with sub-1-nm thickness are promising building blocks for ultrascaled field-effect transistor (FET) applications due to their resilience against short-channel effects, high air stability, and potential for low-energy device operation. However, the n-type dominance of ultrathin oxide FET has hindered their integration into complementary metal-oxide-semiconductor (CMOS) technology, which requires both n-and p-type devices. Here we develop an ab initio device-driven computational screening workflow to identify sub-1-nm thickness oxide semiconductors for sub-5-nm FET applications. We demonstrate that ultrathin CaO2, CaO, and SrO are compatible with p-type device operations under both high-performance (HP) and low-power (LP) requirements specified by the International Technology Roadmap of Semiconductors (ITRS), thereby expanding the limited family of p-type oxide semiconductors. Notably, CaO and SrO emerge as the first-of-kind sub-1-nm thickness oxide semiconductors capable of simultaneously meeting the ITRS HP and LP criteria for both n-and p-type devices. CaO and SrO FETs outperform many existing low-dimensional semiconductors, exhibiting scalability below 5-nm gate length. Our findings offer a pioneering effort in the ab initio, device-driven screening of sub-1-nm thickness oxide semiconductors, significantly broadening the material candidate pool for future CMOS technology nodes.

cond-mat.mtrl-sci↗

arXiv2024

Probing Three-Dimensional Magnetic Fields: III -- Synchrotron Emission and Machine Learning

Synchrotron observation serves as a tool for studying magnetic fields in the interstellar medium and intracluster medium, yet its ability to unveil three-dimensional (3D) magnetic fields, meaning probing the field'splane-of-the-sky (POS) orientation, inclination angle relative to the line of sight, and magnetization from one observational data, remains largely underexplored. Inspired by the latest insights into anisotropic magnetohydrodynamic (MHD) turbulence, we found that synchrotron emission's intensity structures inherently reflect this anisotropy, providing crucial information to aid in 3D magnetic field studies: (i) the structure's elongation gives the magnetic field's POS orientation and (ii) the structure's anisotropy degree and topology reveal the inclination angle and magnetization. Capitalizing on this foundation, we integrate a machine learning approach-Convolutional Neural Network (CNN)-to extract this latent information, thereby facilitating the exploration of 3D magnetic fields. The model is trained on synthetic synchrotron emission maps, derived from 3D MHD turbulence simulations encompassing a range of sub-Alfvénic to super-Alfvénic conditions. We show that the CNN is physically interpretable and the CNN is capable of obtaining the POS orientation, inclination angle, and magnetization. Additionally, we test the CNN against the noise effect and the missing low-spatial frequency. We show that this CNN-based approach maintains a high degree of robustness even when only high-spatial frequencies are maintained. This renders the method particularly suitable for application to interferometric data lacking single-dish measurements. We applied this trained CNN to the synchrotron observations of a diffuse region. The CNN-predicted POS magnetic field orientation shows a statistical agreement with that derived from synchrotron polarization.

astro-ph.GA↗

arXiv2024

Detection of circular permutations by Protein Language Models

Protein circular permutations are crucial for understanding protein evolution and functionality. Traditional detection methods, sequence-based or structure-based, struggle with accuracy and computational efficiency, the latter also limited by treating proteins as rigid bodies. The plmCP method, utilizing a protein language model, not only speeds up the detection process but also enhances the accuracy of identifying circular permutations, contributing significantly to protein research and engineering by acknowledging structural flexibility.

q-bio.QM↗

arXiv2024

Wide-binary eccentricity distribution in young star clusters: dependence on the binary separation and mass

We study the wide-binary eccentricity ($e$) distribution in young star clusters and the role of turbulence in setting the form of the $e$ distribution using magnetohydrodynamical (MHD) simulations of star cluster formation. The simulations incorporate gravity, turbulence, magnetic fields, protostellar heating, and jets/outflows. We find that (1) simulations that employ purely compressive turbulence driving produce binaries with a superthermal $e$ distribution ($α>1$ in $p(e) \propto e^α$), while simulations with purely solenoidal driving or natural mixture of driving modes produce subthermal/thermal distributions ($α\leq$ 1), (2) the $e$ distribution over the full range of binary separations in our simulations is set at the early stages of the star cluster formation process, (3) while binaries (separation of $r_{\mathrm{pair}} \leq 1000\, \mathrm{AU}$) have subthermal to thermal $e$ distributions ($α\sim 0.8$), wide binaries ($r_{\mathrm{pair}} > 1000\, \mathrm{AU}$) have a superthermal distribution ($α\sim 1.8$), and (4) low-mass binary systems (system masses of $M_{\mathrm{sys}} \leq 0.8\, \mathrm{M_\odot}$) have a highly superthermal distribution ($α\sim 2.4$), whereas high-mass systems ($M_{\mathrm{sys}} > 0.8\, \mathrm{M_\odot}$) exhibit a subthermal/thermal distribution ($α\sim 0.8$). The binary eccentricity distribution is often modelled as a thermal distribution. However, our results suggest that the $e$ distribution depends on the range of separation of the sampled binaries, which agrees with the findings from recent Gaia observations. We conclude that the dependence of the $e$ distribution on the binary separation and mass is linked to the binary formation mechanism governed by the turbulent properties of the parent cloud.

astro-ph.GA↗