arXiv subjects

Yuan Gao

Publications and source records attributed to Yuan Gao.

At least 289 records · Page 16Linked to original sources

arXiv2024

Intensity Field Decomposition for Tissue-Guided Neural Tomography

Cone-beam computed tomography (CBCT) typically requires hundreds of X-ray projections, which raises concerns about radiation exposure. While sparse-view reconstruction reduces the exposure by using fewer projections, it struggles to achieve satisfactory image quality. To address this challenge, this article introduces a novel sparse-view CBCT reconstruction method, which empowers the neural field with human tissue regularization. Our approach, termed tissue-guided neural tomography (TNT), is motivated by the distinct intensity differences between bone and soft tissue in CBCT. Intuitively, separating these components may aid the learning process of the neural field. More precisely, TNT comprises a heterogeneous quadruple network and the corresponding training strategy. The network represents the intensity field as a combination of soft and hard tissue components, along with their respective textures. We train the network with guidance from estimated tissue projections, enabling efficient learning of the desired patterns for the network heads. Extensive experiments demonstrate that the proposed method significantly improves the sparse-view CBCT reconstruction with a limited number of projections ranging from 10 to 60. Our method achieves comparable reconstruction quality with fewer projections and faster convergence compared to state-of-the-art neural rendering based methods.

eess.IV↗

arXiv2024

LinFormer: A Linear-based Lightweight Transformer Architecture For Time-Aware MIMO Channel Prediction

The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging. While existing channel prediction methods offer improved accuracy at the expense of increased computational complexity, limiting their practical application in mobile networks. To address these challenges, we present LinFormer, an innovative channel prediction framework based on a scalable, all-linear, encoder-only Transformer model. Our approach, inspired by natural language processing (NLP) models such as BERT, adapts an encoder-only architecture specifically for channel prediction tasks. We propose replacing the computationally intensive attention mechanism commonly used in Transformers with a time-aware multi-layer perceptron (TMLP), significantly reducing computational demands. The inherent time awareness of TMLP module makes it particularly suitable for channel prediction tasks. We enhance LinFormer's training process by employing a weighted mean squared error loss (WMSELoss) function and data augmentation techniques, leveraging larger, readily available communication datasets. Our approach achieves a substantial reduction in computational complexity while maintaining high prediction accuracy, making it more suitable for deployment in cost-effective base stations (BS). Comprehensive experiments using both simulated and measured data demonstrate that LinFormer outperforms existing methods across various mobility scenarios, offering a promising solution for future wireless communication systems.

cs.LG↗

arXiv2024

VideoTetris: Towards Compositional Text-to-Video Generation

Diffusion models have demonstrated great success in text-to-video (T2V) generation. However, existing methods may face challenges when handling complex (long) video generation scenarios that involve multiple objects or dynamic changes in object numbers. To address these limitations, we propose VideoTetris, a novel framework that enables compositional T2V generation. Specifically, we propose spatio-temporal compositional diffusion to precisely follow complex textual semantics by manipulating and composing the attention maps of denoising networks spatially and temporally. Moreover, we propose an enhanced video data preprocessing to enhance the training data regarding motion dynamics and prompt understanding, equipped with a new reference frame attention mechanism to improve the consistency of auto-regressive video generation. Extensive experiments demonstrate that our VideoTetris achieves impressive qualitative and quantitative results in compositional T2V generation. Code is available at: https://github.com/YangLing0818/VideoTetris

cs.CV↗

arXiv2024

Penalized Sparse Covariance Regression with High Dimensional Covariates

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional predictors (i.e., similarity matrices). Specifically, we use the penalization method to identify the informative predictors and estimate their associated coefficients simultaneously. We first investigate the Lasso estimator and subsequently consider the folded concave penalized estimation methods (e.g., SCAD and MCP). However, the theoretical analysis of the existing penalization methods is primarily based on i.i.d. data, which is not directly applicable to our scenario. To address this difficulty, we establish the non-asymptotic error bounds by exploiting the spectral properties of the covariance matrix and similarity matrices. Then, we derive the estimation error bound for the Lasso estimator and establish the desirable oracle property of the folded concave penalized estimator. Extensive simulation studies are conducted to corroborate our theoretical results. We also illustrate the usefulness of the proposed method by applying it to a Chinese stock market dataset.

stat.ME↗

arXiv2024

Enabling On-Chip High-Frequency Adaptive Linear Optimal Control via Linearized Gaussian Process

Unpredictable and complex aerodynamic effects pose significant challenges to achieving precise flight control, such as the downwash effect from upper vehicles to lower ones. Conventional methods often struggle to accurately model these interactions, leading to controllers that require large safety margins between vehicles. Moreover, the controller on real drones usually requires high-frequency and has limited on-chip computation, making the adaptive control design more difficult to implement. To address these challenges, we incorporate Gaussian process (GP) to model the adaptive external aerodynamics with linear model predictive control. The GP is linearized to enable real-time high-frequency solutions. Moreover, to handle the error caused by linearization, we integrate end-to-end Bayesian optimization during sample collection stages to improve the control performance. Experimental results on both simulations and real quadrotors show that we can achieve real-time solvable computation speed with acceptable tracking errors.

cs.RO↗

arXiv2024

Fukaya A-infinity structure near infinity and the categorical formal completion

For a stopped Liouville manifold arising from a Liouville sector, we construct a symplectic analogue of the formal neighborhood of the stop on the level of Fukaya categories. This geometric construction is performed via Floer-theoretic methods by allowing wrappings in the negative direction. On the other hand, inspired by homological mirror symmetry for pairs, where the mirror is the formal neighborhood of a divisor in an ambient projective variety, there is a different approach by taking a `categorical formal completion' introduced by Efimov. Our main results establishes equivalence of these two approaches, confirms computability of this new type of Floer theory by categorical and algebraic means, and indicates contributions from and to computations in homological mirror symmetry.

math.SG↗

arXiv2024

Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Case

Recently, large language model (LLM)-based agents have made significant advances across various fields. One of the most popular research areas involves applying these agents to video games. Traditionally, these methods have relied on game APIs to access in-game environmental and action data. However, this approach is limited by the availability of APIs and does not reflect how humans play games. With the advent of vision language models (VLMs), agents now have enhanced visual understanding capabilities, enabling them to interact with games using only visual inputs. Despite these advances, current approaches still face challenges in action-oriented tasks, particularly in action role-playing games (ARPGs), where reinforcement learning methods are prevalent but suffer from poor generalization and require extensive training. To address these limitations, we select an ARPG, ``Black Myth: Wukong'', as a research platform to explore the capability boundaries of existing VLMs in scenarios requiring visual-only input and complex action output. We define 12 tasks within the game, with 75% focusing on combat, and incorporate several state-of-the-art VLMs into this benchmark. Additionally, we will release a human operation dataset containing recorded gameplay videos and operation logs, including mouse and keyboard actions. Moreover, we propose a novel VARP (Vision Action Role-Playing) agent framework, consisting of an action planning system and a visual trajectory system. Our framework demonstrates the ability to perform basic tasks and succeed in 90% of easy and medium-level combat scenarios. This research aims to provide new insights and directions for applying multimodal agents in complex action game environments. The code and datasets will be made available at https://varp-agent.github.io/.

cs.AI↗

arXiv2024

Grid Point Approximation for Distributed Nonparametric Smoothing and Prediction

Kernel smoothing is a widely used nonparametric method in modern statistical analysis. The problem of efficiently conducting kernel smoothing for a massive dataset on a distributed system is a problem of great importance. In this work, we find that the popularly used one-shot type estimator is highly inefficient for prediction purposes. To this end, we propose a novel grid point approximation (GPA) method, which has the following advantages. First, the resulting GPA estimator is as statistically efficient as the global estimator under mild conditions. Second, it requires no communication and is extremely efficient in terms of computation for prediction. Third, it is applicable to the case where the data are not randomly distributed across different machines. To select a suitable bandwidth, two novel bandwidth selectors are further developed and theoretically supported. Extensive numerical studies are conducted to corroborate our theoretical findings. Two real data examples are also provided to demonstrate the usefulness of our GPA method.

stat.CO↗

arXiv2024

Effects of pristine and photoaged tire wear particles and their leachable additives on key nitrogen removal processes and nitrous oxide accumulation in estuarine sediments

Global estuaries and coastal regions, acting as critical interfaces for mitigating nitrogen flux to marine, concurrently contend with contamination from tire wear particles (TWPs). However, the effects of pristine and photoaged TWP (P-TWP and A-TWP) and their leachates (P-TWPL and A-TWPL) on key nitrogen removal processes in estuarine sediments remain unclear. This study explored the responses of denitrification rate, anammox rate, and nitrous oxide (N2O) accumulation to P-TWP, A-TWP, P-TWPL, and A-TWPL exposures in estuarine sediments, and assessed the potential biotoxic substances in TWPL. Results indicate that P-TWP inhibited the denitrification rate and increased N2O accumulation without significantly impacting the anammox rate. A-TWP intensified the denitrification rate inhibition by further reducing narG gene abundance and NAR activity, and also decreased the hzo gene abundance, HZO activity, and Candidatus Kuenenia abundance, thereby slowing the anammox rate. N2O accumulation was lower after A-TWP exposure than P-TWP, with the NIR/NOS and NOR/NOS activity ratios closely associated with N2O accumulation. Batch experiments indicated that photoaging promoted Zn release from TWPL, significantly contributing to the inhibited denitrification rate and increased N2O accumulation by TWP. In addition, TWP drives changes in microbial community structure through released additives, with the abundance of DNB and AnAOB closely linked to the Zn, Mn, and As concentrations in TWPL. This study offers insights into assessing the environmental risks of TWPs in estuarine ecosystems.

q-bio.PE↗

arXiv2024

Time-Varying Foot-Placement Control for Underactuated Humanoid Walking on Swaying Rigid Surfaces

Locomotion on dynamic rigid surface (i.e., rigid surface accelerating in an inertial frame) presents complex challenges for controller design, which are essential for deploying humanoid robots in dynamic real-world environments such as moving trains, ships, and airplanes. This paper introduces a real-time, provably stabilizing control approach for underactuated humanoid walking on periodically swaying rigid surface. The first key contribution is the analytical extension of the classical angular momentum-based linear inverted pendulum model from static to swaying grounds. This extension results in a time-varying, nonhomogeneous robot model, which is fundamentally different from the existing pendulum models. We synthesize a discrete footstep control law for the model and derive a new set of sufficient stability conditions that verify the controller's stabilizing effect. Another key contribution is the development of a hierarchical control framework that incorporates the proposed footstep control law as its higher-layer planner to ensure the stability of underactuated walking. The closed-loop stability of the complete hybrid, full-order robot dynamics under this control framework is provably analyzed based on nonlinear control theory. Finally, experiments conducted on a Digit humanoid robot, both in simulations and with hardware, demonstrate the framework's effectiveness in addressing underactuated bipedal locomotion on swaying ground, even in the presence of uncertain surface motions and unknown external pushes.

cs.RO↗

arXiv2024

Serialized Speech Information Guidance with Overlapped Encoding Separation for Multi-Speaker Automatic Speech Recognition

Serialized output training (SOT) attracts increasing attention due to its convenience and flexibility for multi-speaker automatic speech recognition (ASR). However, it is not easy to train with attention loss only. In this paper, we propose the overlapped encoding separation (EncSep) to fully utilize the benefits of the connectionist temporal classification (CTC) and attention hybrid loss. This additional separator is inserted after the encoder to extract the multi-speaker information with CTC losses. Furthermore, we propose the serialized speech information guidance SOT (GEncSep) to further utilize the separated encodings. The separated streams are concatenated to provide single-speaker information to guide attention during decoding. The experimental results on LibriMix show that the single-speaker encoding can be separated from the overlapped encoding. The CTC loss helps to improve the encoder representation under complex scenarios. GEncSep further improved performance.

cs.SD↗

arXiv2024

Ordinal Learning: Longitudinal Attention Alignment Model for Predicting Time to Future Breast Cancer Events from Mammograms

Precision breast cancer (BC) risk assessment is crucial for developing individualized screening and prevention. Despite the promising potential of recent mammogram (MG) based deep learning models in predicting BC risk, they mostly overlook the 'time-to-future-event' ordering among patients and exhibit limited explorations into how they track history changes in breast tissue, thereby limiting their clinical application. In this work, we propose a novel method, named OA-BreaCR, to precisely model the ordinal relationship of the time to and between BC events while incorporating longitudinal breast tissue changes in a more explainable manner. We validate our method on public EMBED and inhouse datasets, comparing with existing BC risk prediction and time prediction methods. Our ordinal learning method OA-BreaCR outperforms existing methods in both BC risk and time-to-future-event prediction tasks. Additionally, ordinal heatmap visualizations show the model's attention over time. Our findings underscore the importance of interpretable and precise risk assessment for enhancing BC screening and prevention efforts. The code will be accessible to the public.

eess.IV↗

arXiv2024

Water-induced high-performance quantum-dot light-emitting diodes

Solution-processed light-emitting diodes (LEDs) are appealing for their potential in the low-cost fabrication of large-area devices. However, the limited performance of solution-processed blue LEDs, particularly their short operation lifetime, is hindering their practical use in display technologies. Here, we demonstrate that trace water in device, previously considered detrimental to most solution-processed LEDs, dramatically enhances the performance of quantum-dot LEDs (QLEDs). This breakthrough stems from our comprehensive mechanism investigations into the positive ageing phenomenon, a long-standing puzzle in the QLED field. Our findings reveal that water passivation on the surface of electron-transport layers, which are composed of zinc-oxide-based nanoparticles, improves charge transport and enhances exciton radiative recombination during device operation. Combined with the advanced top-emitting architecture, our blue QLEDs achieve a high current efficiency of 35.5 cd A-1, a blue index (colour coordinate corrected current efficiency) of over 470 cd A-1 CIEy-1, and unprecedented stability, with an extrapolated T95 lifetime (at an initial brightness of 1,000 cd m-2) of 287 hours. Our work may inspire further exploration into surface passivation of nanocrystalline functional layers, critical for the advancement of emerging solution-processed optoelectronic and electronic devices.

physics.optics↗

arXiv2024

Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions

The visible-light camera, which is capable of environment perception and navigation assistance, has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems (IWTS). However, the visual imaging quality inevitably suffers from several kinds of degradations (e.g., limited visibility, low contrast, color distortion, etc.) under complex weather conditions (e.g., haze, rain, and low-lightness). The degraded visual information will accordingly result in inaccurate environment perception and delayed operations for navigational risk. To promote the navigational safety of vessels, many computational methods have been presented to perform visual quality enhancement under poor weather conditions. However, most of these methods are essentially specific-purpose implementation strategies, only available for one specific weather type. To overcome this limitation, we propose to develop a general-purpose multi-scene visibility enhancement method, i.e., edge reparameterization- and attention-guided neural network (ERANet), to adaptively restore the degraded images captured under different weather conditions. In particular, our ERANet simultaneously exploits the channel attention, spatial attention, and reparameterization technology to enhance the visual quality while maintaining low computational cost. Extensive experiments conducted on standard and IWTS-related datasets have demonstrated that our ERANet could outperform several representative visibility enhancement methods in terms of both imaging quality and computational efficiency. The superior performance of IWTS-related object detection and scene segmentation could also be steadily obtained after ERANet-based visibility enhancement under complex weather conditions.

cs.CV↗

arXiv2024

Some properties on the reversibility and the linear response theory of Langevin dynamics

Linear response theory is a fundamental framework studying the macroscopic response of a physical system to an external perturbation. This paper focuses on the rigorous mathematical justification of linear response theory for Langevin dynamics. We give some equivalent characterizations for reversible overdamped/underdamped Langevin dynamics, which is the unperturbed reference system. Then we clarify sufficient conditions for the smoothness and exponential convergence to the invariant measure for the overdamped case. We also clarify those sufficient conditions for the underdamped case, which corresponds to hypoellipticity and hypocoercivity. Based on these, the asymptotic dependence of the response function on the small perturbation is proved in both finite and infinite time horizons. As applications, Green-Kubo relations and linear response theory for a generalized Langevin dynamics are also proved in a rigorous fashion.

math.AP↗

arXiv2024

Fluctuations in Wasserstein dynamics on Graphs

In this paper, we propose a drift-diffusion process on the probability simplex to study stochastic fluctuations in probability spaces. We construct a counting process for linear detailed balanced chemical reactions with finite species such that its thermodynamic limit is a system of ordinary differential equations (ODE) on the probability simplex. This ODE can be formulated as a gradient flow with an Onsager response matrix that induces a Riemannian metric on the probability simplex. After incorporating the induced Riemannian structure, we propose a diffusion approximation of the rescaled counting process for molecular species in the chemical reactions, which leads to Langevin dynamics on the probability simplex with a degenerate Brownian motion constructed from the eigen-decomposition of Onsager's response matrix. The corresponding Fokker-Planck equation on the simplex can be regarded as the usual drift-diffusion equation with the extrinsic representation of the divergence and Laplace-Beltrami operator. The invariant measure is the Gibbs measure, which is the product of the original macroscopic free energy and a volume element. When the drift term vanishes, the Fokker-Planck equation reduces to the heat equation with the Laplace-Beltrami operator, which we refer to as canonical Wasserstein diffusions on graphs. In the case of a two-point probability simplex, the constructed diffusion process is converted to one dimensional Wright-Fisher diffusion process, which leads to a natural boundary condition ensuring that the process remains within the probability simplex.

math.PR↗

arXiv2024

Magnetocaloric Effect of Topological Excitations in Kitaev Magnets

Traditional magnetic sub-Kelvin cooling relies on the nearly free local moments in hydrate paramagnetic salts, whose utility is hampered by the dilute magnetic ions and low thermal conductivity. Here we propose to use instead fractional excitations inherent to quantum spin liquids (QSLs) as an alternative, which are sensitive to external fields and can induce a very distinctive magnetocaloric effect. With state-of-the-art tensor-network approach, we compute low-temperature properties of Kitaev honeycomb model. For the ferromagnetic case, strong demagnetization cooling effect is observed due to the nearly free $Z_2$ vortices via spin fractionalization, described by a paramagnetic equation of state with a renormalized Curie constant. For the antiferromagnetic Kitaev case, we uncover an intermediate-field gapless QSL phase with very large spin entropy, possibly due to the emergence of spinon Fermi surface. Potential realization of topological excitation cooling in Kitaev materials is also discussed, which may offer a promising pathway to circumvent existing limitations in the paramagnetic hydrates.

cond-mat.str-el↗

arXiv2024

Improved Esophageal Varices Assessment from Non-Contrast CT Scans

Esophageal varices (EV), a serious health concern resulting from portal hypertension, are traditionally diagnosed through invasive endoscopic procedures. Despite non-contrast computed tomography (NC-CT) imaging being a less expensive and non-invasive imaging modality, it has yet to gain full acceptance as a primary clinical diagnostic tool for EV evaluation. To overcome existing diagnostic challenges, we present the Multi-Organ-cOhesion-Network (MOON), a novel framework enhancing the analysis of critical organ features in NC-CT scans for effective assessment of EV. Drawing inspiration from the thorough assessment practices of radiologists, MOON establishes a cohesive multiorgan analysis model that unifies the imaging features of the related organs of EV, namely esophagus, liver, and spleen. This integration significantly increases the diagnostic accuracy for EV. We have compiled an extensive NC-CT dataset of 1,255 patients diagnosed with EV, spanning three grades of severity. Each case is corroborated by endoscopic diagnostic results. The efficacy of MOON has been substantiated through a validation process involving multi-fold cross-validation on 1,010 cases and an independent test on 245 cases, exhibiting superior diagnostic performance compared to methods focusing solely on the esophagus (for classifying severe grade: AUC of 0.864 versus 0.803, and for moderate to severe grades: AUC of 0.832 versus 0.793). To our knowledge, MOON is the first work to incorporate a synchronized multi-organ NC-CT analysis for EV assessment, providing a more acceptable and minimally invasive alternative for patients compared to traditional endoscopy.

eess.IV↗