arXiv Science⌕ Search

arXiv subjects

Hao Wu

Publications and source records attributed to Hao Wu.

At least 415 records · Page 23Linked to original sources

Weighted Low-rank Approximation via Stochastic Gradient Descent on Manifolds

We solve a regularized weighted low-rank approximation problem by a stochastic gradient descent on a manifold. To guarantee the convergence of our stochastic gradient descent, we establish a convergence theorem on manifolds for retraction-based stochastic gradient descents admitting confinements. On sample data from the Netflix Prize training dataset, our algorithm outperforms the existing stochastic gradient descent on Euclidean spaces. We also compare the accelerated line search on this manifold to the existing accelerated line search on Euclidean spaces.

math.OC↗

Arrival flow profile estimation and predication for urban arterials using license plate recognition data

Arrival flow profiles enable precise assessment of urban arterial dynamics, aiding signal control optimization. License Plate Recognition (LPR) data, with its comprehensive coverage and event-based detection, is promising for reconstructing arrival flow profiles. This paper introduces an arrival flow profile estimation and prediction method for urban arterials using LPR data. Unlike conventional methods that assume traffic homogeneity and overlook detailed traffic wave features and signal timing impacts, our approach employs a time partition algorithm and platoon dispersion model to calculate arrival flow, considering traffic variations and driving behaviors using only boundary data. Shockwave theory quantifies the piecewise function between arrival flow and profile. We derive the relationship between arrival flow profiles and traffic dissipation at downstream intersections, enabling recursive calculations for all intersections. This approach allows prediction of arrival flow profiles under any signal timing schemes. Validation through simulation and empirical cases demonstrates promising performance and robustness under various conditions.

physics.soc-ph↗

Continuum theory of electrostatic-elastic coupling interactions in colloidal crystals

A mobile Coulomb gas permeating a fixed background crystalline lattice of charged colloidal crystals is subject to an electrostatic-elastic coupling, which we study on the continuum level by introducing a minimal coupling between electrostatic and displacement fields. We derive linearized, Debye-Hückel-like mean-field equations that can be analytically solved, incorporating the minimal coupling between electrostatic and displacement fields leading to an additional effective attractive interaction between mobile charges that depends in general on the strength of the coupling between the electrostatic and displacement fields. By analyzing the Gaussian fluctuations around the mean-field solution we also identify and quantify the region of its stability in terms of the electrostatic-elastic screening length. This detailed continuum theory incorporating the standard lattice elasticity and electrostatics of mobile charges provides a baseline to investigate the electrostatic-elastic coupling for microscopic models in colloid science and materials science.

cond-mat.soft↗

Dense Object Detection Based on De-homogenized Queries

Dense object detection is widely used in automatic driving, video surveillance, and other fields. This paper focuses on the challenging task of dense object detection. Currently, detection methods based on greedy algorithms, such as non-maximum suppression (NMS), often produce many repetitive predictions or missed detections in dense scenarios, which is a common problem faced by NMS-based algorithms. Through the end-to-end DETR (DEtection TRansformer), as a type of detector that can incorporate the post-processing de-duplication capability of NMS, etc., into the network, we found that homogeneous queries in the query-based detector lead to a reduction in the de-duplication capability of the network and the learning efficiency of the encoder, resulting in duplicate prediction and missed detection problems. To solve this problem, we propose learnable differentiated encoding to de-homogenize the queries, and at the same time, queries can communicate with each other via differentiated encoding information, replacing the previous self-attention among the queries. In addition, we used joint loss on the output of the encoder that considered both location and confidence prediction to give a higher-quality initialization for queries. Without cumbersome decoder stacking and guaranteeing accuracy, our proposed end-to-end detection framework was more concise and reduced the number of parameters by about 8% compared to deformable DETR. Our method achieved excellent results on the challenging CrowdHuman dataset with 93.6% average precision (AP), 39.2% MR-2, and 84.3% JI. The performance overperformed previous SOTA methods, such as Iter-E2EDet (Progressive End-to-End Object Detection) and MIP (One proposal, Multiple predictions). In addition, our method is more robust in various scenarios with different densities.

cs.CV↗

Gradient-free variational learning with conditional mixture networks

Balancing computational efficiency with robust predictive performance is crucial in supervised learning, especially for critical applications. Standard deep learning models, while accurate and scalable, often lack probabilistic features like calibrated predictions and uncertainty quantification. Bayesian methods address these issues but can be computationally expensive as model and data complexity increase. Previous work shows that fast variational methods can reduce the compute requirements of Bayesian methods by eliminating the need for gradient computation or sampling, but are often limited to simple models. We introduce CAVI-CMN, a fast, gradient-free variational method for training conditional mixture networks (CMNs), a probabilistic variant of the mixture-of-experts (MoE) model. CMNs are composed of linear experts and a softmax gating network. By exploiting conditional conjugacy and Pólya-Gamma augmentation, we furnish Gaussian likelihoods for the weights of both the linear layers and the gating network. This enables efficient variational updates using coordinate ascent variational inference (CAVI), avoiding traditional gradient-based optimization. We validate this approach by training two-layer CMNs on standard classification benchmarks from the UCI repository. CAVI-CMN achieves competitive and often superior predictive accuracy compared to maximum likelihood estimation (MLE) with backpropagation, while maintaining competitive runtime and full posterior distributions over all model parameters. Moreover, as input size or the number of experts increases, computation time scales competitively with MLE and other gradient-based solutions like black-box variational inference (BBVI), making CAVI-CMN a promising tool for deep, fast, and gradient-free Bayesian networks.

cs.LG↗

Finding Quasars Behind the Galactic Plane: Spectroscopic Identifications of ~1300 New Quasars at |b|<=20 degree from LAMOST DR10

Quasars behind the Galactic plane (GPQs) are excellent tracers to probe the chemistry and kinematics of the interstellar/intergalactic medium (ISM/IGM) of the Milky Way along sight lines via absorption line spectroscopy. Moreover, the quasars located at low Galactic latitudes will fill the gap in the spatial distribution of known quasars near the Galactic plane, and can be used to construct an astrometric reference frame for accurate measurements of proper motions (PMs) of stars, and substructures of the Milky Way. We started a survey of background quasars in the low Galactic latitude region since the LAMOST phase II survey in 2017. Quasar candidates have been selected from the optical and infrared photometric data of Pan-STARRS1 and WISE surveys based on their variability and color properties. In this paper, we present a sample of 1982 spectroscopically confirmed GPQs with |b| <= 20 degree based on LAMOST Data Release 10 (DR10). Among them, 1338 are newly discovered. Most GPQs are located around 240<l<90 degree, and the spatial distributions are non-uniform. These GPQs have a magnitude distribution with a peak at i-mag 19.0, and mostly around 18.0-19.5mag. The peak of redshift distributions is around ~1.5, and most GPQs have redshifts between 0.3 and 2.5. Our finding demonstrates the potential discovery space for the GPQs from the spectroscopic surveys and the promising applications for future research.

astro-ph.GA↗

Coarse-to-Fine Structure-Aware Artistic Style Transfer

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed style transfer methods have a common problem; that is, they simply transfer the texture and color of the style image to the global structure of the content image. As a result, the content image has a local structure that is not similar to the local structure of the style image. In this paper, we present an effective method that can be used to transfer style patterns while fusing the local style structure into the local content structure. In our method, dif-ferent levels of coarse stylized features are first reconstructed at low resolution using a Coarse Network, in which style color distribution is roughly transferred, and the content structure is combined with the style structure. Then, the reconstructed features and the content features are adopted to synthesize high-quality structure-aware stylized images with high resolution using a Fine Network with three structural selective fusion (SSF) modules. The effectiveness of our method is demonstrated through the generation of appealing high-quality stylization results and a com-parison with some state-of-the-art style transfer methods.

cs.CV↗

Multiscale style transfer based on a Laplacian pyramid for traditional Chinese painting

Style transfer is adopted to synthesize appealing stylized images that preserve the structure of a content image but carry the pattern of a style image. Many recently proposed style transfer methods use only western oil paintings as style images to achieve image stylization. As a result, unnatural messy artistic effects are produced in stylized images when using these methods to directly transfer the patterns of traditional Chinese paintings, which are composed of plain colors and abstract objects. Moreover, most of them work only at the original image scale and thus ignore multiscale image information during training. In this paper, we present a novel effective multiscale style transfer method based on Laplacian pyramid decomposition and reconstruction, which can transfer unique patterns of Chinese paintings by learning different image features at different scales. In the first stage, the holistic patterns are transferred at low resolution by adopting a Style Transfer Base Network. Then, the details of the content and style are gradually enhanced at higher resolutions by a Detail Enhancement Network with an edge information selection (EIS) module in the second stage. The effectiveness of our method is demonstrated through the generation of appealing high-quality stylization results and a comparison with some state-of-the-art style transfer methods. Datasets and codes are available at https://github.com/toby-katakuri/LP_StyleTransferNet.

cs.CV↗

RS-YOLOX: A High Precision Detector for Object Detection in Satellite Remote Sensing Images

Automatic object detection by satellite remote sensing images is of great significance for resource exploration and natural disaster assessment. To solve existing problems in remote sensing image detection, this article proposes an improved YOLOX model for satellite remote sensing image automatic detection. This model is named RS-YOLOX. To strengthen the feature learning ability of the network, we used Efficient Channel Attention (ECA) in the backbone network of YOLOX and combined the Adaptively Spatial Feature Fusion (ASFF) with the neck network of YOLOX. To balance the numbers of positive and negative samples in training, we used the Varifocal Loss function. Finally, to obtain a high-performance remote sensing object detector, we combined the trained model with an open-source framework called Slicing Aided Hyper Inference (SAHI). This work evaluated models on three aerial remote sensing datasets (DOTA-v1.5, TGRS-HRRSD, and RSOD). Our comparative experiments demonstrate that our model has the highest accuracy in detecting objects in remote sensing image datasets.

cs.CV↗

Observation of condensed moire exciton polaritons in twisted photonic lattices at room temperature

Moire lattices attract significant attention in double-layer graphene and TMD layer heterostructures as well as in photonic crystals due to the interesting exotic physics that emerges within these structures. However, direct measurement of the moiré ground, excited states and Bloch bands in twisted photonic lattices is still illusive. In this work we report strong coupling between excitons in CsPbBr3 microplates and moire photonic modes at room temperature. Depending on the coupling strength between the nearest potential sites, we observe staggered moire polariton ground states, excited states and moire polariton bands. Phase locked moire zero (in-phase) states and moire pi (antiphase) states with different spatial distributions are measured. The moire polariton distribution can be tuned into the shape of a parallelogram by controlling the depth and width of the potential in one photonic lattice with another superimposed one fixed. In addition, moire polaritons in twisted 2D honeycomb lattices are also observed. Increasing the pumping density, we realize exciton polariton condensation in the moire potential sites of the 1D/2D twisted lattices with the coherence time of around 1.4 ps. Our work lays the foundation to study coherent moire polariton condensation in twisted photonic lattices at room temperature.

physics.optics↗

Decentralized Conjugate Gradient and Memoryless BFGS Methods

This paper proposes a new decentralized conjugate gradient (NDCG) method and a decentralized memoryless BFGS (DMBFGS) method for the nonconvex and strongly convex decentralized optimization problem, respectively, of minimizing a finite sum of continuously differentiable functions over a fixed-connected undirected network. Gradient tracking techniques are applied in these two methods to enhance their convergence properties and the numerical stability. In particular, we show global convergence of NDCG with constant stepsize for general nonconvex smooth decentralized optimization. Our new DMBFGS method uses a scaled memoryless BFGS technique and only requires gradient information to approximate second-order information of the component functions in the objective. We also establish global convergence and linear convergence rate of DMBFGS with constant stepsize for strongly convex smooth decentralized optimization. Our numerical results show that NDCG and DMBFGS are very efficient in terms of both iteration and communication cost compared with other state-of-the-art methods for solving smooth decentralized optimization.

math.OC↗

DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting

The ever-increasing sensor service, though opening a precious path and providing a deluge of earth system data for deep-learning-oriented earth science, sadly introduce a daunting obstacle to their industrial level deployment. Concretely, earth science systems rely heavily on the extensive deployment of sensors, however, the data collection from sensors is constrained by complex geographical and social factors, making it challenging to achieve comprehensive coverage and uniform deployment. To alleviate the obstacle, traditional approaches to sensor deployment utilize specific algorithms to design and deploy sensors. These methods \textit{dynamically adjust the activation times of sensors to optimize the detection process across each sub-region}. Regrettably, formulating an activation strategy generally based on historical observations and geographic characteristics, which make the methods and resultant models were neither simple nor practical. Worse still, the complex technical design may ultimately lead to a model with weak generalizability. In this paper, we introduce for the first time the concept of spatio-temporal data dynamic sparse training and are committed to adaptively, dynamically filtering important sensor distributions. To our knowledge, this is the \textbf{first} proposal (\textit{termed DynST}) of an \textbf{industry-level} deployment optimization concept at the data level. However, due to the existence of the temporal dimension, pruning of spatio-temporal data may lead to conflicts at different timestamps. To achieve this goal, we employ dynamic merge technology, along with ingenious dimensional mapping to mitigate potential impacts caused by the temporal aspect. During the training process, DynST utilize iterative pruning and sparse training, repeatedly identifying and dynamically removing sensor perception areas that contribute the least to future predictions.

cs.AI↗

HpC: A Calculus for Hybrid and Mobile Systems -- Full Version

Networked cybernetic and physical systems of the Internet of Things (IoT) immerse civilian and industrial infrastructures into an interconnected and dynamic web of hybrid and mobile devices. The key feature of such systems is the hybrid and tight coupling of mobile and pervasive discrete communications in a continuously evolving environment (discrete computations with predominant continuous dynamics). In the aim of ensuring the correctness and reliability of such heterogeneous infrastructures, we introduce the hybrid π-calculus (HpC), to formally capture both mobility, pervasiveness and hybridisation in infrastructures where the network topology and its communicating entities evolve continuously in the physical world. The π-calculus proposed by Robin Milner et al. is a process calculus that can model mobile communications and computations in a very elegant manner. The HpC we propose is a conservative extension of the classical π-calculus, i.e., the extension is ``minimal'', and yet describes mobility, time and physics of systems, while allowing to lift all theoretical results (e.g. bisimulation) to the context of that extension. We showcase the HpC by considering a realistic handover protocol among mobile devices.

cs.PL↗

Unconventional bias-dependent tunneling magnetoresistance in van der Waals ferromagnetic/semiconductor heterojunctions

Two-dimensional van der Waals (vdW) ferromagnetic/semiconductor heterojunctions represent an ideal platform for studying and exploiting tunneling magnetoresistance (TMR) effects due to the versatile band structure of semiconductors and their high-quality interfaces. In the all-vdW magnetic tunnel junction (MTJ) devices, both the magnitude and sign of the TMR can be tuned by an applied voltage. Typically, as the bias voltage increases, first the amplitude of the TMR decreases, then the sign of the TMR reverses and/or oscillates. Here, we report on an unconventional bias-dependent TMR in the all-vdW Fe3GaTe2/GaSe/Fe3GaTe2 MTJs, where the TMR first increases, then decreases, and finally undergoes a sign reversal as the bias voltage increases. This dependence cannot be explained by traditional models of MTJs. We propose an in-plane electron momentum (k//) resolved tunneling model that considers both the coherent degree of k// and the decay of the electron wave function through the semiconductor spacer layer. This can explain well the conventional and unconventional bias-dependent TMR. Our results thus provide a deeper understanding of the bias-dependent spin-transport in semiconductor-based MTJs and offer new insights into semiconductor spintronics.

cond-mat.mtrl-sci↗

PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Prediction

In this paper, we investigate the challenge of spatio-temporal video prediction task, which involves generating future video frames based on historical spatio-temporal observation streams. Existing approaches typically utilize external information such as semantic maps to improve video prediction accuracy, which often neglect the inherent physical knowledge embedded within videos. Worse still, their high computational costs could impede their applications for high-resolution videos. To address these constraints, we introduce a novel framework called \underline{P}hysics-\underline{a}ssisted \underline{S}patio-\underline{t}emporal \underline{Net}work (PastNet) for high-quality video prediction. The core of PastNet lies in incorporating a spectral convolution operator in the Fourier domain, which efficiently introduces inductive biases from the underlying physical laws. Additionally, we employ a memory bank with the estimated intrinsic dimensionality to discretize local features during the processing of complex spatio-temporal signals, thereby reducing computational costs and facilitating efficient high-resolution video prediction. Extensive experiments on various widely-used spatio-temporal video benchmarks demonstrate the effectiveness and efficiency of the proposed PastNet compared with a range of state-of-the-art methods, particularly in high-resolution scenarios.

cs.CV↗

CoDe: Communication Delay-Tolerant Multi-Agent Collaboration via Dual Alignment of Intent and Timeliness

Communication has been widely employed to enhance multi-agent collaboration. Previous research has typically assumed delay-free communication, a strong assumption that is challenging to meet in practice. However, real-world agents suffer from channel delays, receiving messages sent at different time points, termed {\it{Asynchronous Communication}}, leading to cognitive biases and breakdowns in collaboration. This paper first defines two communication delay settings in MARL and emphasizes their harm to collaboration. To handle the above delays, this paper proposes a novel framework, Communication Delay-tolerant Multi-Agent Collaboration (CoDe). At first, CoDe learns an intent representation as messages through future action inference, reflecting the stable future behavioral trends of the agents. Then, CoDe devises a dual alignment mechanism of intent and timeliness to strengthen the fusion process of asynchronous messages. In this way, agents can extract the long-term intent of others, even from delayed messages, and selectively utilize the most recent messages that are relevant to their intent. Experimental results demonstrate that CoDe outperforms baseline algorithms in three MARL benchmarks without delay and exhibits robustness under fixed and time-varying delays.

cs.MA↗

NeuralDiffuser: Neuroscience-inspired Diffusion Guidance for fMRI Visual Reconstruction

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and more, remains challenging. The stable diffusion models inevitably result in the variability of reconstructed images, even under identical conditions. To address this challenge, we first uncover the neuroscientific perspective of diffusion methods, which primarily involve top-down creation using pre-trained knowledge from extensive image datasets, but tend to lack detail-driven bottom-up perception, leading to a loss of faithful details. In this paper, we propose NeuralDiffuser, which incorporates primary visual feature guidance to provide detailed cues in the form of gradients. This extension of the bottom-up process for diffusion models achieves both semantic coherence and detail fidelity when reconstructing visual stimuli. Furthermore, we have developed a novel guidance strategy for reconstruction tasks that ensures the consistency of repeated outputs with original images rather than with various outputs. Extensive experimental results on the Natural Senses Dataset (NSD) qualitatively and quantitatively demonstrate the advancement of NeuralDiffuser by comparing it against baseline and state-of-the-art methods horizontally, as well as conducting longitudinal ablation studies.

cs.NE↗

Analyzing Divergence for Nondeterministic Probabilistic Models

Branching and weak probabilistic bisimilarities are two well-known notions capturing behavioral equivalence between nondeterministic probabilistic systems. For probabilistic systems, divergence is of major concern. Recently several divergence-sensitive refinements of branching and weak probabilistic bisimilarities have been proposed in the literature. Both the definitions of these equivalences and the techniques to investigate them differ significantly. This paper presents a comprehensive comparative study on divergence-sensitive behavioral equivalence relations that refine the branching and weak probabilistic bisimilarities. Additionally, these equivalence relations are shown to have efficient checking algorithms. The techniques of this paper might be of independent interest in a more general setting.

cs.LO↗