arXiv Science⌕ Search

arXiv subjects

Xiaoyu Wang

Publications and source records attributed to Xiaoyu Wang.

At least 163 records · Page 9Linked to original sources
arXiv2024

SynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving

To advance research in learning-based defogging algorithms, various synthetic fog datasets have been developed. However, existing datasets created using the Atmospheric Scattering Model (ASM) or real-time rendering engines often struggle to produce photo-realistic foggy images that accurately mimic the actual imaging process. This limitation hinders the effective generalization of models from synthetic to real data. In this paper, we introduce an end-to-end simulation pipeline designed to generate photo-realistic foggy images. This pipeline comprehensively considers the entire physically-based foggy scene imaging process, closely aligning with real-world image capture methods. Based on this pipeline, we present a new synthetic fog dataset named SynFog, which features both sky light and active lighting conditions, as well as three levels of fog density. Experimental results demonstrate that models trained on SynFog exhibit superior performance in visual perception and detection accuracy compared to others when applied to real-world foggy images.

cs.CV↗
arXiv2024

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise

Heavy-ball momentum with decaying learning rates is widely used with SGD for optimizing deep learning models. In contrast to its empirical popularity, the understanding of its theoretical property is still quite limited, especially under the standard anisotropic gradient noise condition for quadratic regression problems. Although it is widely conjectured that heavy-ball momentum method can provide accelerated convergence and should work well in large batch settings, there is no rigorous theoretical analysis. In this paper, we fill this theoretical gap by establishing a non-asymptotic convergence bound for stochastic heavy-ball methods with step decay scheduler on quadratic objectives, under the anisotropic gradient noise condition. As a direct implication, we show that heavy-ball momentum can provide $\tilde{\mathcal{O}}(\sqrtκ)$ accelerated convergence of the bias term of SGD while still achieving near-optimal convergence rate with respect to the stochastic variance term. The combined effect implies an overall convergence rate within log factors from the statistical minimax rate. This means SGD with heavy-ball momentum is useful in the large-batch settings such as distributed machine learning or federated learning, where a smaller number of iterations can significantly reduce the number of communication rounds, leading to acceleration in practice.

cs.LG↗
arXiv2023

Multi-channel Sensor Network Construction, Data Fusion and Challenges for Smart Home

Both sensor networks and data fusion are essential foundations for developing the smart home Internet of Things (IoT) and related fields. We proposed a multi-channel sensor network construction method involving hardware, acquisition, and synchronization in the smart home environment and a smart home data fusion method (SHDFM) for multi-modal data (position, gait, voice, pose, facial expression, temperature, and humidity) generated in the smart home environment to address the configuration of a multi-channel sensor network, improve the quality and efficiency of various human activities and environmental data collection, and reduce the difficulty of multi-modal data fusion in the smart home. SHDFM contains 5 levels, with inputs and outputs as criteria to provide recommendations for multi-modal data fusion strategies in the smart home. We built a real experimental environment using the proposed method in this paper. To validate our method, we created a real experimental environment - a physical setup in a home-like scenario where the multi-channel sensor network and data fusion techniques were deployed and evaluated. The acceptance and testing results show that the proposed construction and data fusion methods can be applied to the examples with high robustness, replicability, and scalability. Besides, we discuss how smart homes with multi-channel sensor networks can support digital twins.

cs.HC↗
arXiv2023

Using Metadynamics to Reveal Extractant Conformational Free Energy Landscapes

Understanding the impact of extractant functionalization in solvent extraction is essential to guide the development of better separations processes. Traditionally, computational extractant design uses electronic structure calculations to determine the metal binding energy of the lowest energy state. Although highly accurate, this approach does not account for all the relevant physics encountered under experimental conditions, such as temperature effects and ligand flexibility, in addition to approximating solvent-extractant interactions with implicit solvent models. In this study, we use classical MD simulations with an advanced sampling method, metadynamics, to map out extractant molecule conformational free energies in the condensed phase. We generate the complete conformational landscape in solution for a family of bidentate malonamide-based extractants with different functionalizations of the head group and the side chains. In particular, we show how such alkyl functionalization reshapes the free energy landscape, affecting the free energy penalty of organizing the extractant into the cis-like metal binding conformation from the trans-like conformation of the free extractant in solution. Specifically, functionalizing alkyl tails to the center of the head group has a greater influence on increasing molecular rigidity and disfavoring the binding conformation than functionalizing side chains. These findings are consistent with trends in metal binding energetics based on experimentally reported distribution ratios. This study demonstrates the feasibility of using molecular dynamics simulations with advance sampling techniques to investigate extractant conformational energetics in solution, which, more broadly, will enable extractant design that accounts for entropic effects and explicit solvation.

physics.chem-ph↗
arXiv2023

Solvent Effects on Extractant Conformational Energetics in Liquid-Liquid Extraction: A Simulation Study of Molecular Solvents and Ionic Liquids

Extractant design in liquid-liquid extraction (LLE) is a research frontier of metal ion separations that typically focuses on the direct extractant-metal interactions. However, a more detailed understanding of energetic drivers of separations beyond primary metal coordination is often lacking, including the role of solvent in the extractant phase. In this work, we propose a new mechanism for enhancing metal-complexant energetics with nanostructured solvents. Using molecular dynamics simulations with umbrella sampling, we find that the organic solvent can reshape the energetics of the extractant's intramolecular conformational landscape. We calculate free energy profiles of different conformations of a representative bidentate extractant, n-octyl(phenyl)-N,N-diisobutyl carbamoyl methyl phosphinoxide (CMPO), in four different solvents: dodecane, tributyl phosphate (TBP), and dry and wet ionic liquid (IL) 1-ethyl-3-methylimidazolium bis(trifluoromethylsulfonyl)imide ([EMIM][Tf_2N]). By promoting reorganization of the extractant molecule into its binding conformation, our findings reveal how particular solvents can ameliorate this unfavorable step of the metal separation process. In particular, the charge alternating nanodomains formed in ILs substantially reduce the free energy penalty associated with extractant reorganization. Importantly, using alchemical free energy calculations, we find that this stabilization persists even when we explicitly include the extracted cation. These findings provide insight into the energic drivers of metal ion separations and potentially suggest a new approach to designing effective separations using a molecular-level understanding of solvent effects.

physics.chem-ph↗
arXiv2023

Influence of N,N,N-trimethyl-1-adamantyl ammonium (TMAda+) Structure Directing Agent on Al Pair Distributions and Features in Chabazite Zeolite

While organic structure directing agents (OSDAs) are well known to have a directional influence on the topology of a crystallizing zeolite, the relationship between OSDA charge and siting of aliovalent ions on a primarily siliceous framework is unclear. Here, we explore the relationship between OSDA orientation, Al3+ siting, and lattice energy, taking as a model system CHA zeolite occluded with N,N,N-trimethyl-1-adamantyl ammonium (TMAda+) at an Si/Al ratio of 11/1. We use density functional theory calculations to parametrize a fixed-charge classical model describing van der Waals and electrostatic interactions between framework and OSDA. We enumerate and explore all possible combinations of OSDA orientation and Al location (attending to Lowenstein's rule) within a 36 T-site supercell. We find that interaction energies vary over 60 kJ/double-six-ring-unit (d6r). Further, analysis of configurations reveals that energies are sensitive to Al-Al proximity, such that low energies are associated with Al3+ pairs in 8-membered rings and higher energies associated with Al3+ pairs in smaller 6- and 4-membered rings. Comparisons with Al siting inferred from CHA zeolite crystallized with TMAda+ suggests that these computed interaction energies are useful reporters of observed Al siting in CHA synthesized with TMAda+.

cond-mat.mtrl-sci↗
arXiv2023

Revisiting Bloch electrons in magnetic field: Hofstadter physics via hybrid Wannier states

We revisit the Hofstadter butterfly for a subset of topologically trivial Bloch bands arising from a continuum free electron Hamiltonian in a periodic lattice potential. We employ the recently developed procedure -- which was previously used to analyze the case of topologically non-trivial bands [\href{https://journals.aps.org/prb/abstract/10.1103/PhysRevB.106.L121111}{Phys. Rev. B \textbf{106}, L121111 (2022)}] -- to construct the finite field Hilbert space from the zero-field hybrid Wannier basis states. Such states are Bloch extended along one direction and exponentially localized along the other. The method is illustrated for square and triangular lattice potentials and is shown to reproduce all the main features of the Hofstadter spectrum obtained from a numerically exact Landau level expansion method. In the regime when magnetic length is much longer than the spatial extent of the hybrid Wannier state in the localized direction we recover the well known Harper equation. Because the method applies to both topologically trivial and non-trivial bands, it provides an alternative and efficient approach to moiré materials in magnetic field.

cond-mat.mes-hall↗
arXiv2023

The mass spectrum and strong decay properties of the charmed-strange mesons within Godfrey-Isgur model considering the coupled-channel effects

Motivated by the recently observed $D_{s0}(2590)$ state by LHCb, we investigate the mass spectrum and the strong decay properties of the charmed-strange mesons within Godfrey-Isgur model considering the coupled-channel effects. Our results support that $D_{s0}^*(2317)$ and $D_{s1}(2460)$ can be interpreted as the $D_{s}(1^3P_0)$ and $D_{s}(1^3P_1)$ states with larger $DK$ and $D^*K$ components, respectively, and $D_{s1}(2700)$, $D_{s1}(2536)$, $D^*_{s2}(2573)$, $D_{s1}^*(2860)$, $D_{s3}^*(2860)$, and $D_{sJ}^*(3040)$ can be well interpreted as the $D_s(2^3S_1)$, $D_s(1^1P_1)$, $D_s(1^3P_2)$, $D_s(1^3D_1)$, $D_s(1^3D_3)$, and $D_s(2^1P_1)$ states, respectively. Although, $D_{s0}(2590)$ mass is about 50 MeV less than our prediction for the $D_{s}(2^1S_0)$ state, its width is still in good agreement with the one of $D_{s}(2^1S_0)$. Therefore, $D_{s0}(2590)$ state needs to be further confirmed by the experimental measurements, and the more precise information about $D_{s0}(2590)$ will shed light on its assignment of $D_{s}(2^1S_0)$. Furthermore, we predict the masses and the strong decay properties of the charmed-strange mesons with masses around 3 GeV, which would be helpful to experimentally search for these states.

hep-ph↗
arXiv2023

Fast-ParC: Capturing Position Aware Global Feature for ConvNets and ViTs

Transformer models have made tremendous progress in various fields in recent years. In the field of computer vision, vision transformers (ViTs) also become strong alternatives to convolutional neural networks (ConvNets), yet they have not been able to replace ConvNets since both have their own merits. For instance, ViTs are good at extracting global features with attention mechanisms while ConvNets are more efficient in modeling local relationships due to their strong inductive bias. A natural idea that arises is to combine the strengths of both ConvNets and ViTs to design new structures. In this paper, we propose a new basic neural network operator named position-aware circular convolution (ParC) and its accelerated version Fast-ParC. The ParC operator can capture global features by using a global kernel and circular convolution while keeping location sensitiveness by employing position embeddings. Our Fast-ParC further reduces the O(n2) time complexity of ParC to O(n log n) using Fast Fourier Transform. This acceleration makes it possible to use global convolution in the early stages of models with large feature maps, yet still maintains the overall computational cost comparable with using 3x3 or 7x7 kernels. The proposed operation can be used in a plug-and-play manner to 1) convert ViTs to pure-ConvNet architecture to enjoy wider hardware support and achieve higher inference speed; 2) replacing traditional convolutions in the deep stage of ConvNets to improve accuracy by enlarging the effective receptive field. Experiment results show that our ParC op can effectively enlarge the receptive field of traditional ConvNets, and adopting the proposed op benefits both ViTs and ConvNet models on all three popular vision tasks, image classification, object

cs.CV↗
arXiv2023

Generalized Polyak Step Size for First Order Optimization with Momentum

In machine learning applications, it is well known that carefully designed learning rate (step size) schedules can significantly improve the convergence of commonly used first-order optimization algorithms. Therefore how to set step size adaptively becomes an important research question. A popular and effective method is the Polyak step size, which sets step size adaptively for gradient descent or stochastic gradient descent without the need to estimate the smoothness parameter of the objective function. However, there has not been a principled way to generalize the Polyak step size for algorithms with momentum accelerations. This paper presents a general framework to set the learning rate adaptively for first-order optimization methods with momentum, motivated by the derivation of Polyak step size. It is shown that the resulting techniques are much less sensitive to the choice of momentum parameter and may avoid the oscillation of the heavy-ball method on ill-conditioned problems. These adaptive step sizes are further extended to the stochastic settings, which are attractive choices for stochastic gradient descent with momentum. Our methods are demonstrated to be more effective for stochastic gradient methods than prior adaptive step size algorithms in large-scale machine learning tasks.

math.OC↗
arXiv2023

NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learning

As more deep learning models are being applied in real-world applications, there is a growing need for modeling and learning the representations of neural networks themselves. An efficient representation can be used to predict target attributes of networks without the need for actual training and deployment procedures, facilitating efficient network deployment and design. Recently, inspired by the success of Transformer, some Transformer-based representation learning frameworks have been proposed and achieved promising performance in handling cell-structured models. However, graph neural network (GNN) based approaches still dominate the field of learning representation for the entire network. In this paper, we revisit Transformer and compare it with GNN to analyse their different architecture characteristics. We then propose a modified Transformer-based universal neural network representation learning model NAR-Former V2. It can learn efficient representations from both cell-structured networks and entire networks. Specifically, we first take the network as a graph and design a straightforward tokenizer to encode the network into a sequence. Then, we incorporate the inductive representation learning capability of GNN into Transformer, enabling Transformer to generalize better when encountering unseen architecture. Additionally, we introduce a series of simple yet effective modifications to enhance the ability of the Transformer in learning representation from graph structures. Our proposed method surpasses the GNN-based method NNLP by a significant margin in latency estimation on the NNLQP dataset. Furthermore, regarding accuracy prediction on the NASBench101 and NASBench201 datasets, our method achieves highly comparable performance to other state-of-the-art methods.

cs.LG↗
arXiv2023

Universal Object Detection with Large Vision Model

Over the past few years, there has been growing interest in developing a broad, universal, and general-purpose computer vision system. Such systems have the potential to address a wide range of vision tasks simultaneously, without being limited to specific problems or data domains. This universality is crucial for practical, real-world computer vision applications. In this study, our focus is on a specific challenge: the large-scale, multi-domain universal object detection problem, which contributes to the broader goal of achieving a universal vision system. This problem presents several intricate challenges, including cross-dataset category label duplication, label conflicts, and the necessity to handle hierarchical taxonomies. To address these challenges, we introduce our approach to label handling, hierarchy-aware loss design, and resource-efficient model training utilizing a pre-trained large vision model. Our method has demonstrated remarkable performance, securing a prestigious second-place ranking in the object detection track of the Robust Vision Challenge 2022 (RVC 2022) on a million-scale cross-dataset object detection benchmark. We believe that our comprehensive study will serve as a valuable reference and offer an alternative approach for addressing similar challenges within the computer vision community. The source code for our work is openly available at https://github.com/linfeng93/Large-UniDet.

cs.CV↗
arXiv2023

Quantum anomalous Hall state in a fluorinated 1T-MoSe$_2$ monolayer

The quantum anomalous Hall state with a large band gap and a high Chern number is significant for practical applications in spintronics. By performing first-principles calculations, we investigate electronic properties of the fully fluorinated 1T-MoSe$_{2}$ monolayer. Without considering the spin-orbit coupling, the band structure demonstrates single-spin semi-metallic properties and the trigonal warping around $K_{\pm}$ valleys. The introduction of the spin-orbit coupling opens considerable band gaps of $117.2$ meV around the two valleys, leading to a nontrivial quantum anomalous Hall state with a Chern number of $|C|=2$, which provides two chiral dissipationless transport channels from topological edge states and associated quantized anomalous Hall conductivity. In addition, an effective model is constructed to describe the low-energy physics of the monolayer. Our findings in the MoSe$_{2}$F$_{2}$ monolayer sheds light on large-gap quantum anomalous Hall states in two-dimensional materials with the chemical functionalization, and provides opportunities in designing low-power and noise-tolerant spintronic devices.

cond-mat.mes-hall↗
arXiv2023

Tunable Magnetism and Valleys in VSiZ$_3$ monolayers

Two-dimensional magnetism and valleys have recently emerged as two significant research areas, with intriguing properties and practical uses in advanced information technology. Considering the importance of these two areas and their couplings, controllable creations of both the magnetism and valley polarization are highly sought after. Based on first-principles calculations, we propose a new class of two-dimensional monolayers with a chemical formula of MAZ$_3$, which is viewed as a 2H-MZ$_2$ trilayer passivated by the A-Z bilayer on its one side. Taking VSiN$_3$ as an example, the MAZ$_3$ monolayers are found to exhibit tunable magnetism and valleys. For the intrinsic VSiN$_3$ monolayer, it is a non-magnetic semiconductor, with multiple degenerate valleys and trigonal warping near $K_\pm$ points in the band structure. Besides, the bands have spin splittings owing to the spin-orbit coupling. Under a moderate carrier doping, the monolayer becomes a Stoner ferromagnet, which enhances the spin splittings of the valence band and generates valley splittings. Moreover, the Berry curvature is valley contrasting, leading to distinct valley-spin related anomalous Hall currents as the doping concentration increases. Our work opens up new way to modulate the spin splittings and valley splittings via electric means, and provides opportunities for exploring advanced spintronic and valleytronic devices.

cond-mat.mtrl-sci↗
arXiv2023

Magnetically and electrically controllable valley splittings in MXene monolayers

The modulation of the valley structure in two-dimensional valley materials is vital in the field of valleytronics. The multiferroicity provides possibility for multiple modulations of the valley, including the magnetic and electric means. Based on the first-principle calculations, we study the valley properties and associated manipulations of multiferroic Co$_2$CF$_2$ monolayers with different stacking patterns. Our calculations show that the Co$_2$CF$_2$ monolayer in the H$^{\prime}$ phase is a ferrovalley material, with sizable valley splittings. By rotating the magnetization direction, the valley splittings can be tuned for both the magnitude and sign. The electric field, driving the reversal of the electric polarization, can also change the magnitude of the valley splittings. Besides, a metastable T$^{\prime}$ phase exhibits valley splittings as well, of which the magnitude and sign can be simultaneously controlled by applied magnetic and electric fields. These findings offer a practical way for realizing highly tunable valleys by multiferroic couplings.

cond-mat.mtrl-sci↗
arXiv2023

Incorporating increased variability in testing for cancer DNA methylation

Cancer development is associated with aberrant DNA methylation, including increased stochastic variability. Statistical tests for discovering cancer methylation biomarkers have focused on changes in mean methylation. To improve the power of detection, we propose to incorporate increased variability in testing for cancer differential methylation by two joint constrained tests: one for differential mean and increased variance, the other for increased mean and increased variance. To improve small sample properties, likelihood ratio statistics are developed, accounting for the variability in estimating the sample medians in the Levene test. Efficient algorithms were developed and implemented in DMVC function of R package DMtest. The proposed joint constrained tests were compared to standard tests and partial area under the curve (pAUC) for the receiver operating characteristic curve (ROC) in simulated datasets under diverse models. Application to the high-throughput methylome data in The Cancer Genome Atlas (TCGA) shows substantially increased yield of candidate CpG markers.

stat.ME↗
arXiv2023

DMseg: a Python algorithm for de novo detection of differentially or variably methylated regions

Detecting and assessing statistical significance of differentially methylated regions (DMRs) is a fundamental task in methylome association studies. While the average differential methylation in different phenotype groups has been the inferential focus, methylation changes in chromosomal regions may also present as differential variability, i.e., variably methylated regions (VMRs). Testing statistical significance of regional differential methylation is a challenging problem, and existing algorithms do not provide accurate type I error control for genome-wide DMR or VMR analysis. No algorithm has been publicly available for detecting VMRs. We propose DMseg, a Python algorithm with efficient DMR/VMR detection and significance assessment for array-based methylome data, and compare its performance to Bumphunter, a popular existing algorithm. Operationally, DMseg searches for DMRs or VMRs within CpG clusters that are adaptively determined by both gap distance and correlation between contiguous CpG sites in a microarray. Levene test was implemented for assessing differential variability of individual CpGs. A likelihood ratio statistic is proposed to test for a constant difference within CpGs in a DMR or VMR to summarize the evidence of regional difference. Using a stratified permutation scheme and pooling null distributions of LRTs from clusters with similar numbers of CpGs, DMseg provides accurate control of the type I error rate. In simulation experiments, DMseg shows superior power than Bumphunter to detect DMRs. Application to methylome data of Barrett's esophagus and esophageal adenocarcinoma reveals a number of DMRs and VMRs of biological interest.

stat.ME↗
arXiv2023

Perimeter Control Using Deep Reinforcement Learning: A Model-free Approach towards Homogeneous Flow Rate Optimization

Perimeter control maintains high traffic efficiency within protected regions by controlling transfer flows among regions to ensure that their traffic densities are below critical values. Existing approaches can be categorized as either model-based or model-free, depending on whether they rely on network transmission models (NTMs) and macroscopic fundamental diagrams (MFDs). Although model-based approaches are more data efficient and have performance guarantees, they are inherently prone to model bias and inaccuracy. For example, NTMs often become imprecise for a large number of protected regions, and MFDs can exhibit scatter and hysteresis that are not captured in existing model-based works. Moreover, no existing studies have employed reinforcement learning for homogeneous flow rate optimization in microscopic simulation, where spatial characteristics, vehicle-level information, and metering realizations -- often overlooked in macroscopic simulations -- are taken into account. To circumvent issues of model-based approaches and macroscopic simulation, we propose a model-free deep reinforcement learning approach that optimizes the flow rate homogeneously at the perimeter at the microscopic level. Results demonstrate that our model-free reinforcement learning approach without any knowledge of NTMs or MFDs can compete and match the performance of a model-based approach, and exhibits enhanced generalizability and scalability.

cs.LG↗