arXiv Science⌕ Search

arXiv subjects

Ming Yang

Publications and source records attributed to Ming Yang.

At least 91 records · Page 5Linked to original sources

Single-loop Algorithms for Stochastic Non-convex Optimization with Weakly-Convex Constraints

Constrained optimization with multiple functional inequality constraints has significant applications in machine learning. This paper examines a crucial subset of such problems where both the objective and constraint functions are weakly convex. Existing methods often face limitations, including slow convergence rates or reliance on double-loop algorithmic designs. To overcome these challenges, we introduce a novel single-loop penalty-based stochastic algorithm. Following the classical exact penalty method, our approach employs a {\bf hinge-based penalty}, which permits the use of a constant penalty parameter, enabling us to achieve a {\bf state-of-the-art complexity} for finding an approximate Karush-Kuhn-Tucker (KKT) solution. We further extend our algorithm to address finite-sum coupled compositional objectives, which are prevalent in artificial intelligence applications, establishing improved complexity over existing approaches. Finally, we validate our method through experiments on fair learning with receiver operating characteristic (ROC) fairness constraints and continual learning with non-forgetting constraints.

cs.LG↗

An item is worth one token in Multimodal Large Language Models-based Sequential Recommendation

Sequential recommendations (SR) predict users' future interactions based on their historical behavior. The rise of Large Language Models (LLMs) has brought powerful generative and reasoning capabilities, significantly enhancing SR performance, while Multimodal LLMs (MLLMs) further extend this by introducing data like images and interactive relationships. However, critical issues remain, i.e., (a) Suboptimal item representations caused by lengthy and redundant descriptions, leading to inefficiencies in both training and inference; (b) Modality-related cognitive bias, as LLMs are predominantly pretrained on textual data, limiting their ability to effectively integrate and utilize non-textual modalities; (c) Weakening sequential perception in long interaction sequences, where attention mechanisms struggle to capture earlier interactions, hindering the modeling of long-range dependencies. To address these issues, we propose Speeder, an efficient MLLM-based paradigm for SR featuring three key innovations: 1) Multimodal Representation Compression (MRC), which condenses item attributes into concise yet informative tokens, reducing redundancy and computational cost; 2) Modality-aware Progressive Optimization (MPO), enabling gradual learning of multimodal representations; 3) Sequential Position Awareness Enhancement (SPAE), improving the LLM's capability to capture both relative and absolute sequential dependencies in long interaction sequences. Extensive experiments on real-world datasets demonstrate the effectiveness and efficiency of Speeder. Speeder increases training speed to 250% of the original while reducing inference time to 25% on the Amazon dataset.

cs.IR↗

Unexpected type-II multiferroic phase in GdMnO3 under high magnetic fields

Perovskite manganites with small A-site ions, as the first and canonical branch of type-II multiferroics, are ideal systems to exhibit magnetism-induced ferroelectricity. Despite their established magnetoelectric phase diagrams under low magnetic fields, here an unidentified phase with a large magnetism-induced polarization (up to 1500 μC/m2) is revealed in GdMnO3 under high magnetic fields up to 60 T. Based on multiprobe experiments, a complete phase diagram is constructed with successive polar-nonpolar-polar-nonpolar transitions. Such a nonmonotonic evolution is well mimicked by model simulation, while the spin-lattice coupling is the key ingredient for the reentrant ferroelectric phase.

cond-mat.mtrl-sci↗

Explainable Molecular Property Prediction: Aligning Chemical Concepts with Predictions via Language Models

Providing explainable molecular property predictions is critical for many scientific domains, such as drug discovery and material science. Though transformer-based language models have shown great potential in accurate molecular property prediction, they neither provide chemically meaningful explanations nor faithfully reveal the molecular structure-property relationships. In this work, we develop a framework for explainable molecular property prediction based on language models, dubbed as Lamole, which can provide chemical concepts-aligned explanations. We take a string-based molecular representation -- Group SELFIES -- as input tokens to pretrain and fine-tune our Lamole, as it provides chemically meaningful semantics. By disentangling the information flows of Lamole, we propose combining self-attention weights and gradients for better quantification of each chemically meaningful substructure's impact on the model's output. To make the explanations more faithfully respect the structure-property relationship, we then carefully craft a marginal loss to explicitly optimize the explanations to be able to align with the chemists' annotations. We bridge the manifold hypothesis with the elaborated marginal loss to prove that the loss can align the explanations with the tangent space of the data manifold, leading to concept-aligned explanations. Experimental results over six mutagenicity datasets and one hepatotoxicity dataset demonstrate Lamole can achieve comparable classification accuracy and boost the explanation accuracy by up to 14.3%, being the state-of-the-art in explainable molecular property prediction.

cs.LG↗

Crystalline Material Discovery in the Era of Artificial Intelligence

Crystalline materials, with symmetrical and periodic structures, exhibit a wide spectrum of properties and have been widely used in numerous applications across electronics, energy, and beyond. For crystalline materials discovery, traditional experimental and computational approaches are time-consuming and expensive. In these years, thanks to the explosive amount of crystalline materials data, great interest has been given to data-driven materials discovery. Particularly, recent advancements have exploited the expressive representation ability of deep learning to model the highly complex atomic systems within crystalline materials, opening up new avenues for fast and accurate materials discovery. These works typically focus on four types of tasks, including physicochemical property prediction, crystalline material synthesis, aiding characterization, and accelerating theoretical computations. Despite the remarkable progress, there is still a lack of systematic investigation to summarize their distinctions and limitations. To fill this gap, we systematically investigated the progress made in recent years. We first introduce several data representations of the crystalline materials. Based on the representations, we summarize various fundamental deep learning models and their tailored usages in various material discovery tasks. Finally, we highlight the remaining challenges and propose future directions.

cs.CE↗

Performance Bounds of Joint Detection with Kalman Filtering and Channel Decoding for Wireless Networked Control Systems

The joint detection uses Kalman filtering (KF) to estimate the prior probability of control outputs to assist channel decoding. In this paper, we regard the joint detection as maximum a posteriori (MAP) decoding and derive the lower and upper bounds based on the pairwise error probability considering system interference, quantization interval, and weight distribution. We first derive the limiting bounds as the signal-to-noise ratio (SNR) goes to infinity and the system interference goes to zero. Then, we construct an infinite-state Markov chain to describe the consecutive packet losses of the control systems to derive the MAP bounds. Finally, the MAP bounds are approximated as the bounds of the transition probability from the state with no packet loss to the state with consecutive single packet loss. The simulation results show that the MAP performance of $\left(64,16\right)$ polar code and 16-bit CRC coincides with the limiting upper bound as the SNR increases and has $3.0$dB performance gain compared with the normal approximation of the finite block rate at block error rate $10^{-3}$.

cs.IT↗

Learning Diffusion Policy from Primitive Skills for Robot Manipulation

Diffusion policies (DP) have recently shown great promise for generating actions in robotic manipulation. However, existing approaches often rely on global instructions to produce short-term control signals, which can result in misalignment in action generation. We conjecture that the primitive skills, referred to as fine-grained, short-horizon manipulations, such as ``move up'' and ``open the gripper'', provide a more intuitive and effective interface for robot learning. To bridge this gap, we propose SDP, a skill-conditioned DP that integrates interpretable skill learning with conditional action planning. SDP abstracts eight reusable primitive skills across tasks and employs a vision-language model to extract discrete representations from visual observations and language instructions. Based on them, a lightweight router network is designed to assign a desired primitive skill for each state, which helps construct a single-skill policy to generate skill-aligned actions. By decomposing complex tasks into a sequence of primitive skills and selecting a single-skill policy, SDP ensures skill-consistent behavior across diverse tasks. Extensive experiments on two challenging simulation benchmarks and real-world robot deployments demonstrate that SDP consistently outperforms SOTA methods, providing a new paradigm for skill-based robot learning with diffusion policies.

cs.RO↗

Interfacial Polarons Driven by Charge Transfer In WSe2/Cuprate Superconductor Systems

Understanding the electronic properties of doped copper-oxygen planes remains a significant challenge in condensed matter physics and is crucial to unraveling the mechanisms behind high-temperature superconductivity in cuprates. Recently, the observation of charge transfer and interfacial polarons in superconducting interface has aroused extensive research interest. However, experimental data to investigate charge transfer on the CuO2 plane and the presence of polarons are still missing. Here we conduct extensive research on the optical and electronic properties of two-dimensional material supported on copper-based superconductors. Unlike monolayer-WSe2 on other substrates, monolayer-WSe2 on La1.85Sr0.15CuO4 (WSe2/LSCO) produces a special band structure. Using high-resolution spectroscopic ellipsometry and density functional theory calculation methods, the special electronic structure can be attributed to the formation of the interfacial small polaron at the WSe2/LSCO interface which is driven by charge transfer between the CuO2 plane of the cuprate superconductor and WSe2. In addition, the structural phase transition of the LSCO substrate was observed to reduce the electron-hole (e-h) interaction of WSe2. These findings may spur future investigations on the effect of the interfacial polaron on the superconductivity of cuprates, and highlight the significant influence of interface effects on the electronic structure of WSe2 films. It provides an effective method to further explore the intrinsic relationship between interfacial polarons and superconductivity.

cond-mat.supr-con↗

Iterative Joint Detection of Kalman Filter and Channel Decoder for Sensor-to-Controller Link in Wireless Networked Control Systems

In this letter, we propose an iterative joint detection algorithm of Kalman filter (KF) and channel decoder for the sensor-to-controller link of wireless networked control systems, which utilizes the prior information of control system to improve control and communication performance. In this algorithm, we first use the KF to estimate the probability density of the control system outputs and calculate the prior probability of received signals to assist decoder. Then, the possible outputs of the control system are traversed to update the prior probability in order to implement iterative detection. The simulation results show that the prior information and the iterative structure can reduce the block error rate performance of communications while improving the root mean square error performance of controls.

cs.IT↗

Coalescence of multiple topological orders in quasi-one-dimensional bismuth halide chains

Topology is being widely adopted to understand and to categorize quantum matter in modern physics. The nexus of topology orders, which engenders distinct quantum phases with benefits to both fundamental research and practical applications for future quantum devices, can be driven by topological phase transition through modulating intrinsic or extrinsic ordering parameters. The conjoined topology, however, is still elusive in experiments due to the lack of suitable material platforms. Here we use scanning tunneling microscopy, angle-resolved photoemission spectroscopy, and theoretical calculations to investigate the doping-driven band structure evolution of a quasi-one-dimensional material system, bismuth halide, which contains rare multiple band inversions in two time-reversal-invariant momenta. According to the unique bulk-boundary correspondence in topological matter, we unveil a composite topological phase, the coexistence of a strong topological phase and a high-order topological phase, evoked by the band inversion associated with topological phase transition in this system. Moreover, we reveal multiple-stage topological phase transitions by varying the halide element ratio: from high-order topology to weak topology, the unusual dual topology, and trivial/weak topology subsequently. Our results not only realize an ideal material platform with composite topology, but also provide an insightful pathway to establish abundant topological phases in the framework of band inversion theory.

cond-mat.mtrl-sci↗

Field manipulation of Weyl modes in an ideal Dirac semimetal

The emergent Weyl modes with the broken time-reversal symmetry or inversion symmetry provide large Berry curvature and chirality to carriers, offering the realistic platforms to explore topology of electrons in three-dimensional systems. However, the reversal transition between different types of Weyl modes in a single material, which is of particular interest in the fundamental research in Weyl physics and potential application in spintronics, is scarcely achieved due to restriction of inborn symmetry in crystals. Here, by tuning the direction and strength of magnetic field in an ideal Dirac semimetal, Bi4(Br0.27I0.73)4, we report the realization of multiple Weyl modes, including gapped Weyl mode, Weyl nodal ring, and coupled Weyl mode by the magnetoresistivity measurements and electronic structure calculations. Specifically, under a magnetic field with broken mirror symmetry, anomalous Hall effect with step feature results from the large Berry curvature for the gapped Weyl mode. A prominent negative magnetoresistivity is observed at low magnetic field with preserved mirror symmetry and disappears at high magnetic field, which is correlated to the chiral anomaly and its annihilation of Weyl nodal ring, respectively. Our findings reveal distinct Weyl modes under the intertwined crystal symmetry and time-reversal breaking, laying the foundation of manipulating multiple Weyl modes in chiral spintronic network.

cond-mat.mes-hall↗

StrokeNet: Unveiling How to Learn Fine-Grained Interactions in Online Handwritten Stroke Classification

Stroke classification remains challenging due to variations in writing style, ambiguous content, and dynamic writing positions. The core challenge in stroke classification is modeling the semantic relationships between strokes. Our observations indicate that stroke interactions are typically localized, making it difficult for existing deep learning methods to capture such fine-grained relationships. Although viewing strokes from a point-level perspective can address this issue, it introduces redundancy. However, by selecting reference points and using their sequential order to represent strokes in a fine-grained manner, this problem can be effectively solved. This insight inspired StrokeNet, a novel network architecture encoding strokes as reference pair representations (points + feature vectors), where reference points enable spatial queries and features mediate interaction modeling. Specifically, we dynamically select reference points for each stroke and sequence them, employing an Inline Sequence Attention (ISA) module to construct contextual features. To capture spatial feature interactions, we devised a Cross-Ellipse Query (CEQ) mechanism that clusters reference points and extracts features across varying spatial scales. Finally, a joint optimization framework simultaneously predicts stroke categories via reference points regression and adjacent stroke semantic transition modeling through an Auxiliary Branch (Aux-Branch). Experimental results show that our method achieves state-of-the-art performance on multiple public online handwritten datasets. Notably, on the CASIA-onDo dataset, the accuracy improves from 93.81$\%$ to 95.54$\%$, demonstrating the effectiveness and robustness of our approach.

cs.CV↗

Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey

Learning-based 3D reconstruction has emerged as a transformative technique in autonomous driving, enabling precise modeling of environments through advanced neural representations. It has inspired pioneering solutions for vital tasks in autonomous driving, such as dense mapping and closed-loop simulation, as well as comprehensive scene feature for driving scene understanding and reasoning. Given the rapid growth in related research, this survey provides a comprehensive review of both technical evolutions and practical applications in autonomous driving. We begin with an introduction to the preliminaries of learning-based 3D reconstruction to provide a solid technical background foundation, then progress to a rigorous, multi-dimensional examination of cutting-edge methodologies, systematically organized according to the distinctive technical requirements and fundamental challenges of autonomous driving. Through analyzing and summarizing development trends and cutting-edge research, we identify existing technical challenges, along with insufficient disclosure of on-board validation and safety verification details in the current literature, and ultimately suggest potential directions to guide future studies.

cs.CV↗

Strings at the Tip of the Cone and Black Hole Entropy From the Worldsheet: Part I

We study the nonlinear sigma model (NLSM) worldsheet action describing the motion of closed bosonic strings in the target space of a two-dimensional (2D) flat cone in polar coordinates. We calculate the cylinder partition function. We first place the cylindrical worldsheet on a rectangular lattice before taking the continuum limit. We find an integer number of string configurations on the worldsheet, which we call line defects, that run from one boundary of the cylinder to the other. We insert two sources (conical defects) at each boundary and fix the two ends of the line defect by Dirichlet boundary conditions to a point $r_c$ in target space. In target space, a line defect appears as an Susskind\&Uglum-type open string ending on $r_c$. We compute the semiclassical contribution to the off-shell cylinder amplitude by saddle point approximation. The amplitude has an interesting infrared (IR) divergence structure that depends on the given range of the cone angle. We then compute the entropy by varying the cone angle. In a particular renormalization scheme that relates the ultraviolet (UV) and to the infrared (IR) limits of the modulus integral, we find the entropy to be free of IR divergences but linearly dependent on the radial cutoff. We argue that our calculation provides a well-defined state on a constant Euclidean-time slice directly from the string worldsheet. We also study the 2D flat cone NLSM without discretization. We compute the entropy from the off-shell stationary action and show it is finite in each winding sector $W$ with a maximum at $r_c=\sqrt{α'}/|W|$. After summing over all winding sectors, it still has a finite maximum in the UV limit but for $r_c >0$.

hep-th↗

End-to-end Autonomous Vehicle Following System using Monocular Fisheye Camera

The increase in vehicle ownership has led to increased traffic congestion, more accidents, and higher carbon emissions. Vehicle platooning is a promising solution to address these issues by improving road capacity and reducing fuel consumption. However, existing platooning systems face challenges such as reliance on lane markings and expensive high-precision sensors, which limits their general applicability. To address these issues, we propose a vehicle following framework that expands its capability from restricted scenarios to general scenario applications using only a camera. This is achieved through our newly proposed end-to-end method, which improves overall driving performance. The method incorporates a semantic mask to address causal confusion in multi-frame data fusion. Additionally, we introduce a dynamic sampling mechanism to precisely track the trajectories of preceding vehicles. Extensive closed-loop validation in real-world vehicle experiments demonstrates the system's ability to follow vehicles in various scenarios, outperforming traditional multi-stage algorithms. This makes it a promising solution for cost-effective autonomous vehicle platooning. A complete real-world vehicle experiment is available at https://youtu.be/zL1bcVb9kqQ.

cs.RO↗

Double-Ended Palindromic Trees in Linear Time

The palindromic tree (a.k.a. eertree) is a data structure that provides access to all palindromic substrings of a string. In this paper, we propose a dynamic version of eertree, called double-ended eertree, which supports online operations on the stored string, including double-ended queue operations, counting distinct palindromic substrings, and finding the longest palindromic prefix/suffix. At the heart of our construction, we identify a new class of substring occurrences, called surfaces, that are palindromic substring occurrences that are neither prefixes nor suffixes of any other palindromic substring occurrences, which is of independent interest. Surfaces characterize the link structure of all palindromic substrings in the eertree, thereby allowing a linear-time implementation of double-ended eertrees through a linear-time maintenance of surfaces.

cs.DS↗

FedeCouple: Fine-Grained Balancing of Global-Generalization and Local-Adaptability in Federated Learning

In privacy-preserving mobile network transmission scenarios with heterogeneous client data, personalized federated learning methods that decouple feature extractors and classifiers have demonstrated notable advantages in enhancing learning capability. However, many existing approaches primarily focus on feature space consistency and classification personalization during local training, often neglecting the local adaptability of the extractor and the global generalization of the classifier. This oversight results in insufficient coordination and weak coupling between the components, ultimately degrading the overall model performance. To address this challenge, we propose FedeCouple, a federated learning method that balances global generalization and local adaptability at a fine-grained level. Our approach jointly learns global and local feature representations while employing dynamic knowledge distillation to enhance the generalization of personalized classifiers. We further introduce anchors to refine the feature space; their strict locality and non-transmission inherently preserve privacy and reduce communication overhead. Furthermore, we provide a theoretical analysis proving that FedeCouple converges for nonconvex objectives, with iterates approaching a stationary point as the number of communication rounds increases. Extensive experiments conducted on five image-classification datasets demonstrate that FedeCouple consistently outperforms nine baseline methods in effectiveness, stability, scalability, and security. Notably, in experiments evaluating effectiveness, FedeCouple surpasses the best baseline by a significant margin of 4.3%.

cs.CV↗

Stochastic Momentum Methods for Non-smooth Non-Convex Finite-Sum Coupled Compositional Optimization

Finite-sum Coupled Compositional Optimization (FCCO), characterized by its coupled compositional objective structure, emerges as an important optimization paradigm for addressing a wide range of machine learning problems. In this paper, we focus on a challenging class of non-convex non-smooth FCCO, where the outer functions are non-smooth weakly convex or convex and the inner functions are smooth or weakly convex. Existing state-of-the-art result face two key limitations: (1) a high iteration complexity of $O(1/ε^6)$ under the assumption that the stochastic inner functions are Lipschitz continuous in expectation; (2) reliance on vanilla SGD-type updates, which are not suitable for deep learning applications. Our main contributions are two fold: (i) We propose stochastic momentum methods tailored for non-smooth FCCO that come with provable convergence guarantees; (ii) We establish a new state-of-the-art iteration complexity of $O(1/ε^5)$. Moreover, we apply our algorithms to multiple inequality constrained non-convex optimization problems involving smooth or weakly convex functional inequality constraints. By optimizing a smoothed hinge penalty based formulation, we achieve a new state-of-the-art complexity of $O(1/ε^5)$ for finding an (nearly) $ε$-level KKT solution. Experiments on three tasks demonstrate the effectiveness of the proposed algorithms.

cs.LG↗