arXiv Science⌕ Search

arXiv subjects

Xiao Lin

Publications and source records attributed to Xiao Lin.

At least 73 records · Page 4Linked to original sources

Personalized Tree-Based Progressive Regression Model for Watch-Time Prediction in Short Video Recommendation

In online video platforms, accurate watch time prediction has become a fundamental and challenging problem in video recommendation. Previous research has revealed that the accuracy of watch time prediction highly depends on both the transformation of watch-time labels and the decomposition of the estimation process. TPM (Tree based Progressive Regression Model) achieves State-of-the-Art performance with a carefully designed and effective decomposition paradigm. TPM discretizes the watch time into several ordinal intervals and organizes them into a binary decision tree, where each node corresponds to a specific interval. At each non-leaf node, a binary classifier is used to determine the specific interval in which the watch time variable most likely falls, based on the prediction outcome at its parent node. The tree structure is central to TPM, as it defines the decomposition of watch time estimation and how ordinal intervals are discretized. However, TPM uses a predefined full binary tree, which may be sub-optimal for two reasons. First, full binary trees imply equal partitioning of the watch time space, which may fail to capture the complexity of real-world distributions. Second, rather than relying on a fixed global structure, we advocate for a personalized, data-driven tree that can be learned end-to-end. Thus, we propose PTPM to enable highly personalized decomposition of watch estimation with better efficacy and efficiency. Moreover, we show that TPM suffers from selection bias due to conditional modeling and propose a simple solution. We conduct extensive experiments on offline datasets and online environments. Offline results show improved watch time accuracy, and online A/B tests further validate the effectiveness of our framework. PTPM has been fully deployed in core traffic scenarios and now serves over 400 million users daily.

cs.IR↗

Thermomodulated intrinsic Josephson effect in Kagome CsV3Sb5

Superconducting chiral domains associated with a time-reversal symmetry-breaking order parameter have garnered significant attention in Kagome systems. In this work, we demonstrate both the intrinsic direct-current and alternating-current Josephson effects in the nanoplates of the vanadium-based Kagome material CsV3Sb5, as evidenced by Fraunhofer-like patterns and Shapiro steps. Moreover, both the Fraunhofer-like patterns and Shapiro steps are modulated by thermal cycling, suggesting that the Josephson effects arise from dynamic superconducting domains. These findings may provide new insights into chiral superconductivity in CsV3Sb5 and highlight the potential of these intrinsic Josephson junctions for applications in chiral superconductor based quantum devices.

cond-mat.supr-con↗

Orbital-selective charge transfer drives two-step negative thermal expansion structural transitions in PbTa2Se4

The negative thermal expansion (NTE) effect has been found generally combined with structural phase transitions. However, the charge and orbital freedoms of the NTE has not been well studied. This study employs angle-resolved photoemission spectroscopy and first-principles calculations to elucidate the charge and orbital kinetics of the anomalous two-step negative thermal expansion structural phase transitions in PbTa2Se4. As the temperature decreases, each transition undergoes a similar block-layer sliding, although the charge transfer behaviors differ significantly. During the first transition, charge is mainly transferred from the Pb 6pz orbital to an M-shaped band below the Fermi level, barely altering the Fermi surface. In contrast, the second transition involves modifications to both the Fermi surface and charge-transfer orbitals, with charge selectively transferred from Pb 6px/py orbitals to Ta 5dz2 orbitals and a decrease of the Fermi pockets formed by Pb 6px/py orbitals. Furthermore, a small pressure can easily tune the base structure phase among the three phases and the corresponding superconductivity. Therefore, our findings reveal that the orbital-selective charge transfer drives the unusual structure transition in PbTa2Se4, offering new insights into the NTE mechanisms and providing a unique window to study the pressure-tuned superconductivity in this metal-intercalated transition chalcogenides.

cond-mat.mtrl-sci↗

CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation

Category-level object pose estimation aims to recover the rotation, translation and size of unseen instances within predefined categories. In this task, deep neural network-based methods have demonstrated remarkable performance. However, previous studies show they suffer from spurious correlations raised by "unclean" confounders in models, hindering their performance on novel instances with significant variations. To address this issue, we propose CleanPose, a novel approach integrating causal learning and knowledge distillation to enhance category-level pose estimation. To mitigate the negative effect of unobserved confounders, we develop a causal inference module based on front-door adjustment, which promotes unbiased estimation by reducing potential spurious correlations. Additionally, to further improve generalization ability, we devise a residual-based knowledge distillation method that has proven effective in providing comprehensive category information guidance. Extensive experiments across multiple benchmarks (REAL275, CAMERA25 and HouseCat6D) hightlight the superiority of proposed CleanPose over state-of-the-art methods. Code will be available at https://github.com/chrislin0621/CleanPose.

cs.CV↗

AirLine: Efficient Learnable Line Detection with Local Edge Voting

Line detection is widely used in many robotic tasks such as scene recognition, 3D reconstruction, and simultaneous localization and mapping (SLAM). Compared to points, lines can provide both low-level and high-level geometrical information for downstream tasks. In this paper, we propose a novel learnable edge-based line detection algorithm, AirLine, which can be applied to various tasks. In contrast to existing learnable endpoint-based methods, which are sensitive to the geometrical condition of environments, AirLine can extract line segments directly from edges, resulting in a better generalization ability for unseen environments. To balance efficiency and accuracy, we introduce a region-grow algorithm and a local edge voting scheme for line parameterization. To the best of our knowledge, AirLine is one of the first learnable edge-based line detection methods. Our extensive experiments have shown that it retains state-of-the-art-level precision, yet with a 3 to 80 times runtime acceleration compared to other learning-based methods, which is critical for low-power robots.

cs.RO↗

Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting

Time-series forecasting plays a critical role in many real-world applications. Although increasingly powerful models have been developed and achieved superior results on benchmark datasets, through a fine-grained sample-level inspection, we find that (i) no single model consistently outperforms others across different test samples, but instead (ii) each model excels in specific cases. These findings prompt us to explore how to adaptively leverage the distinct strengths of various forecasting models for different samples. We introduce TimeFuse, a framework for collective time-series forecasting with sample-level adaptive fusion of heterogeneous models. TimeFuse utilizes meta-features to characterize input time series and trains a learnable fusor to predict optimal model fusion weights for any given input. The fusor can leverage samples from diverse datasets for joint training, allowing it to adapt to a wide variety of temporal patterns and thus generalize to new inputs, even from unseen datasets. Extensive experiments demonstrate the effectiveness of TimeFuse in various long-/short-term forecasting tasks, achieving near-universal improvement over the state-of-the-art individual models. Code is available at https://github.com/ZhiningLiu1998/TimeFuse.

cs.LG↗

MORALISE: A Structured Benchmark for Moral Alignment in Visual Language Models

Warning: This paper contains examples of harmful language and images. Reader discretion is advised. Recently, vision-language models have demonstrated increasing influence in morally sensitive domains such as autonomous driving and medical analysis, owing to their powerful multimodal reasoning capabilities. As these models are deployed in high-stakes real-world applications, it is of paramount importance to ensure that their outputs align with human moral values and remain within moral boundaries. However, existing work on moral alignment either focuses solely on textual modalities or relies heavily on AI-generated images, leading to distributional biases and reduced realism. To overcome these limitations, we introduce MORALISE, a comprehensive benchmark for evaluating the moral alignment of vision-language models (VLMs) using diverse, expert-verified real-world data. We begin by proposing a comprehensive taxonomy of 13 moral topics grounded in Turiel's Domain Theory, spanning the personal, interpersonal, and societal moral domains encountered in everyday life. Built on this framework, we manually curate 2,481 high-quality image-text pairs, each annotated with two fine-grained labels: (1) topic annotation, identifying the violated moral topic(s), and (2) modality annotation, indicating whether the violation arises from the image or the text. For evaluation, we encompass two tasks, \textit{moral judgment} and \textit{moral norm attribution}, to assess models' awareness of moral violations and their reasoning ability on morally salient content. Extensive experiments on 19 popular open- and closed-source VLMs show that MORALISE poses a significant challenge, revealing persistent moral limitations in current state-of-the-art models. The full benchmark is publicly available at https://huggingface.co/datasets/Ze1025/MORALISE.

cs.CV↗

ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method

Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format of time series, recording the climate features, geolocation, time attributes, etc. Recently, much research attention has been paid to the climate benchmarks. In addition to the most common task of weather forecasting, several pioneering benchmark works are proposed for extending the modality, such as domain-specific applications like tropical cyclone intensity prediction and flash flood damage estimation, or climate statement and confidence level in the format of natural language. To further motivate the artificial general intelligence development for climate science, in this paper, we first contribute a multi-modal climate benchmark, i.e., ClimateBench-M, which aligns (1) the time series climate data from ERA5, (2) extreme weather events data from NOAA, and (3) satellite image data from NASA HLS based on a unified spatial-temporal granularity. Second, under each data modality, we also propose a simple but strong generative method that could produce competitive performance in weather forecasting, thunderstorm alerts, and crop segmentation tasks in the proposed ClimateBench-M. The data and code of ClimateBench-M are publicly available at https://github.com/iDEA-iSAIL-Lab-UIUC/ClimateBench-M.

cs.LG↗

Anomalous Maxwell-Garnett theory for photonic time crystals

Maxwell-Garnett theory, dating back to James Clerk Maxwell-Garnett's foundational work in 1904, provides a simple yet powerful framework to describe the inhomogeneous structure as an effective homogeneous medium, which significantly reduces the overall complexity of analysis, calculation, and design. As such, the Maxwell-Garnett theory enables many practical applications in diverse realms, ranging from photonics, acoustics, mechanics, thermodynamics, to material science. It has long been thought that the Maxwell-Garnett theory of light in impedance-mismatched periodic structures is valid only within the long-wavelength limit, necessitating either the temporal or spatial period of light to be much larger than that of structures. Here, we break this long-held belief by revealing an anomalous Maxwell-Garnett theory for impedance-mismatched photonic time crystals beyond this long-wavelength limit. The key to this anomaly lies in the Fabry-Perot resonance. We discover that under the Fabry-Pérot resonance, the impedance-mismatched photonic time crystal could be essentially equivalent to a homogeneous temporal slab simultaneously at specific discrete wavelengths, despite the temporal period of these light being comparable to or even much smaller than that of photonic time crystals.

physics.optics↗

CATS: Mitigating Correlation Shift for Multivariate Time Series Classification

Unsupervised Domain Adaptation (UDA) leverages labeled source data to train models for unlabeled target data. Given the prevalence of multivariate time series (MTS) data across various domains, the UDA task for MTS classification has emerged as a critical challenge. However, for MTS data, correlations between variables often vary across domains, whereas most existing UDA works for MTS classification have overlooked this essential characteristic. To bridge this gap, we introduce a novel domain shift, {\em correlation shift}, measuring domain differences in multivariate correlation. To mitigate correlation shift, we propose a scalable and parameter-efficient \underline{C}orrelation \underline{A}dapter for M\underline{TS} (CATS). Designed as a plug-and-play technique compatible with various Transformer variants, CATS employs temporal convolution to capture local temporal patterns and a graph attention module to model the changing multivariate correlation. The adapter reweights the target correlations to align the source correlations with a theoretically guaranteed precision. A correlation alignment loss is further proposed to mitigate correlation shift, bypassing the alignment challenge from the non-i.i.d. nature of MTS data. Extensive experiments on four real-world datasets demonstrate that (1) compared with vanilla Transformer-based models, CATS increases over $10\%$ average accuracy while only adding around $1\%$ parameters, and (2) all Transformer variants equipped with CATS either reach or surpass state-of-the-art baselines.

cs.LG↗

TeleLoRA: Teleporting Model-Specific Alignment Across LLMs

Mitigating Trojans in Large Language Models (LLMs) is one of many tasks where alignment data is LLM specific, as different LLMs have different Trojan triggers and trigger behaviors to be removed. In this paper, we introduce TeleLoRA (Teleporting Low-Rank Adaptation), a novel framework that synergizes model-specific alignment data across multiple LLMs to enable zero-shot Trojan mitigation on unseen LLMs without alignment data. TeleLoRA learns a unified generator of LoRA adapter weights by leveraging local activation information across multiple LLMs. This generator is designed to be permutation symmetric to generalize across models with different architectures and sizes. We optimize the model design for memory efficiency, making it feasible to learn with large-scale LLMs with minimal computational resources. Experiments on LLM Trojan mitigation benchmarks demonstrate that TeleLoRA effectively reduces attack success rates while preserving the benign performance of the models.

cs.LG↗

General-Purpose Aerial Intelligent Agents Empowered by Large Language Models

The emergence of large language models (LLMs) opens new frontiers for unmanned aerial vehicle (UAVs), yet existing systems remain confined to predefined tasks due to hardware-software co-design challenges. This paper presents the first aerial intelligent agent capable of open-world task execution through tight integration of LLM-based reasoning and robotic autonomy. Our hardware-software co-designed system addresses two fundamental limitations: (1) Onboard LLM operation via an edge-optimized computing platform, achieving 5-6 tokens/sec inference for 14B-parameter models at 220W peak power; (2) A bidirectional cognitive architecture that synergizes slow deliberative planning (LLM task planning) with fast reactive control (state estimation, mapping, obstacle avoidance, and motion planning). Validated through preliminary results using our prototype, the system demonstrates reliable task planning and scene understanding in communication-constrained environments, such as sugarcane monitoring, power grid inspection, mine tunnel exploration, and biological observation applications. This work establishes a novel framework for embodied aerial artificial intelligence, bridging the gap between task planning and robotic autonomy in open environments.

cs.RO↗

Rapid morphology characterization of two-dimensional TMDs and lateral heterostructures based on deep learning

Two-dimensional (2D) materials and heterostructures exhibit unique physical properties, necessitating efficient and accurate characterization methods. Leveraging advancements in artificial intelligence, we introduce a deep learning-based method for efficiently characterizing heterostructures and 2D materials, specifically MoS2-MoSe2 lateral heterostructures and MoS2 flakes with varying shapes and thicknesses. By utilizing YOLO models, we achieve an accuracy rate of over 94.67% in identifying these materials. Additionally, we explore the application of transfer learning across different materials, which further enhances model performance. This model exhibits robust generalization and anti-interference ability, ensuring reliable results in diverse scenarios. To facilitate practical use, we have developed an application that enables real-time analysis directly from optical microscope images, making the process significantly faster and more cost-effective than traditional methods. This deep learning-driven approach represents a promising tool for the rapid and accurate characterization of 2D materials, opening new avenues for research and development in material science.

cs.LG↗

UIFace: Unleashing Inherent Model Capabilities to Enhance Intra-Class Diversity in Synthetic Face Recognition

Face recognition (FR) stands as one of the most crucial applications in computer vision. The accuracy of FR models has significantly improved in recent years due to the availability of large-scale human face datasets. However, directly using these datasets can inevitably lead to privacy and legal problems. Generating synthetic data to train FR models is a feasible solution to circumvent these issues. While existing synthetic-based face recognition methods have made significant progress in generating identity-preserving images, they are severely plagued by context overfitting, resulting in a lack of intra-class diversity of generated images and poor face recognition performance. In this paper, we propose a framework to Unleash Inherent capability of the model to enhance intra-class diversity for synthetic face recognition, shortened as UIFace. Our framework first trains a diffusion model that can perform sampling conditioned on either identity contexts or a learnable empty context. The former generates identity-preserving images but lacks variations, while the latter exploits the model's intrinsic ability to synthesize intra-class-diversified images but with random identities. Then we adopt a novel two-stage sampling strategy during inference to fully leverage the strengths of both types of contexts, resulting in images that are diverse as well as identitypreserving. Moreover, an attention injection module is introduced to further augment the intra-class variations by utilizing attention maps from the empty context to guide the sampling process in ID-conditioned generation. Experiments show that our method significantly surpasses previous approaches with even less training data and half the size of synthetic dataset. The proposed UIFace even achieves comparable performance with FR models trained on real datasets when we further increase the number of synthetic identities.

cs.CV↗

AV$_3$Sb$_5$ kagome superconductors: a review with transport measurements

Kagome systems have garnered considerable attention due to the unique features of the sublattice structure and band topology. The recently discovered kagome metals AV$_3$Sb$_5$ (where A = K, Rb, Cs) host a rich array of symmetry-breaking phases, including exotic charge density waves (CDW), electronic nematicity, pair density waves (PDW) and superconductivity. Despite extensive experimental and theoretical investigations into the diverse phases, several key issues remain contentious, such as a solid clarification of the time-reversal symmetry breaking (TRS-breaking) in the CDW order and its implications for the nature of superconducting (SC) pairing symmetry. This review aims to shed light on the transport properties of these intertwined phases, emphasizing the pivotal role that transport measurements play in uncovering the non-trivial quantum states of matter.

cond-mat.supr-con↗

Fluid Antenna Multiple Access Assisted Integrated Data and Energy Transfer: Outage and Multiplexing Gain Analysis

Fluid antenna multiple access (FAMA) exploits the spatial opportunities in wireless channels to overcome multiuser interference by position (a.k.a.~port) switching, which can achieve better performance compared to traditional fixed multiple-input multiple-output (MIMO) systems. Additionally, integrated data and energy transfer (IDET) is capable of providing both wireless data transfer (WDT) and wireless energy transfer (WET) services towards low-power devices. In this paper, a FAMA-assisted IDET system is investigated, where a base station (BS) equipped with $N$ fixed antennas provides dedicated IDET services towards $N$ user equipments (UEs). Each UE is equipped with a single fluid antenna, while the power splitting (PS) approach is conceived for coordinating WDT and WET. The outage probabilities of both WDT and WET are derived and approximated into closed-forms, where the fluid antenna (FA) at each UE selects the optimal port to achieve the maximum signal-to-interference-plus-noise ratio (SINR) or the energy harvesting power (EHP). The IDET outage probabilities are defined and subsequently derived and approximated into closed-forms. Further, multiplexing gains of the proposed system are defined and analyzed to evaluate the performace. Numerical results validate the theoretical analysis, while also illustrate that the trade-off is achieved between WDT and WET performance by exploiting different port selection strategies. Furthermore, the number of UEs should be optimized to achieve better IDET performance of the system.

cs.IT↗

Superconducting Diode Effects: Mechanisms, Materials and Applications

Superconducting diode effects (SDEs) generally emerge in superconducting systems where both time-reversal and inversion symmetries are broken, showing nonreciprocal current characteristics: nondissipative in one direction and ohmic in the opposite. Since the discovery of the SDEs by Ando et al. in the noncentrosymmetric superconductor [Nb/V/Ta]n in 2020, notable progress has been achieved on both the theoretical and experimental fronts. It has been proposed that intrinsic SDEs are closely linked to various exotic superconducting states, such as the Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state, topological superconductivity, and chiral superconductivity. Recently, SDEs have emerged as important experimental tools for detecting symmetry breaking in exotic superconducting states. This advancement not only enhances our understanding of the fundamental nature of SDEs but also opens new possibilities for their applications in superconducting physics and related fields. This review focuses on the recent experimental progress in the observation of the SDEs and discusses their primary mechanisms from the perspective of material properties and symmetry breaking. Finally, we summarize the observed rectification efficiency of SDE devices and discuss future research directions in this rapidly developing field.

cond-mat.supr-con↗

SAM-LAD: Segment Anything Model Meets Zero-Shot Logic Anomaly Detection

Visual anomaly detection is vital in real-world applications, such as industrial defect detection and medical diagnosis. However, most existing methods focus on local structural anomalies and fail to detect higher-level functional anomalies under logical conditions. Although recent studies have explored logical anomaly detection, they can only address simple anomalies like missing or addition and show poor generalizability due to being heavily data-driven. To fill this gap, we propose SAM-LAD, a zero-shot, plug-and-play framework for logical anomaly detection in any scene. First, we obtain a query image's feature map using a pre-trained backbone. Simultaneously, we retrieve the reference images and their corresponding feature maps via the nearest neighbor search of the query image. Then, we introduce the Segment Anything Model (SAM) to obtain object masks of the query and reference images. Each object mask is multiplied with the entire image's feature map to obtain object feature maps. Next, an Object Matching Model (OMM) is proposed to match objects in the query and reference images. To facilitate object matching, we further propose a Dynamic Channel Graph Attention (DCGA) module, treating each object as a keypoint and converting its feature maps into feature vectors. Finally, based on the object matching relations, an Anomaly Measurement Model (AMM) is proposed to detect objects with logical anomalies. Structural anomalies in the objects can also be detected. We validate our proposed SAM-LAD using various benchmarks, including industrial datasets (MVTec Loco AD, MVTec AD), and the logical dataset (DigitAnatomy). Extensive experimental results demonstrate that SAM-LAD outperforms existing SoTA methods, particularly in detecting logical anomalies.

cs.CV↗