arXiv Science⌕ Search

arXiv subjects

Yang Chen

Publications and source records attributed to Yang Chen.

At least 271 records · Page 15Linked to original sources

AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses

Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Traditional tools for knowledge acquisition are reactive, relying on user initiative and limiting their ability to uncover hidden interests. Through formative studies, we introduce AiGet, a proactive AI assistant integrated with AR smart glasses, designed to seamlessly embed informal learning into low-demand daily activities (e.g., casual walking and shopping). AiGet analyzes real-time user gaze patterns, environmental context, and user profiles, leveraging large language models to deliver personalized, context-aware knowledge with low disruption to primary tasks. In-lab evaluations and real-world testing, including continued use over multiple days, demonstrate AiGet's effectiveness in uncovering overlooked yet surprising interests, enhancing primary task enjoyment, reviving curiosity, and deepening connections with the environment. We further propose design guidelines for AI-assisted informal learning, focused on transforming everyday moments into enriching learning experiences.

cs.HC↗

Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay Perspective

Direct Preference Optimization (DPO) has gained attention as an efficient alternative to reinforcement learning from human feedback (RLHF) for aligning large language models (LLMs) with human preferences. Despite its advantages, DPO suffers from a length bias, generating responses longer than those from the reference model. Existing solutions like SimPO and SamPO address this issue but uniformly treat the contribution of rewards across sequences, overlooking temporal dynamics. To this end, we propose an enhanced preference optimization method that incorporates a temporal decay factor controlled by a gamma parameter. This dynamic weighting mechanism adjusts the influence of each reward based on its position in the sequence, prioritizing earlier tokens that are more critical for alignment. By adaptively focusing on more relevant feedback, our approach mitigates overfitting to less pertinent data and remains responsive to evolving human preferences. Experimental results on several benchmarks show that our approach consistently outperforms vanilla DPO by 5.9-8.8 points on AlpacaEval 2 and 3.3-9.7 points on Arena-Hard across different model architectures and sizes. Furthermore, additional experiments on mathematical and reasoning benchmarks (MMLU, GSM8K, and MATH) confirm that our method enhances performance without compromising general capabilities. Our codebase would be available at \url{https://github.com/LotuSrc/D2PO}.

cs.CL↗

Transferable and Forecastable User Targeting Foundation Model

User targeting, the process of selecting targeted users from a pool of candidates for non-expert marketers, has garnered substantial attention with the advancements in digital marketing. However, existing user targeting methods encounter two significant challenges: (i) Poor cross-domain and cross-scenario transferability and generalization, and (ii) Insufficient forecastability in real-world applications. These limitations hinder their applicability across diverse industrial scenarios. In this work, we propose FOUND, an industrial-grade, transferable, and forecastable user targeting foundation model. To enhance cross-domain transferability, our framework integrates heterogeneous multi-scenario user data, aligning them with one-sentence targeting demand inputs through contrastive pre-training. For improved forecastability, the text description of each user is derived based on anticipated future behaviors, while user representations are constructed from historical information. Experimental results demonstrate that our approach significantly outperforms existing baselines in cross-domain, real-world user targeting scenarios, showcasing the superior capabilities of FOUND. Moreover, our method has been successfully deployed on the Alipay platform and is widely utilized across various scenarios.

cs.LG↗

Combined Light Excitation and Scanning Gate Microscopy on Heterostructure Nanowire Photovoltaic Devices

Nanoscale optoelectronic components achieve functionality via spatial variation in electronic structure induced by composition, defects, and dopants. To dynamically change the local band alignment and influence defect states, a scanning gate electrode is highly useful. However, this technique is rarely combined with photoexcitation by a controlled external light source. We explore a setup that combines several types of light excitation with high resolution scanning gate and atomic force microscopy (SGM/AFM). We apply the technique to InAs nanowires with an atomic scale defined InP segment, that have attracted considerable attention for studies of hot carrier devices. Using AFM we image the topography of the nanowire device. SGM measurements without light excitation show how current profiles can be influenced by local gating near the InP segment. Modelling of the tip and nanowire can well predict the results based on the axial band structure variation and an asymmetric tip. SGM studies including light excitation are then performed using both a white light LED and laser diodes at 515 and 780nm. Both negative and positive photoconductance can be observed and the combined effect of light excitation and local gating is observed. SGM can then be used to discriminate between effects related to the wire axial compositional structure and surface states. The setup explored in the current work has significant advantages to study optoelectronics at realistic conditions and with rapid turnover.

physics.app-ph↗

Stable Soliton Microcomb Generation in X-cut Lithium Tantalate via Thermal-Assisted Photorefractive Suppression

Chip-based soliton frequency microcombs combine compact size, broad bandwidth, and high coherence, presenting a promising solution for integrated optical telecommunications, precision sensing, and spectroscopy. Recent progress in ferroelectric thin films, particularly thin-film Lithium niobate (LN) and thin-film Lithium tantalate (LT), has significantly advanced electro-optic (EO) modulation and soliton microcombs generation, leveraging their strong third-order nonlinearity and high Pockels coefficients. However, achieving soliton frequency combs in X-cut ferroelectric materials remains challenging due to the competing effects of thermo-optic and photorefractive phenomena. These issues hinder the simultaneous realization of soliton generation and high-speed EO modulation. Here, following the thermal-regulated carrier behaviour and auxiliary-laser-assisted approach, we propose a convenient mechanism to suppress both photorefractive and thermal dragging effect at once, and implement a facile method for soliton formation and its long-term stabilization in integrated X-cut LT microresonators for the first time. The resulting mode-locked states exhibit robust stability against perturbations, enabling new pathways for fully integrated photonic circuits that combine Kerr nonlinearity with high-speed EO functionality.

physics.optics↗

Efficient Reinforcement Learning Through Adaptively Pretrained Visual Encoder

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are task-dependent, preventing effective feature extraction in different settings. To address this issue, recent studies have tried to pretrain encoders with diverse visual inputs in order to improve their performance. However, they rely on existing pretrained encoders without further exploring the impact of pretraining period. In this work, we propose APE: efficient reinforcement learning through Adaptively Pretrained visual Encoder -- a framework that utilizes adaptive augmentation strategy during the pretraining phase and extracts generalizable features with only a few interactions within the task environments in the policy learning period. Experiments are conducted across various domains, including DeepMind Control Suite, Atari Games and Memory Maze benchmarks, to verify the effectiveness of our method. Results show that mainstream RL methods, such as DreamerV3 and DrQ-v2, achieve state-of-the-art performance when equipped with APE. In addition, APE significantly improves the sampling efficiency using only visual inputs during learning, approaching the efficiency of state-based method in several control tasks. These findings demonstrate the potential of adaptive pretraining of encoder in enhancing the generalization ability and efficiency of visual RL algorithms.

cs.CV↗

Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learning

Dense contrastive representation learning (DCRL) has greatly improved the learning efficiency for image-dense prediction tasks, showing its great potential to reduce the large costs of medical image collection and dense annotation. However, the properties of medical images make unreliable correspondence discovery, bringing an open problem of large-scale false positive and negative (FP&N) pairs in DCRL. In this paper, we propose GEoMetric vIsual deNse sImilarity (GEMINI) learning which embeds the homeomorphism prior to DCRL and enables a reliable correspondence discovery for effective dense contrast. We propose a deformable homeomorphism learning (DHL) which models the homeomorphism of medical images and learns to estimate a deformable mapping to predict the pixels' correspondence under topological preservation. It effectively reduces the searching space of pairing and drives an implicit and soft learning of negative pairs via a gradient. We also propose a geometric semantic similarity (GSS) which extracts semantic information in features to measure the alignment degree for the correspondence learning. It will promote the learning efficiency and performance of deformation, constructing positive pairs reliably. We implement two practical variants on two typical representation learning tasks in our experiments. Our promising results on seven datasets which outperform the existing methods show our great superiority. We will release our code on a companion link: https://github.com/YutingHe-list/GEMINI.

cs.CV↗

Gaze-Assisted Human-Centric Domain Adaptation for Cardiac Ultrasound Image Segmentation

Domain adaptation (DA) for cardiac ultrasound image segmentation is clinically significant and valuable. However, previous domain adaptation methods are prone to be affected by the incomplete pseudo-label and low-quality target to source images. Human-centric domain adaptation has great advantages of human cognitive guidance to help model adapt to target domain and reduce reliance on labels. Doctor gaze trajectories contains a large amount of cross-domain human guidance. To leverage gaze information and human cognition for guiding domain adaptation, we propose gaze-assisted human-centric domain adaptation (GAHCDA), which reliably guides the domain adaptation of cardiac ultrasound images. GAHCDA includes following modules: (1) Gaze Augment Alignment (GAA): GAA enables the model to obtain human cognition general features to recognize segmentation target in different domain of cardiac ultrasound images like humans. (2) Gaze Balance Loss (GBL): GBL fused gaze heatmap with outputs which makes the segmentation result structurally closer to the target domain. The experimental results illustrate that our proposed framework is able to segment cardiac ultrasound images more effectively in the target domain than GAN-based methods and other self-train based methods, showing great potential in clinical application.

cs.CV↗

Adaptive Margin Contrastive Learning for Ambiguity-aware 3D Semantic Segmentation

In this paper, we propose an adaptive margin contrastive learning method for 3D point cloud semantic segmentation, namely AMContrast3D. Most existing methods use equally penalized objectives, which ignore per-point ambiguities and less discriminated features stemming from transition regions. However, as highly ambiguous points may be indistinguishable even for humans, their manually annotated labels are less reliable, and hard constraints over these points would lead to sub-optimal models. To address this, we design adaptive objectives for individual points based on their ambiguity levels, aiming to ensure the correctness of low-ambiguity points while allowing mistakes for high-ambiguity points. Specifically, we first estimate ambiguities based on position embeddings. Then, we develop a margin generator to shift decision boundaries for contrastive feature embeddings, so margins are narrowed due to increasing ambiguities with even negative margins for extremely high-ambiguity points. Experimental results on large-scale datasets, S3DIS and ScanNet, demonstrate that our method outperforms state-of-the-art methods.

cs.CV↗

A Preliminary Study of Fixed Flaky Tests in Rust Projects on GitHub

Prior research has extensively studied flaky tests in various domains, such as web applications, mobile applications, and other open-source projects in a range of multiple programing languages, including Java, Javascript, Python, Ruby, and more. However, little attention has been given to flaky tests in Rust -- an emerging popular language known for its safety features relative to C/C++. Rust incorporates interesting features that make it easy to detect some flaky tests, e.g., the Rust standard randomizes the order of elements in hash tables, effectively exposing implementation-dependent flakiness. However, Rust still has several sources of nondeterminism that can lead to flaky tests. We present our work-in-progress on studying flaky tests in Rust projects on GitHub. Searching through the closed Github issues and pull requests. We focus on flaky tests that are fixed, not just reported, as the fixes can offer valuable information on root causes, manifestation characteristics, and strategies of fixes. By far, we have inspected 53 tests. Our initial findings indicate that the predominant root causes include asynchronous wait (33.9%), concurrency issues (24.5%), logic errors (9.4%). and network-related problems (9.4%).

cs.SE↗

Universally optimizable strategy for magnetic gaps towards high-temperature quantum anomalous Hall states via magnetic-insulator/topological-insulator building-blocks

Optimizing the magnetic Zeeman-splitting term, specifically the magnetic gap of the topological surface states (TSSs), is a crucial issue and central challenge in advancing higher-temperature quantum anomalous Hall (QAH) states. In this work, we demonstrate a counterintuitive, nonmonotonic relationship between the magnetic gap and the hybridization strength in ferromagnetic-insulator (FMI)/topological-insulator (TI) sandwich structures. Concretely, insufficient hybridization strength fails to induce a substantial magnetic gap; while excessive hybridization incandesces the competition between kinetic and Coulomb exchange interactions, thereby reducing the gap. Strong hybridization strength also spatially delocalizes the TSSs, diminishing the effective orbital coupling between TSS-based p and magnetic d orbitals, which further weakens kinetic and Coulomb exchange interaction strength. Moreover, modifying the stacking order offers an experimentally viable approach to optimizing magnetic gaps, enabling the tunability of Chern numbers, chirality and maximizing global gaps. These findings unveil a universal guiding principle for optimizing magnetic gaps in FMI-TI proximity-based QAH systems, offering valuable insights for advancing experimental implementations in this field.

cond-mat.mtrl-sci↗

Evolution of X-ray Gas in SN 1987A from 2007 to 2021: Ring Fading and Ejecta Brightening Unveiled through Differential Emission Measure Analysis

As the nearest supernova (SN) observed since Kepler's SN of 1604, SN 1987A provides an unprecedented opportunity to study in detail the early evolution of supernova remnants (SNRs). Despite extensive studies through both observations and simulations, there is still an urgent need for a more effective approach to integrate the results from two sides. In this study, we conducted a detailed differential emission measure (DEM) analysis on the XMM-Newton observations taken in 2007 to 2021 to characterize the continuous temperature structure of SN 1987A, which can be better compared with simulations. The X-ray plasma exhibit a temperature distribution with a major peak at $\sim0.5$-$1$ keV and a high-temperature tail extending to $\gtrsim5$ keV. The emission measure (EM) of the major peak started to decline around 2014, while the EM of the tail continued increasing and appears to have formed a secondary peak at $\sim3$-$5$ keV in recent years. Our DEM results consistent well with simulations, which help to further identify the major peak as originating from the equatorial ring and the secondary peak as arising from the newly shocked ejecta. Together with the simulations, our DEM analysis reveals recent fading of the ring and brightening of the ejecta in X-rays from SN 1987A. Additionally, we observed a recent decrease in the centroid energy of Fe K line, providing further evidence of newly shocked ejecta.

astro-ph.HE↗

Exploring Transferable Homogeneous Groups for Compositional Zero-Shot Learning

Conditional dependency present one of the trickiest problems in Compositional Zero-Shot Learning, leading to significant property variations of the same state (object) across different objects (states). To address this problem, existing approaches often adopt either all-to-one or one-to-one representation paradigms. However, these extremes create an imbalance in the seesaw between transferability and discriminability, favoring one at the expense of the other. Comparatively, humans are adept at analogizing and reasoning in a hierarchical clustering manner, intuitively grouping categories with similar properties to form cohesive concepts. Motivated by this, we propose Homogeneous Group Representation Learning (HGRL), a new perspective formulates state (object) representation learning as multiple homogeneous sub-group representation learning. HGRL seeks to achieve a balance between semantic transferability and discriminability by adaptively discovering and aggregating categories with shared properties, learning distributed group centers that retain group-specific discriminative features. Our method integrates three core components designed to simultaneously enhance both the visual and prompt representation capabilities of the model. Extensive experiments on three benchmark datasets validate the effectiveness of our method.

cs.CV↗

Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning

Large language models (LLMs), such as LLaMA, Alpaca, Vicuna, GPT-3.5 and GPT-4, have advanced the performance of AI systems on various natural language processing tasks to human-like levels. However, their generalisation and robustness when performing logical reasoning has not been sufficiently assessed. To comprehensively evaluate this ability, we develop three new logical reasoning datasets named "ReClor-plus", "LogiQA-plus" and "LogiQAv2-plus" that extend standard logical reasoning datasets to evaluate the robustness of the LLM's reasoning. For each, we create three subsets: the first with randomly shuffled options, the second with the correct choices replaced by "none of the other options is correct", and the third with a combination of shuffling and substitution. Experiments on these datasets show that these simple augmentations greatly hinder the models' performance. Despite their high performance on the original publicly available datasets, we find that all models perform poorly on these newly constructed datasets. We also demonstrate that introducing task variations into the training set can markedly improve the model's performance on both the original and our developed datasets. Finally, we show that applying logic-driven data augmentation for fine-tuning and prompting can enhance generalisation in both discriminative and generative models, offering a path to improving their robustness for tasks involving logical reasoning. Source code and data are made publicly available at https://github.com/Strong-AI-Lab/Logical-and-abstract-reasoning.

cs.CL↗

AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling

In this paper, we introduce AceMath, a suite of frontier math models that excel in solving complex math problems, along with highly effective reward models capable of evaluating generated solutions and reliably identifying the correct ones. To develop the instruction-tuned math models, we propose a supervised fine-tuning (SFT) process that first achieves competitive performance across general domains, followed by targeted fine-tuning for the math domain using a carefully curated set of prompts and synthetically generated responses. The resulting model, AceMath-72B-Instruct greatly outperforms Qwen2.5-Math-72B-Instruct, GPT-4o and Claude-3.5 Sonnet. To develop math-specialized reward model, we first construct AceMath-RewardBench, a comprehensive and robust benchmark for evaluating math reward models across diverse problems and difficulty levels. After that, we present a systematic approach to build our math reward models. The resulting model, AceMath-72B-RM, consistently outperforms state-of-the-art reward models. Furthermore, when combining AceMath-72B-Instruct with AceMath-72B-RM, we achieve the highest average rm@8 score across the math reasoning benchmarks. We release model weights, training data, and evaluation benchmarks at: https://research.nvidia.com/labs/adlr/acemath

cs.CL↗

On the optimal prediction of extreme events in heavy-tailed time series with applications to solar flare forecasting

The prediction of extreme events in time series is a fundamental problem arising in many financial, scientific, engineering, and other applications. We begin by establishing a general Neyman-Pearson-type characterization of optimal extreme event predictors in terms of density ratios. This yields new insights and several closed-form optimal extreme event predictors for additive models. These results naturally extend to time series, where we study optimal extreme event prediction for both light- and heavy-tailed autoregressive and moving average models. Using a uniform law of large numbers for ergodic time series, we establish the asymptotic optimality of an empirical version of the optimal predictor for autoregressive models. Using multivariate regular variation, we obtain an expression for the optimal extremal precision in heavy-tailed infinite moving averages, which provides theoretical bounds on the ability to predict extremes in this general class of models. We address the important problem of predicting solar flares by applying our theory and methodology to a state-of-the-art time series consisting of solar soft X-ray flux measurements. Our results demonstrate the success and limitations in solar flare forecasting of long-memory autoregressive models and long-range-dependent, heavy-tailed FARIMA models.

math.ST↗

Modeling the Saddle-like GeV-TeV Spectrum of HESS J1809-193: $γ$-Rays Arising from Reverse-Shocked Pulsar Wind Nebula?

Evolution of pulsar wind nebulae (PWNe) could be expected to leave imprints in $γ$-rays. We suggest that intriguing GeV-TeV spectral energy distribution (SED) of HESS J1809$-$193 and Fermi-LAT source J1810.3$-$1925e is very likely to be the $γ$-ray signature of PWN J1809$-$193 in light of the scenario that the PWN was struck by the reverse shock of the parent supernova remnant. Based on evolutionary theory of PWNe, we consider that, when the PWN was disrupted during collision by the reverse shock, some very high-energy electrons escaped impulsively. The remaining electrons stayed in the relic PWN, which was displaced from the pulsar. The very high-energy part of the remaining electrons were depleted by the strong magnetic field that was enhanced by the reverse shock compression in the reverberation stage, leaving the other part of them generating GeV emission. The particles injected from the pulsar after the disruption enter the relic PWN through the newly formed tunnel called the cocoon. The $γ$-ray emission from the escaped electrons can account for the TeV spectrum of component A of HESS J1809$-$193 or the TeV halo, while the electrons remaining after disruption can account for the GeV spectrum of J1810.3$-$1925e. Thus, combination of contributions from these two populations of electrons naturally reproduces the saddle-like SED of HESS J1809$-$193 and J1810.3$-$1925e from 5 GeV to 30 TeV, together with the spectral hardening around 100 GeV. We also show that the post-disruption injection of electrons can explain the spectrum of the relatively faint $γ$-ray emission of component B of HESS J1809$-$193.

astro-ph.HE↗

Expanding Molecular Shell and Possible γ-ray Source Associated with Supernova Remnant Kesteven 67

We investigate the molecular environment of the supernova remnant (SNR) Kesteven 67 (G18.8+0.3) using observations in $^{12}$CO, $^{13}$CO, HCO$^+$,and HCN lines and possible associated $γ$-ray emission using 16-yr Fermi-LAT observation. We find that the SNR is closely surrounded by a molecular belt in the southeastern boundary, with the both recessed in the band-like molecular gas structure along the Galactic plane. The asymmetric molecular line profiles are widely present in the surrounding gas around local-standard-of-rest velocity +20 km s$^{-1}$. The secondary components centered at $\sim$+16km s$^{-1}$ in the belt and $\sim$+26 km s$^{-1}$ in the northern clump can be ascribed to the motion of a wind-blown molecular shell. This explanation is supported by the position-velocity diagram along a line cutting across the remnant, which shows an arc-like pattern, suggesting an expanding gas structure. With the simulation of chemical effects of shock propagation, the abundance ratios $N$(HCO$^+$)/$N$($^{12}$CO) $\sim2.6\times 10^{-5}$--$3.6\times 10^{-4}$ obtained in the belt can be more naturally interpreted by the wind-driven bubble shock than by the SNR shock. The belt and northern clump are very likely to be parts of an incomplete molecular shell of bubble driven by O-type progenitor star's wind. The analysis of 0.2--500 GeV $γ$-ray emission uncovers a possible point source (`Source~A') about 6.5$σ$ located in the north of the SNR, which essentially corresponds to northern molecular clump. Our spectral fit of the emission indicates that a hadronic origin is favored by the measured Galactic number ratio between CR electrons and protons $\sim0.01$.

astro-ph.HE↗