arXiv Science⌕ Search

arXiv subjects

Lu Feng

Publications and source records attributed to Lu Feng.

At least 19 recordsLinked to original sources

Latent Q-Barrier Shielding for Safe In-Context Reinforcement Learning

Safe in-context reinforcement learning (ICRL) adapts online from interaction history without test-time parameter updates while controlling episode cost under a safety budget. Under out-of-distribution (OOD) deployment shifts, pretraining-only safe ICRL can give poor reward-safety tradeoffs because the remaining budget affects behavior only through frozen policy conditioning, not an explicit action-level check against predicted future cost. We propose a latent Q-Barrier shield that learns a context representation, latent dynamics, and an ensemble cost critic before deployment. Without parameter updates, the shield infers context from history and filters or softly reweights candidate actions using the remaining budget and predicted future cost. We prove a conditional one-step barrier-margin bound over realized candidate sets, with explicit Bellman and latent-prediction error terms. Across five safe ICRL benchmarks, the shield improves deployment-time reward-safety tradeoffs over a strong safe-ICRL baseline: after a short context window, it achieves higher return in four of five benchmarks while matching or lowering average episode cost in all five. Code is available at https://github.com/kmj1122/q-barrier.

cs.LG↗

Algorithm Distillation for Safe In-Context Reinforcement Learning

Safe in-context reinforcement learning (Safe ICRL) asks a policy with fixed parameters to improve on an unseen constrained task from its interaction history while aiming to keep its cost within a budget. Prior work studied Safe ICRL on five benchmarks in three families: a grid world with a hidden goal and obstacles (DarkRoom), continuous navigation where goals and hazards stay invisible until reached (PointGoal, CarGoal), and locomotion with a hidden velocity limit (HalfCheetah, Ant). Safe Algorithm Distillation (Safe AD), trained on the learning histories of a safe RL algorithm, has shown adaptation failures in prior evaluations. For example, in the locomotion tasks its return stays below zero, and it rarely reaches the goal in CarGoal. We revisit two parts of Safe AD. First, we distill a budget-aware teacher with two phases. It searches for the hidden task, exploring more when more budget remains. After its first reward or cost, an expert policy exploits the task within the remaining budget. We collect the teacher's histories under fixed or dynamic budgets. Dynamic budgets increase the occupancy entropy of the return and budget inputs in every environment, and at test time they improve return and lower cost in DarkRoom and HalfCheetah. Second, we propose A-Lag, a test-time adjustment that reweights the distilled policy's actions by their predicted cost, with an adaptive Lagrange multiplier that is updated from the costs observed. In our experiments, A-Lag had lower mean episode cost than Safe AD in all five environments, with lower mean final return in four.

cs.LG↗

Supporting Calibrated Reliance in AI-Assisted Decision-Making: Different Strategies for Different Tasks

As AI systems increasingly support human decision-making, a central challenge is determining what information helps people recognize when to rely on AI predictions and when to question or override them. Across three controlled human-subject studies spanning abstract visual reasoning with RAVEN matrices and deductive logical reasoning with LSAT problems, we examine how different forms of AI support affect performance in AI-assisted decision-making. A multi-stage reveal study shows that AI predictions and explanations can affect objective accuracy and subjective confidence differently. In visual reasoning, LLM explanations do not improve accuracy beyond the predicted answer alone, and no additional support format significantly outperforms prediction-only support; predicted probabilities show the highest descriptive accuracy and error recovery, while a derived selective-automation policy provides a higher-performing reference benchmark. In language-based logical reasoning, by contrast, LLM explanations yield the highest accuracy and error recovery, outperforming expert-written explanations and probability-based support. These results suggest that the effectiveness of AI support strategies depends on the task setting. Human--AI interfaces should instead be designed to support calibrated reliance and effective error recovery by matching the form of assistance to the task and the evidence available to users.

cs.HC↗

The Palomar 5 Stellar Stream in DESI Legacy Surveys DR10: Wide-field Morphology and Constraints on the Inner Halo Potential Shape

The Palomar 5 stellar stream probes the gravitational potential of the inner Milky Way, where the disk, dark halo, and time-dependent perturbations all contribute substantially to the force field. Using the DESI Legacy Imaging Surveys Data Release 10 (DR10), we map the wide-field morphology of the stream over $-25^\circ<\phione<20^\circ$ and $-5^\circ<\phitwo<10^\circ$. Our analysis combines a cluster-calibrated PARSEC color--magnitude diagram filter, a continuous main-sequence turnoff plus RR Lyrae distance relation, and a field star response tied to local imaging depth. After applying the response correction, we recover the stream clearly over $-15.5^\circ\le\phione\le7.0^\circ$ and reveal no coherent low-surface-brightness extension beyond this range within our DR10 search footprint. Mock stream fits to the measured centroid and width yield an NFW potential flattening parameter $\qphiz=0.82^{+0.13}_{-0.11}$, assuming a static Hernquist bulge, a Miyamoto--Nagai disk, and a potential-flattened NFW halo with fixed $r_s=20\,{\rm kpc}$ and fixed $V_c(R_0)=232\,\kms$ at the Solar radius. The posterior favors an oblate effective inner halo potential, with a minor dependence on the assumed progenitor mass. The DR10 stream morphology therefore provides a homogeneous observational reference well suited for future joint analyses that incorporate density information, proper motions, line-of-sight velocities, and time-dependent perturbations.

astro-ph.GA↗

Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency

While machine learning models help autonomous vehicles (AVs) navigate complex environments, their black-box nature complicates validation and verification (V&V). Vision-language-action (VLA) models offer a unique opportunity: alongside trajectories, they generate an explicit chain-of-thought (CoT) explaining their decisions. We posit that this CoT can serve as a candidate specification to cross-check trajectories and expose unsafe behavior. To assess this, we curate DriveAlignBench, a dataset of 150 CoT-trajectory pairs from NVIDIA's Alpamayo 1.5 VLA, manually annotated for CoT reliability, CoT-trajectory consistency, and trajectory safety. We find that 33.3% of CoTs are unreliable, and among reliable CoTs, 26% have inconsistent trajectories. To detect these cases, we propose integrating a CoT-trajectory consistency check into a runtime monitor. This check is nontrivial because CoTs express open-vocabulary, scene-relative maneuvers, while trajectories are low-level ego-motion sequences whose semantics depend on road geometry and motion context. To bridge this gap, we develop a family of automated consistency monitors. The strongest, the lane-aware monitor, adds lane-relative evidence to the input of the judge model scoring consistency. This raises F1 across all four evaluated judges from 0.56-0.62 with raw waypoints to 0.65-0.82, showing that evidence representation improves detection across judges. Moreover, for reliable CoTs, inconsistency is associated with unsafe behavior: 27% of human-labeled inconsistent trajectories are unsafe compared to 3% of consistent ones, and the lane-aware monitor flags most of these unsafe cases. We release DriveAlignBench, the monitor implementations, and per-run results at https://github.com/less-lab-uva/drive-the-thoughts.

cs.SE↗

Human-Aware Agentic Driving: Rethinking Driver State, Trust, and Intervention

Agentic driving brings goal-directed reasoning, memory, tools, and adaptive interaction into automated vehicles. A vehicle can clarify a request, explain a maneuver, or prepare a driver to take control, then adapt its next action to the response. These capabilities make the vehicle an active participant in shaping the human behavior it observes. We examine how agentic interaction affects driver-state inference, trust and reliance, and human intervention in conditional automation. Established findings on attention, takeover prediction, trust-aware planning, and adaptive warnings provide useful foundations, but their applicability depends on how observations are elicited and how assistance changes the driving task. We distinguish what remains applicable, what changes under flexible interaction, and what remains unresolved across these three areas. The analysis identifies three research priorities: establishing the effects of interventions, jointly designing interaction and driving policies, and maintaining useful adaptation across repeated use and system changes. Progress should be measured through driver comprehension, appropriate reliance, and the ability to perform the required driving action in time.

cs.HC↗

SafeManip: A Property-Driven Benchmark for Temporal Safety Evaluation in Robotic Manipulation

Robotic manipulation is typically evaluated by task success, but reaching the correct final state does not guarantee safe execution. A robot may succeed despite contamination, premature release, or incorrect sequencing. These failures are poorly captured by task-completion metrics or isolated state checks because safety often depends on how behavior unfolds over time. We introduce SafeManip, a benchmark for evaluating temporal safety directly from low-level manipulation rollouts across eight physical and semantic categories. SafeManip grounds symbolic manipulation predicates into reusable temporal properties over finite executions, formalized with LTLf. We further introduce ManipVerse, a property ontology enabling semantic safety rules generalize across objects, tasks, and environments. Finally, SafeManip introduces per-trigger safety metrics that normalize violations by the safety-relevant opportunities that activate each obligation, accounting for differences in how often those opportunities arise across policies and tasks. We instantiate SafeManip on RoboCasa365 and LIBERO to audit seven state-of-the-art robot foundation-model policies. Our results reveal a gap between task capability and temporal safety: higher task success does not necessarily imply safer execution, successful rollouts can still contain violations, and failure patterns vary systematically across safety categories, task horizons, and manipulation suites. SafeManip provides a reusable layer for evaluating how safely manipulation tasks are executed, not only whether they are completed.

cs.RO↗

Optimization-Based Robust Permissive Synthesis for Interval MDPs

We present an optimization-based framework for robust permissive synthesis for Interval Markov Decision Processes (IMDPs). While robust IMDP controller synthesis typically yields a single policy and most permissive-synthesis methods assume exact transition models, we synthesize multi-strategies that retain multiple actions while guaranteeing satisfaction of probabilistic reachability or expected-reward specifications under all admissible transition probabilities. We formulate the problem as a mixed-integer linear program (MILP) that maximizes the number of enabled state--action pairs subject to robust Bellman constraints. We develop two encodings: a direct vertex-enumeration formulation and a dualization-based formulation that avoids explicit enumeration of uncertainty-polytope vertices and has size linear in the number of successor transitions. Experiments on four benchmark domains show that both encodings achieve the same optimal permissiveness and scale to IMDPs with hundreds of thousands of states. Compared with standard robust single-policy synthesis, the resulting multi-strategies retain substantially more action choices.

cs.RO↗

Safe In-Context Reinforcement Learning

In-context reinforcement learning (ICRL) is an emerging RL paradigm where an agent, after pretraining, can adapt to out-of-distribution test tasks without any parameter updates, instead relying on an expanding context of interaction history. While ICRL has shown impressive generalization, safety during this adaptation process remains unexplored, limiting its applicability in real-world deployments where test-time behavior is expected to be safe. In this work, we propose SCARED: Safe Contextual Adaptive Reinforcement via Exact-penalty Dual, the first method that promotes safe adaptation of ICRL under the constrained Markov decision process framework. During the parameter-update-free adaptation process, our agent not only maximizes the reward but also keeps the accumulated cost within a user-specified safety budget. We also demonstrate that the agent actively reacts to the safety budget; with a higher safety budget, the agent behaves more aggressively, and with a lower safety budget the agent behaves more conservatively. Across challenging benchmarks, SCARED consistently enables safe and robust in-context adaptation, outperforming existing ICRL and safe meta-RL baselines.

cs.LG↗

Radio Activity Across Accretion State Changes in Changing-look AGNs: Insights from FIRST and VLASS over Two Decades

Changing-look active galactic nuclei (CL-AGNs) provide a unique opportunity to probe the coupling between accretion flows and relativistic jets in supermassive black holes. We investigate the long-term radio behavior of CL-AGNs over approximately 20 years by combining FIRST and VLASS observations with quasi-simultaneous optical spectroscopy and photometry. From a parent sample of 1092 CL-AGNs, we identify 58 sources with radio detections. Radio-detected CL-AGNs exhibit systematically higher radio kinetic efficiency, quantified by \(P_{\rm j}/L_{\rm bol}\), than both typical radio-detected AGNs and radio transients, consistent with their preference for low Eddington ratios. At the population level, the expected anti-correlation between radio emission and accretion rate is weak. However, a clear source-by-source anti-correlation emerges in a small subset of CL-AGNs with continuous multi-epoch coverage. We further identify four radio transients, including both radio turn-on and turn-off events, and one source exhibiting a multiwavelength flare that may be indicative of tidal disruption event-like activity. These results suggest that radio activity in CL-AGNs is not governed by instantaneous accretion state changes but is instead regulated by long-term accretion history and jet evolution, with additional stochastic or transient channels contributing in rare cases.

astro-ph.GA↗

$J$ and $H$ band sky brightness measurements from polar day to polar night at Dome A, Antarctica

The near-infrared (NIR) sky brightness is a fundamental parameter for evaluating the performance of ground-based infrared observatories. Dome~A on the Antarctic plateau offers exceptional atmospheric conditions, yet its NIR sky background has not been continuously monitored. We present the first continuous $J/H$-band measurements of the sky background at Dome~A from polar day to polar night, and characterize their median levels and temporal variability. The Antarctic Infrared Binocular Telescope (AIRBT), operating in the $J$ and $H$ bands, obtained continuous fixed-pointing observations from February to May 2024, which were used to measure the NIR sky background. The median sky brightness is $5.2/2.9$ and $15.3/13.4~\mathrm{mag~arcsec^{-2}}$ in $J/H$ bands during daytime and nighttime, respectively. The twilight--nighttime boundaries occur at solar elevations of $-9.3^\circ$ in $J$ and $-7.4^\circ$ in $H$. At the same solar elevation, the NIR sky background during the polar night is darker by about $0.1$ and $0.4~\mathrm{mag~arcsec^{-2}}$ in the $J$ and $H$ bands compared with the period of regular day--night alternation. During the polar-night period, the nighttime sky brightness in the $H$ band shows a more evident association with the sunspot number, while the corresponding trend in the $J$ band is weaker. These results reveal systematic differences in sky background between polar and non-polar environments and between polar night and regular day--night cycles. The measured sky brightness may be elevated, as the observations were conducted near solar maximum, highlighting the importance of long-term monitoring across the solar cycle.

astro-ph.IM↗

Neutrino mass constraints in interacting dark energy models after DESI DR2

Recent DESI observations indicate a deviation from the $Λ$CDM model, showing a preference for dynamical dark energy and thereby relaxing the upper limit on the neutrino mass within this framework. This deviation can also be explained by the presence of an interaction between dark energy and dark matter. In this work, we investigate the cosmological upper bounds on the total neutrino mass ($\sum m_ν$) across four different interacting dark energy (IDE) models. The present analysis employs the latest DESI baryon acoustic oscillation, cosmic microwave background, and type Ia supernova datasets. These results demonstrate that the upper bounds on $\sum m_ν$ exhibit profound sensitivity to the specific phenomenological formulation of the interaction term. While the I$Λ$CDM2 model ($Q \propto H ρ_{\mathrm{c}}$) substantially relaxes the stringent upper limit ($\sum m_ν < 0.129$ eV at 95% confidence level), notably the I$Λ$CDM3 model ($Q \propto H_0 ρ_{\mathrm{de}}$), severely compresses the allowed parameter space, yielding a highly restrictive bound of $\sum m_ν < 0.051$ eV. Furthermore, rigorous goodness-of-fit evaluations utilizing the Deviance Information Criterion and $Δχ^2_{\mathrm{MAP}}$ indicate that the current observational data statistically favor these mass-suppressing IDE models. This establishes an exacerbated statistical tension between the observationally preferred IDE scenarios and the normal hierarchy lower bound ($\sim 0.06$ eV) determined by terrestrial neutrino oscillation experiments.

astro-ph.CO↗

Report on the Designing Accountable Software Systems Workshop

The Workshop on Designing Accountable Software Systems (DASS) was convened in November 2024 with support from the U.S. National Science Foundation to engage a wide range of current and future stakeholders from government, academia, and industry on the cross-disciplinary topic of accountability in software systems. Over two days, attendees engaged in a series of panels, invited talks, and breakout sessions covering: (1) the dimensions of accountability, including legal compliance as well as business and societal aspects and drivers; (2) a conceptual model of the various structures needed to realize accountability; (3) the sources of legal requirements that affect software; (4) the operationalization of legal requirements in software; (5) the requirements to preserve evidence needed to conduct investigations; and (6) a range of challenges and contextual factors beyond software that affect why some accountability structures succeed, while others fail. The workshop was conducted as a collaborative systematization of knowledge that culminated in several research directions. The findings include the importance of clarifying definitions and responsibilities within accountable organizations, which can affect whether those researching accountability are making assumptions that limit the generalizability of findings. Further research was also identified as needed to study the ways to improve the translation of accountability structures into the software design process while improving engagement with stakeholders, such as legislators, regulators, business executives and system developers. Finally, a key finding was the high demands that DASS-like research projects place on interdisciplinary teams: both in terms of team formation and sustainment, as well as, the specific demands of cross-disciplinary learning that covers both research methods, research dissemination, and career development.

cs.SE↗

Safety Generalization Under Distribution Shift in Safe Reinforcement Learning: A Diabetes Testbed

Safe Reinforcement Learning (RL) algorithms are typically evaluated under fixed training conditions. We investigate whether training-time safety guarantees transfer to deployment under distribution shift, using diabetes management as a safety-critical testbed. We benchmark safe RL algorithms on a unified clinical simulator and reveal a safety generalization gap: policies satisfying constraints during training frequently violate safety requirements on unseen patients. We demonstrate that test-time shielding, which filters unsafe actions using learned dynamics models, effectively restores safety across algorithms and patient populations. Across eight safe RL algorithms, three diabetes types, and three age groups, shielding achieves Time-in-Range gains of 13--14\% for strong baselines such as PPO-Lag and CPO while reducing clinical risk index and glucose variability. Our simulator and benchmark provide a platform for studying safety under distribution shift in safety-critical control domains. Code is available at https://github.com/safe-autonomy-lab/GlucoSim and https://github.com/safe-autonomy-lab/GlucoAlg.

cs.LG↗

AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration

Automating scientific discovery requires more than generating papers from ideas. Real research is iterative: hypotheses are challenged from multiple perspectives, experiments fail and inform the next attempt, and lessons accumulate across cycles. Existing autonomous research systems often model this process as a linear pipeline: they rely on single-agent reasoning, stop when execution fails, and do not carry experience across runs. We present AutoResearchClaw, a multi-agent autonomous research pipeline built on five mechanisms: structured multi-agent debate for hypothesis generation and result analysis, a self-healing executor with a \textsc{Pivot}/\textsc{Refine} decision loop that transforms failures into information, verifiable result reporting that prevents fabricated numbers and hallucinated citations, human-in-the-loop collaboration with seven intervention modes spanning full autonomy to step-by-step oversight, and cross-run evolution that converts past mistakes into future safeguards. On ARC-Bench, a 25-topic experiment-stage benchmark, AutoResearchClaw outperforms AI Scientist v2 by 54.7%. A human-in-the-loop ablation across seven intervention modes reveals that precise, targeted collaboration at high-leverage decision points consistently outperforms both full autonomy and exhaustive step-by-step oversight. We position AutoResearchClaw as a research amplifier that augments rather than replaces human scientific judgment. Code is available at https://github.com/aiming-lab/AutoResearchClaw.

cs.AI↗

Measuring neutrino mass in light of ACT DR6 and DESI DR2

The recent release of high-precision cosmological data, particularly the small-scale cosmic microwave background (CMB) measurements from ACT and baryon acoustic oscillation (BAO) data from DESI, has opened a new landscape for probing the neutrino mass. In this work, we present updated constraints on the total neutrino mass, $\sum m_ν$, and its hierarchy within the $Λ$CDM, $w$CDM, holographic dark energy (HDE), and $w_0w_a$CDM models, using the latest ACT DR6, DESI DR2, and DESY5 datasets. We find that the upper limits on $\sum m_ν$ are critically governed by the evolutionary behavior of the dark energy equation of state. Specifically, models exhibiting early-time quintessence features (e.g., HDE) yield the most stringent constraints, whereas those allowing for early-time phantom behavior (e.g., $w_0w_a$CDM) result in significantly looser bounds. Despite these model-dependent variations, we observe a robust hierarchy dependence across all scenarios, where the inverted hierarchy consistently yields weaker constraints and the degenerate hierarchy consistently yields tightest constraints. Our analysis demonstrates that the improved small-scale CMB information from ACT, combined with high-precision BAO data, systematically tightens the limits on $\sum m_ν$, providing a crucial benchmark for future neutrino mass measurement.

astro-ph.CO↗

From Model Explanation to Data Misinterpretation: A Cautionary Analysis of Post Hoc Explainers in Business Research

Post hoc explainers such as SHAP and LIME are used widely in business research to interpret complex machine learning models. Although they were designed to explain model predictions, there has been an increasing trend in which the explanations they generate are treated as evidence about underlying data relationships. Based on a systematic review of 181 studies, including 56 published in leading journals, we document that this explanation interpretation is widespread and examine its validity. We also evaluate how well post hoc explanations reliably recover the direction and relative importance of features in true data-generating process. We introduce two metrics-direction alignment and strength alignment-and assess SHAP and LIME using simulated data with known ground truth. Although explanations often appear reasonable on average, they exhibit substantial heterogeneity in their alignment and can fail to be aligned even when their predictive accuracy is high. High predictive performance is therefore necessary but insufficient for reliable explanation. We further show that feature correlation and the Rashomon effect (where many equally accurate models rely on different feature attributions) are key drivers of misalignment. Agreement in explanations across such models provides a practical diagnostic of reliability. Overall, our findings caution against using post hoc explainers for hypothesis validation and instead position them as exploratory tools that generate, rather than confirm, substantive insights.

cs.LG↗

Adaptive Shielding for Safe Reinforcement Learning under Hidden-Parameter Dynamics Shifts

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement learning in constrained hidden-parameter Markov decision processes. A function encoder infers a low-dimensional representation of the underlying dynamics online from transition data, allowing the shield to adapt. To ensure safety during this process, we use a two-layer strategy. First, we introduce safety-regularized optimization that proactively trains the policy away from high-cost regions. Second, the adaptive shielding reactively uses the inferred dynamics to forecast safety risks and applies uncertainty-aware bounds using conformal prediction to filter unsafe actions. We prove that prediction errors in the shielding connect with bounds on the average cost rate. Empirically, across Safe-Gym benchmarks with varying hidden parameters, our approach outperforms baselines on the return-safety trade-off and generalizes reliably to unseen dynamics, while incurring only modest execution-time overhead. Code is available at https://github.com/safe-autonomy-lab/AdaptiveShieldingFE.

cs.LG↗