arXiv Science⌕ Search

arXiv subjects

Jiayu Feng

Publications and source records attributed to Jiayu Feng.

5 recordsLinked to original sources

GT-FENG: General Theory of Factual Evaluation and Normative Grounding in Language Models

Whether a language model's answer is correct often depends on context: the same value can be right under one jurisdiction, date, or legal definition and wrong under another. We introduce GT-FENG (General Theory of Factual Evaluation and Normative Grounding), the first general framework to unify contextual/temporal correctness and rule-based error attribution across law, policy, and other rule-governed domains. GT-FENG checks answers against the applicable rules and identifies documented rules that match incorrect answers. It shows that when multiple rules give the same value, the answer alone cannot tell which rule the model used. In Medicaid income-limit answers from two models, documenting the asked state's own records reduces the number of wrong answers that match only other states' values by 68-78%, and more than half of stable wrong answers then match two or more documented sources. GT-FENG provides a foundation for evaluating language models in rule-governed domains and for future benchmarks and evaluation toolkits. We release GT-FENG as an open-source Python package, gtfeng.

cs.CL↗

Second-harmonic generation from an optically levitated KTP nanocrystal in vacuum

The optically levitated system in vacuum has emerged as a powerful platform for studies of fundamental physics and precision measurements. Although various nanoparticles have been successfully levitated in vacuum, they typically lack the capability to support optical nonlinear processes. Here, we experimentally demonstrate the stable levitation of a potassium titanyl phosphate (KTP) nonlinear nanocrystal in vacuum and investigate its second-harmonic generation (SHG) properties. This levitated system intrinsically provides a pristine dark-background environment with a high signal-to-noise ratio. The trapping laser simultaneously serves as a fundamental light for efficient SHG. Moreover, the polarization of the collected SHG signal is correlated with that of the fundamental laser, providing clear evidence of the optical torque enabling controllable alignment of the nanocrystal with the driving field. Our work establishes a new route, to our knowledge, toward exploring nonlinear optical processes in vacuum levitation systems and designing novel nanodevices with high manipulation agility in a fully contact-free environment.

physics.optics↗

Right Number, Wrong State? Measuring Cross-Jurisdiction Substitution in LLM Recall of State Policy

When an LLM answers a state-specific policy question wrongly, it may be hallucinating, or it may be returning a real value that holds in another state. We test this with a minimal-set design: the question wording is fixed and only the jurisdiction varies, across the 50 U.S. states and the District of Columbia (51 jurisdictions) and three exactly defined Medicaid income-eligibility quantities. Gold values come from an official data book and agree with an independent source in 101 of 102 checked cells. Under a pre-registered protocol, Claude Sonnet 5.5 and GPT-5.6 Sol reproducibly give another state's current value, identical across two independent repeats, for 10 and 25 of 153 items. The count depends on the reference set: crediting any wrong answer that equals another state's value yields 3-5x more reproducible substitutions than checking every number in the asked state's own records, because many apparent cross-state answers are the asked state's own values under another convention or from an earlier year. Claims about cross-jurisdiction error need a complete same-state reference set. We will release the protocol, gold table, and all model outputs.

cs.CL↗

Clinical value claims in multimodal AI outpace supporting evidence

Multimodal prediction models add a data source, such as imaging or an assay, to clinical information, and health systems must decide whether that added test is worth acquiring. We audited 177 studies comparing multimodal with unimodal models: 81 from a systematic review and 96 from a probability sample of 2025-2026 PubMed records. Gains in the area under the receiver operating characteristic curve (AUROC) were smaller when a study fitted a separate model for every data source (adjusted difference, -0.030; 95% CI, -0.056 to -0.005). Within 78 such studies, leaving out the strongest source's model would have raised the average gain from 0.046 to 0.108. This complete benchmarking fell from 69.1% of review studies to an estimated 46.0% of recent ones. An estimated 22% assessed decision utility and none evaluated a model prospectively, yet most claimed potential clinical usefulness or improved care (84.0% and an estimated 87.7%).

cs.LG↗

U-SWIFT: A Unified Surface Wave Inversion Framework with Transformer via Normalization of Dispersion Curves

Deep learning is an increasingly popular approach for inverting surface wave dispersion curves to obtain Vs profiles. However, its generalizability is constrained by the depth and velocity scales of training data. We propose a unified deep learning framework that overcomes this limitation via normalization of dispersion curves. By leveraging the scaling properties of dispersion curves, our approach enables a single, pre-trained model to predict Vs profiles across diverse scales, from shallow subsurface (e.g., < 10 m depth) to crustal levels. The framework incorporates a novel transformer-based model to handle variable-length dispersion curves and removes tedious manual parameterization. Results from synthetic and field data demonstrate that it delivers rapid and robust inversions with uncertainty estimates. This work provides an efficient inversion approach applicable to a wide spectrum of applications, from near-surface engineering to crustal imaging. The framework establishes a paradigm for developing scale-invariant deep learning models in geophysical inversion.

physics.geo-ph↗