arXiv subjects

Ran Li

Publications and source records attributed to Ran Li.

At least 91 records · Page 5Linked to original sources

arXiv2025

Transformers in Pseudo-Random Number Generation: A Dual Perspective on Theory and Practice

Pseudo-random number generators (PRNGs) are high-nonlinear processes, and they are key blocks in optimization of Large language models. Transformers excel at processing complex nonlinear relationships. Thus it is reasonable to generate high-quality pseudo-random numbers based on transformers. In this paper, we explore this question from both theoretical and practical perspectives, highlighting the potential benefits and implications of Transformer in PRNGs. We theoretically demonstrate that decoder-only Transformer models with Chain-of-Thought can simulate both the Linear Congruential Generator (LCG) and Mersenne Twister (MT) PRNGs. Based on this, we conclude that the log-precision decoder-only Transformer can represent non-uniform $\text{AC}^0$. Our simulative theoretical findings are validated through experiments. The random numbers generated by Transformer-based PRNGs successfully pass the majority of NIST tests, whose heat maps exhibit clear statistical randomness. Finally, we assess their capability in prediction attacks.

cs.LG↗

arXiv2025

Impacts of wormholes on false vacuum bubble tunneling

In this study, we generalize the work of Farhi, Guth and Guven [Nucl. Phys. B 339 (1990) 417] to include a wormhole effect. We study the influence of the wormhole on the tunneling of the false vacuum bubble. The spherically symmetric bubble has two domain walls. The classical dynamics of each domain wall are constrained by two classically forbidden regions. We find that the wormhole has increased the number of instantons and thus can enhance the tunneling rate. We have analytically derived the formula for the bubble tunneling rate, which is consistent with the result obtained by Farhi, Guth and Guven when the wormhole disappears. We show that the tunneling rate increases with the throat radius of the wormhole. Furthermore, we illustrate that the tunneling rate increases with an increases in the mass of the black hole or the surface tension. In the case where a wormhole exists within a bubble and is connected to another universe, we demonstrate that the bubble can enter into another universe through quantum tunneling.

gr-qc↗

arXiv2025

A Comparative Study of Halo Mass Estimates from Group Catalogs and Lensing Signals

We compare halo mass estimates from three galaxy group catalogs (redMaPPer, Yang21, and Zou21) with those derived from gravitational lensing measurements. Each catalog employs distinct methodologies, including mass-richness relations, abundance matching, and luminosity-based calibration. A linear correlation is observed between catalog-estimated and lensing-derived masses. The redMaPPer catalog shows the best agreement, especially for lower-redshift groups, with minor deviations in higher-redshift bins. Yang21 is the only catalog containing low mass groups, which gives a reasonably good mass estimation, except for the lowest mass bin. Cross-matched groups between redMaPPer and Yang21 reveal the former catalog provides more accurate mass estimation, while the Yang21 makes under-estimation of halo mass for those sharing the central galaxy with redMaPPer and over-estimation of halo mass for those with different center determination with redMaPPer and for the unique Yang21 groups. These findings emphasize the importance of redshift-dependent calibration and refined group definitions for accurate mass estimation.

astro-ph.CO↗

arXiv2025

Medical-Knowledge Driven Multiple Instance Learning for Classifying Severe Abdominal Anomalies on Prenatal Ultrasound

Fetal abdominal malformations are serious congenital anomalies that require accurate diagnosis to guide pregnancy management and reduce mortality. Although AI has demonstrated significant potential in medical diagnosis, its application to prenatal abdominal anomalies remains limited. Most existing studies focus on image-level classification and rely on standard plane localization, placing less emphasis on case-level diagnosis. In this paper, we develop a case-level multiple instance learning (MIL)-based method, free of standard plane localization, for classifying fetal abdominal anomalies in prenatal ultrasound. Our contribution is three-fold. First, we adopt a mixture-of-attention-experts module (MoAE) to weight different attention heads for various planes. Secondly, we propose a medical-knowledge-driven feature selection module (MFS) to align image features with medical knowledge, performing self-supervised image token selection at the case-level. Finally, we propose a prompt-based prototype learning (PPL) to enhance the MFS. Extensively validated on a large prenatal abdominal ultrasound dataset containing 2,419 cases, with a total of 24,748 images and 6 categories, our proposed method outperforms the state-of-the-art competitors. Codes are available at:https://github.com/LL-AC/AAcls.

cs.CV↗

arXiv2025

Not so dark, not so dense: an alternative explanation for the lensing subhalo in SDSSJ0946+1006

Previous studies of the strong lens system SDSSJ0946+1006 have reported a dark matter subhalo with an unusually high central density, potentially challenging the standard cold dark matter (CDM) paradigm. However, these analyses assumed the subhalo to be completely dark, neglecting the possibility that it may host a faint galaxy. In this work, we revisit the lensing analysis of SDSSJ0946+1006, explicitly modelling the subhalo as a luminous satellite. Incorporating light from the perturber broadens the range of allowed subhalo properties, revealing solutions with significantly lower central densities that are consistent with CDM expectations. The inferred luminosity of the satellite also aligns with predictions from hydrodynamical simulations. While high-concentration subhaloes remain allowed, they are no longer statistically preferred. The luminous subhalo model yields a better fit to the data, while also offering a more plausible explanation that is in line with theoretical expectations. We validate our methodology using mock data, demonstrating that neglecting subhalo light can lead to inferred mass distributions that are artificially compact.

astro-ph.CO↗

arXiv2025

ViT-based Local Volume dwarf galaxy Identificationin (VIDA) in the CSST survey

Identifying dwarf galaxies within the Local Volume is crucial for constraining the luminosity function of satellite galaxies in the nearby universe. We report the detection capabilities of dwarf galaxies within the Local Volume using the Chinese Space Station Telescope (CSST). Based on the simulated imaging data of CSST, we develop a detection and classification pipeline that combines traditional image-based search techniques with advanced machine learning classification models. The simulated Local Volume dwarf galaxies can be identified using a pre-processing method for "extended source detection", followed by classification with a pretrained ViT-Base model. This pipeline achieves a true positive rate (TPR) exceeding 85% with a false positive rate (FPR) of only 0.1%. We quantify the detection completeness of Local Volume dwarf galaxies across a three-dimensional parameter space defined by absolute magnitude ($M_V$), half-light radius ($R_h$), and heliocentric distance, based on simulated single-exposure CSST wide-field imaging survey data. For unresolved or semi-resolved dwarf galaxies, our method achieves a significantly deeper absolute magnitude detection limit compared to catalog-based approaches, reaching $M_V = -7$ within 10 \Mpc. By combining this image-based approach with traditional stellar catalog-based "matched filter" techniques, our automated framework established in this work can identify dwarf galaxies within 20 \Mpc for the CSST mission.

astro-ph.GA↗

arXiv2025

Unit Commitment with Cost-Oriented Temporal Resolution

Time-adaptive unit commitment (UC) has recently been investigated to reduce the scheduling costs by flexibly varying the temporal resolution, which is usually determined by clustering the net load patterns. However, there exists a misalignment between cost and net load patterns due to the discrete start-up costs and out-of-merit-order dispatch triggered by ramping and other constraints. The optimal time-adaptive resolution cannot be completely captured by clustering-based method. This paper proposes a cost-oriented method to address this misalignment by a novel bilevel optimization approach that is efficiently solved through a heuristic greedy algorithm. The impact of varying temporal resolution on the final scheduling costs are tested, based on which the temporal resolution is heuristically updated, achieving significant cost reduction without increasing the number of temporal periods. Subsequently, an improved discretized Adam optimization method together with offline warm start and online refinement strategy is proposed to efficiently search for the better temporal resolution configuration. Results show that the proposed cost-oriented UC temporal resolution determination method achieves enhanced cost efficiency.

eess.SY↗

arXiv2025

Critical slowing down of black hole phase transition and kinetic crossover in supercritical regime

Reissner-Nordström-Anti-de Sitter (RNAdS) black holes in the extended phase space exhibit critical behavior analogous to the liquid-gas system, with critical exponents matching those of van der Waals-type phase transitions. However, the kinetics of these transitions near spinodal and critical points remain poorly understood. We demonstrate that both the autocorrelation time and the variance of trajectories increase significantly as the system approaches these special points, signaling critical slowing down. This behavior is driven by the flattening of the free energy landscape, as further confirmed by the lowest eigenvalue of the Fokker-Planck equation. Moreover, we uncover a clear dynamical crossover separating gas-like and liquid-like regimes in the supercritical region. This kinetic crossover defines the Widom line that closely matches the thermodynamic one obtained from the maxima of the isobaric heat capacity. These findings contribute to a deeper understanding of the kinetics of RNAdS black holes in the vicinity of spinodal and critical points.

gr-qc↗

arXiv2025

Co-Saving: Resource Aware Multi-Agent Collaboration for Software Development

Recent advancements in Large Language Models (LLMs) and autonomous agents have demonstrated remarkable capabilities across various domains. However, standalone agents frequently encounter limitations when handling complex tasks that demand extensive interactions and substantial computational resources. Although Multi-Agent Systems (MAS) alleviate some of these limitations through collaborative mechanisms like task decomposition, iterative communication, and role specialization, they typically remain resource-unaware, incurring significant inefficiencies due to high token consumption and excessive execution time. To address these limitations, we propose a resource-aware multi-agent system -- Co-Saving (meaning that multiple agents collaboratively engage in resource-saving activities), which leverages experiential knowledge to enhance operational efficiency and solution quality. Our key innovation is the introduction of "shortcuts" -- instructional transitions learned from historically successful trajectories -- which allows to bypass redundant reasoning agents and expedite the collective problem-solving process. Experiments for software development tasks demonstrate significant advantages over existing methods. Specifically, compared to the state-of-the-art MAS ChatDev, our method achieves an average reduction of 50.85% in token usage, and improves the overall code quality by 10.06%.

cs.CL↗

arXiv2025

Beyond path selection: Better LLMs for Scientific Information Extraction with MimicSFT and Relevance and Rule-induced(R$^2$)GRPO

Previous study suggest that powerful Large Language Models (LLMs) trained with Reinforcement Learning with Verifiable Rewards (RLVR) only refines reasoning path without improving the reasoning capacity in math tasks while supervised-finetuning(SFT) with distillation can. We study this from the view of Scientific information extraction (SciIE) where LLMs and reasoning LLMs underperforms small Bert-based models. SciIE require both the reasoning and memorization. We argue that both SFT and RLVR can refine the reasoning path and improve reasoning capacity in a simple way based on SciIE. We propose two-stage training with 1. MimicSFT, using structured reasoning templates without needing high-quality chain-of-thought data, 2. R$^2$GRPO with relevance and rule-induced rewards. Experiments on scientific IE benchmarks show that both methods can improve the reasoning capacity. R$^2$GRPO with mimicSFT surpasses baseline LLMs and specialized supervised models in relation extraction. Our code is available at https://github.com/ranlislz/R2GRPO.

cs.CL↗

arXiv2025

Morpho-Photometric Classification of KiDS DR5 Sources Based on Neural Networks: A Comprehensive Star-Quasar-Galaxy Catalog

We present a novel multimodal neural network (MNN) for classifying astronomical sources in multiband ground-based observations, from optical to near infrared, to separate sources in stars, galaxies and quasars. Our approach combines a convolutional neural network branch for learning morphological features from $r$-band images with an artificial neural network branch for extracting spectral energy distribution (SED) information. Specifically, we have used 9-band optical ($ugri$) and NIR ($ZYHJK_s$) data from the Kilo-Degree Survey (KiDS) Data Release 5. The two branches of the network are concatenated and feed into fully-connected layers for final classification. We train the network on a spectroscopically confirmed sample from the Sloan Digital Sky Survey cross-matched with KiDS. The trained model achieves 98.76\% overall accuracy on an independent testing dataset, with F1 scores exceeding 95\% for each class. Raising the output probability threshold, we obtain higher purity at the cost of a lower completeness. We have also validated the network using external catalogs cross-matched with KiDS, correctly classifying 99.74\% of a pure star sample selected from Gaia parallaxes and proper motions, and 99.74\% of an external galaxy sample from the Galaxy and Mass Assembly survey, adjusted for low-redshift contamination. We apply the trained network to 27,335,836 KiDS DR5 sources with $r \leqslant 23$ mag to generate a new classification catalog. This MNN successfully leverages both morphological and SED information to enable efficient and robust classification of stars, quasars, and galaxies in large photometric surveys.

astro-ph.GA↗

arXiv2025

Task Scheduling in Space-Air-Ground Uniformly Integrated Networks with Ripple Effects

Space-air-ground uniformly integrated network (SAGUIN), which integrates the satellite, aerial, and terrestrial networks into a unified communication architecture, is a promising candidate technology for the next-generation wireless systems. Transmitting on the same frequency band, higher-layer access points (AP), e.g., satellites, provide extensive coverage; meanwhile, it may introduce significant signal propagation delays due to the relatively long distances to the ground users, which can be multiple times longer than the packet durations in task-oriented communications. This phenomena is modeled as a new ``ripple effect'', which introduces spatiotemporally correlated interferences in SAGUIN. This paper studies the task scheduling problem in SAGUIN with ripple effect, and formulates it as a Markov decision process (MDP) to jointly minimize the age of information (AoI) at users and energy consumption at APs. The obtained MDP is challenging due to high dimensionality, partial observations, and dynamic resource constraints caused by ripple effect. To address the challenges of high dimensionality, we reformulate the original problem as a Markov game, where the complexities are managed through interactive decision-making among APs. Meanwhile, to tackle partial observations and the dynamic resource constraints, we adopt a modified multi-agent proximal policy optimization (MAPPO) algorithm, where the actor network filters out irrelevant input states based on AP coverage and its dimensionality can be reduced by more than an order of magnitude. Simulation results reveal that the proposed approach outperforms the benchmarks, significantly reducing users' AoI and APs' energy consumption.

cs.NI↗

arXiv2025

LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMs

Efficient red-teaming method to uncover vulnerabilities in Large Language Models (LLMs) is crucial. While recent attacks often use LLMs as optimizers, the discrete language space make gradient-based methods struggle. We introduce LARGO (Latent Adversarial Reflection through Gradient Optimization), a novel latent self-reflection attack that reasserts the power of gradient-based optimization for generating fluent jailbreaking prompts. By operating within the LLM's continuous latent space, LARGO first optimizes an adversarial latent vector and then recursively call the same LLM to decode the latent into natural language. This methodology yields a fast, effective, and transferable attack that produces fluent and stealthy prompts. On standard benchmarks like AdvBench and JailbreakBench, LARGO surpasses leading jailbreaking techniques, including AutoDAN, by 44 points in attack success rate. Our findings demonstrate a potent alternative to agentic LLM prompting, highlighting the efficacy of interpreting and attacking LLM internals through gradient optimization.

cs.LG↗

arXiv2025

Decoherence of quantum superpositions in near-extremal Reissner-Nordström black holes with quantum gravity corrections

We study the quantum gravity corrected decoherence of quantum superpositions in the near-extremal Reissner-Nordström black holes. By employing the effective field theory approach, we model the black hole as a quantum system coupled to an external source via a scalar field, and derive the relation between the decoherence rate and the two-point correlation function of the operators acting on the black quantum system. By utilizing the low-energy Schwarzian effective theory, which captures the boundary dynamics of the $AdS_2$ near-horizon geometry of the near-extremal Reissner-Nordström black holes, we compute the decoherence rate both in the microcanonical and canonical ensembles. We find that in the microcanonical ensemble, where the black hole energy is fixed, quantum gravity corrections do not modify the decoherence rate compared to the semiclassical prediction. However, in the canonical ensemble, where the black hole is in a thermal equilibrium state, quantum gravitational effects significantly enhance the decoherence rate at low temperatures. Our results demonstrate that even in the near-extremal limit where Hawking radiation is suppressed, quantum gravitational fluctuations can strongly influence the coherence of nearby quantum systems.

hep-th↗

arXiv2025

EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agents

Multimodal Large Language Models (MLLMs) have shown significant advancements, providing a promising future for embodied agents. Existing benchmarks for evaluating MLLMs primarily utilize static images or videos, limiting assessments to non-interactive scenarios. Meanwhile, existing embodied AI benchmarks are task-specific and not diverse enough, which do not adequately evaluate the embodied capabilities of MLLMs. To address this, we propose EmbodiedEval, a comprehensive and interactive evaluation benchmark for MLLMs with embodied tasks. EmbodiedEval features 328 distinct tasks within 125 varied 3D scenes, each of which is rigorously selected and annotated. It covers a broad spectrum of existing embodied AI tasks with significantly enhanced diversity, all within a unified simulation and evaluation framework tailored for MLLMs. The tasks are organized into five categories: navigation, object interaction, social interaction, attribute question answering, and spatial question answering to assess different capabilities of the agents. We evaluated the state-of-the-art MLLMs on EmbodiedEval and found that they have a significant shortfall compared to human level on embodied tasks. Our analysis demonstrates the limitations of existing MLLMs in embodied capabilities, providing insights for their future development. We open-source all evaluation data and simulation framework at https://github.com/thunlp/EmbodiedEval.

cs.CV↗

arXiv2025

Galaxy Mass Modelling from Multi-Wavelength JWST Strong Lens Analysis: Dark Matter Substructure, Angular Mass Complexity, or Both?

We analyze two galaxy-scale strong gravitational lenses, SPT0418-47 and SPT2147-50, using JWST NIRCam imaging across multiple filters. To account for angular complexity in the lens mass distribution, we introduce multipole perturbations with orders $m=1, 3, 4$. Our results show strong evidence for angular mass complexity in SPT2147, with multipole strengths of 0.3-1.7 $\%$ for $m=3, 4$ and 2.4-9.5 $\%$ for $m=1$, while SPT0418 shows no such preference. We also test lens models that include a dark matter substructure, finding a strong preference for a substructure in SPT2147-50 with a Bayes factor (log-evidence change) of $\sim 60$ when multipoles are not included. Including multipoles reduces the Bayes factor to $\sim 11$, still corresponding to a $5σ$ detection of a subhalo with an NFW mass of $\log_{10}(M_{200}/M_{\odot}) = 10.87\substack{+0.53\\ -0.71}$. While SPT2147-50 may represent the fourth detection of a dark matter substructure in a strong lens, further analysis is needed to confirm that the signal is not due to systematics associated with the lens mass model.

astro-ph.CO↗

arXiv2025

Power Spectra of Velocity Fluctuations in Granular Heap Flow

This study used Speckle Visibility Spectroscopy to examine velocity fluctuations in a three-dimensional granular heap flow, where the mean velocity profile consists of a fast-flow surface layer and a creep layer beneath. The velocity spectra follow power-law scalings, $E(f) \propto f^α$, with $α\approx -0.85$ in the surface flow layer -- matching the Self-Organized Criticality (SOC) model with open boundaries ($α\approx -0.95$). In the creep layer, $α$ decreases with depth, reaching $α\approx -1.5$ at approximately 55 mean particle diameters, consistent with the SOC model with closed boundaries ($α\approx -1.58$). Analysis of the fluctuation velocity distributions offers additional insights into the microscopic origins of the spectrum's characteristics. These findings help resolve the long-standing puzzle of flow localization in gravity-driven granular flows despite a constant shear stress-to-pressure ratio throughout the material.

cond-mat.soft↗

arXiv2025

Learning to Rewrite: Generalized LLM-Generated Text Detection

Large language models (LLMs) present significant risks when used to generate non-factual content and spread disinformation at scale. Detecting such LLM-generated content is crucial, yet current detectors often struggle to generalize in open-world contexts. We introduce Learning2Rewrite, a novel framework for detecting AI-generated text with exceptional generalization to unseen domains. Our method leverages the insight that LLMs inherently modify AI-generated content less than human-written text when tasked with rewriting. By training LLMs to minimize alterations on AI-generated inputs, we amplify this disparity, yielding a more distinguishable and generalizable edit distance across diverse text distributions. Extensive experiments on data from 21 independent domains and four major LLMs (GPT-3.5, GPT-4, Gemini, and Llama-3) demonstrate that our detector outperforms state-of-the-art detection methods by up to 23.04% in AUROC for in-distribution tests, 37.26% for out-of-distribution tests, and 48.66% under adversarial attacks. Our unique training objective ensures better generalizability compared to directly training for classification, when leveraging the same amount of parameters. Our findings suggest that reinforcing LLMs' inherent rewriting tendencies offers a robust and scalable solution for detecting AI-generated text.

cs.CL↗