arXiv subjects

Xiaojun Bi

Publications and source records attributed to Xiaojun Bi.

At least 19 recordsLinked to original sources

arXiv2026

Are We There Yet? Assessing Computer-Use Agents for Blind Users' Accessible Interaction with Desktop Applications

Computer-use agents are emerging as a paradigm for agentic human-AI interaction, combining language reasoning with multi-modal interface grounding to operate GUIs. Yet their effectiveness for blind screen-reader users in real-world desktop workflows remains unclear. We present a three-week diary study with 8 blind users using OLLA, a screen-reader-accessible CUA prototype, collecting 1,258 commands across 12 applications with screenshots, UI trees, model responses, and action traces. We evaluate GPT-5 during deployment and re-execute the same commands with four additional models. GPT-5 achieved the highest success rate at 52.5%. Trace analysis reveals grounding, planning, constraint-tracking, and termination failures, while interviews reveal beyond-automation needs.

cs.HC↗

arXiv2026

Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible Products

AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the available product-manual resources to assemble, operate, and troubleshoot physical or tangible products - tasks requiring spatial reasoning, structural understanding, and precise execution. We address this knowledge gap via an interview study and a usability study with blind participants, investigating how they leverage AI tools and product manuals for DIY tasks with physical products. Findings show that manuals are essential resources, but product-manual instructions are often inadequate for blind users. AI tools presently do not adequately address this insufficiency; in fact, we observed that they often exacerbate this issue with incomplete, incoherent, or misleading guidance. Lastly, we suggest improvements to AI tools for generating tailored instructions for blind users' DIY tasks involving tangible products.

cs.HC↗

arXiv2026

Finding the Signal in the Noise: An Exploratory Study on Assessing the Effectiveness of AI and Accessibility Forums for Blind Users' Support Needs

Accessibility forums and, more recently, generative AI tools have become vital resources for blind users seeking solutions to computer-interaction issues and learning about new assistive technologies, screen reader features, tutorials, and software updates. Understanding user experiences with these resources is essential for identifying and addressing persistent support gaps. Towards this, we interviewed 14 blind users who regularly engage with forums and GenAI tools. Findings revealed that forums often overwhelm users with multiple overlapping topics, redundant or irrelevant content, and fragmented responses that must be mentally pieced together, increasing cognitive load. GenAI tools, while offering more direct assistance, introduce new barriers by producing unreliable answers, including overly verbose or fragmented guidance, fabricated information, and contradictory suggestions that fail to follow prompts, thereby heightening verification demands. Based on these insights, we outlined design opportunities to improve the reliability of assistive resources, aiming to provide blind users with more trustworthy and cognitively-manageable support.

cs.HC↗

arXiv2026

KeySense: LLM-Powered Hands-Down, Ten-Finger Typing on Commodity Touchscreens

Existing touchscreen software keyboards prevent users from resting their hands, forcing slow and fatiguing index-finger tapping ("chicken typing") instead of familiar hands-down ten-finger typing. We present KeySense, a purely software solution that preserves physical keyboard motor skills. KeySense isolates intentional taps from resting-finger noise using cognitive-motor timing patterns, and then uses a fine-tuned LLM decoder to convert the resulting noisy letter sequence into the intended word. In controlled component tests, the decoder substantially outperforms two statistical baselines (top-1 accuracy 84.8% vs 75.7% and 79.3%). A 12-participant study shows clear ergonomic and performance benefits: compared with the conventional hover-style keyboard, users rated KeySense as markedly less physically demanding (NASA-TLX median 1.5 vs 4.0), and after brief practice typed significantly faster (WPM 28.3 vs 26.2, p < 0.01). These results indicate that KeySense enables accurate, efficient, and comfortable ten-finger text entry on commodity touchscreens without any extra hardware.

cs.HC↗

arXiv2025

A Giant Peanut-shaped Ultra-High-Energy Gamma-Ray Emitter Off the Galactic Plane

Ultra-high-energy (UHE), exceeding 100 TeV (10^12 electronvolts), {\gamma}-rays manifests extreme particle acceleration in astrophysical sources. Recent observations by {\gamma}-ray telescopes, particularly by the Large High Altitude Air Shower Observatory (LHAASO), have revealed a few tens of UHE sources, indicating numerous Galactic sources capable of accelerating particles to PeV (10^15 electronvolts) energies. However, discerning the dominant acceleration mechanisms (leptonic versus hadronic), the relative contributions of specific source classes, and the role of particle transport in shaping their observed emission are central goals of modern UHE astrophysics. Here we report the discovery of a giant UHE {\gamma}-ray emitter at -17.5{\deg} off the Galactic plane - a region where UHE {\gamma}-ray sources are rarely found. The emitter exhibits a distinctive asymmetric shape, resembling a giant "Peanut" spanning 0.45{\deg} \times 4.6{\deg}, indicative of anisotropic particle distribution over a large area. A highly aged millisecond pulsar (MSP) J0218+4232 is the sole candidate accelerator positionally coincident with the Peanut region. Its association with UHE {\gamma}-rays extending to 0.7 PeV, if confirmed, would provide the first evidence of a millisecond pulsar powering PeV particles. Such a finding challenges prevailing models, which posit that millisecond pulsars cannot sustain acceleration to PeV energies. The detection reveals fundamental gaps in understanding particle acceleration, cosmic-ray transport, and interstellar magnetic field effects, potentially revealing new PeV accelerator (PeVatron) classes.

astro-ph.HE↗

arXiv2025

Uni-DocDiff: A Unified Document Restoration Model Based on Diffusion

Removing various degradations from damaged documents greatly benefits digitization, downstream document analysis, and readability. Previous methods often treat each restoration task independently with dedicated models, leading to a cumbersome and highly complex document processing system. Although recent studies attempt to unify multiple tasks, they often suffer from limited scalability due to handcrafted prompts and heavy preprocessing, and fail to fully exploit inter-task synergy within a shared architecture. To address the aforementioned challenges, we propose Uni-DocDiff, a Unified and highly scalable Document restoration model based on Diffusion. Uni-DocDiff develops a learnable task prompt design, ensuring exceptional scalability across diverse tasks. To further enhance its multi-task capabilities and address potential task interference, we devise a novel \textbf{Prior \textbf{P}ool}, a simple yet comprehensive mechanism that combines both local high-frequency features and global low-frequency features. Additionally, we design the \textbf{Prior \textbf{F}usion \textbf{M}odule (PFM)}, which enables the model to adaptively select the most relevant prior information for each specific task. Extensive experiments show that the versatile Uni-DocDiff achieves performance comparable or even superior performance compared with task-specific expert models, and simultaneously holds the task scalability for seamless adaptation to new tasks.

cs.CV↗

arXiv2025

Gather and Trace: Rethinking Video TextVQA from an Instance-oriented Perspective

Video text-based visual question answering (Video TextVQA) aims to answer questions by explicitly reading and reasoning about the text involved in a video. Most works in this field follow a frame-level framework which suffers from redundant text entities and implicit relation modeling, resulting in limitations in both accuracy and efficiency. In this paper, we rethink the Video TextVQA task from an instance-oriented perspective and propose a novel model termed GAT (Gather and Trace). First, to obtain accurate reading result for each video text instance, a context-aggregated instance gathering module is designed to integrate the visual appearance, layout characteristics, and textual contents of the related entities into a unified textual representation. Then, to capture dynamic evolution of text in the video flow, an instance-focused trajectory tracing module is utilized to establish spatio-temporal relationships between instances and infer the final answer. Extensive experiments on several public Video TextVQA datasets validate the effectiveness and generalization of our framework. GAT outperforms existing Video TextVQA methods, video-language pretraining methods, and video large language models in both accuracy and inference speed. Notably, GAT surpasses the previous state-of-the-art Video TextVQA methods by 3.86\% in accuracy and achieves ten times of faster inference speed than video large language models. The source code is available at https://github.com/zhangyan-ucas/GAT.

cs.CV↗

arXiv2025

DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms

Dongba pictographic is the only pictographic script still in use in the world. Its pictorial ideographic features carry rich cultural and contextual information. However, due to the lack of relevant datasets, research on semantic understanding of Dongba hieroglyphs has progressed slowly. To this end, we constructed \textbf{DongbaMIE} - the first dataset focusing on multimodal information extraction of Dongba pictographs. The dataset consists of images of Dongba hieroglyphic characters and their corresponding semantic annotations in Chinese. It contains 23,530 sentence-level and 2,539 paragraph-level high-quality text-image pairs. The annotations cover four semantic dimensions: object, action, relation and attribute. Systematic evaluation of mainstream multimodal large language models shows that the models are difficult to perform information extraction of Dongba hieroglyphs efficiently under zero-shot and few-shot learning. Although supervised fine-tuning can improve the performance, accurate extraction of complex semantics is still a great challenge at present.

cs.CV↗

arXiv2025

SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring

Fingerspelling is a critical part of American Sign Language (ASL) recognition and has become an accessible optional text entry method for Deaf and Hard of Hearing (DHH) individuals. In this paper, we introduce SpellRing, a single smart ring worn on the thumb that recognizes words continuously fingerspelled in ASL. SpellRing uses active acoustic sensing (via a microphone and speaker) and an inertial measurement unit (IMU) to track handshape and movement, which are processed through a deep learning algorithm using Connectionist Temporal Classification (CTC) loss. We evaluated the system with 20 ASL signers (13 fluent and 7 learners), using the MacKenzie-Soukoref Phrase Set of 1,164 words and 100 phrases. Offline evaluation yielded top-1 and top-5 word recognition accuracies of 82.45% (9.67%) and 92.42% (5.70%), respectively. In real-time, the system achieved a word error rate (WER) of 0.099 (0.039) on the phrases. Based on these results, we discuss key lessons and design implications for future minimally obtrusive ASL recognition wearables.

cs.HC↗

arXiv2024

Constraining anisotropic diffusion between Geminga and Earth with the cosmic-ray electron and positron spectrum

The gamma-ray halo surrounding Geminga suggests a notable reduction in cosmic-ray diffusion. One potential explanation for this phenomenon is the projection effect of slow diffusion perpendicular to the average magnetic field (represented by the diffusion coefficient $D_\perp$) within an anisotropic diffusion framework. In this context, the diffusion coefficient parallel to the mean field ($D_\parallel$) may remain substantial, allowing electrons and positrons ($e^\pm$) generated by Geminga to effectively propagate towards Earth along magnetic field lines, potentially leading to an observable $e^\pm$ flux. This study initially establishes the fundamental parameters of the anisotropic model based on the morphology and spectral observations of the Geminga halo, and subsequently forecasts the $e^\pm$ flux generated by Geminga at Earth's location. Our findings indicate that the $e^-+e^+$ spectrum obtained by DAMPE can provide critical constraints on the anisotropic diffusion model: to ensure that the projected spectrum does not surpass the observational data, the Alfv\'en Mach number of the turbulent magnetic field ($M_A$) should not fall below 0.75, corresponding to $D_\parallel/D_\perp\lesssim3$ given $D_\perp=D_\parallel M_A^4$. This suggests that a substantial reduction in $D_\parallel$ relative to the Galactic average may still be necessary. Additionally, our analysis reveals that within the anisotropic diffusion framework, Geminga could generate a distinct peak around 1 TeV in the $e^-+e^+$ spectrum, potentially accounting for the anomalous 1.4 TeV excess tentatively detected by DAMPE.

astro-ph.HE↗

arXiv2024

Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models

Blind individuals, who by necessity depend on screen readers to interact with computers, face considerable challenges in navigating the diverse and complex graphical user interfaces of different computer applications. The heterogeneity of various application interfaces often requires blind users to remember different keyboard combinations and navigation methods to use each application effectively. To alleviate this significant interaction burden imposed by heterogeneous application interfaces, we present Savant, a novel assistive technology powered by large language models (LLMs) that allows blind screen reader users to interact uniformly with any application interface through natural language. Novelly, Savant can automate a series of tedious screen reader actions on the control elements of the application when prompted by a natural language command from the user. These commands can be flexible in the sense that the user is not strictly required to specify the exact names of the control elements in the command. A user study evaluation of Savant with 11 blind participants demonstrated significant improvements in interaction efficiency and usability compared to current practices.

cs.HC↗

arXiv2024

A New Perspective on the Diffuse Gamma-Ray Emission Excess

The Large High-Altitude Air Shower Observatory (LHAASO) recently published measurements of diffuse Galactic gamma-ray emission (DGE) in the 10-1000 TeV energy range. The measured DGE flux is significantly higher than the expectation from hadronic interactions between cosmic rays (CRs) and the interstellar medium. This excess has been proposed to originate from unknown extended sources produced by electron radiation, such as pulsar wind nebulae or pulsar halos (PWNe/halos). In this study, we propose a new perspective to explain the DGE excess observed by LHAASO. The masking regions used in the LHAASO DGE measurement may not fully encompass the extended signals of PWNe/halos. By employing a two-zone diffusion model for electrons around pulsars, we find that the DGE excess in most regions of the Galactic plane can be well explained by the signal leakage model under certain parameters. Our results indicate that the signal leakage from known sources and contributions from unresolved sources should be considered complementary in explaining the DGE excess.

astro-ph.HE↗

arXiv2024

Mix Q-learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning

Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages in data acquisition and interpretability. However, current models often overlook collaboration, which affects not only impacts overall traffic efficiency but also hinders the vehicle's own normal driving in the long run. To address the aforementioned issue, this paper proposes a method named Mix Q-learning for Lane Changing(MQLC) that integrates a hybrid value Q network, taking into account both collective and individual benefits for the greater good. At the collective level, our method coordinates the individual Q and global Q networks by utilizing global information. This enables agents to effectively balance their individual interests with the collective benefit. At the individual level, we integrated a deep learning-based intent recognition module into our observation and enhanced the decision network. These changes provide agents with richer decision information and more accurate feature extraction for improved lane-changing decisions. This strategy enables the multi-agent system to learn and formulate optimal decision-making strategies effectively. Our MQLC model, through extensive experimental results, impressively outperforms other state-of-the-art multi-agent decision-making methods, achieving significantly safer and faster lane-changing decisions. The code is available at https:github.com/pku-smart-city/source_code/tree/main/MQLC.

cs.AI↗

arXiv2019

QCD axion and Neutrino induced by Hidden flavor structure

We study the reasonable requirements of two anomalous $U(1)$s in a flavored-axion framework for the anomaly cancellations of both $U(1)$-mixed gravity and $U(1)_Y\times[U(1)]^2$ which in turn determine the $U(1)_Y$ charges where $U(1)_Y$ is the hypercharge gauge symmetry of the standard model. We argue that, with a flavor symmetry group, axion-induced topology in symmetry-broken phases plays crucial roles in describing how quarks and leptons are organized at a fundamental level and make deep connections with each other. A unified model, as an example, is then proposed in a simple way to describe a whole spectrum of particles where both flavored-axion interactions with normal matter and the masses and mixings of fermions emerge from the spontaneous breaking of a given symmetry group. Once a scale of active neutrino mass defined at a seesaw scale is fixed by the commensurate $U(1)$ flavored-PQ charge of fermions, that of QCD axion decay constant $F_A$ is determined. In turn, fundamental physical parameters complementary to each other are predicted with the help of precision flavor experiments. Model predictions are extracted on the characteristics of neutrino and flavored-axion: $F_A=3.57^{\,+1.52}_{\,-1.53}\times10^{10}$ GeV (consequently, QCD axion mass $m_a=1.52^{+1.14}_{-0.46}\times10^{-4}$ eV, axion to photon coupling $|g_{a\gamma\gamma}|=2.15^{+1.61}_{-0.64}\times10^{-14}\,\text{GeV}^{-1}$, axion to electron coupling $g_{Aee}=3.29^{+2.47}_{-0.98}\times10^{-14}$, etc.); atmospheric mixing angle $\theta_{23}$, Dirac CP phase $\delta_{CP}$, and $0\nu\beta\beta${\it-decay rate} for normal mass ordering and inverted one by taking quantum corrections into account.

hep-ph↗

arXiv2019

The Large High Altitude Air Shower Observatory (LHAASO) Science Book (2021 Edition)

Since the science white paper of the Large High Altitude Air Shower Observatory (LHAASO) published on arXiv in 2019 [e-Print: 1905.02773 (astro-ph.HE)], LHAASO has completed the transition from a project to an operational gamma-ray astronomical observatory LHAASO is a new generation multi-component facility located in Daocheng, Sichuan province of China, at an altitude of 4410 meters. It aims at measuring with unprecedented sensitivity the spectrum, composition, and anisotropy of cosmic rays in the energy range between 10$^{12}$ and 10$^{18}$~eV, and acting simultaneously as a wide aperture (one stereoradiant) continuously operating gamma-ray telescope in the energy range between 10$^{11}$ and $10^{15}$~eV with the designed sensitivity of 1.3\% of the Crab Unit (CU) above 100 TeV. LHAASO's capability of measuring simultaneously different shower components (electrons, muons, and Cherenkov/fluorescence light), will allow it to investigate the origin, acceleration, and propagation of CR through measurement of the energy spectrum, elemental composition, and anisotropy with unprecedented resolution. The remarkable sensitivity of LHAASO will play a key role in CR physics and gamma-ray astronomy for a general and comprehensive exploration of the high energy universe and will allow important studies of fundamental physics (such as indirect dark matter search, Lorentz invariance violation, quantum gravity) and solar and heliospheric physics. The LHAASO Collaboration organized an editorial working group and finished all editorial work of this science book, to summarize the instrumental features and outline the prospects of scientific researches with the LHAASO experiment.

astro-ph.HE↗

arXiv2019

A Light Dual-Task Neural Network for Haze Removal

Single-image dehazing is a challenging problem due to its ill-posed nature. Existing methods rely on a suboptimal two-step approach, where an intermediate product like a depth map is estimated, based on which the haze-free image is subsequently generated using an artificial prior formula. In this paper, we propose a light dual-task Neural Network called LDTNet that restores the haze-free image in one shot. We use transmission map estimation as an auxiliary task to assist the main task, haze removal, in feature extraction and to enhance the generalization of the network. In LDTNet, the haze-free image and the transmission map are produced simultaneously. As a result, the artificial prior is reduced to the smallest extent. Extensive experiments demonstrate that our algorithm achieves superior performance against the state-of-the-art methods on both synthetic and real-world images.

cs.CV↗

arXiv2011

Neutrino Splitting and Density-Dependent Dispersion Relations

We show that particles can split only when their group velocity exceeds their phase velocity. In this sense the splitting process is the quantum analog of the modulational instability in anomalous dispersive media. In the case of a neutrino whose dispersion relation contains a subdominant Lorentz-violating correction of the form aP^k, the neutrino will decay into two neutrinos and an antineutrino at a rate proportional to a^3G_F^2E^{2+3k}. Unlike the Cohen-Glashow instability, the splitting instability exists even if all particles involved in the interaction have the same dispersion relations at the relevant energy scales. We show that this instability leads to strong constraints even if the energy E is a function of both the momentum P and also of the background density rho, for example we show that it alone would have been sufficient to eliminate any model of the MINOS/OPERA velocity anomaly which modifies the neutrino dispersion relation while leaving those of other particles intact.

hep-ph↗

arXiv2010

Modeling the Multi-Wavelength Emission of Shell-Type Supernova Remnant RX J1713.7-3946

Emission mechanisms of the shell-type supernova remnant (SNR) RX J1713.7-3946 are studied with multi-wavelength observational data from radio, X-ray, GeV $\gamma$-ray to TeV $\gamma$-ray band. A Markov Chain Monte Carlo method is employed to explore the high-dimensional model parameter space systematically. Three scenarios for the $\gamma$-ray emission are investigated: the leptonic, the hadronic and a hybrid one. Thermal emission from the background plasma is also included to constrain the gas density, assuming ionization equilibrium, and a 2$\sigma$ upper limit of about 0.03 cm$^{-3}$ is obtained as far as thermal energies account for a significant fraction of the dissipated kinetic energy of the SNR shock. Although systematic errors dominate the $\chi^2$ of the spectral fit of all models, we find that 1) the leptonic model has the best constrained model parameters, whose values can be easily accommodated with a typical supernova, but gives relatively poor fit to the TeV $\gamma$-ray data; 2) The hybrid scenario has one more parameter than the leptonic one and improves the overall spectral fit significantly; 3) The hadronic one, which has three more parameters than the leptonic model, gives the best fit to the overall spectrum with relatively not-well-constrained model parameters and very hard spectra of accelerated particles. The uncertainties of the model parameters decrease significantly if the spectral indices of accelerated electrons and protons are the same. The hybrid and hadronic models also require an energy input into high-energy protons, which seems to be too high compared with typical values of a supernova explosion. Further investigations are required to reconcile these observations with SNR theories.

astro-ph.HE↗