arXiv Science⌕ Search

arXiv subjects

Han Li

Publications and source records attributed to Han Li.

At least 235 records · Page 13Linked to original sources

3DGR-CT: Sparse-View CT Reconstruction with a 3D Gaussian Representation

Sparse-view computed tomography (CT) reduces radiation exposure by acquiring fewer projections, making it a valuable tool in clinical scenarios where low-dose radiation is essential. However, this often results in increased noise and artifacts due to limited data. In this paper we propose a novel 3D Gaussian representation (3DGR) based method for sparse-view CT reconstruction. Inspired by recent success in novel view synthesis driven by 3D Gaussian splatting, we leverage the efficiency and expressiveness of 3D Gaussian representation as an alternative to implicit neural representation. To unleash the potential of 3DGR for CT imaging scenario, we propose two key innovations: (i) FBP-image-guided Guassian initialization and (ii) efficient integration with a differentiable CT projector. Extensive experiments and ablations on diverse datasets demonstrate the proposed 3DGR-CT consistently outperforms state-of-the-art counterpart methods, achieving higher reconstruction accuracy with faster convergence. Furthermore, we showcase the potential of 3DGR-CT for real-time physical simulation, which holds important clinical applications while challenging for implicit neural representations.

eess.IV↗

Comprehensive List Generation for Multi-Generator Reranking

Reranking models solve the final recommendation lists that best fulfill users' demands. While existing solutions focus on finding parametric models that approximate optimal policies, recent approaches find that it is better to generate multiple lists to compete for a ``pass'' ticket from an evaluator, where the evaluator serves as the supervisor who accurately estimates the performance of the candidate lists. In this work, we show that we can achieve a more efficient and effective list proposal with a multi-generator framework and provide empirical evidence on two public datasets and online A/B tests. More importantly, we verify that the effectiveness of a generator is closely related to how much it complements the views of other generators with sufficiently different rerankings, which derives the metric of list comprehensiveness. With this intuition, we design an automatic complementary generator-finding framework that learns a policy that simultaneously aligns the users' preferences and maximizes the list comprehensiveness metric. The experimental results indicate that the proposed framework can further improve the multi-generator reranking performance.

cs.IR↗

Generative Regression Based Watch Time Prediction for Short-Video Recommendation

Watch time prediction (WTP) has emerged as a pivotal task in short video recommendation systems, designed to quantify user engagement through continuous interaction modeling. Predicting users' watch times on videos often encounters fundamental challenges, including wide value ranges and imbalanced data distributions, which can lead to significant estimation bias when directly applying regression techniques. Recent studies have attempted to address these issues by converting the continuous watch time estimation into an ordinal regression task. While these methods demonstrate partial effectiveness, they exhibit notable limitations: (1) the discretization process frequently relies on bucket partitioning, inherently reducing prediction flexibility and accuracy and (2) the interdependencies among different partition intervals remain underutilized, missing opportunities for effective error correction. Inspired by language modeling paradigms, we propose a novel Generative Regression (GR) framework that reformulates WTP as a sequence generation task. Our approach employs \textit{structural discretization} to enable nearly lossless value reconstruction while maintaining prediction fidelity. Through carefully designed vocabulary construction and label encoding schemes, each watch time is bijectively mapped to a token sequence. To mitigate the training-inference discrepancy caused by teacher-forcing, we introduce a \textit{curriculum learning with embedding mixup} strategy that gradually transitions from guided to free-generation modes. We evaluate our method against state-of-the-art approaches on two public datasets and one industrial dataset. We also perform online A/B testing on the Kuaishou App to confirm the real-world effectiveness. The results conclusively show that GR outperforms existing techniques significantly.

cs.LG↗

Explicit Uncertainty Modeling for Video Watch Time Prediction

In video recommendation, a critical component that determines the system's recommendation accuracy is the watch-time prediction module, since how long a user watches a video directly reflects personalized preferences. One of the key challenges of this problem is the user's stochastic watch-time behavior. To improve the prediction accuracy for such an uncertain behavior, existing approaches show that one can either reduce the noise through duration bias modeling or formulate a distribution modeling task to capture the uncertainty. However, the uncontrolled uncertainty is not always equally distributed across users and videos, inducing a balancing paradox between the model accuracy and the ability to capture out-of-distribution samples. In practice, we find that the uncertainty of the watch-time prediction model also provides key information about user behavior, which, in turn, could benefit the prediction task itself. Following this notion, we derive an explicit uncertainty modeling strategy for the prediction model and propose an adversarial optimization framework that can better exploit the user watch-time behavior. This framework has been deployed online on an industrial video sharing platform that serves hundreds of millions of daily active users, which obtains a significant increase in users' video watch time by 0.31% through the online A/B test. Furthermore, extended offline experiments on two public datasets verify the effectiveness of the proposed framework across various watch-time prediction backbones.

cs.IR↗

Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which retrieves relevant documents from the user's history to reflect their preferences and enhance LLM generation, is one commonly used approach for personalization. However, existing personalized RAG methods do not consider that the histories of similar users can also assist in personalized generation for the current user, meaning that collaborative information between users can also benefit personalized generation. Inspired by the application of collaborative filtering in recommender systems, we propose a method called CFRAG, which adapts Collaborative Filtering to RAG for personalized text generation. However, this presents two challenges: (1)~how to incorporate collaborative information without explicit user similarity labels? (2)~how to retrieve documents that support personalized LLM generation? For Challenge 1, we use contrastive learning to train user embeddings to retrieve similar users and introduce collaborative information. For Challenge 2, we design a personalized retriever and reranker to retrieve the top-$k$ documents from these users' histories. We take into account the user's preference during retrieval and reranking. Then we leverage feedback from the LLM to fine-tune the personalized retriever and reranker, enabling them to retrieve documents that meet the personalized generation needs of the LLM. Experimental results on the Language Model Personalization (LaMP) benchmark validate the effectiveness of CFRAG. Further analysis confirms the importance of incorporating collaborative information.

cs.IR↗

QE-RAG: A Robust Retrieval-Augmented Generation Benchmark for Query Entry Errors

Retriever-augmented generation (RAG) has become a widely adopted approach for enhancing the factual accuracy of large language models (LLMs). While current benchmarks evaluate the performance of RAG methods from various perspectives, they share a common assumption that user queries used for retrieval are error-free. However, in real-world interactions between users and LLMs, query entry errors such as keyboard proximity errors, visual similarity errors, and spelling errors are frequent. The impact of these errors on current RAG methods against such errors remains largely unexplored. To bridge this gap, we propose QE-RAG, the first robust RAG benchmark designed specifically to evaluate performance against query entry errors. We augment six widely used datasets by injecting three common types of query entry errors into randomly selected user queries at rates of 20\% and 40\%, simulating typical user behavior in real-world scenarios. We analyze the impact of these errors on LLM outputs and find that corrupted queries degrade model performance, which can be mitigated through query correction and training a robust retriever for retrieving relevant documents. Based on these insights, we propose a contrastive learning-based robust retriever training method and a retrieval-augmented query correction method. Extensive in-domain and cross-domain experiments reveal that: (1) state-of-the-art RAG methods including sequential, branching, and iterative methods, exhibit poor robustness to query entry errors; (2) our method significantly enhances the robustness of RAG when handling query entry errors and it's compatible with existing RAG methods, further improving their robustness.

cs.IR↗

1-Tb/s/λ Transmission over Record 10714-km AR-HCF

We present the first single-channel 1.001-Tb/s DP-36QAM-PCS recirculating transmission over 73 loops of 146.77-km ultra-low-loss & low-IMI DNANF-5 fiber, achieving a record transmission distance of 10,714.28 km.

physics.optics↗

Comment Staytime Prediction with LLM-enhanced Comment Understanding

In modern online streaming platforms, the comments section plays a critical role in enhancing the overall user experience. Understanding user behavior within the comments section is essential for comprehensive user interest modeling. A key factor of user engagement is staytime, which refers to the amount of time that users browse and post comments. Existing watchtime prediction methods struggle to adapt to staytime prediction, overlooking interactions with individual comments and their interrelation. In this paper, we present a micro-video recommendation dataset with video comments (named as KuaiComt) which is collected from Kuaishou platform. correspondingly, we propose a practical framework for comment staytime prediction with LLM-enhanced Comment Understanding (LCU). Our framework leverages the strong text comprehension capabilities of large language models (LLMs) to understand textual information of comments, while also incorporating fine-grained comment ranking signals as auxiliary tasks. The framework is two-staged: first, the LLM is fine-tuned using domain-specific tasks to bridge the video and the comments; second, we incorporate the LLM outputs into the prediction model and design two comment ranking auxiliary tasks to better understand user preference. Extensive offline experiments demonstrate the effectiveness of our framework, showing significant improvements on the task of comment staytime prediction. Additionally, online A/B testing further validates the practical benefits on industrial scenario. Our dataset KuaiComt (https://github.com/lyingCS/KuaiComt.github.io) and code for LCU (https://github.com/lyingCS/LCU) are fully released.

cs.IR↗

Density wave order with antiphase feature associated with the pseudogap in cuprate superconductor Bi2+xSr2-xCuO6+delta

The strong correlation effect in cuprate superconductors have greatly enriched the phase diagram showing the co-existence of superconductivity with many intertwined orders. One of the prominent issues concerning the superconductivity mechanism is about the pseudogap phase which behaves either as cooperator or competitor for superconductivity and its fundamental reason remains still elusive. Here we report the measurements of scanning tunneling microscopy/spectroscopy (STM/STS) in the model superconducting system Bi2+xSr2-xCuO6+delta with a transition temperature Tc~7 K. Although this system is supposed to be slightly overdoped, a pseudogap feature can be easily observed in the energy region of about 20-60 meV. A modulation of local density of states (LDOS) with a periodicity of about 4a0/3 (a0: Cu-O-Cu bond length) can be easily observed, which is also supported by the Fourier transformation pattern with wavevectors at about (0,+-3pi/2a0) and (+-3pi/2a0,0). Surprisingly, we find that the LDOS exhibits a clear antiphase feature in the pseudogap energy region below and above the Fermi energy, indicating that it is an intrinsic feature of the pseudogap phase. We interpret this modulation and antiphase feature as a possible consequence of the pair density wave due to the Amperean pairing with finite momentum. Our results give a deep insight on the understanding of the pseudogap phase in cuprate superconductors.

cond-mat.supr-con↗

HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimation

Existing 2D-to-3D human pose estimation (HPE) methods struggle with the occlusion issue by enriching information like temporal and visual cues in the lifting stage. In this paper, we argue that these methods ignore the limitation of the sparse skeleton 2D input representation, which fundamentally restricts the 2D-to-3D lifting and worsens the occlusion issue. To address these, we propose a novel two-stage generative densification method, named Hierarchical Pose AutoRegressive Transformer (HiPART), to generate hierarchical 2D dense poses from the original sparse 2D pose. Specifically, we first develop a multi-scale skeleton tokenization module to quantize the highly dense 2D pose into hierarchical tokens and propose a Skeleton-aware Alignment to strengthen token connections. We then develop a Hierarchical AutoRegressive Modeling scheme for hierarchical 2D pose generation. With generated hierarchical poses as inputs for 2D-to-3D lifting, the proposed method shows strong robustness in occluded scenarios and achieves state-of-the-art performance on the single-frame-based 3D HPE. Moreover, it outperforms numerous multi-frame methods while reducing parameter and computational complexity and can also complement them to further enhance performance and robustness.

cs.CV↗

An experimental study of using artificial reefs as scour protection around an offshore wind monopile

Artificial reefs (ARs) are man-made structures deployed on the seabed to support benthic marine ecosystems. Their presence significantly damps the local flow and therefore can be used for scour protection of offshore wind monopiles. Although the concept appears feasible, the underlying flow-sediment process is very complex and has yet been systematically investigated. To fill in this gap, a set of fixed-bed flume tests were conducted to reveal the hydrodynamic details of two typical AR shapes (cubic and hemisphere) tightly placed around a monopile in a 3x3 pattern. In parallel, a set of live-bed tests were conducted to demonstrate the AR's efficiency in scour protection. The cubic ARs almost eliminate the downward flow on the upstream side of the monopile and reduces the wake flow by 50-80%. The hemisphere ARs also significantly weaken the wake flow but guide descending flow in front of the monopile. While cubic ARs decrease upstream and downstream scour depth by up to 100%, their edge scour can lead to ARs displacement and hence reduce scour protection. The hemisphere ARs provided less scour reduction, but also less edge scour, making them more adaptive to morphology changes. Based on these findings, an optimized AR layout was proposed.

physics.flu-dyn↗

"Half-Bogoliubons" as the intermediate states for the phase coherence in underdoped cuprates

Superconductivity is achieved by the pairing of electrons and phase coherence between the Cooper pairs. According to the Bardeen-Cooper-Schrieffer theory, the quasiparticles with Bogoliubov dispersion exists and reveal particle-hole symmetric coherence peaks on the single particle tunneling spectrum. Here we report the observation of two kinds of tunneling spectra showing only one side of the "coherence peak" but with symmetric energies (about +-11 meV) in underdoped cuprate superconductor Bi2Sr2-xLaxCuO6 single crystals (p=0.114) with fractional superconductivity. Merging these two kinds of spectra can mimic the complete Bogoliubov dispersion, thus we name the electronic states associated with these half-peaked spectrum as "half Bogoliubons". In previous studies, it was shown that two doped holes may bind into a local pair within the 4a0 x 4a0 plaquette of CuO bonds (a0: distance between nearest Cu atoms). We attribute the "half-Bogoliubons" to the intermediate states for the phase coherence, and they correspond to the three-hole and one-hole states as the excited ones from the local pairing state of two holes. An entanglement of these two "half-Bogoliubons" would mean the dynamic hopping of charge freedom resulting in the phase coherence between the local paired states. Our results unravel a unique process for establishing the phase coherence through exchanging a charge between the regions with local pairs.

cond-mat.supr-con↗

AccessFixer: Enhancing GUI Accessibility for Low Vision Users With R-GCN Model

The Graphical User Interface (GUI) plays a critical role in the interaction between users and mobile applications (apps), aiming at facilitating the operation process. However, due to the variety of functions and non-standardized design, GUIs might have many accessibility issues, like the size of components being too small or their intervals being narrow. These issues would hinder the operation of low vision users, preventing them from obtaining information accurately and conveniently. Although several technologies and methods have been proposed to address these issues, they are typically confined to issue identification, leaving the resolution in the hands of developers. Moreover, it can be challenging to ensure that the color, size, and interval of the fixed GUIs are appropriately compared to the original ones. In this work, we propose a novel approach named AccessFixer, which utilizes the Relational-Graph Convolutional Neural Network (R-GCN) to simultaneously fix three kinds of accessibility issues, including small sizes, narrow intervals, and low color contrast in GUIs. With AccessFixer, the fixed GUIs would have a consistent color palette, uniform intervals, and adequate size changes achieved through coordinated adjustments to the attributes of related components. Our experiments demonstrate the effectiveness and usefulness of AccessFixer in fixing GUI accessibility issues. After fixing 30 real-world apps, our approach solves an average of 81.2% of their accessibility issues. Also, we apply AccessFixer to 10 open-source apps by submitting the fixed results with pull requests (PRs) on GitHub. The results demonstrate that developers approve of our submitted fixed GUIs, with 8 PRs being merged or under fixing. A user study examines that low vision users host a positive attitude toward the GUIs fixed by our method.

cs.SE↗

New Constant Dimension Codes From the Inserting Mixed Dimension Construction and Multilevel Construction

Constant dimension codes (CDCs) are essential for error correction in random network coding. A fundamental problem of CDCs is to determine their maximal possible size for given parameters. Inserting construction and multilevel construction are two effective techniques for constructing CDCs. We first provide a sufficient condition for a subspace to be added to the code from the mixed dimension construction in Lao et al. (IEEE Trans. Inf. Theory 69(7): 4333-4344, 2023). By appropriately combining matrix blocks from small CDCs and rank-metric codes, we introduce three inserting constructions based on the mixed dimension construction. Furthermore, the mixed dimension construction and these inserting constructions are improved by the multilevel construction that is based on lifting rank-restricted Ferrers diagram rank-metric codes. Our constructions yield some new lower bounds for CDCs, which are superior to the previously best-known ones.

cs.IT↗

On Disentangled Training for Nonlinear Transform in Learned Image Compression

Learned image compression (LIC) has demonstrated superior rate-distortion (R-D) performance compared to traditional codecs, but is challenged by training inefficiency that could incur more than two weeks to train a state-of-the-art model from scratch. Existing LIC methods overlook the slow convergence caused by compacting energy in learning nonlinear transforms. In this paper, we first reveal that such energy compaction consists of two components, i.e., feature decorrelation and uneven energy modulation. On such basis, we propose a linear auxiliary transform (AuxT) to disentangle energy compaction in training nonlinear transforms. The proposed AuxT obtains coarse approximation to achieve efficient energy compaction such that distribution fitting with the nonlinear transforms can be simplified to fine details. We then develop wavelet-based linear shortcuts (WLSs) for AuxT that leverages wavelet-based downsampling and orthogonal linear projection for feature decorrelation and subband-aware scaling for

eess.IV↗

Effects of skull properties on long-pulsed transcranial focused ultrasound transmission

Transcranial low-intensity focused ultrasound can deliver energy to the brain in a minimally invasive manner for neuromodulation applications. However, continuous sonication through the skull introduces significant wave interactions, complicating precise energy delivery to the target. We present a comprehensive examination of intracranial acoustic fields generated by focused ultrasound transducers and assess the characteristics of cranial bone that affect acoustic transmission. Acoustic field maps were generated at 88 regions of interest across 10 historical and 2 Thiel-embalmed human skull specimens with sonication at frequencies of 220 kHz, 650 kHz, and 1000 kHz. The average peak pressure insertion losses for historical were 3.6$\pm$3.4 dB, 9.3$\pm$3.3 dB, and 14.8$\pm$5.8 dB, respectively, and for Thiel skulls, the respective losses were 2.9$\pm$1.8 dB, 9.4$\pm$2.6 dB, and 17.0$\pm$5.5 dB. The effect of skull thickness, skull density ratio, and skull curvature on intracranial peak pressure, power and focal area was investigated and linear fits produced. Several unfavorable focusing performances were observed in regions with excessive thickness variation. The effects of angulation and spacing between the transducer and the skull were also investigated. Preliminary findings indicate that wave superposition resulting from skull and transducer spacing could lead to a 30-40% uncertainty in peak recorded intracranial pressure.

physics.med-ph↗

The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships

As conversational AI systems increasingly permeate the socio-emotional realms of human life, they bring both benefits and risks to individuals and society. Despite extensive research on detecting and categorizing harms in AI systems, less is known about the harms that arise from social interactions with AI chatbots. Through a mixed-methods analysis of 35,390 conversation excerpts shared on r/replika, an online community for users of the AI companion Replika, we identified six categories of harmful behaviors exhibited by the chatbot: relational transgression, verbal abuse and hate, self-inflicted harm, harassment and violence, mis/disinformation, and privacy violations. The AI contributes to these harms through four distinct roles: perpetrator, instigator, facilitator, and enabler. Our findings highlight the relational harms of AI chatbots and the danger of algorithmic compliance, enhancing the understanding of AI harms in socio-emotional interactions. We also provide suggestions for designing ethical and responsible AI systems that prioritize user safety and well-being.

cs.HC↗

ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability

Retrieval-Augmented Generation (RAG) models are designed to incorporate external knowledge, reducing hallucinations caused by insufficient parametric (internal) knowledge. However, even with accurate and relevant retrieved content, RAG models can still produce hallucinations by generating outputs that conflict with the retrieved information. Detecting such hallucinations requires disentangling how Large Language Models (LLMs) utilize external and parametric knowledge. Current detection methods often focus on one of these mechanisms or without decoupling their intertwined effects, making accurate detection difficult. In this paper, we investigate the internal mechanisms behind hallucinations in RAG scenarios. We discover hallucinations occur when the Knowledge FFNs in LLMs overemphasize parametric knowledge in the residual stream, while Copying Heads fail to effectively retain or integrate external knowledge from retrieved content. Based on these findings, we propose ReDeEP, a novel method that detects hallucinations by decoupling LLM's utilization of external context and parametric knowledge. Our experiments show that ReDeEP significantly improves RAG hallucination detection accuracy. Additionally, we introduce AARF, which mitigates hallucinations by modulating the contributions of Knowledge FFNs and Copying Heads.

cs.CL↗