arXiv subjects

Yichen Liu

Publications and source records attributed to Yichen Liu.

At least 91 records · Page 5Linked to original sources

arXiv2024

Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models

Location-based services (LBS) have accumulated extensive human mobility data on diverse behaviors through check-in sequences. These sequences offer valuable insights into users' intentions and preferences. Yet, existing models analyzing check-in sequences fail to consider the semantics contained in these sequences, which closely reflect human visiting intentions and travel preferences, leading to an incomplete comprehension. Drawing inspiration from the exceptional semantic understanding and contextual information processing capabilities of large language models (LLMs) across various domains, we present Mobility-LLM, a novel framework that leverages LLMs to analyze check-in sequences for multiple tasks. Since LLMs cannot directly interpret check-ins, we reprogram these sequences to help LLMs comprehensively understand the semantics of human visiting intentions and travel preferences. Specifically, we introduce a visiting intention memory network (VIMN) to capture the visiting intentions at each record, along with a shared pool of human travel preference prompts (HTPP) to guide the LLM in understanding users' travel preferences. These components enhance the model's ability to extract and leverage semantic information from human mobility data effectively. Extensive experiments on four benchmark datasets and three downstream tasks demonstrate that our approach significantly outperforms existing models, underscoring the effectiveness of Mobility-LLM in advancing our understanding of human mobility data within LBS contexts.

cs.LG↗

arXiv2024

A Lower Bound of the Hofer-Zehnder Capacity via Delzant Polytopes

Given a symplectic toric manifold, the moment maps of sub-circle actions can be modified to be admissible functions in the sense of Hofer-Zehnder. By exploiting the relationship between the period of Hamiltonian sub-circle actions of a symplectic toric manifold and its Delzant polytope, we develop an invariant of Delzant polytopes which gives a lower bound of the Hofer-Zehnder capacity.

math.SG↗

arXiv2024

Optimized Biomedical Question-Answering Services with LLM and Multi-BERT Integration

We present a refined approach to biomedical question-answering (QA) services by integrating large language models (LLMs) with Multi-BERT configurations. By enhancing the ability to process and prioritize vast amounts of complex biomedical data, this system aims to support healthcare professionals in delivering better patient outcomes and informed decision-making. Through innovative use of BERT and BioBERT models, combined with a multi-layer perceptron (MLP) layer, we enable more specialized and efficient responses to the growing demands of the healthcare sector. Our approach not only addresses the challenge of overfitting by freezing one BERT model while training another but also improves the overall adaptability of QA services. The use of extensive datasets, such as BioASQ and BioMRC, demonstrates the system's ability to synthesize critical information. This work highlights how advanced language models can make a tangible difference in healthcare, providing reliable and responsive tools for professionals to manage complex information, ultimately serving the broader goal of improved care and data-driven insights.

cs.CL↗

arXiv2024

Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning

Humanoid robots, with their human-like skeletal structure, are especially suited for tasks in human-centric environments. However, this structure is accompanied by additional challenges in locomotion controller design, especially in complex real-world environments. As a result, existing humanoid robots are limited to relatively simple terrains, either with model-based control or model-free reinforcement learning. In this work, we introduce Denoising World Model Learning (DWL), an end-to-end reinforcement learning framework for humanoid locomotion control, which demonstrates the world's first humanoid robot to master real-world challenging terrains such as snowy and inclined land in the wild, up and down stairs, and extremely uneven terrains. All scenarios run the same learned neural network with zero-shot sim-to-real transfer, indicating the superior robustness and generalization capability of the proposed method.

cs.RO↗

arXiv2024

PTrajM: Efficient and Semantic-rich Trajectory Learning with Pretrained Trajectory-Mamba

Vehicle trajectories provide crucial movement information for various real-world applications. To better utilize vehicle trajectories, it is essential to develop a trajectory learning approach that can effectively and efficiently extract rich semantic information, including movement behavior and travel purposes, to support accurate downstream applications. However, creating such an approach presents two significant challenges. First, movement behavior are inherently spatio-temporally continuous, making them difficult to extract efficiently from irregular and discrete trajectory points. Second, travel purposes are related to the functionalities of areas and road segments traversed by vehicles. These functionalities are not available from the raw spatio-temporal trajectory features and are hard to extract directly from complex textual features associated with these areas and road segments. To address these challenges, we propose PTrajM, a novel method capable of efficient and semantic-rich vehicle trajectory learning. To support efficient modeling of movement behavior, we introduce Trajectory-Mamba as the learnable model of PTrajM, which effectively extracts continuous movement behavior while being more computationally efficient than existing structures. To facilitate efficient extraction of travel purposes, we propose a travel purpose-aware pre-training procedure, which enables PTrajM to discern the travel purposes of trajectories without additional computational resources during its embedding process. Extensive experiments on two real-world datasets and comparisons with several state-of-the-art trajectory learning methods demonstrate the effectiveness of PTrajM. Code is available at https://anonymous.4open.science/r/PTrajM-C973.

cs.LG↗

arXiv2024

Multi-Garment Customized Model Generation

This paper introduces Multi-Garment Customized Model Generation, a unified framework based on Latent Diffusion Models (LDMs) aimed at addressing the unexplored task of synthesizing images with free combinations of multiple pieces of clothing. The method focuses on generating customized models wearing various targeted outfits according to different text prompts. The primary challenge lies in maintaining the natural appearance of the dressed model while preserving the complex textures of each piece of clothing, ensuring that the information from different garments does not interfere with each other. To tackle these challenges, we first developed a garment encoder, which is a trainable UNet copy with shared weights, capable of extracting detailed features of garments in parallel. Secondly, our framework supports the conditional generation of multiple garments through decoupled multi-garment feature fusion, allowing multiple clothing features to be injected into the backbone network, significantly alleviating conflicts between garment information. Additionally, the proposed garment encoder is a plug-and-play module that can be combined with other extension modules such as IP-Adapter and ControlNet, enhancing the diversity and controllability of the generated models. Extensive experiments demonstrate the superiority of our approach over existing alternatives, opening up new avenues for the task of generating images with multiple-piece clothing combinations

cs.CV↗

arXiv2024

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding

Knowledge Graph Embedding (KGE), which projects entities and relations into continuous vector spaces, has garnered significant attention. Although high-dimensional KGE methods offer better performance, they come at the expense of significant computation and memory overheads. Decreasing embedding dimensions significantly deteriorates model performance. While several recent efforts utilize knowledge distillation or non-Euclidean representation learning to augment the effectiveness of low-dimensional KGE, they either necessitate a pre-trained high-dimensional teacher model or involve complex non-Euclidean operations, thereby incurring considerable additional computational costs. To address this, this work proposes Confidence-aware Self-Knowledge Distillation (CSD) that learns from the model itself to enhance KGE in a low-dimensional space. Specifically, CSD extracts knowledge from embeddings in previous iterations, which would be utilized to supervise the learning of the model in the next iterations. Moreover, a specific semantic module is developed to filter reliable knowledge by estimating the confidence of previously learned embeddings. This straightforward strategy bypasses the need for time-consuming pre-training of teacher models and can be integrated into various KGE methods to improve their performance. Our comprehensive experiments on six KGE backbones and four datasets underscore the effectiveness of the proposed CSD.

cs.LG↗

arXiv2024

PromptSAM+: Malware Detection based on Prompt Segment Anything Model

Machine learning and deep learning (ML/DL) have been extensively applied in malware detection, and some existing methods demonstrate robust performance. However, several issues persist in the field of malware detection: (1) Existing work often overemphasizes accuracy at the expense of practicality, rarely considering false positive and false negative rates as important metrics. (2) Considering the evolution of malware, the performance of classifiers significantly declines over time, greatly reducing the practicality of malware detectors. (3) Prior ML/DL-based efforts heavily rely on ample labeled data for model training, largely dependent on feature engineering or domain knowledge to build feature databases, making them vulnerable if correct labels are scarce. With the development of computer vision, vision-based malware detection technology has also rapidly evolved. In this paper, we propose a visual malware general enhancement classification framework, `PromptSAM+', based on a large visual network segmentation model, the Prompt Segment Anything Model(named PromptSAM+). Our experimental results indicate that 'PromptSAM+' is effective and efficient in malware detection and classification, achieving high accuracy and low rates of false positives and negatives. The proposed method outperforms the most advanced image-based malware detection technologies on several datasets. 'PromptSAM+' can mitigate aging in existing image-based malware classifiers, reducing the considerable manpower needed for labeling new malware samples through active learning. We conducted experiments on datasets for both Windows and Android platforms, achieving favorable outcomes. Additionally, our ablation experiments on several datasets demonstrate that our model identifies effective modules within the large visual network.

cs.CR↗

arXiv2024

Crossed real nodal-line phonons in gold monobromide

Spacetime inversion symmetry can generate intriguing types of spinless excitations in crystalline materials. Here, we propose a topological phase protected by spacetime inversion symmetry - the crossed real nodal line (RNL) in the phonon spectrum of gold monobromide (AuBr). In AuBr, there exist four straight nodal lines, which are linked by a crossed nodal line formed by two lower bands. Remarkably, each adjacent two of the four straight nodal lines is a pair, forming a crossed RNL with nontrivial real Chern number. Such configuration and pairing mode of RNL have never been reported. The crossed RNL exhibits unique surface and hinge states distinguished from that of the conventional RNLs. The symmetry protection and the transformation under the symmetry-preserving strain of the crossed RNL are also investigated. Our results open the door to a new class of topological states, and predict its realization in experimentally synthesized material.

cond-mat.mtrl-sci↗

arXiv2024

DAVOS: Dwarf Active Galactic Nuclei from Variability for the Origins of Seeds: Properties of Variability-Selected Active Galactic Nuclei in the COSMOS Field and Expectations for the Rubin Observatory

We study the black hole mass $-$ host galaxy stellar mass relation, $M_{\rm{BH}}-M_{\ast}$, of a sample of $z<4$ optically-variable AGNs in the COSMOS field. The parent sample of 491 COSMOS AGNs were identified by optical variability from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) program. Using publicly-available catalogs and spectra, we consolidate their spectroscopic redshifts and estimate virial black hole masses using broad line widths and luminosities. We show that variability searches with deep, high precision photometry like the HSC-SSP can identity AGNs in low mass galaxies up to $z\sim1$. However, their black holes are more massive given their host galaxy stellar masses than predicted by the local relation for active galaxies. We report that $z\sim 0.5-4$ variability-selected AGNs are meanwhile more consistent with the $M_{\rm{BH}}-M_{\ast}$ relation for local inactive early-type galaxies. This result is consistent with most previous studies of the $M_{\rm{BH}}-M_{\ast}$ relation at similar redshifts and indicates that AGNs selected from variability are not intrinsically different from the broad-line Type 1 AGN population at similar luminosities. Our results demonstrate the need for robust black hole and stellar mass estimates for intermediate-mass black hole candidates in low-mass galaxies at similar redshifts. Assuming that these results do not reflect a selection bias, they appear to be consistent with self-regulated feedback models wherein the central black hole and stars in galaxies grow in tandem.

astro-ph.GA↗

arXiv2024

Valley polarization in twisted altermagnetism

The combination of altermagnetism, twistronics and valleytronics is of great significance for potential applications in advanced electronic devices. Twisted magnetic van der Waals bilayers have been identified as an ideal platform for altermagnetism of any type, such as $d$-wave, $g$-wave, and $i$-wave, by choosing the constituent monolayer with specific symmetry [arXiv:2404.17146 (2024)]. Here, we propose a way for achieving valley polarization in twisted altermagnetism by applying out-of-plane external electric field. Since the out-of-plane electric field creates a layer-dependent electrostatic potential, the valleys form different layers will stagger, producing valley polarization. We also demonstrate the effectiveness of our proposed way using the twisted tight-binding model. It is found that the applied electric field can also induce valley/spin-gapless semiconductor and half metal besides valley polarization. Based on first-principles calculations, our proposed way to achieve valley polarization can be verified in twisted bilayer VOBr and monolayer $\mathrm{Ca(CoN)_2}$ as a special twisted altermagnet. These findings provide new opportunities for innovative spintronics, twistronics and valleytronics applications.

cond-mat.mtrl-sci↗

arXiv2024

VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchification

Recent conditional 3D completion works have mainly relied on CLIP or BERT to encode textual information, which cannot support complex instruction. Meanwhile, large language models (LLMs) have shown great potential in multi-modal understanding and generation tasks. Inspired by the recent advancements of LLM, we present Volume Patch LLM (VP-LLM), which leverages LLMs to perform conditional 3D completion in a single-forward pass. To integrate a 3D model into the LLM tokenization configuration, the incomplete 3D object is first divided into small patches that can be encoded independently. These encoded patches are then fed into an LLM along with the text prompt, instructing the LLM to capture the relations between these patches as well as injecting semantic meanings into the 3D object. Our results demonstrate a strong ability of LLMs to interpret complex text instructions and understand 3D objects, surpassing state-of-the-art diffusion-based 3D completion models in generation quality.

cs.CV↗

arXiv2024

Creation and Manipulation of Higher-Order Topological States by Altermagnets

We propose to implement tunable higher-order topological states in a heterojunction consisting of a two-dimensional (2D) topological insulator and the recently discovered altermagnets, whose unique spin-polarization in both real and reciprocal space and null magnetization are in contrast to conventional ferromagnets and antiferromagnets. Based on symmetry analysis and effective edge theory, we show that the special spin splitting in altermagnets with different symmetries, such as $d$-wave, can introduce Dirac mass terms with opposite signs on the adjacent boundaries of the topological insulator, resulting in the higher-order topological state with mass-domain bound corner states. Moreover, by adjusting the direction of the Néel vector, we can manipulate such topological corner states by moving their positions. By first-principles calculations, taking a 2D topological insulator bismuthene with a square lattice on an altermagnet MnF$_2$ as an example, we demonstrate the feasibility of creating and manipulating the higher-order topological states through altermagnets. Finally, we discuss the experimental implementation and detection of the tunable topological corner states, as well as the potential non-Abelian braiding of the Dirac corner fermions.

cond-mat.mes-hall↗

arXiv2024

Neural Radiance Field in Autonomous Driving: A Survey

Neural Radiance Field (NeRF) has garnered significant attention from both academia and industry due to its intrinsic advantages, particularly its implicit representation and novel view synthesis capabilities. With the rapid advancements in deep learning, a multitude of methods have emerged to explore the potential applications of NeRF in the domain of Autonomous Driving (AD). However, a conspicuous void is apparent within the current literature. To bridge this gap, this paper conducts a comprehensive survey of NeRF's applications in the context of AD. Our survey is structured to categorize NeRF's applications in Autonomous Driving (AD), specifically encompassing perception, 3D reconstruction, simultaneous localization and mapping (SLAM), and simulation. We delve into in-depth analysis and summarize the findings for each application category, and conclude by providing insights and discussions on future directions in this field. We hope this paper serves as a comprehensive reference for researchers in this domain. To the best of our knowledge, this is the first survey specifically focused on the applications of NeRF in the Autonomous Driving domain.

cs.CV↗

arXiv2024

Twisted Magnetic Van der Waals Bilayers: An Ideal Platform for Altermagnetism

We introduce a universal methodology for generating and manipulating altermagnetism in two-dimensional (2D) magnetic van der Waals (MvdW) materials through twisting. We find that a key in-plane 2-fold rotational operation can be achieved in a twisted bilayer of any 2D MvdW material, which takes one of all five 2D Bravais lattices, thereby inducing altermagnetism. By choosing the constituent MvdW monolayer with specific symmetry, our approach can tailor altermagnetism of any type, such as $d$-wave, $g$-wave, and $i$-wave. Furthermore, the properties of our twisted altermagnetic materials can be easily engineered. Taking a transition-metal oxyhalide VOBr as an example, we find that by tuning the twist angle and Fermi level a giant spin Hall angle can be obtained, much larger than the experimentally reported. This approach establishes a general, robust, and adjustable platform to explore altermagnetism, and provides a new efficient way to generate and manipulate the spin current.

cond-mat.mtrl-sci↗

arXiv2024

DepthMOT: Depth Cues Lead to a Strong Multi-Object Tracker

Accurately distinguishing each object is a fundamental goal of Multi-object tracking (MOT) algorithms. However, achieving this goal still remains challenging, primarily due to: (i) For crowded scenes with occluded objects, the high overlap of object bounding boxes leads to confusion among closely located objects. Nevertheless, humans naturally perceive the depth of elements in a scene when observing 2D videos. Inspired by this, even though the bounding boxes of objects are close on the camera plane, we can differentiate them in the depth dimension, thereby establishing a 3D perception of the objects. (ii) For videos with rapidly irregular camera motion, abrupt changes in object positions can result in ID switches. However, if the camera pose are known, we can compensate for the errors in linear motion models. In this paper, we propose \textit{DepthMOT}, which achieves: (i) detecting and estimating scene depth map \textit{end-to-end}, (ii) compensating the irregular camera motion by camera pose estimation. Extensive experiments demonstrate the superior performance of DepthMOT in VisDrone-MOT and UAVDT datasets. The code will be available at \url{https://github.com/JackWoo0831/DepthMOT}.

cs.CV↗

arXiv2024

SANeRF-HQ: Segment Anything for NeRF in High Quality

Recently, the Segment Anything Model (SAM) has showcased remarkable capabilities of zero-shot segmentation, while NeRF (Neural Radiance Fields) has gained popularity as a method for various 3D problems beyond novel view synthesis. Though there exist initial attempts to incorporate these two methods into 3D segmentation, they face the challenge of accurately and consistently segmenting objects in complex scenarios. In this paper, we introduce the Segment Anything for NeRF in High Quality (SANeRF-HQ) to achieve high-quality 3D segmentation of any target object in a given scene. SANeRF-HQ utilizes SAM for open-world object segmentation guided by user-supplied prompts, while leveraging NeRF to aggregate information from different viewpoints. To overcome the aforementioned challenges, we employ density field and RGB similarity to enhance the accuracy of segmentation boundary during the aggregation. Emphasizing on segmentation accuracy, we evaluate our method on multiple NeRF datasets where high-quality ground-truths are available or manually annotated. SANeRF-HQ shows a significant quality improvement over state-of-the-art methods in NeRF object segmentation, provides higher flexibility for object localization, and enables more consistent object segmentation across multiple views. Results and code are available at the project site: https://lyclyc52.github.io/SANeRF-HQ/.

cs.CV↗

arXiv2024

Isoleucine gate blocks K+ conduction in C-type inactivation

Many voltage-gated potassium (Kv) channels display a time-dependent phenomenon called C-type inactivation, whereby prolonged activation by voltage leads to the inhibition of ionic conduction, a process that involves a conformational change at the selectivity filter toward a non-conductive state. Recently, a high-resolution structure of a strongly inactivating triple-mutant channel kv1.2-kv2.1-3m revealed a novel conformation of the selectivity filter that is dilated at its outer end, distinct from the well-characterized conductive state. While the experimental structure was interpreted as the elusive non-conductive state, molecular dynamics simulations and electrophysiology measurements demonstrate that the dilated filter of kv1.2-kv2.1-3m, however, is conductive and, as such, cannot completely account for the inactivation of the channel observed in functional experiments. An additional conformational change implicating isoleucine residues at position 398 along the pore lining segment S6 is required to effectively block ion conduction. It is shown that the I398 residues from the four subunits act as a state-dependent hydrophobic gate located immediately beneath the selectivity filter. As a critical piece of the C-type inactivation machinery, this structural feature is the potential target of a broad class of QA blockers and negatively charged activators thus opening new research directions towards the development of drugs that specifically modulate gating-states of Kv channels.

physics.bio-ph↗