arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 181 records · Page 10Linked to original sources

arXiv2024

Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance

Implicit neural representations and 3D Gaussian splatting (3DGS) have shown great potential for scene reconstruction. Recent studies have expanded their applications in autonomous reconstruction through task assignment methods. However, these methods are mainly limited to single robot, and rapid reconstruction of large-scale scenes remains challenging. Additionally, task-driven planning based on surface uncertainty is prone to being trapped in local optima. To this end, we propose the first 3DGS-based centralized multi-robot autonomous 3D reconstruction framework. To further reduce time cost of task generation and improve reconstruction quality, we integrate online open-vocabulary semantic segmentation with surface uncertainty of 3DGS, focusing view sampling on regions with high instance uncertainty. Finally, we develop a multi-robot collaboration strategy with mode and task assignments improving reconstruction quality while ensuring planning efficiency. Our method demonstrates the highest reconstruction quality among all planning methods and superior planning efficiency compared to existing multi-robot methods. We deploy our method on multiple robots, and results show that it can effectively plan view paths and reconstruct scenes with high quality.

cs.RO↗

arXiv2024

Impact of tensor forces on quasifission product yield distributions

We employ the microscopic time-dependent Hartree-Fock (TDHF) theory to study the 48Ca+249Bk and 48Ti+238U systems, taking into account the dependence on orientation for deformed nuclei and full range of impact parameters. By analyzing fragment distributions of neutron and proton numbers, we assess the influence of different isoscalar and isovector tensor coupling constants of the effective nucleon-nucleon interaction. The quasifission yield distributions of 48Ca + 249Bk collision system utilizing SLy5t and T31 parametrizations exhibit more pronounced spherical shell effects compared to those using SLy5, T44 and T62 sets. Furthermore, within each parametrization group, the distributions for SLy5t and T31 are closely aligned, as are those for SLy5, T44, and T62. Similarly, the yield distributions for the 48Ti + 238U system using SLy5t and T31 also reflect the more pronounced spherical shell effects relative to SLy5 and T62, while the charge distribution shows much better agreement with experimental results for the SLy5t and T62 parametrizations compared to SLy5 and T31. The yield distributions for the 48Ca+249Bk and 48Ti+238U systems, when compared across the SLy5, SLy5t, T31, T44, and T62 parametrizations, indicate that the influence of tensor forces on quasifission fragments is reflected in the prominence of shell effects. This influence appears to be sensitive only in specific regions within the isoscalar and isovector coupling constant parameter space. In the 48Ti + 238U system, the prominence of shell effects is manifested not only through shifts in peak positions but also through narrower yield distributions.

nucl-th↗

arXiv2024

Resurfaced CsPbBr3 Nanocrystals Enable Free Radical Thermal Polymerization of Efficient Ultrafast Polyvinyl Styrene Nanocomposite Scintillators

Lead halide perovskite nanocrystals (LHP-NCs) embedded in a plastic matrix are highly promising for a variety of photonic technologies and are quickly gaining attention as ultrafast, radiation-resistant nanoscintillators for radiation detection. However, advancements in LHP-NC-based photonics are hindered by their well-known thermal instability, which makes them unsuitable for industrial thermally activated mass polymerization processes - crucial for creating polystyrene-based scintillating nanocomposites. In this study, we address this challenge by presenting the first thermal nanocomposite scintillators made from CsPbBr3 NCs passivated with fluorinated ligands that remain attached to the particles surfaces even at high temperatures, enabling their integration into mass-cured polyvinyl toluene without compromising optical properties. Consequently, these nanocomposites demonstrate scintillation light yields reaching 10,400 photons/MeV, sub-nanosecond scintillation kinetics, and remarkable radiation resilience, able to withstand gamma radiation doses of up to 1 MGy. This performance not only meets but also exceeds the scintillation of plastic scintillators, despite the radiation-induced damage to the host matrix.

physics.optics↗

arXiv2024

Chanel-Orderer: A Channel-Ordering Predictor for Tri-Channel Natural Images

This paper shows a proof-of-concept that, given a typical 3-channel images but in a randomly permuted channel order, a model (termed as Chanel-Orderer) with ad-hoc inductive biases in terms of both architecture and loss functions can accurately predict the channel ordering and knows how to make it right. Specifically, Chanel-Orderer learns to score each of the three channels with the priors of object semantics and uses the resulting scores to predict the channel ordering. This brings up benefits into a typical scenario where an \texttt{RGB} image is often mis-displayed in the \texttt{BGR} format and needs to be corrected into the right order. Furthermore, as a byproduct, the resulting model Chanel-Orderer is able to tell whether a given image is a near-gray-scale image (near-monochromatic) or not (polychromatic). Our research suggests that Chanel-Orderer mimics human visual coloring of our physical natural world.

cs.CV↗

arXiv2024

Design of a LYSO Crystal Electromagnetic Calorimeter for DarkSHINE Experiment

This paper presents the design and optimization of a LYSO crystal electromagnetic calorimeter (ECAL) for the DarkSHINE experiment, which aims to search for dark photons as potential mediators of dark forces. The ECAL design was evaluated through comprehensive simulations, focusing on optimizing dimensions, material selection, energy distribution, and energy resolution. The ECAL configuration consists of 21$\times$21$\times$11 LYSO crystals, each measuring 2.5$\times$2.5$\times$4 cm$^3$, arranged in a staggered layout to improve signal detection efficiency. A 4 GeV energy dynamic range was established to ensure accurate energy measurements without saturation, which is essential for background rejection and signal identification. A detailed digitization model was developed to simulate the scintillation, SiPM, and ADC behaviors, providing a more realistic representation of detector performance. Additionally, the study assessed radiation damage in the ECAL region, highlighting the necessity of radiation-resistant scintillators and silicon sensors.

physics.ins-det↗

arXiv2024

A Consistency-Aware Spot-Guided Transformer for Versatile and Hierarchical Point Cloud Registration

Deep learning-based feature matching has shown great superiority for point cloud registration in the absence of pose priors. Although coarse-to-fine matching approaches are prevalent, the coarse matching of existing methods is typically sparse and loose without consideration of geometric consistency, which makes the subsequent fine matching rely on ineffective optimal transport and hypothesis-and-selection methods for consistency. Therefore, these methods are neither efficient nor scalable for real-time applications such as odometry in robotics. To address these issues, we design a consistency-aware spot-guided Transformer (CAST), which incorporates a spot-guided cross-attention module to avoid interfering with irrelevant areas, and a consistency-aware self-attention module to enhance matching capabilities with geometrically consistent correspondences. Furthermore, a lightweight fine matching module for both sparse keypoints and dense features can estimate the transformation accurately. Extensive experiments on both outdoor LiDAR point cloud datasets and indoor RGBD point cloud datasets demonstrate that our method achieves state-of-the-art accuracy, efficiency, and robustness.

cs.CV↗

arXiv2024

CalliffusionV2: Personalized Natural Calligraphy Generation with Flexible Multi-modal Control

In this paper, we introduce CalliffusionV2, a novel system designed to produce natural Chinese calligraphy with flexible multi-modal control. Unlike previous approaches that rely solely on image or text inputs and lack fine-grained control, our system leverages both images to guide generations at fine-grained levels and natural language texts to describe the features of generations. CalliffusionV2 excels at creating a broad range of characters and can quickly learn new styles through a few-shot learning approach. It is also capable of generating non-Chinese characters without prior training. Comprehensive tests confirm that our system produces calligraphy that is both stylistically accurate and recognizable by neural network classifiers and human evaluators.

cs.CL↗

arXiv2024

Thermodynamic origin of the phonon Hall effect in a honeycomb antiferromagnet

The underlying mechanism of the thermal Hall effect (THE) generated by phonons in a variety of insulators is yet to be identified. Here, we report on a sizeable thermal Hall conductivity in NiPS$_3$, a van der Waals stack of honeycomb layers with a zigzag antiferromagnetic order below $T_N$ = 155 K. The longitudinal ($κ_{aa}$) and the transverse ($κ_{ab}$) thermal conductivities peak at the same temperature and the thermal Hall angle, at this peak, respects a previously identified bound. The amplitude of $κ_{ab}$ is extremely sensitive to the amplitude of magnetization along the $b$-axis, in contrast to the phonon mean free path, which is not at all. We show that the magnon and acoustic phonon bands cross each other along the $b^\ast$ orientation in the momentum space. The relevance of a thermodynamic property, combined with the irrelevance of the mean free path, points to an intrinsic origin.

cond-mat.str-el↗

arXiv2024

Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking

Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task (ReID) into the detector, achieving a balance between inference speed and tracking performance. However, solving the competition between the detector and the feature extractor has always been a challenge. Meanwhile, the issue of directly embedding the ReID task into MOT has remained unresolved. The lack of high discriminability in appearance features results in their limited utility. In this paper, a new learning approach using cross-correlation to capture temporal information of objects is proposed. The feature extraction network is no longer trained solely on appearance features from each frame but learns richer motion features by utilizing feature heatmaps from consecutive frames, which addresses the challenge of inter-class feature similarity. Furthermore, our learning approach is applied to a more lightweight feature extraction network, and treat the feature matching scores as strong cues rather than auxiliary cues, with an appropriate weight calculation to reflect the compatibility between our obtained features and the MOT task. Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks, i.e., MOT17, MOT20, and DanceTrack datasets. Specifically, on the DanceTrack test set, we achieve 56.8 HOTA, 58.1 IDF1 and 92.5 MOTA, making it the best online tracker capable of achieving real-time performance. Comparative evaluations with other trackers prove that our tracker achieves the best balance between speed, robustness and accuracy. Code is available at https://github.com/yfzhang1214/TCBTrack.

cs.CV↗

arXiv2024

Generating High-quality Symbolic Music Using Fine-grained Discriminators

Existing symbolic music generation methods usually utilize discriminator to improve the quality of generated music via global perception of music. However, considering the complexity of information in music, such as rhythm and melody, a single discriminator cannot fully reflect the differences in these two primary dimensions of music. In this work, we propose to decouple the melody and rhythm from music, and design corresponding fine-grained discriminators to tackle the aforementioned issues. Specifically, equipped with a pitch augmentation strategy, the melody discriminator discerns the melody variations presented by the generated samples. By contrast, the rhythm discriminator, enhanced with bar-level relative positional encoding, focuses on the velocity of generated notes. Such a design allows the generator to be more explicitly aware of which aspects should be adjusted in the generated music, making it easier to mimic human-composed music. Experimental results on the POP909 benchmark demonstrate the favorable performance of the proposed method compared to several state-of-the-art methods in terms of both objective and subjective metrics.

cs.SD↗

arXiv2024

Multipolar Electromagnetic Emission of Newborn Magnetar

It is generally recognized that the electromagnetic multipolar emission from magnetars can be used to explain radiation from Soft Gamma Repeaters (SGRs) or Anomalous X-ray Pulsars (AXPs), but they have little impact on the spindown of magnetars. We here present a comprehensive analytical solution for the neutron star multipolar electromagnetic fields and their associated expected luminosities. We find that for newborn millisecond magnetars, the spin-down luminosity from higher multipolar components can match or even exceed that from the dipole component. Such high-intensity radiation will undoubtedly affect related astrophysical phenomena at the birth of a magnetar. We show that the spin-down luminosity from multipoles can well explain the majority of Gamma-Ray Bursts (GRBs) afterglows, from the plateau starting at several hundred seconds till the normal decay phase lasting for many years. The fitted magnetar parameters for GRB afterglows are all typical values, with spins in the millisecond range and magnetic field strengths in the order of $10^{14} - 10^{15}$ Gauss. Our results in turn, provide support for the hypothesis that GRBs originate from the birth of magnetars with a few millisecond period, thus deepening our understanding of the complex magnetic field structure and the equation of state of magnetars.

astro-ph.HE↗

arXiv2024

Downstream-Pretext Domain Knowledge Traceback for Active Learning

Active learning (AL) is designed to construct a high-quality labeled dataset by iteratively selecting the most informative samples. Such sampling heavily relies on data representation, while recently pre-training is popular for robust feature learning. However, as pre-training utilizes low-level pretext tasks that lack annotation, directly using pre-trained representation in AL is inadequate for determining the sampling score. To address this problem, we propose a downstream-pretext domain knowledge traceback (DOKT) method that traces the data interactions of downstream knowledge and pre-training guidance for selecting diverse and instructive samples near the decision boundary. DOKT consists of a traceback diversity indicator and a domain-based uncertainty estimator. The diversity indicator constructs two feature spaces based on the pre-training pretext model and the downstream knowledge from annotation, by which it locates the neighbors of unlabeled data from the downstream space in the pretext space to explore the interaction of samples. With this mechanism, DOKT unifies the data relations of low-level and high-level representations to estimate traceback diversity. Next, in the uncertainty estimator, domain mixing is designed to enforce perceptual perturbing to unlabeled samples with similar visual patches in the pretext space. Then the divergence of perturbed samples is measured to estimate the domain uncertainty. As a result, DOKT selects the most diverse and important samples based on these two modules. The experiments conducted on ten datasets show that our model outperforms other state-of-the-art methods and generalizes well to various application scenarios such as semantic segmentation and image captioning.

cs.LG↗

arXiv2024

Distractors-Immune Representation Learning with Cross-modal Contrastive Regularization for Change Captioning

Change captioning aims to succinctly describe the semantic change between a pair of similar images, while being immune to distractors (illumination and viewpoint changes). Under these distractors, unchanged objects often appear pseudo changes about location and scale, and certain objects might overlap others, resulting in perturbational and discrimination-degraded features between two images. However, most existing methods directly capture the difference between them, which risk obtaining error-prone difference features. In this paper, we propose a distractors-immune representation learning network that correlates the corresponding channels of two image representations and decorrelates different ones in a self-supervised manner, thus attaining a pair of stable image representations under distractors. Then, the model can better interact them to capture the reliable difference features for caption generation. To yield words based on the most related difference features, we further design a cross-modal contrastive regularization, which regularizes the cross-modal alignment by maximizing the contrastive alignment between the attended difference features and generated words. Extensive experiments show that our method outperforms the state-of-the-art methods on four public datasets. The code is available at https://github.com/tuyunbin/DIRL.

cs.CV↗

arXiv2024

Technique Report of CVPR 2024 PBDL Challenges

The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. In recent years, deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop. The challenge consisted of eight tracks, focusing on Low-Light Enhancement and Detection as well as High Dynamic Range (HDR) Imaging. This report details the objectives, methodologies, and results of each track, highlighting the top-performing solutions and their innovative approaches.

cs.CV↗

arXiv2024

StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing

Given a script, the challenge in Movie Dubbing (Visual Voice Cloning, V2C) is to generate speech that aligns well with the video in both time and emotion, based on the tone of a reference audio track. Existing state-of-the-art V2C models break the phonemes in the script according to the divisions between video frames, which solves the temporal alignment problem but leads to incomplete phoneme pronunciation and poor identity stability. To address this problem, we propose StyleDubber, which switches dubbing learning from the frame level to phoneme level. It contains three main components: (1) A multimodal style adaptor operating at the phoneme level to learn pronunciation style from the reference audio, and generate intermediate representations informed by the facial emotion presented in the video; (2) An utterance-level style learning module, which guides both the mel-spectrogram decoding and the refining processes from the intermediate embeddings to improve the overall style expression; And (3) a phoneme-guided lip aligner to maintain lip sync. Extensive experiments on two of the primary benchmarks, V2C and Grid, demonstrate the favorable performance of the proposed method as compared to the current stateof-the-art. The code will be made available at https://github.com/GalaxyCong/StyleDubber.

cs.CL↗

arXiv2024

Multi-Level Sequence Denoising with Cross-Signal Contrastive Learning for Sequential Recommendation

Sequential recommender systems (SRSs) aim to suggest next item for a user based on her historical interaction sequences. Recently, many research efforts have been devoted to attenuate the influence of noisy items in sequences by either assigning them with lower attention weights or discarding them directly. The major limitation of these methods is that the former would still prone to overfit noisy items while the latter may overlook informative items. To the end, in this paper, we propose a novel model named Multi-level Sequence Denoising with Cross-signal Contrastive Learning (MSDCCL) for sequential recommendation. To be specific, we first introduce a target-aware user interest extractor to simultaneously capture users' long and short term interest with the guidance of target items. Then, we develop a multi-level sequence denoising module to alleviate the impact of noisy items by employing both soft and hard signal denoising strategies. Additionally, we extend existing curriculum learning by simulating the learning pattern of human beings. It is worth noting that our proposed model can be seamlessly integrated with a majority of existing recommendation models and significantly boost their effectiveness. Experimental studies on five public datasets are conducted and the results demonstrate that the proposed MSDCCL is superior to the state-of-the-art baselines. The source code is publicly available at https://github.com/lalunex/MSDCCL/tree/main.

cs.IR↗

arXiv2024

Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices

The distributed inference paradigm enables the computation workload to be distributed across multiple devices, facilitating the implementations of deep learning based intelligent services on extremely resource-constrained Internet of Things (IoT) scenarios. Yet it raises great challenges to perform complicated inference tasks relying on a cluster of IoT devices that are heterogeneous in their computing/communication capacity and prone to crash or timeout failures. In this paper, we present RoCoIn, a robust cooperative inference mechanism for locally distributed execution of deep neural network-based inference tasks over heterogeneous edge devices. It creates a set of independent and compact student models that are learned from a large model using knowledge distillation for distributed deployment. In particular, the devices are strategically grouped to redundantly deploy and execute the same student model such that the inference process is resilient to any local failures, while a joint knowledge partition and student model assignment scheme are designed to minimize the response latency of the distributed inference system in the presence of devices with diverse capacities. Extensive simulations are conducted to corroborate the superior performance of our RoCoIn for distributed inference compared to several baselines, and the results demonstrate its efficacy in timely inference and failure resiliency.

cs.DC↗

arXiv2024

Probing Thermal Electrons in GRB Afterglows

Particle-in-cell simulations have unveiled that shock-accelerated electrons do not follow a pure power-law distribution, but have an additional low-energy "thermal" part, which owns a considerable portion of the total energy of electrons. Investigating the effects of these thermal electrons on gamma-ray burst (GRB) afterglows may provide valuable insights into the particle acceleration mechanisms. We solve the continuity equation of electrons in the energy space, from which multi-wavelength afterglows are derived by incorporating processes including synchrotron radiation, synchrotron self-absorption, synchrotron self-Compton scattering, and gamma-gamma annihilation. First, there is an underlying positive correlation between temporal and spectral indices due to the cooling of electrons. Moreover, thermal electrons would result in the simultaneous non-monotonic variation in both spectral and temporal indices at multi-wavelength, which could be individually recorded by the 2.5-meter Wide Field Survey Telescope and Vera Rubin Observatory Legacy Survey of Space and Time (LSST). The thermal electrons could also be diagnosed from afterglow spectra by synergy observation in the optical (with LSST) and X-ray bands (with the Microchannel X-ray Telescope on board the Space Variable Objects Monitor). Finally, we use Monte Carlo simulations to obtain the distribution of peak flux ratio ($R_{\rm X}$) between soft and hard X-rays, and of the time delay ($Δt$) between peak times of soft X-ray and optical light curves. The thermal electrons significantly raise the upper limits of both $R_{\rm X}$ and $Δt$. Thus the distribution of GRB afterglows with thermal electrons is more dispersive in the $R_{\rm X} - Δt$ plane.

astro-ph.HE↗