arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 505 records · Page 28Linked to original sources

arXiv2024

Phenomenological relationship between eccentric and quasi-circular orbital binary black hole waveform

Eccentricity, an important parameter of gravitational waves, has been paid more and more attention because it can reflect the dynamics of compact object mergers. Obtaining an accurate and fast gravitational waveform template is of great significance for the estimation of gravitational wave parameters. This paper aims to do an extended study of the phenomenological fitting model proposed by Setyawati and Ohme for adding eccentricity to quasi-circular orbital waveforms. It can be applied to higher eccentricity up to e = 0.4. But the higher the eccentricity, the less the accuracy. For e in [0, 0.1], it gives an overlap of more than 99.99%. For e in [0.1, 0.2], it gives an overlap of more than 99.9%. For e in [0.2, 0.3], it gives an overlap of more than 99%. For e in [0.3, 0.4], it gives an overlap of more than 90%. The reason for these phenomena is that the larger the eccentricity, the larger the deviation of the eccentricity estimator from the cosine function due to the large change in the morphology of the eccentric waveform, and the worse the fitting effect of the model. It can be applied to higher-order modes and gives the same overlap behavior. After adding a shift parameter, it can be applied to spin-aligned or spin-antialigned waveforms. After obtaining spin-precessing effect, it can be applied to the spin-precessing case. In summary, non-spining, spin-aligned, spin-antialigned or spin-precessing waveforms with eccentricity can be constructed from quasi-circular non-spining waveforms by the phenomenological model, which is not only helpful for us to quickly construct phenomenological gravitational wave templates, but also reveals a phenomenological and universal relationship between eccentric waveform and quasi-circular orbital waveform.

gr-qc↗

arXiv2024

Characterizing the effect of eccentricity on the dynamics of binary black hole mergers in numerical relativity

Many articles have partially studied the configuration of eccentric orbital binary black hole (BBH) mergers. However, there is a scarcity of systematic and comprehensive research on the effect of eccentricity on BBH dynamics. Thanks to the rich and numerous numerical relativistic simulations of eccentric orbital BBH mergers from RIT catalog, this paper aims to investigate the impact of initial eccentricity $e_0$ on various dynamic quantities such as merger time $T_{\text{merger}}$, peak luminosity $L_{\text{peak}}$ of gravitational waves, recoil velocity $V_f$, mass $M_f$, and spin $α_f$ of merger remnants. We cover configurations of no spin, spin alignment, and spin precession, as well as a broad parameter space of mass ratio ranging from 1/32 to 1 and initial eccentricity from 0 to 1. For non-spinning BBH with an initial coordinate separation of $11.3M$ ($M$ is the total mass of BBH), we make the first discovery of a ubiquitous oscillation in the relationship between dynamic quantities $L_{\text{peak}}$, $V_f$, $M_f$, $α_f$, and initial eccentricity $e_0$. Additionally, at $24.6M$, we observe the same oscillation phenomenon in the case of mass ratio $q=1$, but do not see it in other mass ratios, suggesting that this oscillation will be evident in numerical simulations with sufficiently dense initial eccentricity. abbreviated

gr-qc↗

arXiv2024

Reward driven workflows for unsupervised explainable analysis of phases and ferroic variants from atomically resolved imaging data

Rapid progress in aberration corrected electron microscopy necessitates development of robust methods for the identification of phases, ferroic variants, and other pertinent aspects of materials structure from imaging data. While unsupervised methods for clustering and classification are widely used for these tasks, their performance can be sensitive to hyperparameter selection in the analysis workflow. In this study, we explore the effects of descriptors and hyperparameters on the capability of unsupervised ML methods to distill local structural information, exemplified by discovery of polarization and lattice distortion in Sm doped BiFeO3 (BFO) thin films. We demonstrate that a reward-driven approach can be used to optimize these key hyperparameters across the full workflow, where rewards were designed to reflect domain wall continuity and straightness, ensuring that the analysis aligns with the material's physical behavior. This approach allows us to discover local descriptors that are best aligned with the specific physical behavior, providing insight into the fundamental physics of materials. We further extend the reward driven workflows to disentangle structural factors of variation via optimized variational autoencoder (VAE). Finally, the importance of well-defined rewards was explored as a quantifiable measure of success of the workflow.

cond-mat.mtrl-sci↗

arXiv2024

MTFusion: Reconstructing Any 3D Object from Single Image Using Multi-word Textual Inversion

Reconstructing 3D models from single-view images is a long-standing problem in computer vision. The latest advances for single-image 3D reconstruction extract a textual description from the input image and further utilize it to synthesize 3D models. However, existing methods focus on capturing a single key attribute of the image (e.g., object type, artistic style) and fail to consider the multi-perspective information required for accurate 3D reconstruction, such as object shape and material properties. Besides, the reliance on Neural Radiance Fields hinders their ability to reconstruct intricate surfaces and texture details. In this work, we propose MTFusion, which leverages both image data and textual descriptions for high-fidelity 3D reconstruction. Our approach consists of two stages. First, we adopt a novel multi-word textual inversion technique to extract a detailed text description capturing the image's characteristics. Then, we use this description and the image to generate a 3D model with FlexiCubes. Additionally, MTFusion enhances FlexiCubes by employing a special decoder network for Signed Distance Functions, leading to faster training and finer surface representation. Extensive evaluations demonstrate that our MTFusion surpasses existing image-to-3D methods on a wide range of synthetic and real-world images. Furthermore, the ablation study proves the effectiveness of our network designs.

cs.CV↗

arXiv2024

Reward based optimization of resonance-enhanced piezoresponse spectroscopy

Dynamic spectroscopies in Scanning Probe Microscopy (SPM) are critical for probing material properties, such as force interactions, mechanical properties, polarization switching, and electrochemical reactions and ionic dynamics. However, the practical implementation of these measurements is constrained by the need to balance imaging time and data quality. Signal to noise requirements favor long acquisition times and high frequencies to improve signal fidelity. However, these are limited on the low end by contact resonant frequency and photodiode sensitivity, and on the high end by the time needed to acquire high-resolution spectra, or the propensity for samples degradation under high field excitation over long times. The interdependence of key parameters such as instrument settings, acquisition times, and sampling rates makes manual tuning labor-intensive and highly dependent on user expertise, often yielding operator-dependent results. These limitations are prominent in techniques like Dual Amplitude Resonance Tracking (DART) in Piezoresponse Force Microscopy (PFM) that utilize multiple concurrent feedback loops for topography and resonance frequency tracking. Here, a reward-driven workflow is proposed that automates the tuning process, adapting experimental conditions in real time to optimize data quality. This approach significantly reduces the complexity and time required for manual adjustments and can be extended to other SPM spectroscopic methods, enhancing overall efficiency and reproducibility.

cond-mat.mtrl-sci↗

arXiv2024

Imaging half-unit-cell Cooper-pair density waves in monolayer 1T$^{\prime}$-MoTe$_2$

Unconventional superconductors that spontaneously break space-group symmetries of their underlying crystal lattice are distinguished by spatial modulations of the superconducting order parameter. These states have recently captured significant attention in various strongly correlated materials, where the breaking of translational or intra-unit-cell symmetries results in the emergence of pair density waves with wavelengths extending across one or multiple unit cells. Here, we employ a spectroscopic-imaging scanning tunneling microscope to identify robust half-unit-cell modulations of the superconducting gap magnitude, coherence strength and subgap states in tunable 1T$^{\prime}$-MoTe$_2$ monolayer. The modulations are oriented perpendicular to the zigzag Mo chains and coexist with three-unit-cell primary pair density wave modulations along the Mo chains, both of which attenuate with increasing temperature and the application of external magnetic fields. Importantly, we find that the superconductivity modulations are strongly linked to unconventional electron pairing mechanisms, which significantly deviate from the Cooper pairing observed in traditional Bardeen-Cooper-Schrieffer superconductors. Our results advance the knowledge of Cooper-pair density modulations and the intricate interplay with other symmetry-breaking states in strongly correlated superconductors.

cond-mat.supr-con↗

arXiv2024

Instruction-Driven Fusion of Infrared-Visible Images: Tailoring for Diverse Downstream Tasks

The primary value of infrared and visible image fusion technology lies in applying the fusion results to downstream tasks. However, existing methods face challenges such as increased training complexity and significantly compromised performance of individual tasks when addressing multiple downstream tasks simultaneously. To tackle this, we propose Task-Oriented Adaptive Regulation (T-OAR), an adaptive mechanism specifically designed for multi-task environments. Additionally, we introduce the Task-related Dynamic Prompt Injection (T-DPI) module, which generates task-specific dynamic prompts from user-input text instructions and integrates them into target representations. This guides the feature extraction module to produce representations that are more closely aligned with the specific requirements of downstream tasks. By incorporating the T-DPI module into the T-OAR framework, our approach generates fusion images tailored to task-specific requirements without the need for separate training or task-specific weights. This not only reduces computational costs but also enhances adaptability and performance across multiple tasks. Experimental results show that our method excels in object detection, semantic segmentation, and salient object detection, demonstrating its strong adaptability, flexibility, and task specificity. This provides an efficient solution for image fusion in multi-task environments, highlighting the technology's potential across diverse applications.

cs.CV↗

arXiv2024

Mechanism of magnetic phase transition in correlated magnetic metal: insight into itinerant ferromagnet Fe$_{3-δ}$GeTe$_2$

Developing a comprehensive magnetic theory for correlated itinerant magnets poses challenges due to the difficulty in reconciling both local moments and itinerant electrons. In this work, we investigate the microscopic process of magnetic phase transition in ferromagnetic metal Fe$_{3-δ}$GeTe$_2$. We find that Hund's coupling is crucial for establishing ferromagnetic order. During the ferromagnetic transition, we observe the formation of quasiparticle flat bands and an opposing tendency in spectral weight transfer, primarily between the lower and upper Hubbard bands, across the two spin channels. Moreover, our results indicate that one of the inequivalent Fe sites exhibits Mott physics, while the other Fe site exhibits Hund's physics, attributable to their distinct atomic environments. We suggest that ferromagnetic order reduces spin fluctuations and makes flat bands near the Fermi level more distinct. The hybridization between the distinctly flat bands and other itinerant bands offers a possible way to form heavy fermion behavior in ferromagnets. The complex interactions of competing orders drive correlated magnetic metals to a new frontier for discovering outstanding quantum states.

cond-mat.str-el↗

arXiv2024

"I Came Across a Junk": Understanding Design Flaws of Data Visualization from the Public's Perspective

The visualization community has a rich history of reflecting upon flaws of visualization design, and research in this direction has remained lively until now. However, three main gaps still exist. First, most existing work characterizes design flaws from the perspective of researchers rather than the perspective of general users. Second, little work has been done to infer why these design flaws occur. Third, due to problems such as unclear terminology and ambiguous research scope, a better framework that systematically outlines various design flaws and helps distinguish different types of flaws is desired. To address the above gaps, this work investigated visualization design flaws through the lens of the public, constructed a framework to summarize and categorize the identified flaws, and explored why these flaws occur.

cs.HC↗

arXiv2024

Improved Video VAE for Latent Video Diffusion Model

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a pretrained image VAE into the 3D causal structure for temporal-spatial compression, this paper presents two astonishing findings: (1) The initialization from a well-trained image VAE with the same latent dimensions suppresses the improvement of subsequent temporal compression capabilities. (2) The adoption of causal reasoning leads to unequal information interactions and unbalanced performance between frames. To alleviate these problems, we propose a keyframe-based temporal compression (KTC) architecture and a group causal convolution (GCConv) module to further improve video VAE (IV-VAE). Specifically, the KTC architecture divides the latent space into two branches, in which one half completely inherits the compression prior of keyframes from a lower-dimension image VAE while the other half involves temporal compression through 3D group causal convolution, reducing temporal-spatial conflicts and accelerating the convergence speed of video VAE. The GCConv in above 3D half uses standard convolution within each frame group to ensure inter-frame equivalence, and employs causal logical padding between groups to maintain flexibility in processing variable frame video. Extensive experiments on five benchmarks demonstrate the SOTA video reconstruction and generation capabilities of the proposed IV-VAE (https://wpy1999.github.io/IV-VAE/).

cs.CV↗

arXiv2024

Generalizing Hyperedge Expansion for Hyper-relational Knowledge Graph Modeling

By representing knowledge in a primary triple associated with additional attribute-value qualifiers, hyper-relational knowledge graph (HKG) that generalizes triple-based knowledge graph (KG) has been attracting research attention recently. Compared with KG, HKG is enriched with the semantic qualifiers as well as the hyper-relational graph structure. However, to model HKG, existing studies mainly focus on either semantic information or structural information therein, which however fail to capture both simultaneously. To tackle this issue, in this paper, we generalize the hyperedge expansion in hypergraph learning and propose an equivalent transformation for HKG modeling, referred to as TransEQ. Specifically, the equivalent transformation transforms a HKG to a KG, which considers both semantic and structural characteristics. Then an encoder-decoder framework is developed to bridge the modeling research between KG and HKG. In the encoder part, KG-based graph neural networks are leveraged for structural modeling; while in the decoder part, various HKG-based scoring functions are exploited for semantic modeling. Especially, we design the sharing embedding mechanism in the encoder-decoder framework with semantic relatedness captured. We further theoretically prove that TransEQ preserves complete information in the equivalent transformation, and also achieves full expressivity. Finally, extensive experiments on three benchmarks demonstrate the superior performance of TransEQ in terms of both effectiveness and efficiency. On the largest benchmark WikiPeople, TransEQ significantly improves the state-of-the-art models by 15\% on MRR.

cs.AI↗

arXiv2024

SK-PINN: Accelerated physics-informed deep learning by smoothing kernel gradients

The automatic differentiation (AD) in the vanilla physics-informed neural networks (PINNs) is the computational bottleneck for the high-efficiency analysis. The concept of derivative discretization in smoothed particle hydrodynamics (SPH) can provide an accelerated training method for PINNs. In this paper, smoothing kernel physics-informed neural networks (SK-PINNs) are established, which solve differential equations using smoothing kernel discretization. It is a robust framework capable of solving problems in the computational mechanics of complex domains. When the number of collocation points gradually increases, the training speed of SK-PINNs significantly surpasses that of vanilla PINNs. In cases involving large collocation point sets or higher-order problems, SK-PINN training can be up to tens of times faster than vanilla PINN. Additionally, analysis using neural tangent kernel (NTK) theory shows that the convergence rates of SK-PINNs are consistent with those of vanilla PINNs. The superior performance of SK-PINNs is demonstrated through various examples, including regular and complex domains, as well as forward and inverse problems in fluid dynamics and solid mechanics.

physics.comp-ph↗

arXiv2024

ACE: All-round Creator and Editor Following Instructions via Diffusion Transformer

Diffusion models have emerged as a powerful generative technology and have been found to be applicable in various scenarios. Most existing foundational diffusion models are primarily designed for text-guided visual generation and do not support multi-modal conditions, which are essential for many visual editing tasks. This limitation prevents these foundational diffusion models from serving as a unified model in the field of visual generation, like GPT-4 in the natural language processing field. In this work, we propose ACE, an All-round Creator and Editor, which achieves comparable performance compared to those expert models in a wide range of visual generation tasks. To achieve this goal, we first introduce a unified condition format termed Long-context Condition Unit (LCU), and propose a novel Transformer-based diffusion model that uses LCU as input, aiming for joint training across various generation and editing tasks. Furthermore, we propose an efficient data collection approach to address the issue of the absence of available training data. It involves acquiring pairwise images with synthesis-based or clustering-based pipelines and supplying these pairs with accurate textual instructions by leveraging a fine-tuned multi-modal large language model. To comprehensively evaluate the performance of our model, we establish a benchmark of manually annotated pairs data across a variety of visual generation tasks. The extensive experimental results demonstrate the superiority of our model in visual generation fields. Thanks to the all-in-one capabilities of our model, we can easily build a multi-modal chat system that responds to any interactive request for image creation using a single model to serve as the backend, avoiding the cumbersome pipeline typically employed in visual agents. Code and models will be available on the project page: https://ali-vilab.github.io/ace-page/.

cs.CV↗

arXiv2024

In-Context LoRA for Diffusion Transformers

Recent research arXiv:2410.15027 has explored the use of diffusion transformers (DiTs) for task-agnostic image generation by simply concatenating attention tokens across images. However, despite substantial computational resources, the fidelity of the generated images remains suboptimal. In this study, we reevaluate and streamline this framework by hypothesizing that text-to-image DiTs inherently possess in-context generation capabilities, requiring only minimal tuning to activate them. Through diverse task experiments, we qualitatively demonstrate that existing text-to-image DiTs can effectively perform in-context generation without any tuning. Building on this insight, we propose a remarkably simple pipeline to leverage the in-context abilities of DiTs: (1) concatenate images instead of tokens, (2) perform joint captioning of multiple images, and (3) apply task-specific LoRA tuning using small datasets (e.g., 20~100 samples) instead of full-parameter tuning with large datasets. We name our models In-Context LoRA (IC-LoRA). This approach requires no modifications to the original DiT models, only changes to the training data. Remarkably, our pipeline generates high-fidelity image sets that better adhere to prompts. While task-specific in terms of tuning data, our framework remains task-agnostic in architecture and pipeline, offering a powerful tool for the community and providing valuable insights for further research on product-level task-agnostic generation systems. We release our code, data, and models at https://github.com/ali-vilab/In-Context-LoRA

cs.CV↗

arXiv2024

Detector integration at HEPS: a systematic, efficient and high-performance approach

At least 25 kinds of detector-like devices need to be integrated in Phase I of the High Energy Photon Source (HEPS), and the work needs to be carefully planned to maximise productivity with highly limited human resources. After a systematic analysis on the actual work involved in detector integration, a separation of concerns between collaborating groups of personnel is established to minimise the duplication of efforts. To facilitate software development for detector integration, the ADGenICam library, which abstracts repeated code in EPICS modules for cameras, is extended to support a much wider range of detectors. An increasingly considerable fraction of detectors, both inside and outside HEPS, offer performance that exceed capabilities of the areaDetector framework in EPICS. Given this background, areaDetector's limitations in performance and architecture are analysed, and a QueueIOC -based framework that overcomes these limitations is introduced. A simple, flexible ZeroMQ-based protocol is used for data transport in this framework, while RDMA transport and multi-node readout will be explored for higher data throughputs. By calling C/C++ libraries from within Python, the performance of the former and the expressiveness of the latter can coexist nicely; the expressiveness allows for much higher efficiency in the implementation and use of integration modules functionally comparable to their EPICS counterparts.

physics.ins-det↗

arXiv2024

A versatile framework for attitude tuning of beamlines at advanced light sources

Aside from regular beamline experiments at light sources, the preparation steps before these experiments are also worth systematic consideration in terms of automation; a representative category in these steps is attitude tuning, which typically appears in names like beam focusing, sample alignment etc. With the goal of saving time and manpower in both writing and using in mind, a Mamba-based attitude-tuning framework is created. It supports flexible input/output ports, easy integration of diverse evaluation functions, and free selection of optimisation algorithms; with the help from Mamba's infrastructure, machine learning (ML) and artificial intelligence (AI) technologies can also be readily integrated. The tuning of a polycapillary lens and of an X-ray emission spectrometer are given as examples for the general use of this framework, featuring powerful command-line interfaces (CLIs) and friendly graphical user interfaces (GUIs) that allow comfortable human-in-the-loop control. The tuning of a Raman spectrometer demonstrates more specialised use of the framework with customised optimisation algorithms. With similar applications in mind, our framework is estimated to be capable of fulfilling a majority of attitude-tuning needs. Also reported is a virtual-beamline mechanism based on easily customisable simulated detectors and motors, which facilitates both testing for developers and training for users.

physics.ins-det↗

arXiv2024

Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning

Multi-Modal Large Language Models (MLLMs) have demonstrated impressive performance in various VQA tasks. However, they often lack interpretability and struggle with complex visual inputs, especially when the resolution of the input image is high or when the interested region that could provide key information for answering the question is small. To address these challenges, we collect and introduce the large-scale Visual CoT dataset comprising 438k question-answer pairs, annotated with intermediate bounding boxes highlighting key regions essential for answering the questions. Additionally, about 98k pairs of them are annotated with detailed reasoning steps. Importantly, we propose a multi-turn processing pipeline that dynamically focuses on visual inputs and provides interpretable thoughts. We also introduce the related benchmark to evaluate the MLLMs in scenarios requiring specific local region identification. Extensive experiments demonstrate the effectiveness of our framework and shed light on better inference strategies. The Visual CoT dataset, benchmark, and pre-trained models are available on https://hao-shao.com/projects/viscot.html to support further research in this area.

cs.CV↗

arXiv2024

A conditional normalizing flow for domain decomposed uncertainty quantification

In this paper we present a conditional KRnet (cKRnet) based domain decomposed uncertainty quantification (CKR-DDUQ) approach to propagate uncertainties across different physical domains in models governed by partial differential equations (PDEs) with random inputs. This approach is based on the domain decomposed uncertainty quantification (DDUQ) method presented in [Q. Liao and K. Willcox, SIAM J. Sci. Comput., 37 (2015), pp. A103--A133], which suffers a bottleneck of density estimation for local joint input distributions in practice. In this work, we reformulate the required joint distributions as conditional distributions, and propose a new conditional normalizing flow model, called cKRnet, to efficiently estimate the conditional probability density functions. We present the general framework of CKR-DDUQ, conduct its convergence analysis, validate its accuracy and demonstrate its efficiency with numerical experiments.

math.NA↗