arXiv subjects

Tao Wang

Publications and source records attributed to Tao Wang.

At least 361 records · Page 20Linked to original sources

arXiv2024

Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentation

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the reasoning of linguistic and visual modalities, along with the temporal association of target objects. However, the seminal work employs only loose feature fusion and overlooks the utilization of long-term information on tracked objects. In this study, we introduce a compact Transformer-based method, termed TenRMOT. We conduct feature fusion at both encoding and decoding stages to fully exploit the advantages of Transformer architecture. Specifically, we incrementally perform cross-modal fusion layer-by-layer during the encoding phase. In the decoding phase, we utilize language-guided queries to probe memory features for accurate prediction of the desired objects. Moreover, we introduce a query update module that explicitly leverages temporal prior information of the tracked objects to enhance the consistency of their trajectories. In addition, we introduce a novel task called Referring Multi-Object Tracking and Segmentation (RMOTS) and construct a new dataset named Ref-KITTI Segmentation. Our dataset consists of 18 videos with 818 expressions, and each expression averages 10.7 masks, which poses a greater challenge compared to the typical single mask in most existing referring video segmentation datasets. TenRMOT demonstrates superior performance on both the referring multi-object tracking and the segmentation tasks.

cs.CV↗

arXiv2024

Large Enhancement of Properties in Strained Lead-free Multiferroic Solid Solutions with Strong Deviation from Vegard's Law

Efforts to combine the advantages of multiple systems to enhance functionlities through solid solution design present a great challenge due to the constraint imposed by the classical Vegard law. Here, we successfully navigate this trade off by leveraging the synergistic effect of chemical doping and strain engineering in solid solution system of BiFeO3 BaTiO3. Unlike bulks, a significant deviation from the Vegard law accompanying with enhanced multiferroism is observed in the strained solid solution epitaxial films, where we achieve a pronounced tetragonality, enhanced saturated magnetization, substantial polarization, high ferroelectric Curie temperature, all while maintaining impressively low leakage current. These characteristics surpass the properties of their parent BiFeO3 and BaTiO3 films. Moreover, the superior ferroelectricity has never been reported in corresponding bulks. These findings underscore the potential of strained BiFeO3 BaTiO3 films as lead-free, room-temperature multiferroics.

cond-mat.mtrl-sci↗

arXiv2024

Graph Propagation Transformer for Graph Representation Learning

This paper presents a novel transformer architecture for graph representation learning. The core insight of our method is to fully consider the information propagation among nodes and edges in a graph when building the attention module in the transformer blocks. Specifically, we propose a new attention mechanism called Graph Propagation Attention (GPA). It explicitly passes the information among nodes and edges in three ways, i.e. node-to-node, node-to-edge, and edge-to-node, which is essential for learning graph-structured data. On this basis, we design an effective transformer architecture named Graph Propagation Transformer (GPTrans) to further help learn graph data. We verify the performance of GPTrans in a wide range of graph learning experiments on several benchmark datasets. These results show that our method outperforms many state-of-the-art transformer-based graph models with better performance. The code will be released at https://github.com/czczup/GPTrans.

cs.LG↗

arXiv2024

Electromagnetic and hadronic decay of fully heavy tetraquark

In this study, we compute the electromagnetic and hadronic decay widths of the S-wave fully heavy tetraquark $T_{4Q}$ ($Q=c$ or $b$) at lowest order in $α_s$ and $v$, in the framework of nonrelativistic QCD. The short-distance coefficients are determined through the standard procedure of matching. The nonperturbative long-distance matrix elements are related to the phenomenological four-body Schrödinger wave functions at the origin, whose values are taken from literature. The branching fractions are predicted to be around $10^{-4}$ and $10^{-7}-10^{-6}$ for the $T_{4c}$ hadronic decay and electromagnetic decay, respectively. Combing our results with the $T_{4c}$ production cross sections at the LHC, we also predict the event numbers for various decay channels. With integrated luminosity $\mathcal{L}=100 \,{\rm fb}^{-1}$, it is expected that the event numbers can reach $10^3$ for $T_{4c}\to γγ$, and $10^6$ for $T_{4c}\to {\rm LH}$, at the LHC. The detecting prospect is promising. In addition, the decay widths of $T_{4b}$ are estimated based on simple dimensional analysis as well as velocity scaling rule.

hep-ph↗

arXiv2024

Cheeger type inequalities associated with isocapacitary constants on graphs

In this paper, we introduce Cheeger type constants via isocapacitary constants introduced by Maz'ya to estimate first Dirichlet, Neumann and Steklov eigenvalues on a finite subgraph of a graph. Moreover, we estimate the bottom of the spectrum of the Laplace operator and the Dirichlet-to-Neumann operator for an infinite subgraph. Estimates for higher-order Steklov eigenvalues on a finite or infinite subgraph are also proved.

math.DG↗

arXiv2024

General relativistic stochastic thermodynamics

Based on the recent work [1,2], we formulate the first law and the second law of stochastic thermodynamics in the framework of general relativity. These laws are established for a charged Brownian particle moving in a heat reservoir and subjecting to an external electromagnetic field in generic stationary spacetime background, and in order to maintain general covariance, they are presented respectively in terms of the divergences of the energy current and the entropy density current. The stability of the equilibrium state is also analyzed.

gr-qc↗

arXiv2024

A simple explanation of the absence of the spherical nuclei with the hidden-color states

Inspired by the EMC effect, the Cd puzzle and the SU3-IBM, a hypothesis can be given for a nucleus, that only the nucleus itself is a trivial (0,0) representation of the SU(3) group, which leads to the simple conclusion that spherical nucleus does not exist and the spherical mean field is not allowed. The key conclusion is that the whole nucleus should have many hidden-color states, and the quark-gluon degrees of freedom are required even at the low-energy excitation of the nucleus.

nucl-th↗

arXiv2024

A Knowledge-Informed Large Language Model Framework for U.S. Nuclear Power Plant Shutdown Initiating Event Classification for Probabilistic Risk Assessment

Identifying and classifying shutdown initiating events (SDIEs) is critical for developing low power shutdown probabilistic risk assessment for nuclear power plants. Existing computational approaches cannot achieve satisfactory performance due to the challenges of unavailable large, labeled datasets, imbalanced event types, and label noise. To address these challenges, we propose a hybrid pipeline that integrates a knowledge-informed machine learning mode to prescreen non-SDIEs and a large language model (LLM) to classify SDIEs into four types. In the prescreening stage, we proposed a set of 44 SDIE text patterns that consist of the most salient keywords and phrases from six SDIE types. Text vectorization based on the SDIE patterns generates feature vectors that are highly separable by using a simple binary classifier. The second stage builds Bidirectional Encoder Representations from Transformers (BERT)-based LLM, which learns generic English language representations from self-supervised pretraining on a large dataset and adapts to SDIE classification by fine-tuning it on an SDIE dataset. The proposed approaches are evaluated on a dataset with 10,928 events using precision, recall ratio, F1 score, and average accuracy. The results demonstrate that the prescreening stage can exclude more than 97% non-SDIEs, and the LLM achieves an average accuracy of 93.4% for SDIE classification.

cs.AI↗

arXiv2024

Objectively Evaluating the Reliability of Cell Type Annotation Using LLM-Based Strategies

Reliability in cell type annotation is challenging in single-cell RNA-sequencing data analysis because both expert-driven and automated methods can be biased or constrained by their training data, especially for novel or rare cell types. Although large language models (LLMs) are useful, our evaluation found that only a few matched expert annotations due to biased data sources and inflexible training inputs. To overcome these limitations, we developed the LICT (Large language model-based Identifier for Cell Types) software package using a multi-model fusion and "talk-to-machine" strategy. Tested across various single-cell RNA sequencing datasets, our approach significantly improved annotation reliability, especially in datasets with low cellular heterogeneity. Notably, we established objective criteria to assess annotation reliability using the "talk-to-machine" approach, which addresses discrepancies between our annotations and expert ones, enabling reliable evaluation even without reference data. This strategy enhances annotation credibility and sets the stage for advancing future LLM-based cell type annotation methods.

q-bio.QM↗

arXiv2024

Realization of a period-3 coplanar state in one-dimensional spin-orbit coupled optical lattice

In ultracold atoms, achieving a period-$3$ structure poses a significant challenge. In this work, we propose a three-sublattice spin-flop transition mechanism, differing from the two-sublattice counterpart used to explain the emergence of ferrimagnetic orders in higher dimensions. Guided by this mechanism, we design a setup of alkaline-earth-metal atoms to create a spin-orbit coupled optical lattice, where we identify a triplet-fold degenerate $YX\bar{Y}$ state with a period-$3$ coplanar spin ordering within the deep Mott-insulating phase region of the ground-state phase diagram. The $YX\bar{Y}$ state is protected by a finite gap, and its characteristic angle can be finely tuned by specific setup parameters. Moreover, we use the Rabi spectroscopy technique to detect the $YX\bar{Y}$ state. Our work not only shows the feasibility of achieving a period-$3$ structure \textit{via} the new mechanism but also suggests its potential applications for exploring other periodic structures in optical lattices.

cond-mat.quant-gas↗

arXiv2024

Application-Defined Receive Side Dispatching on the NIC

Application layer (L7) processing is increasingly implemented in proxies (e.g., Envoy) to simplify administration and management. However, prior work has observed that this reduces application performance and increases resource requirements. The reason is that moving logic out of the application required duplicating some computation and additional inter-process communication. This paper describes QingNiao, a system that moves L7 dispatch (a function implemented by all L7 proxies and affects all messages received by an application) to a NIC that is on the application's communication path. Unfortunately, the data formats and protocols used by modern applications pose a challenge when moving L7 dispatch to NICs. Consequently, when designing QingNiao we had to rethink not just the NIC hardware, but also how applications encode data sent over the network. We prototyped QingNiao using a 100GbE FPGA NIC, and show that for real-world applications QingNiao can achieve 6.6x to 7.15x higher throughput compared to software proxies.

cs.NI↗

arXiv2024

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling knowledge from LLMs. However, prior studies have often overlooked the diversity and quality of knowledge, especially the untapped potential of negative knowledge. Constructing effective negative knowledge remains severely understudied. In this paper, we introduce a novel framework called quality-guided contrastive rationale distillation aimed at enhancing reasoning capabilities through contrastive knowledge learning. For positive knowledge, we enrich its diversity through temperature sampling and employ self-consistency for further denoising and refinement. For negative knowledge, we propose an innovative self-adversarial approach that generates low-quality rationales by sampling previous iterations of smaller language models, embracing the idea that one can learn from one's own weaknesses. A contrastive loss is developed to distill both positive and negative knowledge into smaller language models, where an online-updating discriminator is integrated to assess qualities of rationales and assign them appropriate weights, optimizing the training process. Through extensive experiments across multiple reasoning tasks, we demonstrate that our method consistently outperforms existing distillation techniques, yielding higher-quality rationales.

cs.CL↗

arXiv2024

Precise structure and polarization determination of Hf0.5Zr0.5O2 with electron ptychography

Hf0.5Zr0.5O2 (HZO) is a promising candidate for next generation ferroelectric memories and transistors. However, its ferroelectricity origin is still under debate due to the complex of its phase and microstructure in practical samples. In this study, we investigate the atomic structure of substrate-free HZO freestanding film with multislice electron ptychography, for which the ultra-high space resolution (up to ~25 pm) and capability to simultaneously image the cation and oxygen allow us to precisely determine the intrinsic atomic structures of different phases and reveal subtle changes among them. We clarify that the orthorhombic phase is ferroelectric with spontaneous polarization ~34{\pm}4 μC/cm2 (corresponding to 56{\pm}6 pm in displacement) that is accurately measured through statistical analysis. Significant polarization suppression is observed near the grain boundary, while no distinguishable structural changes are detected near the 180° ferroelectric domain walls. Through the direct oxygen imaging of orthorhombic phase from the [111] zone axis, we quantify a substantial number of oxygen vacancies with a preferential distribution, which influences the polarization direction and strength. These findings provide fundamentals for HZO research, and thus lay a foundation for the design of high-performance ferroelectric devices.

cond-mat.mtrl-sci↗

arXiv2024

DPI-TTS: Directional Patch Interaction for Fast-Converging and Style Temporal Modeling in Text-to-Speech

In recent years, speech diffusion models have advanced rapidly. Alongside the widely used U-Net architecture, transformer-based models such as the Diffusion Transformer (DiT) have also gained attention. However, current DiT speech models treat Mel spectrograms as general images, which overlooks the specific acoustic properties of speech. To address these limitations, we propose a method called Directional Patch Interaction for Text-to-Speech (DPI-TTS), which builds on DiT and achieves fast training without compromising accuracy. Notably, DPI-TTS employs a low-to-high frequency, frame-by-frame progressive inference approach that aligns more closely with acoustic properties, enhancing the naturalness of the generated speech. Additionally, we introduce a fine-grained style temporal modeling method that further improves speaker style similarity. Experimental results demonstrate that our method increases the training speed by nearly 2 times and significantly outperforms the baseline models.

cs.SD↗

arXiv2024

Single-atom-resolved vibrational spectroscopy of a dislocation

Phonon resistance from dislocation scattering is often divided into short-range core interactions and long-range strain field interactions. Using electron energy-loss spectroscopy on a GaN dislocation, we report observations of vibrational modes localized at specific core atoms (short-range) and strain-driven phonon energy shifts around the dislocation (long-range). Ab initio calculations support these findings and draw out additional details. This study reveals atomically resolved vibrational spectra of dislocations, thus offering insights for engineering improved material functionalities.

cond-mat.mtrl-sci↗

arXiv2024

Text Prompt is Not Enough: Sound Event Enhanced Prompt Adapter for Target Style Audio Generation

Current mainstream audio generation methods primarily rely on simple text prompts, often failing to capture the nuanced details necessary for multi-style audio generation. To address this limitation, the Sound Event Enhanced Prompt Adapter is proposed. Unlike traditional static global style transfer, this method extracts style embedding through cross-attention between text and reference audio for adaptive style control. Adaptive layer normalization is then utilized to enhance the model's capacity to express multiple styles. Additionally, the Sound Event Reference Style Transfer Dataset (SERST) is introduced for the proposed target style audio generation task, enabling dual-prompt audio generation using both text and audio references. Experimental results demonstrate the robustness of the model, achieving state-of-the-art Fréchet Distance of 26.94 and KL Divergence of 1.82, surpassing Tango, AudioLDM, and AudioGen. Furthermore, the generated audio shows high similarity to its corresponding audio reference. The demo, code, and dataset are publicly available.

eess.AS↗

arXiv2024

Student Classroom Behavior Detection based on YOLOv7-BRA and Multi-Model Fusion

Accurately detecting student behavior in classroom videos can aid in analyzing their classroom performance and improving teaching effectiveness. However, the current accuracy rate in behavior detection is low. To address this challenge, we propose the Student Classroom Behavior Detection system based on based on YOLOv7-BRA (YOLOv7 with Bi-level Routing Attention ). We identified eight different behavior patterns, including standing, sitting, speaking, listening, walking, raising hands, reading, and writing. We constructed a dataset, which contained 11,248 labels and 4,001 images, with an emphasis on the common behavior of raising hands in a classroom setting (Student Classroom Behavior dataset, SCB-Dataset). To improve detection accuracy, we added the biformer attention module to the YOLOv7 network. Finally, we fused the results from YOLOv7 CrowdHuman, SlowFast, and DeepSort models to obtain student classroom behavior data. We conducted experiments on the SCB-Dataset, and YOLOv7-BRA achieved an mAP@0.5 of 87.1%, resulting in a 2.2% improvement over previous results. Our SCB-dataset can be downloaded from: https://github.com/Whiffe/SCB-datase

cs.CV↗

arXiv2024

SCB-Dataset3: A Benchmark for Detecting Student Classroom Behavior

The use of deep learning methods to automatically detect students' classroom behavior is a promising approach for analyzing their class performance and improving teaching effectiveness. However, the lack of publicly available datasets on student behavior poses a challenge for researchers in this field. To address this issue, we propose the Student Classroom Behavior dataset (SCB-dataset3), which represents real-life scenarios. Our dataset comprises 5686 images with 45578 labels, focusing on six behaviors: hand-raising, reading, writing, using a phone, bowing the head, and leaning over the table. We evaluated the dataset using the YOLOv5, YOLOv7, and YOLOv8 algorithms, achieving a mean average precision (map) of up to 80.3$\%$. We believe that our dataset can serve as a robust foundation for future research in student behavior detection and contribute to advancements in this field. Our SCB-dataset3 is available for download at: https://github.com/Whiffe/SCB-dataset

cs.CV↗