arXiv Science⌕ Search

arXiv subjects

Gang Chen

Publications and source records attributed to Gang Chen.

At least 253 records · Page 14Linked to original sources
arXiv2023

Optimal and Heuristic Min-Reg Scheduling Algorithms for GPU Programs

Given a basic block of instructions, finding a schedule that requires the minimum number of registers for evaluation is a well-known problem. The problem is NP-complete when the dependences among instructions form a directed-acyclic graph instead of a tree. We are striving to find efficient approximation algorithms for this problem not simply because it is an interesting graph optimization problem in theory. A good solution to this problem is also an essential component in solving the more complex instruction scheduling problem on GPU. In this paper, we start with explanations on why this problem is important in GPU instruction scheduling. We then explore two different approaches to tackling this problem. First we model this problem as a constraint-programming problem. Using a state-of-the-art CP-SAT solver, we can find optimal answers for much larger cases than previous works on a modest desktop PC. Second, guided by the optimal answers, we design and evaluate heuristics that can be applied to the polynomial-time list scheduling algorithms. A combination of those heuristics can achieve the register-pressure results that are about 17\% higher than the optimal minimum on average. However, there are still near 6\% cases in which the register pressure by the heuristic approach is 50\% higher than the optimal minimum.

cs.PL↗
arXiv2023

Infinite critical boson non-Fermi liquid on heterostructure interfaces

We study the emergence of non-Fermi liquid on heterostructure interfaces where there exists an infinite number of critical boson modes accounting for the magnetic fluctuations in two spatial dimensions. The interfacial Dzyaloshinskii-Moriya interaction naturally arises in magnetic interactions due to the absence of inversion symmetry, resulting in a degenerate contour for the low-energy bosonic modes in the momentum space which simultaneously becomes critical near the magnetic phase transition. The itinerant electrons are scattered by the critical boson contour via the Yukawa coupling. When the boson contour is much smaller than the Fermi surface, it is shown that, there exists a regime with a dynamic critical exponent z=3 while the boson contour still controls the low-energy magnetic fluctuations. Using a self-consistent renormalization calculation for this regime, we uncover a prominent non-Fermi liquid behavior in the resistivity with a characteristic temperature scaling power. These findings open up new avenues for understanding boson-fermion interactions and the novel fermionic quantum criticality.

cond-mat.str-el↗
arXiv2023

On the Weisfeiler algorithm of depth-$1$ stabilization

An origin of the multidimensional Weisfeiler-Leman algorithm goes back to a refinement procedure of deep stabilization, introduced by B. Weisfeiler in a paper included in the collective monograph ``On construction and identification of graphs"(1976). This procedure is recursive and the recursion starts from an algorithm of depth-$1$ stabilization, which has never been discussed in the literature. A goal of the present paper is to show that a simplified algorithm of the depth-$1$ stabilization has the same power as the $3$-dimensional Weisfeiler-Leman algorithm. It is proved that the class of coherent configurations obtained at the output of this simplified algorithm coincides with the class introduced earlier by the third author. As an application we also prove that if there exist at least two nonisomorphic projective planes of order $q$, then the Weisfeiler-Leman dimension of the incidence graph of any projective plane of order $q$ is at least $4$.

math.CO↗
arXiv2023

Practical development of efficient thermoelectric-photovoltaic hybrid systems based on wide-gap solar cells

The decrease of solar cell efficiency with temperature is a known problem for photovoltaics (PV). Temperature sensitivity can lead to a considerable amount of energy losses over the lifetime of solar panels. In this perspective Hybrid Thermoelectric-Photovoltaic (HTEPV) systems, which recover solar cell heat losses to produce an additional power output, can be a suitable option. However only hybridization of wide-gap solar cells is convenient in terms of efficiency gains and deserves investigation to evaluate HTEPV devices effectiveness. In this work we report the modeling and the development of customized bismuth telluride thermoelectric generators, optimized to be hybridized with amorphous silicon (aSi), Gallium Indium Phosphide (GaInP) or Perovskites solar cells. The model results showed in all three cases efficiency gains with a maximum of +3.1% for Perovskites (from 16.4% to 19.5%). These enhancements were then experimentally validated for the case of Perovskites solar cells, for which maximum gains were found to occur at typical operating temperatures of conventional PVs. This experimental evaluation demonstrated in an accurate fashion the real potential of thermoelectric hybridization of solar cells.

physics.app-ph↗
arXiv2023

TLM: Token-Level Masking for Transformers

Structured dropout approaches, such as attention dropout and DropHead, have been investigated to regularize the multi-head attention mechanism in Transformers. In this paper, we propose a new regularization scheme based on token-level rather than structure-level to reduce overfitting. Specifically, we devise a novel Token-Level Masking (TLM) training strategy for Transformers to regularize the connections of self-attention, which consists of two masking techniques that are effective and easy to implement. The underlying idea is to manipulate the connections between tokens in the multi-head attention via masking, where the networks are forced to exploit partial neighbors' information to produce a meaningful representation. The generality and effectiveness of TLM are thoroughly evaluated via extensive experiments on 4 diversified NLP tasks across 18 datasets, including natural language understanding benchmark GLUE, ChineseGLUE, Chinese Grammatical Error Correction, and data-to-text generation. The results indicate that TLM can consistently outperform attention dropout and DropHead, e.g., it increases by 0.5 points relative to DropHead with BERT-large on GLUE. Moreover, TLM can establish a new record on the data-to-text benchmark Rotowire (18.93 BLEU). Our code will be publicly available at https://github.com/Young1993/tlm.

cs.CL↗
arXiv2023

Photomolecular Effect: Visible Light Interaction with Air-Water Interface

Although water is almost transparent to visible light, we demonstrate that the air-water interface interacts strongly with visible light via what we hypothesize as the photomolecular effect. In this effect, transverse-magnetic polarized photons cleave off water clusters from the air-water interface. We use over 10 different experiments to demonstrate the existence of this effect and its dependence on the wavelength, incident angle and polarization of visible light. We further demonstrate that visible light heats up thin fogs, suggesting that this process can impact weather, climate, and the earth's water cycle. Our study suggests that the photomolecular effect should happen widely in nature, from clouds to fogs, ocean to soil surfaces, and plant transpiration, and can also lead to new applications in energy and clear water.

physics.optics↗
arXiv2023

SPA: A Graph Spectral Alignment Perspective for Domain Adaptation

Unsupervised domain adaptation (UDA) is a pivotal form in machine learning to extend the in-domain model to the distinctive target domains where the data distributions differ. Most prior works focus on capturing the inter-domain transferability but largely overlook rich intra-domain structures, which empirically results in even worse discriminability. In this work, we introduce a novel graph SPectral Alignment (SPA) framework to tackle the tradeoff. The core of our method is briefly condensed as follows: (i)-by casting the DA problem to graph primitives, SPA composes a coarse graph alignment mechanism with a novel spectral regularizer towards aligning the domain graphs in eigenspaces; (ii)-we further develop a fine-grained message propagation module -- upon a novel neighbor-aware self-training mechanism -- in order for enhanced discriminability in the target domain. On standardized benchmarks, the extensive experiments of SPA demonstrate that its performance has surpassed the existing cutting-edge DA methods. Coupled with dense model analysis, we conclude that our approach indeed possesses superior efficacy, robustness, discriminability, and transferability. Code and data are available at: https://github.com/CrownX/SPA.

cs.CV↗
arXiv2023

Continuous Occupancy Mapping in Dynamic Environments Using Particles

Particle-based dynamic occupancy maps were proposed in recent years to model the obstacles in dynamic environments. Current particle-based maps describe the occupancy status in discrete grid form and suffer from the grid size problem, wherein a large grid size is unfavorable for motion planning, while a small grid size lowers efficiency and causes gaps and inconsistencies. To tackle this problem, this paper generalizes the particle-based map into continuous space and builds an efficient 3D egocentric local map. A dual-structure subspace division paradigm, composed of a voxel subspace division and a novel pyramid-like subspace division, is proposed to propagate particles and update the map efficiently with the consideration of occlusions. The occupancy status of an arbitrary point in the map space can then be estimated with the particles' weights. To further enhance the performance of simultaneously modeling static and dynamic obstacles and minimize noise, an initial velocity estimation approach and a mixture model are utilized. Experimental results show that our map can effectively and efficiently model both dynamic obstacles and static obstacles. Compared to the state-of-the-art grid-form particle-based map, our map enables continuous occupancy estimation and substantially improves the performance in different resolutions.

cs.RO↗
arXiv2023

Co-movement Pattern Mining from Videos

Co-movement pattern mining from GPS trajectories has been an intriguing subject in spatial-temporal data mining. In this paper, we extend this research line by migrating the data source from GPS sensors to surveillance cameras, and presenting the first investigation into co-movement pattern mining from videos. We formulate the new problem, re-define the spatial-temporal proximity constraints from cameras deployed in a road network, and theoretically prove its hardness. Due to the lack of readily applicable solutions, we adapt existing techniques and propose two competitive baselines using Apriori-based enumerator and CMC algorithm, respectively. As the principal technical contributions, we introduce a novel index called temporal-cluster suffix tree (TCS-tree), which performs two-level temporal clustering within each camera and constructs a suffix tree from the resulting clusters. Moreover, we present a sequence-ahead pruning framework based on TCS-tree, which allows for the simultaneous leverage of all pattern constraints to filter candidate paths. Finally, to reduce verification cost on the candidate paths, we propose a sliding-window based co-movement pattern enumeration strategy and a hashing-based dominance eliminator, both of which are effective in avoiding redundant operations. We conduct extensive experiments for scalability and effectiveness analysis. Our results validate the efficiency of the proposed index and mining algorithm, which runs remarkably faster than the two baseline methods. Additionally, we construct a video database with 1169 cameras and perform an end-to-end pipeline analysis to study the performance gap between GPS-driven and video-driven methods. Our results demonstrate that the derived patterns from the video-driven approach are similar to those derived from groundtruth trajectories, providing evidence of its effectiveness.

cs.DB↗
arXiv2023

A Simple Text to Video Model via Transformer

We present a general and simple text to video model based on Transformer. Since both text and video are sequential data, we encode both texts and images into the same hidden space, which are further fed into Transformer to capture the temporal consistency and then decoder to generate either text or images. Considering the image signal may become weak in the long sequence, we introduce the U-Net to reconstruct image from its noised version. Specifically, we increase the noise level to the original image in the long sequence, then use the $down$ module from U-Net to encode noised images, which are further input to transformer to predict next clear images. We also add a constraint to promote motion between any generated image pair in the video. We use GPT2 and test our approach on UCF101 dataset and show it can generate promising videos.

cs.CV↗
arXiv2023

Controllable Textual Inversion for Personalized Text-to-Image Generation

The recent large-scale generative modeling has attained unprecedented performance especially in producing high-fidelity images driven by text prompts. Text inversion (TI), alongside the text-to-image model backbones, is proposed as an effective technique in personalizing the generation when the prompts contain user-defined, unseen or long-tail concept tokens. Despite that, we find and show that the deployment of TI remains full of "dark-magics" -- to name a few, the harsh requirement of additional datasets, arduous human efforts in the loop and lack of robustness. In this work, we propose a much-enhanced version of TI, dubbed Controllable Textual Inversion (COTI), in resolving all the aforementioned problems and in turn delivering a robust, data-efficient and easy-to-use framework. The core to COTI is a theoretically-guided loss objective instantiated with a comprehensive and novel weighted scoring mechanism, encapsulated by an active-learning paradigm. The extensive results show that COTI significantly outperforms the prior TI-related approaches with a 26.05 decrease in the FID score and a 23.00% boost in the R-precision.

cs.CV↗
arXiv2023

Upper branch thermal Hall effect in quantum paramagnets

Inspired by the persistent thermal Hall effects at finite temperatures in various quantum paramagnets, we explore the origin of the thermal Hall effects from the perspective of the upper branch parts by invoking the dispersive and twisted crystal field excitations. It is shown that the upper branches of the local energy levels could hybridize and form the dispersive bands. The observation is that, upon the time-reversal symmetry breaking by the magnetic fields, these upper branch bands could acquire a Berry curvature distribution and contribute to the thermal Hall effect in the paramagnetic regime. As a proof of principle, we consider the setting on the kagomé lattice with one ground state singlet and an excited doublet, and show this is indeed possible. We expect this effect to be universal and has no strong connection with the underlying lattice. Although the thermal Hall signal can be contributed from other sources such as phonons and their scattering in the actual materials, we discuss the application to the Mott systems with the large local Hilbert spaces.

cond-mat.str-el↗
arXiv2023

ModelGiF: Gradient Fields for Model Functional Distance

The last decade has witnessed the success of deep learning and the surge of publicly released trained models, which necessitates the quantification of the model functional distance for various purposes. However, quantifying the model functional distance is always challenging due to the opacity in inner workings and the heterogeneity in architectures or tasks. Inspired by the concept of "field" in physics, in this work we introduce Model Gradient Field (abbr. ModelGiF) to extract homogeneous representations from the heterogeneous pre-trained models. Our main assumption underlying ModelGiF is that each pre-trained deep model uniquely determines a ModelGiF over the input space. The distance between models can thus be measured by the similarity between their ModelGiFs. We validate the effectiveness of the proposed ModelGiF with a suite of testbeds, including task relatedness estimation, intellectual property protection, and model unlearning verification. Experimental results demonstrate the versatility of the proposed ModelGiF on these tasks, with significantly superiority performance to state-of-the-art competitors. Codes are available at https://github.com/zju-vipa/modelgif.

cs.LG↗
arXiv2023

Enhancement of Quantum Sensing in a Cavity Optomechanical System around Quantum Critical Point

The precision of quantum sensing could be improved by exploiting quantum phase transitions, where the physical quantity tends to diverge when the system approaches the quantum critical point. This critical enhancement phenomenon has been applied to the quantum Rabi model in a dynamic framework, showing a promising sensing enhancement without the need for complex initial state preparation. In this work, we present a quantum phase transition in the coupling cavity-mechanical oscillator system when the coupling strength crosses a critical point, determined by the effective detuning of cavity and frequency of mechanical mode. By utilizing this critical phenomenon, we obtain a prominent enhancement of quantum sensing, such as the position and momentum of the mechanical oscillator. This result provides an alternative method to enhance the quantum sensing of some physical quantities, such as mass, charge, and weak force, in a large mass system.

quant-ph↗
arXiv2023

An introduction to the parton and hadron cascade model PACIAE 3.0

We introduce a parton and hadron cascade model PACIAE 3.0 based on PYTHIA 6.428 and the PACIAE 2.2 program series. The simulation framework of C-, B-, and A-loops are designed for the high energy ($\sqrt{s_{NN}}\geq 3$ GeV) and low energy ($\sqrt{s_{NN}}<3$ GeV) nuclear collisions, respectively, in PACIAE 3.0. In the C-loop simulation, the parton-parton inelastic scattering processes are added in the partonic rescattering process. The single string structure and multiple string interaction mechanism have been introduced investigating the strangeness enhancement in C- and B-loop. An improved mapping relation between the centrality percentage definition and the impact parameter definition is proposed responding the observation of $b_{max}\approx 20$ fm from ALICE, ATLAS, and CMS collaborations. We have extensively modified the phenomenological coalescence hadronization model. The PACIAE 3.0 model simulated results of particle yield, transverse momentum distribution, and rapidity distribution well reproduce, respectively, the experimental data measured at FOPI, E895, RHIC, and LHC energies.

hep-ph↗
arXiv2023

Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread deployment, there is a general lack of research that thoroughly discusses and analyzes the potential risks concealed. In that case, we intend to conduct a preliminary but pioneering study covering the robustness, consistency, and credibility of LLMs systems. With most of the related literature in the era of LLM uncharted, we propose an automated workflow that copes with an upscaled number of queries/responses. Overall, we conduct over a million queries to the mainstream LLMs including ChatGPT, LLaMA, and OPT. Core to our workflow consists of a data primitive, followed by an automated interpreter that evaluates these LLMs under different adversarial metrical systems. As a result, we draw several, and perhaps unfortunate, conclusions that are quite uncommon from this trendy community. Briefly, they are: (i)-the minor but inevitable error occurrence in the user-generated query input may, by chance, cause the LLM to respond unexpectedly; (ii)-LLMs possess poor consistency when processing semantically similar query input. In addition, as a side finding, we find that ChatGPT is still capable to yield the correct answer even when the input is polluted at an extreme level. While this phenomenon demonstrates the powerful memorization of the LLMs, it raises serious concerns about using such data for LLM-involved evaluation in academic development. To deal with it, we propose a novel index associated with a dataset that roughly decides the feasibility of using such data for LLM-involved evaluation. Extensive empirical studies are tagged to support the aforementioned claims.

cs.LG↗
arXiv2023

Distinguishing thermodynamics and spectroscopy for octupolar U(1) spin liquid of Ce-pyrochlores

Inspired by the progress on the spin liquid candidates Ce$_2$Sn$_2$O$_7$ and Ce$_2$Zr$_2$O$_7$ where the Ce ions carry the dipole-octupole doublets, we analyze the distinction between the thermodynamic and spectroscopic measurements for the octupolar U(1) spin liquid. Due to the peculiar properties of octupolar U(1) spin liquid and the selective Zeeman coupling, both uniform susceptibility and the spectroscopic measurements only probe the spinon excitations, while the specific heat measures all excitations. After clarifying the contents in each measurement, we observe that, thermodynamics carries the information of single spinon, while the spectroscopy is associated with spinon pairs. Such distinction immediately leads to the multiplicity relation of the excitation gaps from different measurements that include the uniform susceptibility, Knight shift and $1/T_1$ spin lattice relaxation of NMR and $μ$SR, and the inelastic neutron scattering measurements. We hope this work provides a useful recipe for the identification of fractionalization in the octupolar U(1) spin liquid and other spin liquids.

cond-mat.str-el↗
arXiv2023

Coulombic antiferromagnet in spin-1/2 pyrochlores with dipole-octupole doublets

Exotic state of matter could coexist with conventional orders such that the gauge fields and fractionalized excitations could prevail in a seemingly ordered state. We explore the Coulombic antiferromagnet in the spin-1/2 pyrochlores with dipole-octupole doublets. This fractionalized antiferromagnetic state carries both antiferromagnetic order and emergent quantum electrodynamics with the gapless gauge photon and fractionalized quasiparticles. We explain the characteristic physical properties including the thermodynamics and the dynamics of this exotic state. This includes for example the anomalously large $T^3$ specific heat and the broad spinon continuum in the inelastic neutron scattering. We discuss the experimental and material's relevance and expect this work to inspire interests in the search of exotic physics among the ordered magnets.

cond-mat.str-el↗