arXiv subjects

Xin Dong

Publications and source records attributed to Xin Dong.

At least 91 records · Page 5Linked to original sources

arXiv2023

Measurements of the lightest hypernucleus ($\mathrm{^3_ΛH}$): progress and perspective

The hyperon-nucleon ($Y$-$N$) interaction is important for the description of the equation-of-state of high baryon density matter. Hypernuclei, the cluster object of nucleons and hyperons, serve as cornerstones of a full understanding of the $Y$-$N$ interaction. Recent measurements of the lightest known hypernucleus, the hypertriton's ($\mathrm{^3_ΛH}$) and anti-hypertriton's ($\mathrm{^3_{\barΛ}\bar{H}}$) lifetime, mass and $Λ$ separation energy have attracted interests on the subject. Its cross section and collective flow parameters have also been measured in heavy-ion collisions, which have revealed new features on its production mechanism. In this article we summarise recent measurements of $\mathrm{^3_ΛH}$, focusing on the heavy-ion collisions. We will discuss their implications for the $\mathrm{^3_ΛH}$ properties and the constrains on the $Y$-$N$ interaction models.

nucl-ex↗

arXiv2023

The Cost of Down-Scaling Language Models: Fact Recall Deteriorates before In-Context Learning

How does scaling the number of parameters in large language models (LLMs) affect their core capabilities? We study two natural scaling techniques -- weight pruning and simply training a smaller or larger model, which we refer to as dense scaling -- and their effects on two core capabilities of LLMs: (a) recalling facts presented during pre-training and (b) processing information presented in-context during inference. By curating a suite of tasks that help disentangle these two capabilities, we find a striking difference in how these two abilities evolve due to scaling. Reducing the model size by more than 30\% (via either scaling approach) significantly decreases the ability to recall facts seen in pre-training. Yet, a 60--70\% reduction largely preserves the various ways the model can process in-context information, ranging from retrieving answers from a long context to learning parameterized functions from in-context exemplars. The fact that both dense scaling and weight pruning exhibit this behavior suggests that scaling model size has an inherently disparate effect on fact recall and in-context learning.

cs.CL↗

arXiv2023

Face Encryption via Frequency-Restricted Identity-Agnostic Attacks

Billions of people are sharing their daily live images on social media everyday. However, malicious collectors use deep face recognition systems to easily steal their biometric information (e.g., faces) from these images. Some studies are being conducted to generate encrypted face photos using adversarial attacks by introducing imperceptible perturbations to reduce face information leakage. However, existing studies need stronger black-box scenario feasibility and more natural visual appearances, which challenge the feasibility of privacy protection. To address these problems, we propose a frequency-restricted identity-agnostic (FRIA) framework to encrypt face images from unauthorized face recognition without access to personal information. As for the weak black-box scenario feasibility, we obverse that representations of the average feature in multiple face recognition models are similar, thus we propose to utilize the average feature via the crawled dataset from the Internet as the target to guide the generation, which is also agnostic to identities of unknown face recognition systems; in nature, the low-frequency perturbations are more visually perceptible by the human vision system. Inspired by this, we restrict the perturbation in the low-frequency facial regions by discrete cosine transform to achieve the visual naturalness guarantee. Extensive experiments on several face recognition models demonstrate that our FRIA outperforms other state-of-the-art methods in generating more natural encrypted faces while attaining high black-box attack success rates of 96%. In addition, we validate the efficacy of FRIA using real-world black-box commercial API, which reveals the potential of FRIA in practice. Our codes can be found in https://github.com/XinDong10/FRIA.

cs.CV↗

arXiv2023

Modeling Backward-Angle ($u$-channel) Virtual Compton Scattering at an Electron-Ion Collider

High-energy backward ($u$-channel) reactions can involve very large momentum transfers to the target baryons, shifting them by many units of rapidity. These reactions are difficult to understand in conventional models in which baryon number is carried by the valence quarks. Backward Compton scattering is an especially attractive experimental target, because of its simple final state. There is currently limited data on this process, and that data is at low center-of-mass energies. In this paper, we examine the prospects for studying backward Compton scattering at the future Electron-Ion Collider (EIC). We model the cross-section and kinematics using the limited data on backward Compton scattering and backward meson production, and then simulate Compton scattering at EIC energies, in a simple model of the ePIC detector. Generally, the proton is scattered toward mid-rapidity, while the produced photon is in the far-forward region, visible in a Zero Degree Calorimeter (ZDC). We show that the background from backward $π^0$ production can be rejected using a high-resolution, well-segmented ZDC.

hep-ph↗

arXiv2023

GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning

Image-based Virtual Try-ON aims to transfer an in-shop garment onto a specific person. Existing methods employ a global warping module to model the anisotropic deformation for different garment parts, which fails to preserve the semantic information of different parts when receiving challenging inputs (e.g, intricate human poses, difficult garments). Moreover, most of them directly warp the input garment to align with the boundary of the preserved region, which usually requires texture squeezing to meet the boundary shape constraint and thus leads to texture distortion. The above inferior performance hinders existing methods from real-world applications. To address these problems and take a step towards real-world virtual try-on, we propose a General-Purpose Virtual Try-ON framework, named GP-VTON, by developing an innovative Local-Flow Global-Parsing (LFGP) warping module and a Dynamic Gradient Truncation (DGT) training strategy. Specifically, compared with the previous global warping mechanism, LFGP employs local flows to warp garments parts individually, and assembles the local warped results via the global garment parsing, resulting in reasonable warped parts and a semantic-correct intact garment even with challenging inputs.On the other hand, our DGT training strategy dynamically truncates the gradient in the overlap area and the warped garment is no more required to meet the boundary constraint, which effectively avoids the texture squeezing problem. Furthermore, our GP-VTON can be easily extended to multi-category scenario and jointly trained by using data from different garment categories. Extensive experiments on two high-resolution benchmarks demonstrate our superiority over the existing state-of-the-art methods.

cs.CV↗

arXiv2023

Probing gluon TMDs with reconstructed and tagged heavy flavor hadron pairs at EIC

Study of the transverse structure of the proton is one of the major physics goals of the upcoming Electron Ion Collider (EIC). The gluon transverse momentum dependent distributions (TMD) form an essential focus of this effort and are important towards understanding the angular momentum contribution to proton spin as well as QCD factorization. However, very limited experimental constraints on the gluon TMD exist currently. As the heavy quark production in lepton-nucleon DIS gets a dominant contribution from the photon-gluon-fusion process, heavy quark production makes an attractive tool to probe gluon distributions in nucleons. In this paper we present a study of heavy flavor hadron pair reconstruction at a future EIC detector with MAPS based inner tracking and vertexing subsystems to constrain gluon TMD. We utilize the excellent track pointing resolution provided by the detector to exclusively reconstruct heavy flavor hadron pairs via their hadronic decay channels and also to develop a heavy flavor hadron tagging algorithm. Statistical uncertainty projections on azimuthal asymmetries corresponding to gluon TMD at the EIC is evaluated. The heavy flavor tagging is found to substantially enhance the purity of heavy flavor hadron pair selection, and the statistical precision of the measurement compared to that from exclusive reconstruction. The correlation between the azimuthal angle of the transverse momentum of the gluon initiating the process and that of the corresponding heavy flavor hadron pair was also studied and found to be well correlated. This study opens up heavy flavor hadron pair measurements as an attractive channel to access gluon TMD at the EIC.

hep-ph↗

arXiv2023

GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning

Multi-task learning (MTL) aims at solving multiple related tasks simultaneously and has experienced rapid growth in recent years. However, MTL models often suffer from performance degeneration with negative transfer due to learning several tasks simultaneously. Some related work attributed the source of the problem is the conflicting gradients. In this case, it is needed to select useful gradient updates for all tasks carefully. To this end, we propose a novel optimization approach for MTL, named GDOD, which manipulates gradients of each task using an orthogonal basis decomposed from the span of all task gradients. GDOD decomposes gradients into task-shared and task-conflict components explicitly and adopts a general update rule for avoiding interference across all task gradients. This allows guiding the update directions depending on the task-shared components. Moreover, we prove the convergence of GDOD theoretically under both convex and non-convex assumptions. Experiment results on several multi-task datasets not only demonstrate the significant improvement of GDOD performed to existing MTL models but also prove that our algorithm outperforms state-of-the-art optimization methods in terms of AUC and Logloss metrics.

cs.LG↗

arXiv2022

Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attacks

Mobile edge devices see increased demands in deep neural networks (DNNs) inference while suffering from stringent constraints in computing resources. Split computing (SC) emerges as a popular approach to the issue by executing only initial layers on devices and offloading the remaining to the cloud. Prior works usually assume that SC offers privacy benefits as only intermediate features, instead of private data, are shared from devices to the cloud. In this work, we debunk this SC-induced privacy protection by (i) presenting a novel data-free model inversion method and (ii) demonstrating sample inversion where private data from devices can still be leaked with high fidelity from the shared feature even after tens of neural network layers. We propose Divide-and-Conquer Inversion (DCI) which partitions the given deep network into multiple shallow blocks and inverts each block with an inversion method. Additionally, cycle-consistency technique is introduced by re-directing the inverted results back to the model under attack in order to better supervise the training of the inversion modules. In contrast to prior art based on generative priors and computation-intensive optimization in deriving inverted samples, DCI removes the need for real device data and generative priors, and completes inversion with a single quick forward pass over inversion modules. For the first time, we scale data-free and sample-specific inversion to deep architectures and large datasets for both discriminative and generative networks. We perform model inversion attack to ResNet and RepVGG models on ImageNet and SNGAN on CelebA and recover the original input from intermediate features more than 40 layers deep into the network.

cs.LG↗

arXiv2022

DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning

Building a universal conversational agent has been a long-standing goal of the dialogue research community. Most previous works only focus on a small set of dialogue tasks. In this work, we aim to build a unified dialogue foundation model (DFM) which can be used to solve massive diverse dialogue tasks. To achieve this goal, a large-scale well-annotated dialogue dataset with rich task diversity (DialogZoo) is collected. We introduce a framework to unify all dialogue tasks and propose novel auxiliary self-supervised tasks to achieve stable training of DFM on the highly diverse large scale DialogZoo corpus. Experiments show that, compared with models of the same size, DFM can achieve state-of-the-art or competitive performance on very rich cross-domain downstream dialogue tasks. This demonstrates that DFM largely extends the ability of unified dialogue pre-trained model.

cs.CL↗

arXiv2022

PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on

Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. In this work, we take a step forwards to explore versatile virtual try-on solutions, which we argue should possess three main properties, namely, they should support unsupervised training, arbitrary garment categories, and controllable garment editing. To this end, we propose a characteristic-preserving end-to-end network, the PAtch-routed SpaTially-Adaptive GAN++ (PASTA-GAN++), to achieve a versatile system for high-resolution unpaired virtual try-on. Specifically, our PASTA-GAN++ consists of an innovative patch-routed disentanglement module to decouple the intact garment into normalized patches, which is capable of retaining garment style information while eliminating the garment spatial information, thus alleviating the overfitting issue during unsupervised training. Furthermore, PASTA-GAN++ introduces a patch-based garment representation and a patch-guided parsing synthesis block, allowing it to handle arbitrary garment categories and support local garment editing. Finally, to obtain try-on results with realistic texture details, PASTA-GAN++ incorporates a novel spatially-adaptive residual module to inject the coarse warped garment feature into the generator. Extensive experiments on our newly collected UnPaired virtual Try-on (UPT) dataset demonstrate the superiority of PASTA-GAN++ over existing SOTAs and its ability for controllable garment editing.

cs.CV↗

arXiv2022

SphereFed: Hyperspherical Federated Learning

Federated Learning aims at training a global model from multiple decentralized devices (i.e. clients) without exchanging their private local data. A key challenge is the handling of non-i.i.d. (independent identically distributed) data across multiple clients that may induce disparities of their local features. We introduce the Hyperspherical Federated Learning (SphereFed) framework to address the non-i.i.d. issue by constraining learned representations of data points to be on a unit hypersphere shared by clients. Specifically, all clients learn their local representations by minimizing the loss with respect to a fixed classifier whose weights span the unit hypersphere. After federated training in improving the global model, this classifier is further calibrated with a closed-form solution by minimizing a mean squared loss. We show that the calibration solution can be computed efficiently and distributedly without direct access of local data. Extensive experiments indicate that our SphereFed approach is able to improve the accuracy of multiple existing federated learning algorithms by a considerable margin (up to 6% on challenging datasets) with enhanced computation and communication efficiency across datasets and model architectures.

cs.LG↗

arXiv2022

DRESS: Dynamic REal-time Sparse Subnets

The limited and dynamically varied resources on edge devices motivate us to deploy an optimized deep neural network that can adapt its sub-networks to fit in different resource constraints. However, existing works often build sub-networks through searching different network architectures in a hand-crafted sampling space, which not only can result in a subpar performance but also may cause on-device re-configuration overhead. In this paper, we propose a novel training algorithm, Dynamic REal-time Sparse Subnets (DRESS). DRESS samples multiple sub-networks from the same backbone network through row-based unstructured sparsity, and jointly trains these sub-networks in parallel with weighted loss. DRESS also exploits strategies including parameter reusing and row-based fine-grained sampling for efficient storage consumption and efficient on-device adaptation. Extensive experiments on public vision datasets show that DRESS yields significantly higher accuracy than state-of-the-art sub-networks.

cs.CV↗

arXiv2022

Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibration

Spiking Neural Network (SNN), originating from the neural behavior in biology, has been recognized as one of the next-generation neural networks. Conventionally, SNNs can be obtained by converting from pre-trained Artificial Neural Networks (ANNs) by replacing the non-linear activation with spiking neurons without changing the parameters. In this work, we argue that simply copying and pasting the weights of ANN to SNN inevitably results in activation mismatch, especially for ANNs that are trained with batch normalization (BN) layers. To tackle the activation mismatch issue, we first provide a theoretical analysis by decomposing local conversion error to clipping error and flooring error, and then quantitatively measure how this error propagates throughout the layers using the second-order analysis. Motivated by the theoretical results, we propose a set of layer-wise parameter calibration algorithms, which adjusts the parameters to minimize the activation mismatch. Extensive experiments for the proposed algorithms are performed on modern architectures and large-scale tasks including ImageNet classification and MS COCO detection. We demonstrate that our method can handle the SNN conversion with batch normalization layers and effectively preserve the high accuracy even in 32 time steps. For example, our calibration algorithms can increase up to 65% accuracy when converting VGG-16 with BN layers.

cs.NE↗

arXiv2022

Backward-Angle ($u$-channel) Production at an Electron-Ion Collider

In backward photoproduction of mesons, $γp\rightarrow M p$, the target proton takes most of the photon momentum, while the produced meson recoils in the direction from which the photon came. Thus the Mandelstam $u$ is small, while the squared momentum transfer $t$ is typically large, near the kinematic limit. In a collider geometry, backward production transfers the struck baryon by many units of rapidity, in a striking similarity to baryon stopping. We explore this similarity, and point out the similarities between the Regge theories used to model baryon stopping with those that are used for backward production. We then explore how backward production can be explored at higher energies than are available at fixed target experiments, by studying production at an electron-ion collider. We calculate the expected $ep$ cross sections and rates, finding that the rate for backward $ω$ production is about 1/300 that of forward $ω$s. We discuss the kinematics of backward production and consider the detector requirements for experimental study.

hep-ph↗

arXiv2022

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

We design deep neural networks (DNNs) and corresponding networks' splittings to distribute DNNs' workload to camera sensors and a centralized aggregator on head mounted devices to meet system performance targets in inference accuracy and latency under the given hardware resource constraints. To achieve an optimal balance among computation, communication, and performance, a split-aware neural architecture search framework, SplitNets, is introduced to conduct model designing, splitting, and communication reduction simultaneously. We further extend the framework to multi-view systems for learning to fuse inputs from multiple camera sensors with optimal performance and systemic efficiency. We validate SplitNets for single-view system on ImageNet as well as multi-view system on 3D classification, and show that the SplitNets framework achieves state-of-the-art (SOTA) performance and system latency compared with existing approaches.

cs.LG↗

arXiv2022

Dressing in the Wild by Watching Dance Videos

While significant progress has been made in garment transfer, one of the most applicable directions of human-centric image generation, existing works overlook the in-the-wild imagery, presenting severe garment-person misalignment as well as noticeable degradation in fine texture details. This paper, therefore, attends to virtual try-on in real-world scenes and brings essential improvements in authenticity and naturalness especially for loose garment (e.g., skirts, formal dresses), challenging poses (e.g., cross arms, bent legs), and cluttered backgrounds. Specifically, we find that the pixel flow excels at handling loose garments whereas the vertex flow is preferred for hard poses, and by combining their advantages we propose a novel generative network called wFlow that can effectively push up garment transfer to in-the-wild context. Moreover, former approaches require paired images for training. Instead, we cut down the laboriousness by working on a newly constructed large-scale video dataset named Dance50k with self-supervised cross-frame training and an online cycle optimization. The proposed Dance50k can boost real-world virtual dressing by covering a wide variety of garments under dancing poses. Extensive experiments demonstrate the superiority of our wFlow in generating realistic garment transfer results for in-the-wild images without resorting to expensive paired datasets.

cs.CV↗

arXiv2022

Neural Mean Discrepancy for Efficient Out-of-Distribution Detection

Various approaches have been proposed for out-of-distribution (OOD) detection by augmenting models, input examples, training sets, and optimization objectives. Deviating from existing work, we have a simple hypothesis that standard off-the-shelf models may already contain sufficient information about the training set distribution which can be leveraged for reliable OOD detection. Our empirical study on validating this hypothesis, which measures the model activation's mean for OOD and in-distribution (ID) mini-batches, surprisingly finds that activation means of OOD mini-batches consistently deviate more from those of the training data. In addition, training data's activation means can be computed offline efficiently or retrieved from batch normalization layers as a 'free lunch'. Based upon this observation, we propose a novel metric called Neural Mean Discrepancy (NMD), which compares neural means of the input examples and training data. Leveraging the simplicity of NMD, we propose an efficient OOD detector that computes neural means by a standard forward pass followed by a lightweight classifier. Extensive experiments show that NMD outperforms state-of-the-art OOD approaches across multiple datasets and model architectures in terms of both detection accuracy and computational cost.

cs.LG↗

arXiv2022

Global uniform in $N$ estimates for solutions of a system of Hartree-Fock-Bogoliubov type in the case $β<1$

We extend the results of the 2019 paper by the third and fourth author globally in time. More precisely, we prove uniform in $N$ estimates for the solutions $ϕ$, $Λ$ and $Γ$ of a coupled system of Hartree-Fock-Bogoliubov type with interaction potential $V_N(x-y)=N^{3 β}v(N^β(x-y))$ with $β<1$. The potential satisfies some technical conditions, but is not small. The initial conditions have finite energy and the "pair correlation" part satisfies a smallness condition, but are otherwise general functions in suitable Sobolev spaces, and the expected correlations in $Λ$ develop dynamically in time. The estimates are expected to improve the Fock space bounds from the 2021 paper of the first and fifth author. This will be addressed in a different paper.

math.AP↗