arXiv subjects

Yang Yang

Publications and source records attributed to Yang Yang.

At least 847 records · Page 47Linked to original sources

arXiv2022

Dynamic surface tension of the pure liquid-vapor interface subjected to the cyclic loads

We demonstrate a methodology for computationally investigating the mechanical response of a pure molten lead surface system to the lateral mechanical cyclic loads and try to answer the question: how dose the dynamically driven liquid surface system follow the classical physics of the elastic-driven oscillation? The steady-state oscillation of the dynamic surface tension under cyclic load, including the excitation of high frequency vibration mode at different driving frequencies and amplitudes, was compared with the classical theory of single-body driven damped oscillator. Under the highest studied frequency (50 GHz) and amplitude (5%) of the load, the increase of the (mean value) dynamic surface tension could reach ~5%. The peak and trough values of the instantaneous dynamic surface tension could reach (up to) 40% increase and (up to) 20% decrease compared to the equilibrium surface tension, respectively. The extracted generalized natural frequencies and the generalized damping constants seem to be intimately related to the intrinsic timescales of the atomic temporal-spatial correlation functions of the liquids both in the bulk region and in the outermost surface layers. These insights uncovered could be helpful for quantitative manipulation of the liquid surface tension using ultrafast shockwaves or laser pulses.

physics.comp-ph↗

arXiv2022

Bound-preserving discontinuous Galerkin methods with modified Patankar time integrations for chemical reacting flows

In this paper, we develop bound-preserving discontinuous Galerkin (DG) methods for chemical reactive flows. There are several difficulties in constructing suitable numerical schemes. First of all, the density and internal energy are positive, and the mass fraction of each species is between 0 and 1. Secondly, due to the rapid reaction rate, the system may contain stiff sources, and the strong-stability-preserving explicit Runge-Kutta method may result in limited time step sizes. To obtain physically relevant numerical approximations, we apply the bound-preserving technique to the DG methods. For time discretization, we apply the modified Runge-Kutta/multi-step Patankar methods, which are explicit for the flux while implicit for the source. Such methods can handle stiff sources with relatively large time steps, preserve the positivity of the target variables, and keep the summation of the mass fractions to be 1. Finally, it is not straightforward to combine the bound-preserving DG methods and the Patankar time integrations. The positivity-preserving technique for DG method requires positive numerical approximations at the cell interfaces, while Patankar methods can keep the positivity of the pre-selected point-values of the target variables. To match the degree of freedom, we use $Q^k$ polynomials on rectangular meshes for problems in two space dimensions. To evolve in time, we first read the polynomials at the Gaussian points. Then suitable slope limiters can be applied to enforce the positivity of the solutions at those points, which can be preserved by the Patankar methods, leading to positive updated numerical cell averages. In addition, we use another slope limiter to get positive solutions used for the bound-preserving technique for the flux.

math.NA↗

arXiv2022

String-net construction of RCFT correlators

We use string-net models to accomplish a direct, purely two-dimensional, approach to correlators of two-dimensional rational conformal field theories. We obtain concise geometric expressions for the objects describing bulk and boundary fields in terms of idempotents in the cylinder category of the underlying modular fusion category, comprising more general classes of fields than is standard in the literature. Combining these idempotents with Frobenius graphs on the world sheet yields string nets that form a consistent system of correlators, i.e. a system of invariants under appropriate mapping class groups that are compatible with factorization. Using markings, we extract operator products of field objects from specific correlators; the resulting operator products are natural algebraic expressions that make sense beyond semisimplicity. We also derive an Eckmann-Hilton relation internal to a braided category, thereby demonstrating the utility of string nets for understanding algebra in braided tensor categories. Finally we introduce the notion of a universal correlator. This systematizes the treatment of situations in which different world sheets have the same correlator and allows for the definition of a more comprehensive mapping class group.

math.QA↗

arXiv2022

Region-of-Interest Based Neural Video Compression

Humans do not perceive all parts of a scene with the same resolution, but rather focus on few regions of interest (ROIs). Traditional Object-Based codecs take advantage of this biological intuition, and are capable of non-uniform allocation of bits in favor of salient regions, at the expense of increased distortion the remaining areas: such a strategy allows a boost in perceptual quality under low rate constraints. Recently, several neural codecs have been introduced for video compression, yet they operate uniformly over all spatial locations, lacking the capability of ROI-based processing. In this paper, we introduce two models for ROI-based neural video coding. First, we propose an implicit model that is fed with a binary ROI mask and it is trained by de-emphasizing the distortion of the background. Secondly, we design an explicit latent scaling method, that allows control over the quantization binwidth for different spatial regions of latent variables, conditioned on the ROI mask. By extensive experiments, we show that our methods outperform all our baselines in terms of Rate-Distortion (R-D) performance in the ROI. Moreover, they can generalize to different datasets and to any arbitrary ROI at inference time. Finally, they do not require expensive pixel-level annotations during training, as synthetic ROI masks can be used with little to no degradation in performance. To the best of our knowledge, our proposals are the first solutions that integrate ROI-based capabilities into neural video compression models.

eess.IV↗

arXiv2022

MMGA: Multimodal Learning with Graph Alignment

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very general and important form of data, cannot be easily interacted with other modalities because of its non-regular nature. In this paper, we propose MMGA (Multimodal learning with Graph Alignment), a novel multimodal pre-training framework to incorporate information from graph (social network), image and text modalities on social media to enhance user representation learning. In MMGA, a multi-step graph alignment mechanism is proposed to add the self-supervision from graph modality to optimize the image and text encoders, while using the information from the image and text modalities to guide the graph encoder learning. We conduct experiments on the dataset crawled from Instagram. The experimental results show that MMGA works well on the dataset and improves the fans prediction task's performance. We release our dataset, the first social media multimodal dataset with graph, of 60,000 users labeled with specific topics based on 2 million posts to facilitate future research.

cs.MM↗

arXiv2022

SA-DNet: A on-demand semantic object registration network adapting to non-rigid deformation

As an essential processing step before the fusing of infrared and visible images, the performance of image registration determines whether the two images can be fused at correct spatial position. In the actual scenario, the varied imaging devices may lead to a change in perspective or time gap between shots, making significant non-rigid spatial relationship in infrared and visible images. Even if a large number of feature points are matched, the registration accuracy may still be inadequate, affecting the result of image fusion and other vision tasks. To alleviate this problem, we propose a Semantic-Aware on-Demand registration network (SA-DNet), which mainly purpose is to confine the feature matching process to the semantic region of interest (sROI) by designing semantic-aware module (SAM) and HOL-Deep hybrid matching module (HDM). After utilizing TPS to transform infrared and visible images based on the corresponding feature points in sROI, the registered images are fused using image fusion module (IFM) to achieve a fully functional registration and fusion network. Moreover, we point out that for different demands, this type of approach allows us to select semantic objects for feature matching as needed and accomplishes task-specific registration based on specific requirements. To demonstrate the robustness of SA-DNet for non-rigid distortions, we conduct extensive experiments by comparing SA-DNet with five state-of-the-art infrared and visible image feature matching methods, and the experimental results show that our method adapts better to the presence of non-rigid distortions in the images and provides semantically well-registered images.

cs.CV↗

arXiv2022

VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction

With the booming of pre-trained transformers, representation-based models based on Siamese transformer encoders have become mainstream techniques for efficient text matching. However, these models suffer from severe performance degradation due to the lack of interaction between the text pair, compared with interaction-based models. Prior arts attempt to address this through performing extra interaction for Siamese encoded representations, while the interaction during encoding is still ignored. To remedy this, we propose a \textit{Virtual} InteRacTion mechanism (VIRT) to transfer interactive knowledge from interaction-based models into Siamese encoders through attention map distillation. As a train-time-only component, VIRT could completely maintain the high efficiency of the Siamese structure and brings no extra computation cost during inference. To fully utilize the learned interactive knowledge, we further design a VIRT-adapted interaction strategy. Experimental results on multiple text matching datasets demonstrate that our method outperforms state-of-the-art representation-based models. What's more, VIRT can be easily integrated into existing representation-based methods to achieve further improvements.

cs.CL↗

arXiv2022

GNN-encoder: Learning a Dual-encoder Architecture via Graph Neural Networks for Dense Passage Retrieval

Recently, retrieval models based on dense representations are dominant in passage retrieval tasks, due to their outstanding ability in terms of capturing semantics of input text compared to the traditional sparse vector space models. A common practice of dense retrieval models is to exploit a dual-encoder architecture to represent a query and a passage independently. Though efficient, such a structure loses interaction between the query-passage pair, resulting in inferior accuracy. To enhance the performance of dense retrieval models without loss of efficiency, we propose a GNN-encoder model in which query (passage) information is fused into passage (query) representations via graph neural networks that are constructed by queries and their top retrieved passages. By this means, we maintain a dual-encoder structure, and retain some interaction information between query-passage pairs in their representations, which enables us to achieve both efficiency and efficacy in passage retrieval. Evaluation results indicate that our method significantly outperforms the existing models on MSMARCO, Natural Questions and TriviaQA datasets, and achieves the new state-of-the-art on these datasets.

cs.IR↗

arXiv2022

InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

In the field of face recognition, it is always a hot research topic to improve the loss solution to make the face features extracted by the network have greater discriminative power. Research works in recent years has improved the discriminative power of the face model by normalizing softmax to the cosine space step by step and then adding a fixed penalty margin to reduce the intra-class distance to increase the inter-class distance. Although a great deal of previous work has been done to optimize the boundary penalty to improve the discriminative power of the model, adding a fixed margin penalty to the depth feature and the corresponding weight is not consistent with the pattern of data in the real scenario. To address this issue, in this paper, we propose a novel loss function, InterFace, releasing the constraint of adding a margin penalty only between the depth feature and the corresponding weight to push the separability of classes by adding corresponding margin penalties between the depth features and all weights. To illustrate the advantages of InterFace over a fixed penalty margin, we explained geometrically and comparisons on a set of mainstream benchmarks. From a wider perspective, our InterFace has advanced the state-of-the-art face recognition performance on five out of thirteen mainstream benchmarks. All training codes, pre-trained models, and training logs, are publicly released \footnote{$https://github.com/iamsangmeng/InterFace$}.

cs.CV↗

arXiv2022

Neural Topological Ordering for Computation Graphs

Recent works on machine learning for combinatorial optimization have shown that learning based approaches can outperform heuristic methods in terms of speed and performance. In this paper, we consider the problem of finding an optimal topological order on a directed acyclic graph with focus on the memory minimization problem which arises in compilers. We propose an end-to-end machine learning based approach for topological ordering using an encoder-decoder framework. Our encoder is a novel attention based graph neural network architecture called \emph{Topoformer} which uses different topological transforms of a DAG for message passing. The node embeddings produced by the encoder are converted into node priorities which are used by the decoder to generate a probability distribution over topological orders. We train our model on a dataset of synthetically generated graphs called layered graphs. We show that our model outperforms, or is on-par, with several topological ordering baselines while being significantly faster on synthetic graphs with up to 2k nodes. We also train and test our model on a set of real-world computation graphs, showing performance improvements.

cs.LG↗

arXiv2022

A hybridizable discontinuous Galerkin method on unfitted meshes for single-phase Darcy flow in fractured porous media

We present a novel hybridizable discontinuous Galerkin (HDG) method on unfitted meshes for single-phase Darcy flow in a fractured porous media. In particular we apply the HDG methodology to the recently introduced reinterpreted discrete fracture model (RDFM) [Xu & Yang, 2021 submitted] that use Dirac-$δ$ functions to model both conductive and blocking fractures. Due to the use of Dirac-$δ$ function approach for the fractures, our numerical scheme naturally allows for unfitted meshes with respect to the fractures, which is the major novelty of the proposed scheme. Moreover, the scheme is locally mass conservative and is relatively easy to implement comparing with existing work on the subject. In particular, our scheme is a simple modification of an existing regular Darcy flow HDG solver by adding the following two components: (i) locate the co-dimension one fractures in the background mesh and adding the appropriate surface integrals associated with these fractures into the stiffness matrix, (ii) adjust the penalty parameters on cells cut through conductive and blocking fractures (fractured cells). Despite the simplicity of the proposed scheme, it performs extremely well for various benchmark test cases in both two- and three-dimensions. This is the first time that a truly unfitted finite element scheme been applied to complex fractured porous media flow problems in 3D with both blocking and conductive fractures without any restrictions on the meshes.

math.NA↗

arXiv2022

OpenMedIA: Open-Source Medical Image Analysis Toolbox and Benchmark under Heterogeneous AI Computing Platforms

In this paper, we present OpenMedIA, an open-source toolbox library containing a rich set of deep learning methods for medical image analysis under heterogeneous Artificial Intelligence (AI) computing platforms. Various medical image analysis methods, including 2D/3D medical image classification, segmentation, localisation, and detection, have been included in the toolbox with PyTorch and/or MindSpore implementations under heterogeneous NVIDIA and Huawei Ascend computing systems. To our best knowledge, OpenMedIA is the first open-source algorithm library providing compared PyTorch and MindSpore implementations and results on several benchmark datasets. The source codes and models are available at https://git.openi.org.cn/OpenMedIA.

eess.IV↗

arXiv2022

Real-Time Cattle Interaction Recognition via Triple-stream Network

In stockbreeding of beef cattle, computer vision-based approaches have been widely employed to monitor cattle conditions (e.g. the physical, physiology, and health). To this end, the accurate and effective recognition of cattle action is a prerequisite. Generally, most existing models are confined to individual behavior that uses video-based methods to extract spatial-temporal features for recognizing the individual actions of each cattle. However, there is sociality among cattle and their interaction usually reflects important conditions, e.g. estrus, and also video-based method neglects the real-time capability of the model. Based on this, we tackle the challenging task of real-time recognizing interactions between cattle in a single frame in this paper. The pipeline of our method includes two main modules: Cattle Localization Network and Interaction Recognition Network. At every moment, cattle localization network outputs high-quality interaction proposals from every detected cattle and feeds them into the interaction recognition network with a triple-stream architecture. Such a triple-stream network allows us to fuse different features relevant to recognizing interactions. Specifically, the three kinds of features are a visual feature that extracts the appearance representation of interaction proposals, a geometric feature that reflects the spatial relationship between cattle, and a semantic feature that captures our prior knowledge of the relationship between the individual action and interaction of cattle. In addition, to solve the problem of insufficient quantity of labeled data, we pre-train the model based on self-supervised learning. Qualitative and quantitative evaluation evidences the performance of our framework as an effective method to recognize cattle interaction in real time.

cs.CV↗

arXiv2022

Deep Joint Source-Channel Coding Based on Semantics of Pixels

The semantic information of the image for intelligent tasks is hidden behind the pixels, and slight changes in the pixels will affect the performance of intelligent tasks. In order to preserve semantic information behind pixels for intelligent tasks during wireless image transmission, we propose a joint source-channel coding method based on semantics of pixels, which can improve the performance of intelligent tasks for images at the receiver by retaining semantic information. Specifically, we first utilize gradients of intelligent task's perception results with respect to pixels to represent the semantic importance of pixels. Then, we extract the semantic distortion, and train the deep joint source-channel coding network with the goal of minimizing semantic distortion rather than pixel's distortion. Experiment results demonstrate that the proposed method improves the performance of the intelligent classification task by 1.38% and 66% compared with the SOTA deep joint source-channel coding method and the traditional separately source-channel coding method at the same transmission ra te and signal-to-noise ratio.

eess.IV↗

arXiv2022

Tuning the Magnetic Properties of the CrMnFeCoNi Cantor Alloy

Magnetic properties of more than twenty Cantor alloy samples of varying composition were investigated over a temperature range of 5 K to 300 K and in fields of up to 70 kOe using magnetometry and muon spin relaxation. Two transitions are identified: a spin-glass-like transition that appears between 55 K and 190 K depending on composition, and a ferrimagnetic transition that occurs at approximately 43 K in multiple samples with widely varying compositions. The magnetic signatures at 43 K are remarkably insensitive to chemical composition. A modified Curie-Weiss model was used to fit the susceptibility data and to extract the net effective magnetic moment for each sample. The resulting values for the net effective moment were either diminished with increasing Cr or Mn concentrations or enhanced with decreasing Fe, Co, or Ni concentrations. Beyond a sufficiently large effective moment, the magnetic ground state transitions from ferrimagnetism to ferromagnetism. The effective magnetic moments, together with the corresponding compositions, are used in a global linear regression analysis to extract element-specific effective magnetic moments, which are compared to the values obtained by ab-initio based density functional theory (DFT) calculations. These moments provide the information necessary to controllably tune the magnetic properties of Cantor alloy variants.

cond-mat.mtrl-sci↗

arXiv2022

Conditional Generative Data-free Knowledge Distillation

Knowledge distillation has made remarkable achievements in model compression. However, most existing methods require the original training data, which is usually unavailable due to privacy and security issues. In this paper, we propose a conditional generative data-free knowledge distillation (CGDD) framework for training lightweight networks without any training data. This method realizes efficient knowledge distillation based on conditional image generation. Specifically, we treat the preset labels as ground truth to train a conditional generator in a semi-supervised manner. The trained generator can produce specified classes of training images. For training the student network, we force it to extract the knowledge hidden in teacher feature maps, which provide crucial cues for the learning process. Moreover, an adversarial training framework for promoting distillation performance is constructed by designing several loss functions. This framework helps the student model to explore larger data space. To demonstrate the effectiveness of the proposed method, we conduct extensive experiments on different datasets. Compared with other data-free works, our work obtains state-of-the-art results on CIFAR100, Caltech101, and different versions of ImageNet datasets. The codes will be released.

cs.CV↗

arXiv2022

Continual Unsupervised Domain Adaptation for Semantic Segmentation using a Class-Specific Transfer

In recent years, there has been tremendous progress in the field of semantic segmentation. However, one remaining challenging problem is that segmentation models do not generalize to unseen domains. To overcome this problem, one either has to label lots of data covering the whole variety of domains, which is often infeasible in practice, or apply unsupervised domain adaptation (UDA), only requiring labeled source data. In this work, we focus on UDA and additionally address the case of adapting not only to a single domain, but to a sequence of target domains. This requires mechanisms preventing the model from forgetting its previously learned knowledge. To adapt a segmentation model to a target domain, we follow the idea of utilizing light-weight style transfer to convert the style of labeled source images into the style of the target domain, while retaining the source content. To mitigate the distributional shift between the source and the target domain, the model is fine-tuned on the transferred source images in a second step. Existing light-weight style transfer approaches relying on adaptive instance normalization (AdaIN) or Fourier transformation still lack performance and do not substantially improve upon common data augmentation, such as color jittering. The reason for this is that these methods do not focus on region- or class-specific differences, but mainly capture the most salient style. Therefore, we propose a simple and light-weight framework that incorporates two class-conditional AdaIN layers. To extract the class-specific target moments needed for the transfer layers, we use unfiltered pseudo-labels, which we show to be an effective approximation compared to real labels. We extensively validate our approach (CACE) on a synthetic sequence and further propose a challenging sequence consisting of real domains. CACE outperforms existing methods visually and quantitatively.

cs.CV↗

arXiv2022

Atomistic characterization of the SiO2 high-density liquid/low-density liquid interface

The equilibrium silica liquid-liquid interface between the high-density liquid (HDL) phase and the low-density liquid (LDL) phase is examined using molecular-dynamics simulation. The structure, thermodynamics, and dynamics within the interfacial region are characterized in detail and compared with previous studies on the liquid-liquid phase transition (LLPT) in bulk silica, as well as traditional crystal-melt interfaces. We find that the silica HDL-LDL interface exhibits a spatial fragile-to-strong transition across the interface. Calculations of dynamics properties reveal three types of dynamical heterogeneity hybridizing within the silica HDL-LDL interface. We also observe that as the interface is traversed from HDL to LDL, the Si/O coordination number ratio jumps to an unexpectedly large value, defining a thin region of the interface where HDL and LDL exhibit significant mixing. In addition, the LLPT phase coexistence is interpreted in the framework of the traditional thermodynamics of alloys and phase equilibria.

cond-mat.mtrl-sci↗