arXiv Science⌕ Search

arXiv subjects

Yang Yang

Publications and source records attributed to Yang Yang.

At least 757 records · Page 42Linked to original sources
arXiv2023

How to Generate Popular Post Headlines on Social Media?

Posts, as important containers of user-generated-content pieces on social media, are of tremendous social influence and commercial value. As an integral components of a post, the headline has a decisive contribution to the post's popularity. However, current mainstream method for headline generation is still manually writing, which is unstable and requires extensive human effort. This drives us to explore a novel research question: Can we automate the generation of popular headlines on social media? We collect more than 1 million posts of 42,447 celebrities from public data of Xiaohongshu, which is a well-known social media platform in China. We then conduct careful observations on the headlines of these posts. Observation results demonstrate that trends and personal styles are widespread in headlines on social medias and have significant contribution to posts's popularity. Motivated by these insights, we present MEBART, which combines Multiple preference-Extractors with Bidirectional and Auto-Regressive Transformers (BART), capturing trends and personal styles to generate popular headlines on social medias. We perform extensive experiments on real-world datasets and achieve state-of-the-art performance compared with several advanced baselines. In addition, ablation and case studies demonstrate that MEBART advances in capturing trends and personal styles.

cs.AI↗
arXiv2023

Towards Net-Zero Carbon Emissions in Network AI for 6G and Beyond

A global effort has been initiated to reduce the worldwide greenhouse gas (GHG) emissions, primarily carbon emissions, by half by 2030 and reach net-zero by 2050. The development of 6G must also be compliant with this goal. Unfortunately, developing a sustainable and net-zero emission systems to meet the users' fast growing demands on mobile services, especially smart services and applications, may be much more challenging than expected. Particularly, despite the energy efficiency improvement in both hardware and software designs, the overall energy consumption and carbon emission of mobile networks are still increasing at a tremendous speed. The growing penetration of resource-demanding AI algorithms and solutions further exacerbate this challenge. In this article, we identify the major emission sources and introduce an evaluation framework for analyzing the lifecycle of network AI implementations. A novel joint dynamic energy trading and task allocation optimization framework, called DETA, has been introduced to reduce the overall carbon emissions. We consider a federated edge intelligence-based network AI system as a case study to verify the effectiveness of our proposed solution. Experimental results based on a hardware prototype suggest that our proposed solution can reduce carbon emissions of network AI systems by up to 74.9%. Finally, open problems and future directions are discussed.

cs.NI↗
arXiv2023

Privacy-Aware Joint Source-Channel Coding for image transmission based on Disentangled Information Bottleneck

Current privacy-aware joint source-channel coding (JSCC) works aim at avoiding private information transmission by adversarially training the JSCC encoder and decoder under specific signal-to-noise ratios (SNRs) of eavesdroppers. However, these approaches incur additional computational and storage requirements as multiple neural networks must be trained for various eavesdroppers' SNRs to determine the transmitted information. To overcome this challenge, we propose a novel privacy-aware JSCC for image transmission based on disentangled information bottleneck (DIB-PAJSCC). In particular, we derive a novel disentangled information bottleneck objective to disentangle private and public information. Given the separate information, the transmitter can transmit only public information to the receiver while minimizing reconstruction distortion. Since DIB-PAJSCC transmits only public information regardless of the eavesdroppers' SNRs, it can eliminate additional training adapted to eavesdroppers' SNRs. Experimental results show that DIB-PAJSCC can reduce the eavesdropping accuracy on private information by up to 20\% compared to existing methods.

cs.CR↗
arXiv2023

Numerical study on the effects of fluid properties in electrohydrodynamic pulsating jet under constant voltage

Pulsating jet is one of the common working modes in electrohydrodynamic printing (EHDP) that process is highly affected by operating parameters and material properties. In this paper, the processes of pulsating jet for liquids with different physical properties were investigated using numerical simulation. An electrohydrodynamic solver was established, and a charge flux restricting step was adopted to ensure a realistic distribution of free charges. Three various ejection regimes were observed in our simulations: oscillating cone (OC), choked jet (CJ), and stable cone-jet (SJ). We found that three dimensionless numbers relating to liquid properties determined the ejection regime: the Ohnesorge number, Q0εr/Q, and Q0/(QRe). Based on those dimensionless numbers, the roles of liquid properties on pulsating jet (OC and CJ) were analyzed. In OC, the break of the jet is due to the significant oscillation of the Taylor cone, which is mainly affected by viscosity and conductivity. In CJ, the jet emission is terminated by the excessive resistant force in the cone-jet transition region. For liquids with low and medium viscosity, the dominant resistant force is the polarization force or viscous force when εrRe is larger or smaller than 1, respectively. For high viscosity liquids, the viscous force always becomes the major resistance. These results further reveal the physical mechanism of pulsating jet and can be used to guide its application.

physics.flu-dyn↗
arXiv2023

NICE: CVPR 2023 Challenge on Zero-shot Image Captioning

In this report, we introduce NICE (New frontiers for zero-shot Image Captioning Evaluation) project and share the results and outcomes of 2023 challenge. This project is designed to challenge the computer vision community to develop robust image captioning models that advance the state-of-the-art both in terms of accuracy and fairness. Through the challenge, the image captioning models were tested using a new evaluation dataset that includes a large variety of visual concepts from many domains. There was no specific training data provided for the challenge, and therefore the challenge entries were required to adapt to new types of image descriptions that had not been seen during training. This report includes information on the newly proposed NICE dataset, evaluation methods, challenge results, and technical details of top-ranking entries. We expect that the outcomes of the challenge will contribute to the improvement of AI models on various vision-language tasks.

cs.CV↗
arXiv2023

Prompt-based Node Feature Extractor for Few-shot Learning on Text-Attributed Graphs

Text-attributed Graphs (TAGs) are commonly found in the real world, such as social networks and citation networks, and consist of nodes represented by textual descriptions. Currently, mainstream machine learning methods on TAGs involve a two-stage modeling approach: (1) unsupervised node feature extraction with pre-trained language models (PLMs); and (2) supervised learning using Graph Neural Networks (GNNs). However, we observe that these representations, which have undergone large-scale pre-training, do not significantly improve performance with a limited amount of training samples. The main issue is that existing methods have not effectively integrated information from the graph and downstream tasks simultaneously. In this paper, we propose a novel framework called G-Prompt, which combines a graph adapter and task-specific prompts to extract node features. First, G-Prompt introduces a learnable GNN layer (\emph{i.e.,} adaptor) at the end of PLMs, which is fine-tuned to better capture the masked tokens considering graph neighborhood information. After the adapter is trained, G-Prompt incorporates task-specific prompts to obtain \emph{interpretable} node representations for the downstream task. Our experiment results demonstrate that our proposed method outperforms current state-of-the-art (SOTA) methods on few-shot node classification. More importantly, in zero-shot settings, the G-Prompt embeddings can not only provide better task interpretability than vanilla PLMs but also achieve comparable performance with fully-supervised baselines.

cs.SI↗
arXiv2023

Reconstructing high-order sequence features of dynamic functional connectivity networks based on diversified covert attention patterns for Alzheimer's disease classification

Recent studies have applied deep learning methods such as convolutional recurrent neural networks (CRNs) and Transformers to brain disease classification based on dynamic functional connectivity networks (dFCNs), such as Alzheimer's disease (AD), achieving better performance than traditional machine learning methods. However, in CRNs, the continuous convolution operations used to obtain high-order aggregation features may overlook the non-linear correlation between different brain regions due to the essence of convolution being the linear weighted sum of local elements. Inspired by modern neuroscience on the research of covert attention in the nervous system, we introduce the self-attention mechanism, a core module of Transformers, to model diversified covert attention patterns and apply these patterns to reconstruct high-order sequence features of dFCNs in order to learn complex dynamic changes in brain information flow. Therefore, we propose a novel CRN method based on diversified covert attention patterns, DCA-CRN, which combines the advantages of CRNs in capturing local spatio-temporal features and sequence change patterns, as well as Transformers in learning global and high-order correlation features. Experimental results on the ADNI and ADHD-200 datasets demonstrate the prediction performance and generalization ability of our proposed method.

eess.IV↗
arXiv2023

Persistence of Monoclinic Crystal Structure in Three-Dimensional Second-Order Topological Insulator Candidate 1T'-MoTe2 Thin Flake without Structural Phase transition

A van der Waals material, MoTe2 with a monoclinic 1T' crystal structure is a candidate for three-dimensional (3D) second-order topological insulators (SOTIs) hosting gapless hinge states and insulating surface states. However, due to the temperature-induced structural phase transition, the monoclinic 1T' structure of MoTe2 would be transformed into the orthorhombic Td structure as the temperature is lowered, which hinders the experimental verification and the electronic applications of the predicted SOTI state at low temperatures. Here, we present systematic Raman spectroscopy studies of the exfoliated MoTe2 thin flakes with variable thicknesses at different temperatures. As a spectroscopic signature of the orthorhombic Td structure of MoTe2, the out-of-plane vibration mode D at ~ 125 cm-1 is always visible below a certain temperature in the multilayer flakes thicker than ~ 27.7 nm, but vanishes in the temperature range from 80 K to 320 K when the flake thickness becomes lower than ~ 19.5 nm. The absence of the out-of-plane vibration mode D in the Raman spectra here demonstrates not only the disappearance of the monoclinic-to-orthorhombic phase transition but also the persistence of the monoclinic 1T' structure in the MoTe2 thin flakes thinner than ~ 19.5 nm at low temperatures down to 80 K, which may be caused by the high enough density of the holes introduced during the gold-enhanced exfoliation process and exposure to air. The MoTe2 thin flakes with the low-temperature monoclinic 1T' structure provide a material platform for realizing SOTI states in van der Waals materials at low temperatures, which paves the way for developing a new generation of electronic devices based on SOTIs.

cond-mat.mtrl-sci↗
arXiv2023

SPM: Structured Pretraining and Matching Architectures for Relevance Modeling in Meituan Search

In e-commerce search, relevance between query and documents is an essential requirement for satisfying user experience. Different from traditional e-commerce platforms that offer products, users search on life service platforms such as Meituan mainly for product providers, which usually have abundant structured information, e.g. name, address, category, thousands of products. Modeling search relevance with these rich structured contents is challenging due to the following issues: (1) there is language distribution discrepancy among different fields of structured document, making it difficult to directly adopt off-the-shelf pretrained language model based methods like BERT. (2) different fields usually have different importance and their length vary greatly, making it difficult to extract document information helpful for relevance matching. To tackle these issues, in this paper we propose a novel two-stage pretraining and matching architecture for relevance matching with rich structured documents. At pretraining stage, we propose an effective pretraining method that employs both query and multiple fields of document as inputs, including an effective information compression method for lengthy fields. At relevance matching stage, a novel matching method is proposed by leveraging domain knowledge in search query to generate more effective document representations for relevance scoring. Extensive offline experiments and online A/B tests on millions of users verify that the proposed architectures effectively improve the performance of relevance modeling. The model has already been deployed online, serving the search traffic of Meituan for over a year.

cs.IR↗
arXiv2023

Ferroelectric Domain and Switching Dynamics in Curved In2Se3: First Principle and Deep Learning Molecular Dynamics Simulations

Complex strain status can exist in 2D materials during their synthesis process, resulting in significant impacts on the physical and chemical properties. Despite their prevalence in experiments, their influence on the material properties and the corresponding mechanism are often understudied due to the lack of effective simulation methods. In this work, we investigated the effects of bending, rippling, and bubbling on the ferroelectric domains in In2Se3 monolayer by density functional theory (DFT) and deep learning molecular dynamics (DLMD) simulations. The analysis of the tube model shows that bending deformation imparts asymmetry into the system, and the polarization direction tends to orient towards the tensile side, which has a lower energy state than the opposite polarization direction. The energy barrier for polarization switching can be reduced by compressive strain according DFT results. The dynamics of the polarization switching is investigated by the DLMD simulations. The influence of curvature and temperature on the switching time follows the Arrhenius-style function. For the complex strain status in the rippling and bubbling model, the lifetime of the local transient polarization is analyzed by the autocorrelation function, and the size of the stable polarization domain is identified. Local curvature and temperature can influence the local polarization dynamics following the proposed Arrhenius-style equation. Through cross-scale simulations, this study demonstrates the capability of deep-learning potentials in simulating polarization for ferroelectric materials. It further reveals the potential to manipulate local polarization in ferroelectric materials through strain engineering.

cond-mat.mtrl-sci↗
arXiv2023

CoVLR: Coordinating Cross-Modal Consistency and Intra-Modal Structure for Vision-Language Retrieval

Current vision-language retrieval aims to perform cross-modal instance search, in which the core idea is to learn the consistent visionlanguage representations. Although the performance of cross-modal retrieval has greatly improved with the development of deep models, we unfortunately find that traditional hard consistency may destroy the original relationships among single-modal instances, leading the performance degradation for single-modal retrieval. To address this challenge, in this paper, we experimentally observe that the vision-language divergence may cause the existence of strong and weak modalities, and the hard cross-modal consistency cannot guarantee that strong modal instances' relationships are not affected by weak modality, resulting in the strong modal instances' relationships perturbed despite learned consistent representations.To this end, we propose a novel and directly Coordinated VisionLanguage Retrieval method (dubbed CoVLR), which aims to study and alleviate the desynchrony problem between the cross-modal alignment and single-modal cluster-preserving tasks. CoVLR addresses this challenge by developing an effective meta-optimization based strategy, in which the cross-modal consistency objective and the intra-modal relation preserving objective are acted as the meta-train and meta-test tasks, thereby CoVLR encourages both tasks to be optimized in a coordinated way. Consequently, we can simultaneously insure cross-modal consistency and intra-modal structure. Experiments on different datasets validate CoVLR can improve single-modal retrieval accuracy whilst preserving crossmodal retrieval capacity compared with the baselines.

cs.CV↗
arXiv2023

CO-CHANGES I: IRAM 30m CO Observations of Molecular Gas in the Sombrero Galaxy

Molecular gas plays a critical role in explaining the quiescence of star formation (SF) in massive isolated spiral galaxies, which could be a result of either the low molecular gas content and/or the low SF efficiency. We present IRAM 30m observations of the CO lines in the Sombrero galaxy (NGC~4594), the most massive spiral at $d\lesssim30\rm~Mpc$. We detect at least one of the three CO lines covered by our observations in all 13 observed positions located at the galactic nucleus and along a $\sim25\rm~kpc$-diameter dusty ring. The total extrapolated molecular gas mass of the galaxy is $M_{\rm H_2}\approx4\times10^{8}\rm~M_\odot$. The measured maximum CO gas rotation velocity of $\approx379\rm~km~s^{-1}$ suggests that NGC~4594 locates in a dark matter halo with a mass $M_{\rm200}\gtrsim10^{13}\rm~M_\odot$. Comparing to other galaxy samples, NGC~4594 is extremely gas poor and SF inactive, but the SF efficiency is apparently not inconsistent with that predicted by the Kennicutt-Schmidt law, so there is no evidence of enhanced SF quenching in this extremely massive spiral with a huge bulge. We also calculate the predicted gas supply rate from various sources to replenish the cold gas consumed in SF, and find that the galaxy must experienced a starburst stage at high redshift, then the leftover or recycled gas provides SF fuels to maintain the gradual growth of the galactic disk at a gentle rate.

astro-ph.GA↗
arXiv2023

Routing Recovery for UAV Networks with Deliberate Attacks: A Reinforcement Learning based Approach

The unmanned aerial vehicle (UAV) network is popular these years due to its various applications. In the UAV network, routing is significantly affected by the distributed network topology, leading to the issue that UAVs are vulnerable to deliberate damage. Hence, this paper focuses on the routing plan and recovery for UAV networks with attacks. In detail, a deliberate attack model based on the importance of nodes is designed to represent enemy attacks. Then, a node importance ranking mechanism is presented, considering the degree of nodes and link importance. However, it is intractable to handle the routing problem by traditional methods for UAV networks, since link connections change with the UAV availability. Hence, an intelligent algorithm based on reinforcement learning is proposed to recover the routing path when UAVs are attacked. Simulations are conducted and numerical results verify the proposed mechanism performs better than other referred methods.

cs.NI↗
arXiv2023

IOSG: Image-driven Object Searching and Grasping

When robots retrieve specific objects from cluttered scenes, such as home and warehouse environments, the target objects are often partially occluded or completely hidden. Robots are thus required to search, identify a target object, and successfully grasp it. Preceding works have relied on pre-trained object recognition or segmentation models to find the target object. However, such methods require laborious manual annotations to train the models and even fail to find novel target objects. In this paper, we propose an Image-driven Object Searching and Grasping (IOSG) approach where a robot is provided with the reference image of a novel target object and tasked to find and retrieve it. We design a Target Similarity Network that generates a probability map to infer the location of the novel target. IOSG learns a hierarchical policy; the high-level policy predicts the subtask type, whereas the low-level policies, explorer and coordinator, generate effective push and grasp actions. The explorer is responsible for searching the target object when it is hidden or occluded by other objects. Once the target object is found, the coordinator conducts target-oriented pushing and grasping to retrieve the target from the clutter. The proposed pipeline is trained with full self-supervision in simulation and applied to a real environment. Our model achieves a 96.0% and 94.5% task success rate on coordination and exploration tasks in simulation respectively, and 85.0% success rate on a real robot for the search-and-grasp task.

cs.RO↗
arXiv2023

Your Negative May not Be True Negative: Boosting Image-Text Matching with False Negative Elimination

Most existing image-text matching methods adopt triplet loss as the optimization objective, and choosing a proper negative sample for the triplet of is important for effectively training the model, e.g., hard negatives make the model learn efficiently and effectively. However, we observe that existing methods mainly employ the most similar samples as hard negatives, which may not be true negatives. In other words, the samples with high similarity but not paired with the anchor may reserve positive semantic associations, and we call them false negatives. Repelling these false negatives in triplet loss would mislead the semantic representation learning and result in inferior retrieval performance. In this paper, we propose a novel False Negative Elimination (FNE) strategy to select negatives via sampling, which could alleviate the problem introduced by false negatives. Specifically, we first construct the distributions of positive and negative samples separately via their similarities with the anchor, based on the features extracted from image and text encoders. Then we calculate the false negative probability of a given sample based on its similarity with the anchor and the above distributions via the Bayes' rule, which is employed as the sampling weight during negative sampling process. Since there may not exist any false negative in a small batch size, we design a memory module with momentum to retain a large negative buffer and implement our negative sampling strategy spanning over the buffer. In addition, to make the model focus on hard negatives, we reassign the sampling weights for the simple negatives with a cut-down strategy. The extensive experiments are conducted on Flickr30K and MS-COCO, and the results demonstrate the superiority of our proposed false negative elimination strategy. The code is available at https://github.com/LuminosityX/FNE.

cs.CV↗
arXiv2023

Unifying Two-Stream Encoders with Transformers for Cross-Modal Retrieval

Most existing cross-modal retrieval methods employ two-stream encoders with different architectures for images and texts, \textit{e.g.}, CNN for images and RNN/Transformer for texts. Such discrepancy in architectures may induce different semantic distribution spaces and limit the interactions between images and texts, and further result in inferior alignment between images and texts. To fill this research gap, inspired by recent advances of Transformers in vision tasks, we propose to unify the encoder architectures with Transformers for both modalities. Specifically, we design a cross-modal retrieval framework purely based on two-stream Transformers, dubbed \textbf{Hierarchical Alignment Transformers (HAT)}, which consists of an image Transformer, a text Transformer, and a hierarchical alignment module. With such identical architectures, the encoders could produce representations with more similar characteristics for images and texts, and make the interactions and alignments between them much easier. Besides, to leverage the rich semantics, we devise a hierarchical alignment scheme to explore multi-level correspondences of different layers between images and texts. To evaluate the effectiveness of the proposed HAT, we conduct extensive experiments on two benchmark datasets, MSCOCO and Flickr30K. Experimental results demonstrate that HAT outperforms SOTA baselines by a large margin. Specifically, on two key tasks, \textit{i.e.}, image-to-text and text-to-image retrieval, HAT achieves 7.6\% and 16.7\% relative score improvement of Recall@1 on MSCOCO, and 4.4\% and 11.6\% on Flickr30k respectively. The code is available at \url{https://github.com/LuminosityX/HAT}.

cs.CV↗
arXiv2023

In Search of Infall Motion in Molecular Clumps. IV. Mapping of the Global Infall Sources

We have used the IRAM 30-m telescope to map some targets with HCO$^+$ (1-0) and H$^{13}$CO$^+$ (1-0) lines in order to search for gas infall evidence in the clumps. In this paper, we report the mapping results for 13 targets. All of these targets show HCO$^+$ emissions, while H$^{13}$CO$^+$ emissions are observed in ten of them. The HCO$^+$ integrated intensity maps of ten targets show clear clumpy structures, and nine targets show clumpy structures in the H$^{13}$CO$^+$ maps. Using the RADEX radiative transfer code, we estimate the column density of H$^{13}$CO$^+$, and determine the abundance ratio [H$^{13}$CO$^+$]/[H$_2$] to be approximately 10$^{-12}$ to 10$^{-10}$. Based on the asymmetry of the HCO$^+$ line profiles, we identify 11 targets show blue profiles, while six clumps have global infall evidence. We use the RATRAN and two-layer models to fit the HCO$^+$ line profiles of these infall sources, and analyze their spatial distribution of the infall velocity. The average infall velocities estimated by these two models are 0.24 -- 1.85 km s$^{-1}$ and 0.28 -- 1.45 km s$^{-1}$, respectively. The mass infall rate ranges from approximately 10$^{-5}$ to 10$^{-2}$ M$_{\odot}$ yr$^{-1}$, which suggests that intermediate- or high-mass stars may be forming in the target regions.

astro-ph.GA↗
arXiv2023

The Role of Magnetic Fields in the Formation of the Filamentary Infrared Dark Cloud G11.11-0.12

We report on the near-infrared polarimetric observations of G11.11-0.12 (hereafter G11) obtained with SIRPOL on the 1.4 m IRSF telescope. The starlight polarisation of the background stars reveals the on-sky component of magnetic fields in G11, and these are consistent with the field orientation observed from polarised dust emission at $850\,μ$m. The magnetic fields in G11 are perpendicular to the filament, and are independent of the filament's orientation relative to the Galactic plane. The field strength in the envelope of G11 is in the range $50-100\,μ$G, derived from two methods. The analyses of the magnetic fields and gas velocity dispersion indicate that the envelope of G11 is supersonic but sub-Alfv{é}nic. The critical mass-to-flux ratio in the envelope of G11 is close to 1 and increases to $\gtrsim 1$ on the spine of G11. The relative weights on the importance of magnetic fields, turbulence and gravity indicate that gravity dominates the dynamical state of G11, but with significant contribution from magnetic fields. The field strength, $|\mathbf{B}|$, increases slower than the gas density, $n$, from the envelope to the spine of G11, characterized by $|\mathbf{B}|\propto n^{0.3}$. The observed strength and orientation of magnetic fields in G11 imply that supersonic and sub-Alfv{é}nic gas flow is channelled by the strong magnetic fields and is assembled into filaments perpendicular to the magnetic fields. The formation of low-mass stars is enhanced in the filaments with high column density, in agreement with the excess of low-mass protostars detected in the densest regions of G11.

astro-ph.GA↗