arXiv subjects

Yue Hu

Publications and source records attributed to Yue Hu.

At least 217 records · Page 12Linked to original sources

arXiv2023

Subspace based Federated Unlearning

Federated learning (FL) enables multiple clients to train a machine learning model collaboratively without exchanging their local data. Federated unlearning is an inverse FL process that aims to remove a specified target client's contribution in FL to satisfy the user's right to be forgotten. Most existing federated unlearning algorithms require the server to store the history of the parameter updates, which is not applicable in scenarios where the server storage resource is constrained. In this paper, we propose a simple-yet-effective subspace based federated unlearning method, dubbed SFU, that lets the global model perform gradient ascent in the orthogonal space of input gradient spaces formed by other clients to eliminate the target client's contribution without requiring additional storage. Specifically, the server first collects the gradients generated from the target client after performing gradient ascent, and the input representation matrix is computed locally by the remaining clients. We also design a differential privacy method to protect the privacy of the representation matrix. Then the server merges those representation matrices to get the input gradient subspace and updates the global model in the orthogonal subspace of the input gradient subspace to complete the forgetting task with minimal model performance degradation. Experiments on MNIST, CIFAR10, and CIFAR100 show that SFU outperforms several state-of-the-art (SOTA) federated unlearning algorithms by a large margin in various settings.

cs.LG↗

arXiv2023

Dynamic MRI using Learned Transform-based Tensor Low-Rank Network (LT$^2$LR-Net)

While low-rank matrix prior has been exploited in dynamic MR image reconstruction and has obtained satisfying performance, tensor low-rank models have recently emerged as powerful alternative representations for three-dimensional dynamic MR datasets. In this paper, we introduce a novel deep unrolling network for dynamic MRI, namely the learned transform-based tensor low-rank network (LT$^2$LR-Net). First, we generalize the tensor singular value decomposition (t-SVD) into an arbitrary unitary transform-based version and subsequently propose the novel transformed tensor nuclear norm (TTNN). Then, we design a novel TTNN-based iterative optimization algorithm based on the alternating direction method of multipliers (ADMM) to exploit the tensor low-rank prior in the transformed domain. The corresponding iterative steps are unrolled into the proposed LT$^2$LR-Net, where the convolutional neural network (CNN) is incorporated to adaptively learn the transformation from the dynamic MR dataset for more robust and accurate tensor low-rank representations. Experimental results on the cardiac cine MR dataset demonstrate that the proposed framework can provide improved recovery results compared with the state-of-the-art methods.

eess.IV↗

arXiv2023

FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversation

Emotional Support Conversation (ESConv) aims to reduce help-seekers'emotional distress with the supportive strategy and response. It is essential for the supporter to select an appropriate strategy with the feedback of the help-seeker (e.g., emotion change during dialog turns, etc) in ESConv. However, previous methods mainly focus on the dialog history to select the strategy and ignore the help-seeker's feedback, leading to the wrong and user-irrelevant strategy prediction. In addition, these approaches only model the context-to-strategy flow and pay less attention to the strategy-to-context flow that can focus on the strategy-related context for generating the strategy-constrain response. In this paper, we propose a Feedback-Aware Double COntrolling Network (FADO) to make a strategy schedule and generate the supportive response. The core module in FADO consists of a dual-level feedback strategy selector and a double control reader. Specifically, the dual-level feedback strategy selector leverages the turn-level and conversation-level feedback to encourage or penalize strategies. The double control reader constructs the novel strategy-to-context flow for generating the strategy-constrain response. Furthermore, a strategy dictionary is designed to enrich the semantic information of the strategy and improve the quality of strategy-constrain response. Experimental results on ESConv show that the proposed FADO has achieved the state-of-the-art performance in terms of both strategy selection and response generation. Our code is available at https://github.com/Thedatababbler/FADO.

cs.CL↗

arXiv2022

Probing Three-Dimensional Magnetic Fields: I -- Polarized Dust Emission

Polarized dust emission is widely used to trace the plane-of-the-sky (POS) component of interstellar magnetic fields in two dimensions. Its potential to access three-dimensional magnetic fields, including the inclination angle of the magnetic fields relative to the line-of-sight (LOS), is crucial for a variety of astrophysical problems. Based on the statistical features of observed polarization fraction and POS Alfvén Mach number $\overline{M_{\rm A}}_{,\bot}$ distribution, we present a new method for estimating the inclination angle. The magnetic field fluctuations raised by anisotropic magnetohydrodynamic (MHD) turbulence are taken into account in our method. By using synthetic dust emission generated from 3D compressible MHD turbulence simulations, we show that the fluctuations are preferentially perpendicular to the mean magnetic field. We find the inclination angle is the major agent for depolarization, while fluctuations of magnetic field strength and density have an insignificant contribution. We propose and demonstrate that the mean inclination angle over a region of interest can be calculated from the polarization fraction in a strongly magnetized reference position, where $\overline{M_{\rm A}}_{,\bot}^2\ll1$. We test and show that the new method can trace the 3D magnetic fields in sub-Alfvénic, trans-Alfvénic, and moderately super-Alfvénic conditions ($0.4\lesssim M_{\rm A}\lesssim1.2$). We numerically quantify that the difference between the estimated inclination angle and actual inclination angle ranges from 0 to $20^\circ$ with a median value of $\le10^\circ$.

astro-ph.GA↗

arXiv2022

SOFIA observations of 30 Doradus: II -- Magnetic fields and large scale gas kinematics

The heart of the Large Magellanic Cloud, 30 Doradus, is a complex region with a clear core-halo structure. Feedback from the stellar cluster R$\,$136 has been shown to be the main source of energy creating multiple pc-scale expanding-shells in the outer region, and carving a nebula core in the proximity of the ionization source. We present the morphology and strength of the magnetic fields (B-fields) of 30 Doradus inferred from the far-infrared polarimetric observations by SOFIA/HAWC+ at 89, 154, and 214$\,μ$m. The B-field morphology is complex, showing bending structures around R$\,$136. In addition, we use high spectral and angular resolution [\textsc{CII}] observations from SOFIA/GREAT and CO(2-1) from APEX. The kinematic structure of the region correlates with the B-field morphology and shows evidence of multiple expanding shells. Our B-field strength maps, estimated using the Davis-Chandrasekhar-Fermi method and structure-function, show variations across the cloud within a maximum of 600, 450, and 350$\,μ$G at 89, 154, and 214$\,μ$m, respectively. We estimated that the majority of the 30 Doradus clouds are sub-critical and sub-Alfvénic. The probability distribution function of the gas density shows that the turbulence is mainly compressively driven, while the plasma beta parameter indicates supersonic turbulence. We show that the B-field is sufficient to hold the cloud structure integrity under feedback from R$\,$136. We suggest that supersonic compressive turbulence enables the local gravitational collapse and triggers a new generation of stars to form. The velocity gradient technique (VGT) using [\textsc{CII}] and CO(2-1) is likely to confirm these results.

astro-ph.GA↗

arXiv2022

Explore of exfoliable multifunctional high-k two-dimensional oxides

As the continuing down-scaling of field-effect transistors (FETs) in more-than-Moore integrated circuits, finding new functional two-dimensional (2D) materials with a higher dielectric constant (high-k) serve as gate dielectrics is critical. Here, we identify dozens of binary 2D oxides by screening potentially exfoliable bulk metal oxides despite of their non-layered structures followed by simulation of the exfoliation process. For dynamically stable materials, we fully characterize their static dielectric constants and electronic structures, among which GeO2(011)/(101)/(1-11) 2D oxides exhibit unusually high k values (85-99), being much higher than the k of the currently highly regarded 2D dielectrics CaF2 (k ~6) and \b{eta}-Bi2SeO5 (k ~22), together with band gap of 3.3 eV. We further design 2D high-k oxides/2D semiconductors (such as MoS2) heterostructures, and determine by DFT calculations whether they can form Van der Waals interfaces to evaluate their compatibility as gate dielectrics in 2D FETs. In addition to dielectric properties, we also explore magnetic and mechanical properties of potentially exfoliable 2D oxides, revealing a number of functional materials that can be studied experimentally, notably including ferromagnetic half semiconductors, non-magnetic spintronic materials, flexible high-k 2D oxides, and auxetic monolayers.

cond-mat.mtrl-sci↗

arXiv2022

Multi-Phase Magnetic Fields in the Galaxy NGC 3627

Magnetic fields play an important role in the formation and evolution of a galaxy, but it is challenging to measure them by observation. Here we study the Seyfert galaxy NGC 3627's magnetic field orientations measured from the synchrotron polarization observed with the Very Large Array (VLA) and from the Velocity Gradient Technique (VGT) using spectroscopic data. The latter employs the magnetohydrodynamical (MHD) turbulence's anisotropy to probe the magnetic fields. Being applied to the CO (2-1) and H$α$ emission lines obtained from the PHANGS-ALMA and PHANGS-MUSE surveys, it reveals the magnetic field orientation globally consistent with the polarization. The agreement of the VGT-CO and polarization suggests that the magnetic fields associated with synchrotron emission also percolate through star-forming regions. The VGT-H$α$ measurement reveals the magnetic fields in the warm ionized medium that permeates the disk and disk's vicinity so that it exhibits less agreement with polarization. We find prominent radial fields measured by synchrotron polarization appear in the transition regions from the spiral arms to the galactic bar, while such morphology is less apparent in the VGT-CO and VGT-H$α$ measured magnetic fields. The radial fields suggest that the magnetic torque is important in removing orbiting gas' angular momentum. We notice that magnetic fields inferred from the dust polarization, VGT-CO, and synchrotron polarization are different in the east arm. We interpret this difference as arising from the fact that the three measurements are tracing the magnetic fields associated with pre-collision, the mixture of pre-collision and post-collision, and post-collision flows, respectively.

astro-ph.GA↗

arXiv2022

Optimization-Based Control for Dynamic Legged Robots

In a world designed for legs, quadrupeds, bipeds, and humanoids have the opportunity to impact emerging robotics applications from logistics, to agriculture, to home assistance. The goal of this survey is to cover the recent progress toward these applications that has been driven by model-based optimization for the real-time generation and control of movement. The majority of the research community has converged on the idea of generating locomotion control laws by solving an optimal control problem (OCP) in either a model-based or data-driven manner. However, solving the most general of these problems online remains intractable due to complexities from intermittent unidirectional contacts with the environment, and from the many degrees of freedom of legged robots. This survey covers methods that have been pursued to make these OCPs computationally tractable, with specific focus on how environmental contacts are treated, how the model can be simplified, and how these choices affect the numerical solution methods employed. The survey focuses on model-based optimization, covering its recent use in a stand alone fashion, and suggesting avenues for combination with learning-based formulations to further accelerate progress in this growing field.

cs.RO↗

arXiv2022

Turbulent Magnetic Field Amplification by the Interaction of Shock Wave and Inhomogeneous Medium

Magnetic fields on the order of 100 $μ$G observed in young supernova remnants cannot be amplified by shock compression alone. To investigate the amplification caused by turbulent dynamo, we perform three-dimensional MHD simulations of the interaction between shock wave and inhomogeneous density distribution with a shallow spectrum in the preshock medium. The postshock turbulence is mainly driven by the strongest preshock density contrast and follows the Kolmogorov scaling. The resulting turbulence amplifies the postshock magnetic field. The time evolution of the magnetic fields agrees with the prediction of the nonlinear turbulent dynamo theory in Xu & Lazarian (2016). When the initial weak magnetic field is perpendicular to the shock normal, the maximum amplification of the field's strength achieves a factor of $\approx200$, which is twice larger than that for a parallel shock. We find that the perpendicular shock exhibits a smaller turbulent Alfvén Mach number in the vicinity of the shock front than the parallel shock. However, the strongest magnetic field has a low volume filling factor and is limited by the turbulent energy due to the reconnection diffusion taking place in a turbulent and magnetized fluid. The magnetic field strength averaged along the $z$-axis is reduced by a factor $\gtrsim10$. We decompose the turbulent velocity and magnetic field into solenoidal and compressive modes. The solenoidal mode is dominant and evolves to follow the Kolmogorov scaling, even though the preshock density distribution has a shallow spectrum. When the preshock density distribution has a Kolmogorov spectrum, the turbulent velocity's compressive component increases.

astro-ph.GA↗

arXiv2022

Control Globally, Understand Locally: A Global-to-Local Hierarchical Graph Network for Emotional Support Conversation

Emotional support conversation aims at reducing the emotional distress of the help-seeker, which is a new and challenging task. It requires the system to explore the cause of help-seeker's emotional distress and understand their psychological intention to provide supportive responses. However, existing methods mainly focus on the sequential contextual information, ignoring the hierarchical relationships with the global cause and local psychological intention behind conversations, thus leads to a weak ability of emotional support. In this paper, we propose a Global-to-Local Hierarchical Graph Network to capture the multi-source information (global cause, local intentions and dialog history) and model hierarchical relationships between them, which consists of a multi-source encoder, a hierarchical graph reasoner, and a global-guide decoder. Furthermore, a novel training objective is designed to monitor semantic information of the global cause. Experimental results on the emotional support conversation dataset, ESConv, confirm that the proposed GLHG has achieved the state-of-the-art performance on the automatic and human evaluations. The code will be released in here \footnote{\small{~https://github.com/pengwei-iie/GLHG}}.

cs.CL↗

arXiv2022

STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification

The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe. However, finding suitable prompt in existing methods requires multiple experimental attempts or appropriate vector initialization on formulating suitable template and choosing representative label mapping, which it is more common in few-shot learning tasks. Motivating by PLM working process, we try to construct the prompt from task semantic perspective and thus propose the STPrompt -Semantic-guided and Task-driven Prompt model. Specifically, two novel prompts generated from the semantic dependency tree (Dep-prompt) and task-specific metadata description (Meta-prompt), are firstly constructed in a prompt augmented pool, and the proposed model would automatically select a suitable semantic prompt to motivating the prompt learning process. Our results show that the proposed model achieves the state-of-the-art performance in five different datasets of few-shot text classification tasks, which prove that more semantic and significant prompts could assume as a better knowledge proving tool.

cs.CL↗

arXiv2022

Role of magnetic fields in fueling Seyfert nuclei

Molecular gas is believed to be the fuel for star formation and nuclear activity in Seyfert galaxies. To explore the role of magnetic fields in funneling molecular gas into the nuclear region, measurements of the magnetic fields embedded in molecular gas are needed. By applying the new velocity gradient technique (VGT) to ALMA and PAWS's CO isotopolog data, we obtain the first detection of CO-associated magnetic fields in several nearby Seyfert galaxies and their unprecedented high-resolution magnetic field maps. The VGT-measured magnetic fields in molecular gas globally agree with those inferred from existing HAWC+ dust polarization and VLA synchrotron polarization. An overall good alignment between the magnetic fields traced by VGT-CO and by synchrotron polarization may support the correlation between star formation and cosmic ray generation. We find that the magnetic fields traced by VGT-CO have a significant radial component in the central regions of most Seyferts in our sample, where efficient molecular gas inflows or outflows may happen. In particular, we find local misalignment between the magnetic fields traced by CO and dust polarization within the nuclear ring of NGC 1097, and the former aligns with the central bar's orientation. This misalignment reveals different magnetic field configurations in different gas phases and may provide an observational diagnostic for the ongoing multi-phase fueling of Seyfert activity.

astro-ph.GA↗

arXiv2022

An epitaxial graphene platform for zero-energy edge state nanoelectronics

Graphene's original promise to succeed silicon faltered due to pervasive edge disorder in lithographically patterned deposited graphene and the lack of a new electronics paradigm. Here we demonstrate that the annealed edges in conventionally patterned graphene epitaxially grown on a silicon carbide substrate (epigraphene) are stabilized by the substrate and support a protected edge state. The edge state has a mean free path that is greater than 50 microns, 5000 times greater that the bulk states and involves a theoretically unexpected Majorana-like zero-energy non-degenerate quasiparticle that does not produce a Hall voltage. In seamless integrated structures, the edge state forms a zero-energy one-dimensional ballistic network with essentially dissipationless nodes at ribbon-ribbon junctions. Seamless device structures offer a variety of switching possibilities including quantum coherent devices at low temperatures. This makes epigraphene a technologically viable graphene nanoelectronics platform that has the potential to succeed silicon nanoelectronics.

cond-mat.mes-hall↗

arXiv2022

Number-Adaptive Prototype Learning for 3D Point Cloud Semantic Segmentation

3D point cloud semantic segmentation is one of the fundamental tasks for 3D scene understanding and has been widely used in the metaverse applications. Many recent 3D semantic segmentation methods learn a single prototype (classifier weights) for each semantic class, and classify 3D points according to their nearest prototype. However, learning only one prototype for each class limits the model's ability to describe the high variance patterns within a class. Instead of learning a single prototype for each class, in this paper, we propose to use an adaptive number of prototypes to dynamically describe the different point patterns within a semantic class. With the powerful capability of vision transformer, we design a Number-Adaptive Prototype Learning (NAPL) model for point cloud semantic segmentation. To train our NAPL model, we propose a simple yet effective prototype dropout training strategy, which enables our model to adaptively produce prototypes for each class. The experimental results on SemanticKITTI dataset demonstrate that our method achieves 2.3% mIoU improvement over the baseline model based on the point-wise classification paradigm.

cs.CV↗

arXiv2022

Psychology-guided Controllable Story Generation

Controllable story generation is a challenging task in the field of NLP, which has attracted increasing research interest in recent years. However, most existing works generate a whole story conditioned on the appointed keywords or emotions, ignoring the psychological changes of the protagonist. Inspired by psychology theories, we introduce global psychological state chains, which include the needs and emotions of the protagonists, to help a story generation system create more controllable and well-planned stories. In this paper, we propose a Psychology-guIded Controllable Story Generation System (PICS) to generate stories that adhere to the given leading context and desired psychological state chains for the protagonist. Specifically, psychological state trackers are employed to memorize the protagonist's local psychological states to capture their inner temporal relationships. In addition, psychological state planners are adopted to gain the protagonist's global psychological states for story planning. Eventually, a psychology controller is designed to integrate the local and global psychological states into the story context representation for composing psychology-guided stories. Automatic and manual evaluations demonstrate that PICS outperforms baselines, and each part of PICS shows effectiveness for writing stories with more consistent psychological changes.

cs.CL↗

arXiv2022

Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Maps

Multi-agent collaborative perception could significantly upgrade the perception performance by enabling agents to share complementary information with each other through communication. It inevitably results in a fundamental trade-off between perception performance and communication bandwidth. To tackle this bottleneck issue, we propose a spatial confidence map, which reflects the spatial heterogeneity of perceptual information. It empowers agents to only share spatially sparse, yet perceptually critical information, contributing to where to communicate. Based on this novel spatial confidence map, we propose Where2comm, a communication-efficient collaborative perception framework. Where2comm has two distinct advantages: i) it considers pragmatic compression and uses less communication to achieve higher perception performance by focusing on perceptually critical areas; and ii) it can handle varying communication bandwidth by dynamically adjusting spatial areas involved in communication. To evaluate Where2comm, we consider 3D object detection in both real-world and simulation scenarios with two modalities (camera/LiDAR) and two agent types (cars/drones) on four datasets: OPV2V, V2X-Sim, DAIR-V2X, and our original CoPerception-UAVs. Where2comm consistently outperforms previous methods; for example, it achieves more than $100,000 \times$ lower communication volume and still outperforms DiscoNet and V2X-ViT on OPV2V. Our code is available at https://github.com/MediaBrain-SJTU/where2comm.

cs.CV↗

arXiv2022

Learning Reconstructability for Drone Aerial Path Planning

We introduce the first learning-based reconstructability predictor to improve view and path planning for large-scale 3D urban scene acquisition using unmanned drones. In contrast to previous heuristic approaches, our method learns a model that explicitly predicts how well a 3D urban scene will be reconstructed from a set of viewpoints. To make such a model trainable and simultaneously applicable to drone path planning, we simulate the proxy-based 3D scene reconstruction during training to set up the prediction. Specifically, the neural network we design is trained to predict the scene reconstructability as a function of the proxy geometry, a set of viewpoints, and optionally a series of scene images acquired in flight. To reconstruct a new urban scene, we first build the 3D scene proxy, then rely on the predicted reconstruction quality and uncertainty measures by our network, based off of the proxy geometry, to guide the drone path planning. We demonstrate that our data-driven reconstructability predictions are more closely correlated to the true reconstruction quality than prior heuristic measures. Further, our learned predictor can be easily integrated into existing path planners to yield improvements. Finally, we devise a new iterative view planning framework, based on the learned reconstructability, and show superior performance of the new planner when reconstructing both synthetic and real scenes.

cs.GR↗

arXiv2022

COMMA: Modeling Relationship among Motivations, Emotions and Actions in Language-based Human Activities

Motivations, emotions, and actions are inter-related essential factors in human activities. While motivations and emotions have long been considered at the core of exploring how people take actions in human activities, there has been relatively little research supporting analyzing the relationship between human mental states and actions. We present the first study that investigates the viability of modeling motivations, emotions, and actions in language-based human activities, named COMMA (Cognitive Framework of Human Activities). Guided by COMMA, we define three natural language processing tasks (emotion understanding, motivation understanding and conditioned action generation), and build a challenging dataset Hail through automatically extracting samples from Story Commonsense. Experimental results on NLP applications prove the effectiveness of modeling the relationship. Furthermore, our models inspired by COMMA can better reveal the essential relationship among motivations, emotions and actions than existing methods.

cs.CL↗