arXiv subjects

Jie Zhu

Publications and source records attributed to Jie Zhu.

At least 127 records · Page 7Linked to original sources

arXiv2024

Safety and Performance, Why Not Both? Bi-Objective Optimized Model Compression against Heterogeneous Attacks Toward AI Software Deployment

The size of deep learning models in artificial intelligence (AI) software is increasing rapidly, hindering the large-scale deployment on resource-restricted devices (e.g., smartphones). To mitigate this issue, AI software compression plays a crucial role, which aims to compress model size while keeping high performance. However, the intrinsic defects in a big model may be inherited by the compressed one. Such defects may be easily leveraged by adversaries, since a compressed model is usually deployed in a large number of devices without adequate protection. In this article, we aim to address the safe model compression problem from the perspective of safety-performance co-optimization. Specifically, inspired by the test-driven development (TDD) paradigm in software engineering, we propose a test-driven sparse training framework called SafeCompress. By simulating the attack mechanism as safety testing, SafeCompress can automatically compress a big model to a small one following the dynamic sparse training paradigm. Then, considering two kinds of representative and heterogeneous attack mechanisms, i.e., black-box membership inference attack and white-box membership inference attack, we develop two concrete instances called BMIA-SafeCompress and WMIA-SafeCompress. Further, we implement another instance called MMIA-SafeCompress by extending SafeCompress to defend against the occasion when adversaries conduct black-box and white-box membership inference attacks simultaneously. We conduct extensive experiments on five datasets for both computer vision and natural language processing tasks. The results show the effectiveness and generalizability of our framework. We also discuss how to adapt SafeCompress to other attacks besides membership inference attack, demonstrating the flexibility of SafeCompress.

cs.AI↗

arXiv2023

Coordinated Active-Reactive Power Management of ReP2H Systems with Multiple Electrolyzers

Utility-scale renewable power-to-hydrogen (ReP2H) production typically uses thyristor rectifiers (TRs) to supply power to multiple electrolyzers (ELZs). They exhibit a nonlinear and non-decouplable relation between active and reactive power. The on-off scheduling and load allocation of multiple ELZs simultaneously impact energy conversion efficiency and AC-side active and reactive power flow. Improper scheduling may result in excessive reactive power demand, causing voltage violations and increased network losses, compromising safety and economy. To address these challenges, this paper first explores trade-offs between the efficiency and the reactive load of the electrolyzers. Subsequently, we propose a coordinated approach for scheduling the active and reactive power in the ReP2H system. A mixed-integer second-order cone programming (MISOCP) is established to jointly optimize active and reactive power by coordinating the ELZs, renewable energy sources, energy storage (ES), and var compensations. Case studies demonstrate that the proposed method reduces losses by 3.06% in an off-grid ReP2H system while increasing hydrogen production by 5.27% in average.

math.OC↗

arXiv2023

VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention

The deep learning-based speech enhancement (SE) methods always take the clean speech's waveform or time-frequency spectrum feature as the learning target, and train the deep neural network (DNN) by reducing the error loss between the DNN's output and the target. This is a conventional single-task learning paradigm, which has been proven to be effective, but we find that the multi-task learning framework can improve SE performance. Specifically, we design a framework containing a SE module and a voice activity detection (VAD) module, both of which share the same encoder, and the whole network is optimized by the weighted loss of the two modules. Moreover, we design a causal spatial attention (CSA) block to promote the representation capability of DNN. Combining the VAD aided multi-task learning framework and CSA block, our SE network is named VSANet. The experimental results prove the benefits of multi-task learning and the CSA block, which give VSANet an excellent SE performance.

eess.AS↗

arXiv2023

Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly reduce the computational load and storage requirements associated with matrix inversion without losing accuracy. To demonstrate the versatility and applicability of our method, we apply it to address two crucial uncertainty quantification problems: stochastic elliptic equations and optimal control problems governed by stochastic elliptic PDE constraints. Based on varying dimension reduction ratios, our algorithm exhibits the capability to yield a high precision numerical solution for stochastic partial differential equations, or provides a rough representation of the exact solutions as a pre-processing phase. Meanwhile, our algorithm for solving stochastic optimal control problems allows a diverse range of gradient-based unconstrained optimization methods, rendering it particularly appealing for computationally intensive large-scale problems. Numerical experiments are conducted and the results provide strong validation of the feasibility and effectiveness of our algorithm.

math.NA↗

arXiv2023

Magnitude-and-phase-aware Speech Enhancement with Parallel Sequence Modeling

In speech enhancement (SE), phase estimation is important for perceptual quality, so many methods take clean speech's complex short-time Fourier transform (STFT) spectrum or the complex ideal ratio mask (cIRM) as the learning target. To predict these complex targets, the common solution is to design a complex neural network, or use a real network to separately predict the real and imaginary parts of the target. But in this paper, we propose to use a real network to estimate the magnitude mask and normalized cIRM, which not only avoids the significant increase of the model complexity caused by complex networks, but also shows better performance than previous phase estimation methods. Meanwhile, we devise a parallel sequence modeling (PSM) block to improve the RNN block in the convolutional recurrent network (CRN)-based SE model. We name our method as magnitude-and-phase-aware and PSM-based CRN (MPCRN). The experimental results illustrate that our MPCRN has superior SE performance.

eess.AS↗

arXiv2023

Learning to Rank Onset-Occurring-Offset Representations for Micro-Expression Recognition

This paper focuses on the research of micro-expression recognition (MER) and proposes a flexible and reliable deep learning method called learning to rank onset-occurring-offset representations (LTR3O). The LTR3O method introduces a dynamic and reduced-size sequence structure known as 3O, which consists of onset, occurring, and offset frames, for representing micro-expressions (MEs). This structure facilitates the subsequent learning of ME-discriminative features. A noteworthy advantage of the 3O structure is its flexibility, as the occurring frame is randomly extracted from the original ME sequence without the need for accurate frame spotting methods. Based on the 3O structures, LTR3O generates multiple 3O representation candidates for each ME sample and incorporates well-designed modules to measure and calibrate their emotional expressiveness. This calibration process ensures that the distribution of these candidates aligns with that of macro-expressions (MaMs) over time. Consequently, the visibility of MEs can be implicitly enhanced, facilitating the reliable learning of more discriminative features for MER. Extensive experiments were conducted to evaluate the performance of LTR3O using three widely-used ME databases: CASME II, SMIC, and SAMM. The experimental results demonstrate the effectiveness and superior performance of LTR3O, particularly in terms of its flexibility and reliability, when compared to recent state-of-the-art MER methods.

cs.CV↗

arXiv2023

Variation of Tensor Force due to Nuclear Medium Effect

The enhancement of $J^π(T)$=3$^{+}$(0) state with isospin $T=0$ excited by the tensor force in the free $^{6}$Li nucleus has been observed, for the first time, relative to a shrinkable excitation in the $^{6}$Li cluster component inside its host nucleus. Comparatively, the excitation of $J^π(T)$=0$^{+}$(1) state with isospin $T=1$ for these two $^{6}$Li formations take on an approximately equal excitation strength. The mechanism of such tensor force effect was proposed due to the intensive nuclear medium role on isospin $T$=0 state.

nucl-ex↗

arXiv2023

Aspect of Clusters Correlation at Light Nuclei Excited State

The correlation of $αα$ was probed via measuring the transverse momentum $p_{T}$ and width $δp_{T}$ of one $α$, for the first time, which represents the spatial and dynamical essentialities of the initial coupling state in $^{8}$Be nucleus. The weighted interaction vertex of 3$α$ reflected by the magnitudes of their relative momentums and relative emission angles proves the isosceles triangle configuration for 3$α$ at the high excited energy analogous Hoyle states.

nucl-ex↗

arXiv2023

Exploring the Causal Relationship between Walkability and Affective Walking Experience: Evidence from 7 Major Tertiary Education Campuses in China

This study investigates the causal relationship between campus walkability and the emotional walking experiences of students, with a focus on their mental well-being. Using data from 697 participants across seven Chinese tertiary education campuses, the study employs a counterfactual analysis to estimate the impact of campus walkability on students' walking experiences. The analysis reveals that students living in campuses with improved walkability are 9.75% more likely to have positive walking experiences compared to those without walkability renovations. While walking attitude is strongly correlated with walking experiences, the study emphasizes the significance of objective factors such as campus surroundings and the availability of walking spaces in influencing the walking experience. Geographical features, including campus walkability improvements, have the most substantial impact, and this effect varies across different subsets of respondents. These findings underscore the importance of considering specific subsets and geographical features when assessing the impact of walkability improvements on the walking experience. In conclusion, the study provides compelling evidence of a causal link between improved campus walkability and enhanced emotional walking experiences among students, suggesting the need for further research on mediating factors and cultural variations affecting student mental health on various Chinese campuses.

cs.CY↗

arXiv2023

Continuous Treatment Recommendation with Deep Survival Dose Response Function

We propose a general formulation for continuous treatment recommendation problems in settings with clinical survival data, which we call the Deep Survival Dose Response Function (DeepSDRF). That is, we consider the problem of learning the conditional average dose response (CADR) function solely from historical data in which observed factors (confounders) affect both observed treatment and time-to-event outcomes. The estimated treatment effect from DeepSDRF enables us to develop recommender algorithms with the correction for selection bias. We compared two recommender approaches based on random search and reinforcement learning and found similar performance in terms of patient outcome. We tested the DeepSDRF and the corresponding recommender on extensive simulation studies and the eICU Research Institute (eRI) database. To the best of our knowledge, this is the first time that causal models are used to address the continuous treatment effect with observational data in a medical context.

stat.ML↗

arXiv2023

ATM: Action Temporality Modeling for Video Question Answering

Despite significant progress in video question answering (VideoQA), existing methods fall short of questions that require causal/temporal reasoning across frames. This can be attributed to imprecise motion representations. We introduce Action Temporality Modeling (ATM) for temporality reasoning via three-fold uniqueness: (1) rethinking the optical flow and realizing that optical flow is effective in capturing the long horizon temporality reasoning; (2) training the visual-text embedding by contrastive learning in an action-centric manner, leading to better action representations in both vision and text modalities; and (3) preventing the model from answering the question given the shuffled video in the fine-tuning stage, to avoid spurious correlation between appearance and motion and hence ensure faithful temporality reasoning. In the experiments, we show that ATM outperforms previous approaches in terms of the accuracy on multiple VideoQAs and exhibits better true temporality reasoning ability.

cs.CV↗

arXiv2023

Intelligent mode-locked NPR fiber laser based on laser speckle characteristics

Passively mode-locked fiber lasers based on nonlinear polarization rotation (NPR) have been widely used due to their ability to produce short pulses with high peak power and broad spectrum. Nevertheless, environmental disturbances can disrupt the mode-locked state, making it a challenge for practical implementation. Therefore, scientists have proposed mode-locked NPR lasers assisted with artificial intelligence, which can effectively address the issues related to mode-locking stability. Speckle patterns containing spectral information can be generated when the laser transmitting through a scattering medium, which can be served as indicators of the mode-locked state. The contrast of the Tamura texture feature of the speckle patterns exhibits periodic "V" shaped variations with respect to the rotation angles of the waveplates, according to experimental results. The stable mode-locking region is confined to the area close to the minimum contrast. Based on these characteristics, an intelligent approach employing a modified gradient algorithm to identify the region of minimum speckle contrast for achieving mode-locked state. The average number of iterations needed to achieve initial mode-locking and recover mode-locking are about 20 and 10, respectively. Once the mode-locking is achieved, the neural network can be employed to distinguish single-pulse or multi-pulses outputs based on the speckle pattern, thereby enabling intelligent stable mode-locked single-pulse genration from the NPR fiber laser.

physics.optics↗

arXiv2023

Fairness-Sensitive Policy-Gradient Reinforcement Learning for Reducing Bias in Robotic Assistance

Robots assist humans in various activities, from daily living public service (e.g., airports and restaurants), and to collaborative manufacturing. However, it is risky to assume that the knowledge and strategies robots learned from one group of people can apply to other groups. The discriminatory performance of robots will undermine their service quality for some people, ignore their service requests, and even offend them. Therefore, it is critically important to mitigate bias in robot decision-making for more fair services. In this paper, we designed a self-reflective mechanism -- Fairness-Sensitive Policy Gradient Reinforcement Learning (FSPGRL), to help robots to self-identify biased behaviors during interactions with humans. FSPGRL identifies bias by examining the abnormal update along particular gradients and updates the policy network to support fair decision-making for robots. To validate FSPGRL's effectiveness, a human-centered service scenario, "A robot is serving people in a restaurant," was designed. A user study was conducted; 24 human subjects participated in generating 1,000 service demonstrations. Four commonly-seen issues "Willingness Issue," "Priority Issue," "Quality Issue," "Risk Issue" were observed from robot behaviors. By using FSPGRL to improve robot decisions, robots were proven to have a self-bias detection capability for a more fair service. We have achieved the suppression of bias and improved the quality during the process of robot learning to realize a relatively fair model.

cs.RO↗

arXiv2023

Glass-like Cross-plane Thermal Conductivity of Kagome Metals RbV3Sb5 and CsV3Sb5

This work reports the thermal conductivity of RbV3Sb5 and CsV3Sb5 with three-dimensional charge density wave phase transitions from 80 K to 400 K measured by pump-probe thermoreflectance techniques. The in-plane (basal plane) thermal conductivities are found moderate, i.e., 12 W/mK of RbV3Sb5 and 8.8 W/mK of CsV3Sb5 at 300 K. Low cross-plane (stacking direction) thermal conductivities are observed, with 0.72 W/mK of RbV3Sb5 and 0.49 W/mK of CsV3Sb5 at 300 K. A unique glass-like temperature dependence in the cross-plane thermal conductivity is observed, which decreases monotonically even lower than the Cahill-Pohl limit as the temperature decreases below the phase transition point TCDW. This temperature dependence is found to obey the hopping transport picture. In addition, a peak in cross-plane thermal conductivity is observed at TCDW as a fingerprint of the modulated structural distortion along the stacking direction.

cond-mat.mtrl-sci↗

arXiv2023

Light speed variation from GRB 221009A

It is postulated in Einstein's relativity that the speed of light in vacuum is a constant for all observers. However, the effect of quantum gravity could bring an energy dependence of light speed, and a series of studies on high-energy photon events from gamma-ray bursts (GRBs) and active galactic nuclei (AGNs) suggest a light speed variation $v(E)=c\left(1-E / E_{\mathrm{LV}}\right)$ with $E_{\mathrm{LV}}=3.6 \times 10^{17} ~\mathrm{GeV}$ or a bound $E_{\mathrm{LV}} \ge 3.6 \times 10^{17} ~\mathrm{GeV}$. From the newly observed gamma-ray burst GRB 221009A, we find that a 99.3~GeV photon detected by Fermi-LAT is coincident with the sharp spike in the light curves detected by both Fermi-GBM and HEBS under the above scenario of light speed variation, suggesting an option that this high-energy photon was emitted at the same time as a sharp spike of low-energy photon emission at the GRB source. Thus this highest energy photon event detected by Fermi-LAT during the prompt emission of gamma-ray bursts might be considered as an optional signal for the linear form modification of light speed in cosmological space.

astro-ph.HE↗

arXiv2023

Lorentz Violation in Finsler Geometry

Lorentz invariance is one of the foundations of modern physics; however, Lorentz violation may happen from the perspective of quantum gravity, and plenty of studies on Lorentz violation have arisen in recent years. As a good tool to explore Lorentz violation, Finsler geometry is a natural and fundamental generalization of Riemann geometry. The Finsler structure depends on both coordinates and velocities. Here, we simply introduce the mathematics of Finsler geometry. We review the connection between modified dispersion relations and Finsler geometries and discuss the physical influence from Finsler geometry. We review the connection between Finsler geometries and theories of Lorentz violation, such as the doubly special relativity, the standard-model extension, and the very special relativity.

gr-qc↗

arXiv2023

Trajectories of astroparticles in pseudo-Finsler spacetime with the most general modified dispersion

Finsler geometry is a natural and fundamental generalization of Riemann geometry, and is a tool to research Lorentz invariance violation. We find the connection between the most general modified dispersion relation and a pseudo-Finsler structure, and then we calculate the arrival time delay of astroparticles with different modified dispersion relations in the framework of Finsler geometry. The result suggests that the time delay is irrelevant with the exact form of the modified dispersion relation. If the modified term becomes 0 when $E=p$, there is no arrival time difference, otherwise the time delays only depend on the Lorentz violation scale and the order at which the Lorentz invariance breaks.

gr-qc↗

arXiv2023

Automating Method Naming with Context-Aware Prompt-Tuning

Method names are crucial to program comprehension and maintenance. Recently, many approaches have been proposed to automatically recommend method names and detect inconsistent names. Despite promising, their results are still sub-optimal considering the three following drawbacks: 1) These models are mostly trained from scratch, learning two different objectives simultaneously. The misalignment between two objectives will negatively affect training efficiency and model performance. 2) The enclosing class context is not fully exploited, making it difficult to learn the abstract function of the method. 3) Current method name consistency checking methods follow a generate-then-compare process, which restricts the accuracy as they highly rely on the quality of generated names and face difficulty measuring the semantic consistency. In this paper, we propose an approach named AUMENA to AUtomate MEthod NAming tasks with context-aware prompt-tuning. Unlike existing deep learning based approaches, our model first learns the contextualized representation(i.e., class attributes) of PL and NL through the pre-training model, then fully exploits the capacity and knowledge of large language model with prompt-tuning to precisely detect inconsistent method names and recommend more accurate names. To better identify semantically consistent names, we model the method name consistency checking task as a two-class classification problem, avoiding the limitation of previous similarity-based consistency checking approaches. The experimental results reflect that AUMENA scores 68.6%, 72.0%, 73.6%, 84.7% on four datasets of method name recommendation, surpassing the state-of-the-art baseline by 8.5%, 18.4%, 11.0%, 12.0%, respectively. And our approach scores 80.8% accuracy on method name consistency checking, reaching an 5.5% outperformance. All data and trained models are publicly available.

cs.SE↗