arXiv subjects

Meng Zhang

Publications and source records attributed to Meng Zhang.

At least 199 records · Page 11Linked to original sources

arXiv2021

SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory

Lip reading, aiming to recognize spoken sentences according to the given video of lip movements without relying on the audio stream, has attracted great interest due to its application in many scenarios. Although prior works that explore lip reading have obtained salient achievements, they are all trained in a non-simultaneous manner where the predictions are generated requiring access to the full video. To breakthrough this constraint, we study the task of simultaneous lip reading and devise SimulLR, a simultaneous lip Reading transducer with attention-guided adaptive memory from three aspects: (1) To address the challenge of monotonic alignments while considering the syntactic structure of the generated sentences under simultaneous setting, we build a transducer-based model and design several effective training strategies including CTC pre-training, model warm-up and curriculum learning to promote the training of the lip reading transducer. (2) To learn better spatio-temporal representations for simultaneous encoder, we construct a truncated 3D convolution and time-restricted self-attention layer to perform the frame-to-frame interaction within a video segment containing fixed number of frames. (3) The history information is always limited due to the storage in real-time scenarios, especially for massive video data. Therefore, we devise a novel attention-guided adaptive memory to organize semantic information of history segments and enhance the visual representations with acceptable computation-aware latency. The experiments show that the SimulLR achieves the translation speedup 9.10$\times$ compared with the state-of-the-art non-simultaneous methods, and also obtains competitive results, which indicates the effectiveness of our proposed methods.

cs.CV↗

arXiv2021

Projected entangled pair states study of anisotropic-exchange magnets on triangular lattice

The anisotropic-exchange spin-1/2 model on a triangular lattice has been used to describe the rare-earth chalcogenides, which may have exotic ground states. We investigate the quantum phase diagram of the model by using the projected entangled pair state (PEPS) method, and compare it to the classical phase diagram. Besides two stripe-ordered phase, and the 120$^\circ$ state, there is also a multi-\textbf{Q} phase. We identify the multi-\textbf{Q} phase as a $Z_{2}$ vortex state. No quantum spin liquid state is found in the phase diagram, contrary to the previous DMRG calculations.

cond-mat.str-el↗

arXiv2021

Autoencoder-based Semantic Novelty Detection: Towards Dependable AI-based Systems

Many autonomous systems, such as driverless taxis, perform safety critical functions. Autonomous systems employ artificial intelligence (AI) techniques, specifically for the environment perception. Engineers cannot completely test or formally verify AI-based autonomous systems. The accuracy of AI-based systems depends on the quality of training data. Thus, novelty detection - identifying data that differ in some respect from the data used for training - becomes a safety measure for system development and operation. In this paper, we propose a new architecture for autoencoder-based semantic novelty detection with two innovations: architectural guidelines for a semantic autoencoder topology and a semantic error calculation as novelty criteria. We demonstrate that such a semantic novelty detection outperforms autoencoder-based novelty detection approaches known from literature by minimizing false negatives.

cs.AI↗

arXiv2021

Multi-window SRS imaging using a rapid widely tunable fiber laser

Spectroscopic stimulated Raman scattering (SRS) imaging has become a useful tool finding a broad range of applications. Yet, wider adoption is hindered by the bulky and environmentally-sensitive solid-state optical parametric oscillator (OPO) in current SRS microscope. Moreover, chemically-informative multi-window SRS imaging across C-H, C-D and fingerprint Raman regions is challenging due to the slow wavelength tuning speed of the solid-state OPO. In this work, we present a multi-window SRS imaging system based on a compact and robust fiber laser with rapid and widely tuning capability. To address the relative intensity noise intrinsic to fiber laser, we implemented auto-balanced detection which enhances the signal-to-noise ratio of stimulated Raman loss imaging by 23 times. We demonstrate high-quality SRS metabolic imaging of fungi, cancer cells, and Caenorhabditis elegans across the C-H, C-D and fingerprint Raman windows. Our re-sults showcase the potential of the compact multi-window SRS system for a broad range of applications.

physics.optics↗

arXiv2021

Pricing Fresh Data

We introduce the concept of {\it fresh data trading}, in which a destination user requests, and pays for, fresh data updates from a source provider, and data freshness is captured by the {\it age of information} (AoI) metric. Keeping data fresh relies on frequent data updates by the source, which motivates the source to {\it price fresh data}. In this work, the destination incurs an age-related cost, modeled as a general increasing function of the AoI. The source designs a pricing mechanism to maximize its profit; the destination chooses a data update schedule to trade off its payments to the source and its age-related cost. Depending on different real-time applications and scenarios, we study both a predictable-deadline and an unpredictable-deadline models. The key challenge of designing the optimal pricing scheme lies in the destination's time-interdependent valuations, due to the nature of AoI and the infinite-dimensional and dynamic optimization. To this end, we consider three pricing schemes that exploit and understand the profitability of three different dimensions in designing pricing: a {\it time-dependent} pricing scheme, in which the price for each update depends on when it is requested; a {\it quantity-based} pricing scheme, in which the price of each update depends on how many updates have been previously requested; a {\it subscription-based} pricing scheme, in which the price for each update is flat-rate but the source charges an additional subscription fee. Our analysis reveals that the optimal subscription-based pricing maximizes the source's profit among all possible pricing schemes under both predictable deadline and unpredictable deadline models; the optimal quantity-based pricing scheme is only optimal with a predictable deadline; the time-dependent pricing scheme, under the unpredictable deadline, is asymptotically optimal under significant time discounting.

cs.NI↗

arXiv2021

First-principles study of magnetic structures of triangular antiferromagnets NaYbS$_2$ and NaYbO$_2$

We investigate the magnetic interactions in triangular rare-earth delafossites materials NaYbO$_2$ and NaYbS$_2$ via first-principles calculations. The calculated Curie-Weiss temperatures are in good agreement with experiments. We perform classical Monte Carlo simulations of the two compounds using the extracted exchange parameters. We find that if only the nearest neighbor interactions are considered, the magnetic ground states of NaYbO$_2$ and NaYbS$_2$ are a stripe and a planar 120\degree~ Néel state, respectively. The simulated transition temperatures are much higher than the lowest experimental temperatures, where no magnetic ordering was observed. However, we show by adding suitable second neighbor interactions, the {\it classical} magnetic ground state of NaYbO$_2$ becomes to the $Z_2$ vortex phase, and the simulated specific heat $C_v$ are very similar to the experimental observations, with no obvious phase transition down to the extremely low temperature.

cond-mat.mtrl-sci↗

arXiv2021

Background-Suppressed High-Throughput Mid-Infrared Photothermal Microscopy via Pupil Engineering

Mid-infrared photothermal (MIP) microscopy has been a promising label-free chemical imaging technique for functional characterization of specimens owing to its enhanced spatial resolution and high specificity. Recently developed wide-field MIP imaging modalities have drastically improved speed and enabled high-throughput imaging of micron-scale subjects. However, the weakly scattered signal from sub-wavelength particles becomes indistinguishable from the shot-noise as a consequence of the strong background light, leading to limited sensitivity. Here, we demonstrate background-suppressed chemical fingerprinting at a single nanoparticle level by selectively attenuating the reflected light through pupil engineering in the collection path. Our technique provides over three orders of magnitude background suppression by quasi-darkfield illumination in epi-configuration without sacrificing lateral resolution. We demonstrate 6-fold signal-to-background noise ratio improvement, allowing for simultaneous detection and discrimination of hundreds of nanoparticles across a field of view of 70 um x 70 um. A comprehensive theoretical framework for photothermal image formation is provided and experimentally validated with 300 and 500~nm PMMA beads. The versatility and utility of our technique are demonstrated via hyperspectral dark-field MIP imaging of S. aureus and E. coli bacteria.

physics.optics↗

arXiv2021

Fluorescence-Enhanced Mid-Infrared Photothermal Microscopy

Mid-infrared photothermal microscopy is a new chemical imaging technology in which a visible beam senses the photothermal effect induced by a pulsed infrared laser. This technology provides infrared spectroscopic information at sub-micron spatial resolution and enables infrared spectroscopy and imaging of living cells and organisms. Yet, current mid-infrared photothermal imaging sensitivity suffers from a weak dependance of scattering on temperature and the image quality is vulnerable to the speckles caused by scattering. Here, we present a novel version of mid-infrared photothermal microscopy in which thermo-sensitive fluorescent probes are harnessed to sense the mid-infrared photothermal effect. The fluorescence intensity can be modulated at the level of 1% per Kelvin, which is 100 times larger than the modulation of scattering intensity. In addition, fluorescence emission is free of speckles, thus much improving the image quality. Moreover, fluorophores can target specific organelles or biomolecules, thus augmenting the specificity of photothermal imaging. Spectral fidelity is confirmed through fingerprinting a single bacterium. Finally, the photobleaching issue is successfully addressed through the development of a wide-field fluorescence-enhanced mid-infrared photothermal microscope which allows video rate bond-selective imaging of biological specimens.

physics.optics↗

arXiv2021

Deep Learning Based Defect Detection for Solder Joints on Industrial X-Ray Circuit Board Images

Quality control is of vital importance during electronics production. As the methods of producing electronic circuits improve, there is an increasing chance of solder defects during assembling the printed circuit board (PCB). Many technologies have been incorporated for inspecting failed soldering, such as X-ray imaging, optical imaging, and thermal imaging. With some advanced algorithms, the new technologies are expected to control the production quality based on the digital images. However, current algorithms sometimes are not accurate enough to meet the quality control. Specialists are needed to do a follow-up checking. For automated X-ray inspection, joint of interest on the X-ray image is located by region of interest (ROI) and inspected by some algorithms. Some incorrect ROIs deteriorate the inspection algorithm. The high dimension of X-ray images and the varying sizes of image dimensions also challenge the inspection algorithms. On the other hand, recent advances on deep learning shed light on image-based tasks and are competitive to human levels. In this paper, deep learning is incorporated in X-ray imaging based quality control during PCB quality inspection. Two artificial intelligence (AI) based models are proposed and compared for joint defect detection. The noised ROI problem and the varying sizes of imaging dimension problem are addressed. The efficacy of the proposed methods are verified through experimenting on a real-world 3D X-ray dataset. By incorporating the proposed methods, specialist inspection workload is largely saved.

eess.IV↗

arXiv2021

Dynamic Neural Garments

A vital task of the wider digital human effort is the creation of realistic garments on digital avatars, both in the form of characteristic fold patterns and wrinkles in static frames as well as richness of garment dynamics under avatars' motion. Existing workflow of modeling, simulation, and rendering closely replicates the physics behind real garments, but is tedious and requires repeating most of the workflow under changes to characters' motion, camera angle, or garment resizing. Although data-driven solutions exist, they either focus on static scenarios or only handle dynamics of tight garments. We present a solution that, at test time, takes in body joint motion to directly produce realistic dynamic garment image sequences. Specifically, given the target joint motion sequence of an avatar, we propose dynamic neural garments to jointly simulate and render plausible dynamic garment appearance from an unseen viewpoint. Technically, our solution generates a coarse garment proxy sequence, learns deep dynamic features attached to this template, and neurally renders the features to produce appearance changes such as folds, wrinkles, and silhouettes. We demonstrate generalization behavior to both unseen motion and unseen camera views. Further, our network can be fine-tuned to adopt to new body shape and/or background images. We also provide comparisons against existing neural rendering and image sequence translation approaches, and report clear quantitative improvements.

cs.CV↗

arXiv2021

L2E: Learning to Exploit Your Opponent

Opponent modeling is essential to exploit sub-optimal opponents in strategic interactions. Most previous works focus on building explicit models to directly predict the opponents' styles or strategies, which require a large amount of data to train the model and lack adaptability to unknown opponents. In this work, we propose a novel Learning to Exploit (L2E) framework for implicit opponent modeling. L2E acquires the ability to exploit opponents by a few interactions with different opponents during training, thus can adapt to new opponents with unknown styles during testing quickly. We propose a novel opponent strategy generation algorithm that produces effective opponents for training automatically. We evaluate L2E on two poker games and one grid soccer game, which are the commonly used benchmarks for opponent modeling. Comprehensive experimental results indicate that L2E quickly adapts to diverse styles of unknown opponents.

cs.LG↗

arXiv2021

Self-Amplification of Coherent Energy Modulation in Seeded Free-Electron Lasers

The spectroscopic techniques for time-resolved fine analysis of matter require coherent X-ray radiation with femtosecond duration and high average brightness. Seeded free-electron lasers (FELs), which use the frequency up-conversion of an external seed laser to improve temporal coherence, are ideal for providing fully coherent soft X-ray pulses. However, it is difficult to operate seeded FELs at a high repetition rate due to the limitations of present state-of-the-art laser systems. Here, we report the novel self-modulation method for enhancing laser-induced energy modulation, thereby significantly reducing the requirement of an external laser system. Driven by this scheme, we experimentally realize high harmonic generation in a seeded FEL using an unprecedentedly small energy modulation. An electron beam with a laser-induced energy modulation as small as 1.8 times the slice energy spread is used for lasing at the 7th harmonic of a 266-nm seed laser in a single-stage high-gain harmonic generation (HGHG) setup and the 30th harmonic of the seed laser in a two-stage HGHG setup. The results mark a major step towards a high-repetition-rate, fully coherent X-ray FEL.

physics.acc-ph↗

arXiv2021

Deep Learning for Short-Term Voltage Stability Assessment of Power Systems

To fully learn the latent temporal dependencies from post-disturbance system dynamic trajectories, deep learning is utilized for short-term voltage stability (STVS) assessment of power systems in this paper. First of all, a semi-supervised cluster algorithm is performed to obtain class labels of STVS instances due to the unavailability of reliable quantitative criteria. Secondly, a long short-term memory (LSTM) based assessment model is built through learning the time dependencies from the post-disturbance system dynamics. Finally, the trained assessment model is employed to determine the systems stability status in real time. The test results on the IEEE 39-bus system suggest that the proposed approach manages to assess the stability status of the system accurately and timely. Furthermore, the superiority of the proposed method over traditional shallow learning-based assessment methods has also been proved.

eess.SP↗

arXiv2021

Mechanism Design for Large Scale Network Utility Maximization

Network utility maximization (NUM) is a general framework for designing distributed optimization algorithms for large-scale networks. An economic challenge arises in the presence of strategic agents' private information. Existing studies proposed (economic) mechanisms but largely neglected the issue of large-scale implementation. Specifically, they require certain modifications to the deployed algorithms, which may bring the significant cost. To tackle this challenge, we present the large-scale Vickery-Clark-Grove (VCG) Mechanism for NUM, with a simpler payment rule characterized by the shadow prices. The Large-Scale VCG Mechanism maximizes the network utility and achieves individual rationality and budget balance. With infinitely many agents, agents' truthful reports of their types are their dominant strategies; for the finite case, each agent's incentive to misreport converges quadratically to zero. For practical implementation, we introduce a modified mechanism that possesses an additional important technical property, superimposability, which makes it able to be built upon any (potentially distributed) algorithm that optimally solves the NUM Problem and ensures all agents to obey the algorithm. We then extend this idea to the dynamic case, when agents' types are dynamically evolving as a controlled Markov process. In this case, the mechanism leads to incentive compatible actions of agent for each time slot.

cs.GT↗

arXiv2020

Optimal and Quantized Mechanism Design for Fresh Data Acquisition

The proliferation of real-time applications has spurred much interest in data freshness, captured by the {\it age-of-information} (AoI) metric. When strategic data sources have private market information, a fundamental economic challenge is how to incentivize them to acquire fresh data and optimize the age-related performance. In this work, we consider an information update system in which a destination acquires, and pays for, fresh data updates from multiple sources. The destination incurs an age-related cost, modeled as a general increasing function of the AoI. Each source is strategic and incurs a sampling cost, which is its private information and may not be truthfully reported to the destination. The destination decides on the price of updates, when to get them, and who should generate them, based on the sources' reported sampling costs. We show that a benchmark that naively trusts the sources' reports can lead to an arbitrarily bad outcome compared to the case where sources truthfully report. To tackle this issue, we design an optimal (economic) mechanism for timely information acquisition following Myerson's seminal work. To this end, our proposed optimal mechanism minimizes the sum of the destination's age-related cost and its payment to the sources, while ensuring that the sources truthfully report their private information and will voluntarily participate in the mechanism. However, finding the optimal mechanisms may suffer from \textit{prohibitively expensive computational overheads} as it involves solving a nonlinear infinite-dimensional optimization problem. We further propose a quantized version of the optimal mechanism that achieves asymptotic optimality, maintains the other economic properties, and enables one to tradeoff between optimality and computational overheads.

cs.NI↗

arXiv2020

Word-level Textual Adversarial Attacking as Combinatorial Optimization

Adversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change to the original input. Word-level attacking, which can be regarded as a combinatorial optimization problem, is a well-studied class of textual attack methods. However, existing word-level attack models are far from perfect, largely because unsuitable search space reduction methods and inefficient optimization algorithms are employed. In this paper, we propose a novel attack model, which incorporates the sememe-based word substitution method and particle swarm optimization-based search algorithm to solve the two problems separately. We conduct exhaustive experiments to evaluate our attack model by attacking BiLSTM and BERT on three benchmark datasets. Experimental results demonstrate that our model consistently achieves much higher attack success rates and crafts more high-quality adversarial examples as compared to baseline methods. Also, further experiments show our model has higher transferability and can bring more robustness enhancement to victim models by adversarial training. All the code and data of this paper can be obtained on https://github.com/thunlp/SememePSO-Attack.

cs.CL↗

arXiv2020

Deep Reinforcement Learning for Smart Grid Protection Against Coordinated Multistage Transmission Line Attacks

With the increase of connectivity in power grid, a cascading failure may be triggered by the failure of a transmission line, which can lead to substantial economic losses and serious negative social impacts. Therefore, it is very important to identify the critical lines under various types of attacks that may initiate a cascading failure and deploy defense resources to protect them. Since coordinated multistage line attacks can lead to larger negative impacts compared with a single-stage attack or a multistage attack without coordination, this paper intends to identify the critical lines under coordinated multistage attacks that may initiate a cascading failure and deploy limited defense resources optimally. To this end, we first formulate a total generation loss maximization problem with the consideration of multiple attackers and multiple stages. Due to the large size of solution space, it is very challenging to solve the formulated problem. To overcome the challenge, we reformulate the problem as a Markov game and design its components, e.g., state, action, and reward. Next, we propose a scalable algorithm to solve the Markov game based on multi-agent deep reinforcement learning and prioritized experience replay, which can determine the optimal attacking line sequences. Then, we design a defense strategy to decide the optimal defense line set. Extensive simulation results show the effectiveness of the proposed algorithm and the designed defense strategy.

eess.SY↗

arXiv2020

Observation of two-dimensional superconductivity at the LaAlO3/KTaO3(110) heterointerface

We report on the observation of a Tc ~0.9 K superconductivity at the interface between LaAlO3 film and the 5d transition-metal oxide KTaO3(110) single crystal. The interface shows a large anisotropy of the upper critical field, and its superconducting transition is consistent with a Berezinskii-Kosterlitz-Thouless transition. Both facts suggest that the superconductivity is two-dimensional (2D) in nature. The carrier density measured at 5 K is ~7 time 10^13 cm-2. The superconducting layer thickness and coherence length are estimated to be ~8 and ~30 nm, respectively. Our result provides a new platform for the study of 2D superconductivity at oxide interfaces.

cond-mat.supr-con↗