arXiv Science⌕ Search

arXiv subjects

Zhen Wang

Publications and source records attributed to Zhen Wang.

At least 469 records · Page 26Linked to original sources
arXiv2022

Coherence boosting: When your pretrained language model is not paying enough attention

Long-range semantic coherence remains a challenge in automatic language generation and understanding. We demonstrate that large language models have insufficiently learned the effect of distant words on next-token prediction. We present coherence boosting, an inference procedure that increases a LM's focus on a long context. We show the benefits of coherence boosting with pretrained models by distributional analyses of generated ordinary text and dialog responses. It is also found that coherence boosting with state-of-the-art models for various zero-shot NLP tasks yields performance gains with no additional training.

cs.CL↗
arXiv2022

Regularized Bilinear Discriminant Analysis for Multivariate Time Series Data

In recent years, the methods on matrix-based or bilinear discriminant analysis (BLDA) have received much attention. Despite their advantages, it has been reported that the traditional vector-based regularized LDA (RLDA) is still quite competitive and could outperform BLDA on some benchmark datasets. Nevertheless, it is also noted that this finding is mainly limited to image data. In this paper, we propose regularized BLDA (RBLDA) and further explore the comparison between RLDA and RBLDA on another type of matrix data, namely multivariate time series (MTS). Unlike image data, MTS typically consists of multiple variables measured at different time points. Although many methods for MTS data classification exist within the literature, there is relatively little work in exploring the matrix data structure of MTS data. Moreover, the existing BLDA can not be performed when one of its within-class matrices is singular. To address the two problems, we propose RBLDA for MTS data classification, where each of the two within-class matrices is regularized via one parameter. We develop an efficient implementation of RBLDA and an efficient model selection algorithm with which the cross validation procedure for RBLDA can be performed efficiently. Experiments on a number of real MTS data sets are conducted to evaluate the proposed algorithm and compare RBLDA with several closely related methods, including RLDA and BLDA. The results reveal that RBLDA achieves the best overall recognition performance and the proposed model selection algorithm is efficient; Moreover, RBLDA can produce better visualization of MTS data than RLDA.

cs.LG↗
arXiv2022

Euler-Maruyama scheme for SDEs with Dini continuous coefficients

In this paper, we show the convergence rate of Euler-Maruyama scheme for non-degenerate SDEs with Dini continuous coefficients, by the aid of the regularity of the solution to the associated Kolmogorov equation. We obtain the same conclusions using a simple and clever way to simplify the proof and weaken the conditions in \cite{BHY} by the properties of Dini continuous and Taylor expansion.

math.PR↗
arXiv2022

Adversarial Attacks and Defense Methods for Power Quality Recognition

Vulnerability of various machine learning methods to adversarial examples has been recently explored in the literature. Power systems which use these vulnerable methods face a huge threat against adversarial examples. To this end, we first propose a signal-specific method and a universal signal-agnostic method to attack power systems using generated adversarial examples. Black-box attacks based on transferable characteristics and the above two methods are also proposed and evaluated. We then adopt adversarial training to defend systems against adversarial attacks. Experimental analyses demonstrate that our signal-specific attack method provides less perturbation compared to the FGSM (Fast Gradient Sign Method), and our signal-agnostic attack method can generate perturbations fooling most natural signals with high probability. What's more, the attack method based on the universal signal-agnostic algorithm has a higher transfer rate of black-box attacks than the attack method based on the signal-specific algorithm. In addition, the results show that the proposed adversarial training improves robustness of power systems to adversarial examples.

cs.CR↗
arXiv2022

A Unified Framework for Generalized Moment Problems: a Novel Primal-Dual Approach

Generalized moment problems optimize functional expectation over a class of distributions with generalized moment constraints, i.e., the function in the moment can be any measurable function. These problems have recently attracted growing interest due to their great flexibility in representing nonstandard moment constraints, such as geometry-mean constraints, entropy constraints, and exponential-type moment constraints. Despite the increasing research interest, analytical solutions are mostly missing for these problems, and researchers have to settle for nontight bounds or numerical approaches that are either suboptimal or only applicable to some special cases. In addition, the techniques used to develop closed-form solutions to the standard moment problems are tailored for specific problem structures. In this paper, we propose a framework that provides a unified treatment for any moment problem. The key ingredient of the framework is a novel primal-dual optimality condition. This optimality condition enables us to reduce the original infinite dimensional problem to a nonlinear equation system with a finite number of variables. In solving three specific moment problems, the framework demonstrates a clear path for identifying the analytical solution if one is available, otherwise, it produces semi-analytical solutions that lead to efficient numerical algorithms. Finally, through numerical experiments, we provide further evidence regarding the performance of the resulting algorithms by solving a moment problem and a distributionally robust newsvendor problem.

math.OC↗
arXiv2022

MR-SVS: Singing Voice Synthesis with Multi-Reference Encoder

Multi-speaker singing voice synthesis is to generate the singing voice sung by different speakers. To generalize to new speakers, previous zero-shot singing adaptation methods obtain the timbre of the target speaker with a fixed-size embedding from single reference audio. However, they face several challenges: 1) the fixed-size speaker embedding is not powerful enough to capture full details of the target timbre; 2) single reference audio does not contain sufficient timbre information of the target speaker; 3) the pitch inconsistency between different speakers also leads to a degradation in the generated voice. In this paper, we propose a new model called MR-SVS to tackle these problems. Specifically, we employ both a multi-reference encoder and a fixed-size encoder to encode the timbre of the target speaker from multiple reference audios. The Multi-reference encoder can capture more details and variations of the target timbre. Besides, we propose a well-designed pitch shift method to address the pitch inconsistency problem. Experiments indicate that our method outperforms the baseline method both in naturalness and similarity.

eess.AS↗
arXiv2022

Social physics

Recent decades have seen a rise in the use of physics methods to study different societal phenomena. This development has been due to physicists venturing outside of their traditional domains of interest, but also due to scientists from other disciplines taking from physics the methods that have proven so successful throughout the 19th and the 20th century. Here we dub this field 'social physics' and pay our respect to intellectual mavericks who nurtured it to maturity. We do so by reviewing the current state of the art. Starting with a set of topics that are at the heart of modern human societies, we review research dedicated to urban development and traffic, the functioning of financial markets, cooperation as the basis for our evolutionary success, the structure of social networks, and the integration of intelligent machines into these networks. We then shift our attention to a set of topics that explore potential threats to society. These include criminal behaviour, large-scale migrations, epidemics, environmental challenges, and climate change. We end the coverage of each topic with promising directions for future research. Based on this, we conclude that the future for social physics is bright. Physicists studying societal phenomena are no longer a curiosity, but rather a force to be reckoned with. Notwithstanding, it remains of the utmost importance that we continue to foster constructive dialogue and mutual respect at the interfaces of different scientific disciplines.

physics.soc-ph↗
arXiv2021

Ensemble and Random Collaborative Representation-Based Anomaly Detector for Hyperspectral Imagery

In recent years, hyperspectral anomaly detection (HAD) has become an active topic and plays a significant role in military and civilian fields. As a classic HAD method, the collaboration representation-based detector (CRD) has attracted extensive attention and in-depth research. Despite the good performance of the CRD method, its computational cost mainly arising from the sliding dual window strategy is too high for wide applications. Moreover, it takes multiple repeated tests to determine the size of the dual window, which needs to be reset once the dataset changes and cannot be identified in advance with prior knowledge. To alleviate this problem, we proposed a novel ensemble and random collaborative representation-based detector (ERCRD) for HAD, which comprises two closely related stages. Firstly, we process the random sub-sampling on CRD (RCRD) to gain several detection results instead of the sliding dual window strategy, which significantly reduces the computational complexity and makes it more feasible in practical applications. Secondly, ensemble learning is employed to refine the multiple results of RCRD, which act as various "experts" providing abundant complementary information to better target different anomalies. Such two stages form an organic and theoretical detector, which can not only improve the accuracy and stability of HAD methods but also enhance its generalization ability. Experiments on four real hyperspectral datasets exhibit the accuracy and efficiency of this proposed ERCRD method compared with ten state-of-the-art HAD methods.

eess.IV↗
arXiv2021

The origin of insulating and non-ferromagnetic SrRuO3 monolayers

The electro-magnetic properties of ultrathin epitaxial ruthenate films have long been the subject of debate. Here we combine experimental with theoretical investigations of (SrTiO3)5-(SrRuO3)n-(SrTiO3)5 (STO5-SROn-STO5) heterostructures with n = 1 and 2 unit cells, including extensive atomic-resolution scanning-transmission-electron-microscopy imaging, electron-energy-loss-spectroscopy chemical mapping, as well as transport and magneto-transport measurements. The experimental data demonstrate that the STO5-SRO2-STO5 heterostructure is stoichiometric, metallic, and ferromagnetic with TC ~ 128 K, even though it lacks the characteristic bulk-SRO octahedral tilts and matches the cubic STO structure. In contrast, the STO5-SRO1-STO5 heterostructure features Ru-Ti intermixing in the RuO2 layer, also without octahedral tilts, but is accompanied by a loss of metallicity and ferromagnetism. Density-functional-theory calculations show that stoichiometric n = 1 and n = 2 heterostructures are metallic and ferromagnetic with no octahedral tilts, while non-stoichiometry in the Ru sublattice in the n = 1 case opens an energy gap and induces antiferromagnetic ordering. Thus, the results indicate that the observed non-stoichiometry is the cause of the observed loss of metallicity and ferromagnetism in the n = 1 case.

cond-mat.str-el↗
arXiv2021

Reducing current crowding in meander superconducting strip single-photon detectors by thickening bends

To facilitate high optical coupling efficiency and absorptance, the active area of a superconducting nano/microstrip single-photon detector (SNSPD/SMSPD) is often designed as a meander configuration with a high filling factor (e.g., >=0.5). However, the switching current (Isw) of SNSPD/SMSPD, at which the detector switches into the normal state, is significantly suppressed by a geometry-induced "current crowding effect", where there are sharp bends in the strip. Here we propose and experimentally verify an alternative method to reduce current crowding both in SNSPD and SMSPD by directly increasing the thickness of the bends through the deposition and lift-off of a secondary superconducting film. We measure and compare the performance of SNSPDs and SMSPDs with different filling factors and bend configurations, with or without thickened bends. Improvements for detectors were observed in detection efficiency, intrinsic dark count rate, and time jitter, owing to the enhanced Isw. Our method provides a promising way of optimizing SNSPD/SMSPD detection performance.

physics.app-ph↗
arXiv2021

Electrical detection of the spin-flop and room-temperature magnetic ordering in van der Waals CrPS$_{4}$/(Pt, Pd) heterostructures

We study magneto-transport in heterostructures composed of the van der Waals antiferromagnet CrPS$_{4}$ and the heavy metals Pt and Pd. The transverse resistance (R$_{xy}$) signal reveals the spin-flop transition of CrPS$_{4}$ and a strongly enhanced magnetic ordering temperature (>300 K), which might originate from a strong spin-orbit coupling at the interface. While CrPS$_{4}$/Pt devices allow for easy detection of the spin-flop transition, CrPS$_{4}$/Pd devices show a more substantial enhancement in magnetic ordering temperature and exhibit a topological Hall effect signal, possibly related to chiral spin structures at the interface. The longitudinal magnetoresistance (R$_{xx}$) results from a combination of spin-Hall magnetoresistance and the negative magnetoresistance that can be explained by a field-induced change of the electronic band structure of CrPS$_{4}$.

physics.app-ph↗
arXiv2021

A comparison of particle and fluid models for positive streamer discharges in air

Both fluid and particle models are commonly used to simulate streamer discharges. In this paper, we quantitatively study the agreement between these approaches for axisymmetric and 3D simulations of positive streamers in air. We use a drift-diffusion-reaction fluid model with the local field approximation and a PIC-MCC (particle-in-cell, Monte Carlo collision) particle model. The simulations are performed at 300 K and 1 bar in a 10 mm plate-plate gap with a 2 mm needle electrode. Applied voltages between 11.7 and 15.6 kV are used, which correspond to background fields of about 15 to 20 kV/cm. Streamer properties like maximal electric field, head position and velocity are compared as a function of time or space. Our results show good agreement between the particle and fluid simulations, in contrast to some earlier comparisons that were carried out in 1D or for negative streamers. To quantify discrepancies between the models, we mainly look at streamer velocities as a function of streamer length. For the test cases considered here, the mean deviation in streamer velocity between the particle and fluid simulations is less than 4%. We study the effect of different types of transport data for the fluid model, and find that flux coefficients lead to good agreement whereas bulk coefficients do not. Furthermore, we find that with a two-term Boltzmann solver, data should be computed using a temporal growth model for the best agreement. The numerical convergence of the particle and fluid models is also studied. In fluid simulations the streamer velocity increases somewhat using finer grids, whereas the particle simulations are less sensitive to the grid. Photoionization is the dominant source of stochastic fluctuations in our simulations. When the same stochastic photoionization model is used, particle and fluid simulations exhibit similar fluctuations.

physics.plasm-ph↗
arXiv2021

Inhibition of Current-spike Formation Based on Longitudinal Phase Space Manipulation for High-Repetition-Rate X-ray FEL

The formation of a double-horn current profile is a challenging issue in the achievement of electron bunch with high peak current, especially for high-repetition-rate X-ray free-electron lasers (XFELs) where more nonlinear and intricate beam dynamics propagation is involved. Here, we propose to correct the nonlinear beam longitudinal phase space distortion in the photoinjector section with a dual-mode buncher. In combination with the evolutionary many-objective beam dynamics optimization, this method is shown to be effective in manipulating the longitudinal phase space at the injector exit. Furthermore, the formation of the current spike is avoided after the multi-stage charge density modulation and electron bunch with a peak current of 1.6 kA is achieved for 100-pC bunch charge.Start-to-end simulations based on the Shanghai high-repetition-rate XFEL and extreme light facility demonstrate that the proposed scheme can increase the FEL pulse energy by more than 3 times in a cascading operation of echo-enabled harmonic generation and high-gain harmonic generation. Moreover, this method can also be used for longitudinal phase space shaping of electron beams operating at a high repetition rate to meet the specific demands of different researches.

physics.acc-ph↗
arXiv2021

Redefining the Quantum Supremacy Baseline With a New Generation Sunway Supercomputer

A major milestone in the era of noisy intermediate scale quantum computers is \textit{quantum supremacy} [Nature \textbf{574}, 505 (2019)] claimed on the Sycamore quantum processor of $53$ qubits, which can perform a random circuit sampling task within $200$ seconds while the same task is estimated to require a runtime of $10,000$ years on Summit. This record has been renewed with two recent experiments on the Zuchongzhi $2.0$ ($56$ qubits) and Zuchongzhi $2.1$ ($60$ qubits) quantum processors. On the other front of quantum supremacy comparison, there has also been continuous improvements on both the classical simulation algorithm as well as the underlying hardware. And a fair justification of the computational advantages for those quantum supremacy experiments would require to practically simulate the same problems on current top supercomputers, which is still in lack. Here we report the full-scale simulations of these problems on new generation Sunway supercomputer, based on a customized tensor network contraction algorithm. Our benchmark shows that the most challenging sampling task performed on Sycamore can be accomplished within $1$ week, thus collapsing the quantum supremacy claim of Sycamore. Additionally, we show that the XEB fidelities of the \textit{quantum supremacy circuits} with up to $14$ cycles can be verified in minutes, which also provides strong consistency check for quantum supremacy experiments. Our results redefine quantum supremacy baseline using the new generation Sunway supercomputer.

quant-ph↗
arXiv2021

Closing the "Quantum Supremacy" Gap: Achieving Real-Time Simulation of a Random Quantum Circuit Using a New Sunway Supercomputer

We develop a high-performance tensor-based simulator for random quantum circuits(RQCs) on the new Sunway supercomputer. Our major innovations include: (1) a near-optimal slicing scheme, and a path-optimization strategy that considers both complexity and compute density; (2) a three-level parallelization scheme that scales to about 42 million cores; (3) a fused permutation and multiplication design that improves the compute efficiency for a wide range of tensor contraction scenarios; and (4) a mixed-precision scheme to further improve the performance. Our simulator effectively expands the scope of simulatable RQCs to include the 10*10(qubits)*(1+40+1)(depth) circuit, with a sustained performance of 1.2 Eflops (single-precision), or 4.4 Eflops (mixed-precision)as a new milestone for classical simulation of quantum circuits; and reduces the simulation sampling time of Google Sycamore to 304 seconds, from the previously claimed 10,000 years.

quant-ph↗
arXiv2021

Prolonging Valley Polarization Lifetime through Gate-Controlled Exciton-to-Trion Conversion in Monolayer Molybdenum Ditelluride

Monolayer 2D semiconductors provide an attractive option for valleytronics due to the valley-addressability by helicity-specific light beam. But the short valley lifetime for excitons have hindered potential valleytronic applications. In this paper, we demonstrate a strategy for prolonging the valley lifetime by converting excitons to trions through effective gate control and by taking advantage of much longer valley lifetime for trions than for excitons. In continuous-wave experiments, we found the valley polarization increases as gate voltage is tuned away from the charge neutrality, with the degree of valley polarization increased from near zero to 38 % for excitons and to 33 % for trions. This is the first successful observation of valley-polarization in MoTe2 without a magnetic field. In pump-probe experiments, we found that the intervalley scattering process of excitons is significantly suppressed as gate voltage is tuned away from charge neutrality, with scattering time from 0.85 ps to ~ 2.17 ps. In contrast, the intervalley scattering rate for trions increases due to increased availability of partner charges for trion spin flipping, with scattering time from 1.39 ns down to ~100 ps away from charge neutrality. Interestingly, our results show that, despite the accelerated intervalley scattering, the trion polarization degree increases due to polarized trion generation from the exciton-to-trion conversion overtaking the intervalley trion scatterings. Importantly, the efficient exciton-to-trion conversion changed the dominant depolarization mechanisms. As a result, the valley lifetime is dramatically improved by 1000 times from excitons to trions at the charge neutrality. Our results shed new light into the depolarization dynamics and the interplay of various depolarization channels for excitons and trions and provide an effective strategy for prolonging the valley polarization.

cond-mat.mes-hall↗
arXiv2021

Quantum key distribution over 658 km fiber with distributed vibration sensing

Twin-field quantum key distribution (TF-QKD) promises ultra-long secure key distribution which surpasses the rate distance limit and can reduce the number of the trusted nodes in long-haul quantum network. Tremendous efforts have been made towards implementation of TF-QKD, among which, the secure key with finite size analysis can distribute more than 500 km in the lab and in the field. Here, we demonstrate the sending-or-not-sending TF-QKD experimentally, achieving a secure key distribution with finite size analysis over 658 km ultra-low-loss optical fiber, improve the secure distance record by around 100 km. Meanwhile, in a TF-QKD system, any phase fluctuation due to temperature variation and ambient variation during the channel must be recorded and compensated, and all these phase information can then be utilized to sense the channel vibration perturbations. With our QKD system, we recovered the external vibrational perturbations on the fiber generated by an artificial vibroseis and successfully located the perturbation position with a resolution better than 1 km. Our results not only set a new distance record of QKD, but also demonstrate that the redundant information of TF-QKD can be used for remote sensing of the channel vibration, which can find applications in earthquake detection and landslide monitoring besides secure communication.

quant-ph↗