arXiv subjects

Jin Zhang

Publications and source records attributed to Jin Zhang.

At least 271 records · Page 15Linked to original sources

arXiv2021

Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond

In recent years, Bi-Level Optimization (BLO) techniques have received extensive attentions from both learning and vision communities. A variety of BLO models in complex and practical tasks are of non-convex follower structure in nature (a.k.a., without Lower-Level Convexity, LLC for short). However, this challenging class of BLOs is lack of developments on both efficient solution strategies and solid theoretical guarantees. In this work, we propose a new algorithmic framework, named Initialization Auxiliary and Pessimistic Trajectory Truncated Gradient Method (IAPTT-GM), to partially address the above issues. In particular, by introducing an auxiliary as initialization to guide the optimization dynamics and designing a pessimistic trajectory truncation operation, we construct a reliable approximate version of the original BLO in the absence of LLC hypothesis. Our theoretical investigations establish the convergence of solutions returned by IAPTT-GM towards those of the original BLO without LLC. As an additional bonus, we also theoretically justify the quality of our IAPTT-GM embedded with Nesterov's accelerated dynamics under LLC. The experimental results confirm both the convergence of our algorithm without LLC, and the theoretical findings under LLC.

cs.LG↗

arXiv2021

ViDA-MAN: Visual Dialog with Digital Humans

We demonstrate ViDA-MAN, a digital-human agent for multi-modal interaction, which offers realtime audio-visual responses to instant speech inquiries. Compared to traditional text or voice-based system, ViDA-MAN offers human-like interactions (e.g, vivid voice, natural facial expression and body gestures). Given a speech request, the demonstration is able to response with high quality videos in sub-second latency. To deliver immersive user experience, ViDA-MAN seamlessly integrates multi-modal techniques including Acoustic Speech Recognition (ASR), multi-turn dialog, Text To Speech (TTS), talking heads video generation. Backed with large knowledge base, ViDA-MAN is able to chat with users on a number of topics including chit-chat, weather, device control, News recommendations, booking hotels, as well as answering questions via structured knowledge.

cs.CV↗

arXiv2021

Robust Multi-view Registration of Point Sets with Laplacian Mixture Model

Point set registration is an essential step in many computer vision applications, such as 3D reconstruction and SLAM. Although there exist many registration algorithms for different purposes, however, this topic is still challenging due to the increasing complexity of various real-world scenarios, such as heavy noise and outlier contamination. In this paper, we propose a novel probabilistic generative method to simultaneously align multiple point sets based on the heavy-tailed Laplacian distribution. The proposed method assumes each data point is generated by a Laplacian Mixture Model (LMM), where its centers are determined by the corresponding points in other point sets. Different from the previous Gaussian Mixture Model (GMM) based method, which minimizes the quadratic distance between points and centers of Gaussian probability density, LMM minimizes the sparsity-induced L1 distance, thereby it is more robust against noise and outliers. We adopt Expectation-Maximization (EM) framework to solve LMM parameters and rigid transformations. We approximate the L1 optimization as a linear programming problem by exponential mapping in Lie algebra, which can be effectively solved through the interior point method. To improve efficiency, we also solve the L1 optimization by Alternating Direction Multiplier Method (ADMM). We demonstrate the advantages of our method by comparing it with representative state-of-the-art approaches on benchmark challenging data sets, in terms of robustness and accuracy.

cs.CV↗

arXiv2021

Clock model interpolation and symmetry breaking in O(2) models

The $q$-state clock model is a classical spin model that corresponds to the Ising model when $q=2$ and to the $XY$ model when $q\to\infty$. The integer-$q$ clock model has been studied extensively and has been shown to have a single phase transition when $q=2$,$3$,$4$ and two phase transitions when $q>4$.We define an extended $q$-state clock model that reduces to the ordinary $q$-state clock model when $q$ is an integer and otherwise is a continuous interpolation of the clock model to noninteger $q$. We investigate this class of clock models in 2D using Monte Carlo (MC) and tensor renormalization group (TRG) methods, and we find that the model with noninteger $q$ has a crossover and a second-order phase transition. We also define an extended-$O(2)$ model (with a parameter $γ$) that reduces to the $XY$ model when $γ=0$ and to the extended $q$-state clock model when $γ\to\infty$, and we begin to outline the phase diagram of this model. These models with noninteger $q$ serve as a testbed to study symmetry breaking in situations corresponding to quantum simulators where experimental parameters can be tuned continuously.

hep-lat↗

arXiv2021

Overage and Staleness Metrics for Status Update Systems

Status update systems consist of sensors that take measurements of a physical parameter and transmit them to a remote receiver. Age of Information (AoI) has been studied extensively as a metric for the freshness of information in such systems with and without an enforced hard or soft deadline. In this paper, we propose three metrics for status update systems to measure the ability of different queuing systems to meet a threshold requirement for the AoI. The {\em overage probability} is defined as the probability that the age of the most recent update packet held by the receiver is larger than the threshold. The {\em stale update probability} is the probability that an update is stale, i.e., its age has exceeded the deadline, when it is delivered to the receiver. Finally, the {\em average overage} is defined as the time average of the overage (i.e., age beyond the threshold), and is a measure of the average ``staleness'' of the update packets held by the receiver. We investigate these metrics in three typical status update queuing systems -- M/G/1/1, M/G/1/$2^*$, and M/M/1. Numerical results show the performances for these metrics under different parameter settings and different service distributions. The differences between the average overage and average AoI are also shown. Our results demonstrate that a lower bound exists for the stale update probability when the buffer size is limited. Further, we observe that the overage probability decreases and the stale update probability increases as the update arrival rate increases.

cs.IT↗

arXiv2021

Engineering Three Dimensional Moiré Flat Bands

We demonstrate that the concept of moiré flat bands can be generalized to achieve electronic band engineering in all three spatial dimensions. For many two dimensional van der Waals materials, twisting two adjacent layers with respect to each other leads to flat electronic bands in the two corresponding spatial directions -- a notion sometimes referred to as twistronics as it enables a wealth of physical phenomena. Within this two dimensional plane, large moiré patterns of nanometer size form. The basic concept we propose here is to stack multiple twisted layers on top of each other in a predefined pattern. If the pattern is chosen such that with respect to the stacking direction of layers, the large spatial moiré features are spatially shifted from one twisted layer to the next, the system exhibits twist angle controlled flat bands in all of the three spatial directions. With this, our proposal extends the use of twistronic to three dimensions. We exemplify the general concept by considering graphitic systems, boron nitride and WSe$_2$ as candidate materials, but the approach is applicable to any two-dimensional van der Waals material. For hexagonal boron nitride we develope an ab initio fitted tight binding model that captures the corresponding three dimensional low-energy electronic structure. We outline that interesting three dimensional correlated phases of matter can be induced and controlled following this route, including quantum magnets and unconventional superconducting states.

cond-mat.mtrl-sci↗

arXiv2021

Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond

Bi-Level Optimization (BLO) is originated from the area of economic game theory and then introduced into the optimization community. BLO is able to handle problems with a hierarchical structure, involving two levels of optimization tasks, where one task is nested inside the other. In machine learning and computer vision fields, despite the different motivations and mechanisms, a lot of complex problems, such as hyper-parameter optimization, multi-task and meta-learning, neural architecture search, adversarial learning and deep reinforcement learning, actually all contain a series of closely related subproblms. In this paper, we first uniformly express these complex learning and vision problems from the perspective of BLO. Then we construct a best-response-based single-level reformulation and establish a unified algorithmic framework to understand and formulate mainstream gradient-based BLO methodologies, covering aspects ranging from fundamental automatic differentiation schemes to various accelerations, simplifications, extensions and their convergence and complexity properties. Last but not least, we discuss the potentials of our unified BLO framework for designing new algorithms and point out some promising directions for future research.

cs.LG↗

arXiv2021

Complexes with the double centraliser property

In representation theory, the double centraliser property is an important property for a module (bimodule). It plays a fundamental role in many theories. In this paper, we extend this property to complexes in derived categories of finite dimensional algebras, under the name derived double centraliser property. Characterizations for complexes with the derived double centraliser property and (two-sided) tilting complexes in derived categories of hereditary algebras are given. In particular, all complexes with this property in the derived categories of lower triangular matrix algebras are classified.

math.RT↗

arXiv2021

Hybrid Beamforming for RIS-Aided Communications: Fitness Landscape Analysis and Niching Genetic Algorithm

Reconfigurable Intelligent Surface (RIS) is a revolutionizing approach to provide cost-effective yet energy-efficient communications. The transmit beamforming of the base station (BS) and discrete phase shifts of the RIS are jointly optimized to provide high quality of service. However, existing works ignore the high dependence between the large number of phase shifts and estimate them separately, consequently, easily getting trapped into local optima. To investigate the number and distribution of local optima, we conduct a fitness landscape analysis on the sum rate maximization problems. Two landscape features, the fitness distribution correlation and autocorrelation, are employed to investigate the ruggedness of landscape. The investigation results indicate that the landscape exhibits a rugged, multi-modal structure, i.e., has many local peaks, particularly in the cases with large-scale RISs. To handle the multi-modal landscape structure, we propose a novel niching genetic algorithm to solve the sum rate maximization problem. Particularly, a niching technique, nearest-better clustering, is incorporated to partition the population into several neighborhood species, thereby locating multiple local optima and enhance the global search ability. We also present a minimum species size to further improve the convergence speed. Simulation results demonstrate that our method achieves significant capacity gains compared to existing algorithms, particularly in the cases with large-scale RISs.

cs.NE↗

arXiv2021

Investigating Customization Strategies and Convergence Behaviors of Task-specific ADMM

Alternating Direction Method of Multiplier (ADMM) has been a popular algorithmic framework for separable optimization problems with linear constraints. For numerical ADMM fail to exploit the particular structure of the problem at hand nor the input data information, leveraging task-specific modules (e.g., neural networks and other data-driven architectures) to extend ADMM is a significant but challenging task. This work focuses on designing a flexible algorithmic framework to incorporate various task-specific modules (with no additional constraints) to improve the performance of ADMM in real-world applications. Specifically, we propose Guidance from Optimality (GO), a new customization strategy, to embed task-specific modules into ADMM (GO-ADMM). By introducing an optimality-based criterion to guide the propagation, GO-ADMM establishes an updating scheme agnostic to the choice of additional modules. The existing task-specific methods just plug their task-specific modules into the numerical iterations in a straightforward manner. Even with some restrictive constraints on the plug-in modules, they can only obtain some relatively weaker convergence properties for the resulted ADMM iterations. Fortunately, without any restrictions on the embedded modules, we prove the convergence of GO-ADMM regarding objective values and constraint violations, and derive the worst-case convergence rate measured by iteration complexity. Extensive experiments are conducted to verify the theoretical results and demonstrate the efficiency of GO-ADMM.

cs.CV↗

arXiv2021

Fidelity and entanglement entropy for infinite-order phase transitions

We study the fidelity and the entanglement entropy for the ground states of quantum systems that have infinite-order quantum phase transitions. In particular, we consider the quantum O(2) model with a spin-$S$ truncation, where there is an infinite-order Gaussian (IOG) transition for $S = 1$ and there are Berezinskii-Kosterlitz-Thouless (BKT) transitions for $S \ge 2$. We show that the height of the peak in the fidelity susceptibility ($χ_F$) converges to a finite thermodynamic value as a power law of $1/L$ for the IOG transition and as $1/\ln(L)$ for BKT transitions. The peak position of $χ_F$ resides inside the gapped phase for both the IOG transition and BKT transitions. On the other hand, the derivative of the block entanglement entropy with respect to the coupling constant ($S^{\prime}_{vN}$) has a peak height that diverges as $\ln^{2}(L)$ [$\ln^{3}(L)$] for $S = 1$ ($S \ge 2$) and can be used to locate both kinds of transitions accurately. We include higher-order corrections for finite-size scalings and crosscheck the results with the value of the central charge $c = 1$. The crossing point of $χ_F$ between different system sizes is at the IOG point for $S = 1$ but is inside the gapped phase for $S \ge 2$, while those of $S^{\prime}_{vN}$ are at the phase-transition points for all $S$ truncations. Our work elaborates how to use the finite-size scaling of $χ_F$ or $S^{\prime}_{vN}$ to detect infinite-order quantum phase transitions and discusses the efficiency and accuracy of the two methods.

quant-ph↗

arXiv2021

Clock model interpolation and symmetry breaking in O(2) models

Motivated by recent attempts to quantum simulate lattice models with continuous Abelian symmetries using discrete approximations, we define an extended-O(2) model by adding a $γ\cos(qφ)$ term to the ordinary O(2) model with angular values restricted to a $2π$ interval. In the $γ\rightarrow \infty$ limit, the model becomes an extended $q$-state clock model that reduces to the ordinary $q$-state clock model when $q$ is an integer and otherwise is a continuation of the clock model for noninteger $q$. By shifting the $2π$ integration interval, the number of angles selected can change discontinuously and two cases need to be considered. What we call case $1$ has one more angle than what we call case $2$. We investigate this class of clock models in two space-time dimensions using Monte Carlo and tensor renormalization group methods. Both the specific heat and the magnetic susceptibility show a double-peak structure for fractional $q$. In case $1$, the small-$β$ peak is associated with a crossover, and the large-$β$ peak is associated with an Ising critical point, while both peaks are crossovers in case $2$. When $q$ is close to an integer by an amount $Δq$ and the system is close to the small-$β$ Berezinskii-Kosterlitz-Thouless transition, the system has a magnetic susceptibility that scales as $\sim 1 / (Δq)^{1 - 1/δ'}$ with $δ'$ estimates consistent with the magnetic critical exponent $δ= 15$. The crossover peak and the Ising critical point move to Berezinskii-Kosterlitz-Thouless transition points with the same power-law scaling. A phase diagram for this model in the $(β, q)$ plane is sketched. These results are possibly relevant for configurable Rydberg-atom arrays where the interpolations among phases with discrete symmetries can be achieved by varying continuously the distances among atoms and the detuning frequency.

hep-lat↗

arXiv2021

Full characterization of the instrumental polarization effects of the spectropolarimetric mode of SCExAO-CHARIS

SCExAO at the Subaru telescope is a visible and near-infrared high-contrast imaging instrument employing extreme adaptive optics and coronagraphy. The instrument feeds the near-infrared light (JHK) to the integral-field spectrograph CHARIS. The spectropolarimetric capability of CHARIS is enabled by a Wollaston prism and is unique among high-contrast imagers. We present a detailed Mueller matrix model describing the instrumental polarization effects of the complete optical path, thus the telescope and instrument. From measurements with the internal light source, we find that the image derotator (K-mirror) produces strongly wavelength-dependent crosstalk, in the worst case converting ~95% of the incident linear polarization to circularly polarized light that cannot be measured. Observations of an unpolarized star show that the magnitude of the instrumental polarization of the telescope varies with wavelength between 0.5% and 1%, and that its angle is exactly equal to the altitude angle of the telescope. Using physical models of the fold mirror of the telescope, the half-wave plate, and the derotator, we simultaneously fit the instrumental polarization effects in the 22 wavelength bins. Over the full wavelength range, our model currently reaches a total polarimetric accuracy between 0.08% and 0.24% in the degree of linear polarization. We propose additional calibration measurements to improve the polarimetric accuracy to <0.1% and plan to integrate the complete Mueller matrix model into the existing CHARIS post-processing pipeline. Our calibrations of CHARIS' spectropolarimetric mode will enable unique quantitative polarimetric studies of circumstellar disks and planetary and brown dwarf companions.

astro-ph.IM↗

arXiv2021

Presence of $s$-wave pairing in Josephson junctions made of twisted ultrathin Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ flakes

Since the discovery of high temperature superconductivity in cuprates, Josephson junction based phase-sensitive experiments are believed and used to provide the most convincing evidence for determining the pairing symmetry. Regardless of different junction materials and geometries used, quantum tunneling involved in these experiments is essentially a nanoscale process, and thus, actual experimental results are extremely sensitive to atomic details of the junction structures. The situation has led to controversial results as to the nature of the pairing symmetry of cuprates: while in-plane junction experiments generally support $d$-wave pairing symmetry, those based on out-of-plane ($c$-axis) Josephson junctions between two rotated cuprate blocks favor $s$-wave pairing. In this work, we revisit the $c$-axis experiment by fabricating Josephson junctions with atomic-level control in their interface structure. We fabricate over 90 junctions of ultrathin Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ (BSCCO) flakes by state-of-the-art exfoliation technique and obtain atomically flat junction interfaces in the whole junction regions as characterized by high resolution transmission electron microscopy (TEM). Notably, the resultant uniform junctions at various twist angles all exhibit a single tunneling branch behavior, suggesting that only the first half a unit cell on both sides of the twisted flakes is involved in Josephson tunneling process. With such well-defined geometry/structure and the characteristic single tunneling branch, we repeatedly observe Josephson tunneling at a nominal twist angle of 45 degrees, which is against the expectation from a purely $d$-wave pairing scenario. Our results strongly favor the scenario of a persistent $s$-wave order parameter in the junction.

cond-mat.supr-con↗

arXiv2021

Optimal Output Consensus of Second-Order Uncertain Nonlinear Systems on Weight-Unbalanced Directed Networks

This paper investigates the distributed optimal output consensus problem of second-order uncertain nonlinear multi-agent systems over weight-unbalanced directed networks. Under the standard assumption that local cost functions are strongly convex with globally Lipschitz gradients, a novel distributed dynamic state feedback controller is developed such that the outputs of all the agents reach the optimal solution to minimize the global cost function which is the sum of all the local cost functions. The controller design is based on a two-layer strategy, where a distributed optimal coordinator and a reference-tracking controller are proposed to address the challenges arising from unbalanced directed networks and uncertain nonlinear functions respectively. A key feature of the proposed controller is that the nonlinear functions containing the uncertainties and disturbances are not required to be globally Lipschitz. Furthermore, by exploiting adaptive control technique, no prior knowledge of the uncertainties or disturbances is required either. Two simulation examples are finally provided to illustrate the effectiveness of the proposed control scheme.

math.OC↗

arXiv2021

Truncation effects in the charge representation of the O(2) model

The O(2) model in Euclidean space-time is the zero-gauge-coupling limit of the compact scalar quantum electrodynamics. We obtain a dual representation of it called the charge representation. We study the quantum phase transition in the charge representation with a truncation to ``spin $S$," where the quantum numbers have an absolute value less than or equal to $S$. The charge representation preserves the gapless-to-gapped phase transition even for the smallest spin truncation $S = 1$. The phase transition for $S = 1$ is an infinite-order Gaussian transition with the same critical exponents $δ$ and $η$ as the Berezinskii-Kosterlitz-Thouless (BKT) transition, while there are true BKT transitions for $S \ge 2$. The essential singularity in the correlation length for $S = 1$ is different from that for $S \ge 2$. The exponential convergence of the phase-transition point is studied in both Lagrangian and Hamiltonian formulations. We discuss the effects of replacing the truncated $\hat{U}^{\pm} = \exp(\pm i \hatθ)$ operators by the spin ladder operators $\hat{S}^{\pm}$ in the Hamiltonian. The marginal operators vanish at the Gaussian transition point for $S = 1$, which allows us to extract the $η$ exponent with high accuracy.

cond-mat.quant-gas↗

arXiv2021

A Common Tracking Software Project

The reconstruction of the trajectories of charged particles, or track reconstruction, is a key computational challenge for particle and nuclear physics experiments. While the tuning of track reconstruction algorithms can depend strongly on details of the detector geometry, the algorithms currently in use by experiments share many common features. At the same time, the intense environment of the High-Luminosity LHC accelerator and other future experiments is expected to put even greater computational stress on track reconstruction software, motivating the development of more performant algorithms. We present here A Common Tracking Software (ACTS) toolkit, which draws on the experience with track reconstruction algorithms in the ATLAS experiment and presents them in an experiment-independent and framework-independent toolkit. It provides a set of high-level track reconstruction tools which are agnostic to the details of the detection technologies and magnetic field configuration and tested for strict thread-safety to support multi-threaded event processing. We discuss the conceptual design and technical implementation of ACTS, selected applications and performance of ACTS, and the lessons learned.

physics.ins-det↗

arXiv2021

Serial-EMD: Fast Empirical Mode Decomposition Method for Multi-dimensional Signals Based on Serialization

Empirical mode decomposition (EMD) has developed into a prominent tool for adaptive, scale-based signal analysis in various fields like robotics, security and biomedical engineering. Since the dramatic increase in amount of data puts forward higher requirements for the capability of real-time signal analysis, it is difficult for existing EMD and its variants to trade off the growth of data dimension and the speed of signal analysis. In order to decompose multi-dimensional signals at a faster speed, we present a novel signal-serialization method (serial-EMD), which concatenates multi-variate or multi-dimensional signals into a one-dimensional signal and uses various one-dimensional EMD algorithms to decompose it. To verify the effects of the proposed method, synthetic multi-variate time series, artificial 2D images with various textures and real-world facial images are tested. Compared with existing multi-EMD algorithms, the decomposition time becomes significantly reduced. In addition, the results of facial recognition with Intrinsic Mode Functions (IMFs) extracted using our method can achieve a higher accuracy than those obtained by existing multi-EMD algorithms, which demonstrates the superior performance of our method in terms of the quality of IMFs. Furthermore, this method can provide a new perspective to optimize the existing EMD algorithms, that is, transforming the structure of the input signal rather than being constrained by developing envelope computation techniques or signal decomposition methods. In summary, the study suggests that the serial-EMD technique is a highly competitive and fast alternative for multi-dimensional signal analysis.

cs.CV↗