arXiv subjects

Jin Zhang

Publications and source records attributed to Jin Zhang.

At least 163 records · Page 9Linked to original sources

arXiv2024

Gradient-based algorithms for multi-objective bi-level optimization

Multi-Objective Bi-Level Optimization (MOBLO) addresses nested multi-objective optimization problems common in a range of applications. However, its multi-objective and hierarchical bilevel nature makes it notably complex. Gradient-based MOBLO algorithms have recently grown in popularity, as they effectively solve crucial machine learning problems like meta-learning, neural architecture search, and reinforcement learning. Unfortunately, these algorithms depend on solving a sequence of approximation subproblems with high accuracy, resulting in adverse time and memory complexity that lowers their numerical efficiency. To address this issue, we propose a gradient-based algorithm for MOBLO, called gMOBA, which has fewer hyperparameters to tune, making it both simple and efficient. Additionally, we demonstrate the theoretical validity by accomplishing the desirable Pareto stationarity. Numerical experiments confirm the practical efficiency of the proposed method and verify the theoretical results. To accelerate the convergence of gMOBA, we introduce a beneficial L2O neural network (called L2O-gMOBA) implemented as the initialization phase of our gMOBA algorithm. Comparative results of numerical experiments are presented to illustrate the performance of L2O-gMOBA.

math.OC↗

arXiv2024

Calibrated absolute optical contrast for high-throughput characterization of horizontally aligned carbon nanotube arrays

Horizontally aligned carbon nanotube (HACNT) arrays hold significant potential for various applications in nanoelectronics and material science. However, their high-throughput characterization remains challenging due to the lack of methods with both high efficiency and high accuracy. Here, we present a novel technique, Calibrated Absolute Optical Contrast (CAOC), achieved through the implementation of differential principles to filter out stray signals and high-resolution calibration to endow optical contrast with physical significance. CAOC offers major advantages over previous characterization techniques, providing consistent and reliable measurements of HACNT array density with high throughput and non-destructive assessment. To validate its utility, we demonstrate wafer-scale uniformity assessment by rapid density mapping. This technique not only facilitates the practical evaluation of HACNT arrays but also provides insights into balancing high throughput and high resolution in nanomaterial characterization.

physics.app-ph↗

arXiv2024

Overcoming Lower-Level Constraints in Bilevel Optimization: A Novel Approach with Regularized Gap Functions

Constrained bilevel optimization tackles nested structures present in constrained learning tasks like constrained meta-learning, adversarial learning, and distributed bilevel optimization. However, existing bilevel optimization methods mostly are typically restricted to specific constraint settings, such as linear lower-level constraints. In this work, we overcome this limitation and develop a new single-loop, Hessian-free constrained bilevel algorithm capable of handling more general lower-level constraints. We achieve this by employing a doubly regularized gap function tailored to the constrained lower-level problem, transforming constrained bilevel optimization into an equivalent single-level optimization problem with a single smooth constraint. We rigorously establish the non-asymptotic convergence analysis of the proposed algorithm under the convexity of lower-level problem, avoiding the need for strong convexity assumptions on the lower-level objective or coupling convexity assumptions on lower-level constraints found in existing literature. Additionally, the generality of our method allows for its extension to bilevel optimization with minimax lower-level problem. We evaluate the effectiveness and efficiency of our algorithm on various synthetic problems, typical hyperparameter learning tasks, and generative adversarial network.

math.OC↗

arXiv2024

M$^3$CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought

Multi-modal Chain-of-Thought (MCoT) requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning, which gains increasing attention. Nevertheless, the current MCoT benchmark still faces some challenges: (1) absence of visual modal reasoning, (2) single-step visual modal reasoning, and (3) Domain missing, thereby hindering the development of MCoT. Motivated by this, we introduce a novel benchmark (M$^3$CoT) to address the above challenges, advancing the multi-domain, multi-step, and multi-modal CoT. Additionally, we conduct a thorough evaluation involving abundant MCoT approaches on Vision Large Language Models (VLLMs). In addition, we highlight that the current VLLMs still struggle to correctly reason in M$^3$CoT and there remains a large gap between existing VLLMs and human performance in M$^3$CoT, despite their superior results on previous MCoT benchmarks. To our knowledge, we take the first meaningful step toward the multi-domain, multi-step, and multi-modal scenario in MCoT. We hope that M$^3$CoT can serve as a valuable resource, providing a pioneering foundation in multi-domain, multi-step, multi-modal chain-of-thought research.

cs.CV↗

arXiv2024

Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy

This work focuses on addressing two major challenges in the context of large-scale nonconvex Bi-Level Optimization (BLO) problems, which are increasingly applied in machine learning due to their ability to model nested structures. These challenges involve ensuring computational efficiency and providing theoretical guarantees. While recent advances in scalable BLO algorithms have primarily relied on lower-level convexity simplification, our work specifically tackles large-scale BLO problems involving nonconvexity in both the upper and lower levels. We simultaneously address computational and theoretical challenges by introducing an innovative single-loop gradient-based algorithm, utilizing the Moreau envelope-based reformulation, and providing non-asymptotic convergence analysis for general nonconvex BLO problems. Notably, our algorithm relies solely on first-order gradient information, enhancing its practicality and efficiency, especially for large-scale BLO learning tasks. We validate our approach's effectiveness through experiments on various synthetic problems, two typical hyper-parameter learning tasks, and a real-world neural architecture search application, collectively demonstrating its superior performance.

math.OC↗

arXiv2024

The $H\rightarrow b\bar{s}$ decay and its implication for the vector-like singlet fermion model

The vector-like quark model is one of the extensions of the standard model (SM) of particle physics. The simplest version of this model introduces a vector-like singlet quark which can mix with SM quarks and give rise to new contributions to the flavor-changing decays of the Higgs boson. In this work we first present a systematic analysis of the branching ratios of the decays $H\rightarrow b\bar{s}, b\bar{d}$ at leading order in the standard model. Our results show that it is challenging to observe these two modes because of their small branching ratios. Then augmenting the SM with a vector-like singlet top quark, assuming the top partner only mixes with the top quark, complete one-loop contributions are taken into account in the amplitudes. Further results indicate that the branching ratios of the decays $H\rightarrow b\bar{s}, b\bar{d}$ are sensitive to the mass of the top partner $M_{T}$ and the mixing effects characterized by $\sinθ_{L}$. By tuning the values of $M_{T}$ and $\sinθ_{L}$, the branching ratios may rise to a level accessible to LHC experiments. Combined with the branching ratios obtained from a probabilistic model, the allowed areas in the $M_{T}-\sinθ_{L}$ plane are displayed. Tagging efficiencies and feasibility for detecting $H\rightarrow b\bar{s}$ are specifically discussed and we conclude that with large statistics it is promising to discover the $H\rightarrow b\bar{s}$ decay at the LHC.

hep-ph↗

arXiv2024

Study of γ-ray Emission from a Compact Radio Galaxy with the Fermi Large Area Telescope

The radio galaxy PKS 1007+142 is classified as a compact steep-spectrum source (CSS) and belongs to the class of young Active Galactic Nuclei (AGNs). In this paper, we investigate the $γ$-ray emission from this CSS by conducting a comprehensive analysis of the 15 yr Fermi Large Area Telescope (Fermi-LAT) observation data. The Fermi-LAT latest Source Catalog, 4FGL-DR4, includes an unassociated $γ$-ray source, 4FGL J1010.0+1416, located at 0.24° away from the radio position of PKS 1007+142. Using the 15 yr Fermi-LAT observation data, we re-estimate the best-fit position of the $γ$-ray source and find that PKS 1007+142 is in close proximity to the $γ$-ray source and falls within its 68% error circle. Therefore, we conclude that PKS 1007+142 is the most plausible counterpart to the unassociated LAT source with a detection test statistics (TS) $\sim$43.4 ($\sim 6.6σ$). PKS 1007+142 exhibits a steep power-law spectrum in the 0.1--300 GeV band, with a photon spectral index ($Γ_γ$) of $2.86\pm0.17$. The average flux in the considered time interval is $\rm (2.14\pm0.34)\times10^{-12}\ erg\ cm^{-2}\ s^{-1}$. Comparing PKS 1007+142 with other $γ$-ray emitting AGNs in both the $L_γ-Γ_γ$ and $L_γ-L_{\rm 1.4GHz}$ planes, it shows a softer $γ$-ray spectrum and lower luminosity compared to other $γ$-ray emitting CSSs. Furthermore, the possible origins of $γ$-ray in PKS 1007+142 are also discussed.

astro-ph.HE↗

arXiv2024

Heuristic Solution to Joint Deployment and Beamforming Design for STAR-RIS Aided Networks

This paper tackles the deployment challenges of Simultaneous Transmitting and Reflecting Reconfigurable Intelligent Surface (STAR-RIS) in communication systems. Unlike existing works that use fixed deployment setups or solely optimize the location, this paper emphasizes the joint optimization of the location and orientation of STAR-RIS. This enables searching across all user grouping possibilities and fully boosting the system's performance. We consider a sum rate maximization problem with joint optimization and hybrid beamforming design. An offline heuristic solution is proposed for the problem, developed based on differential evolution and semi-definite programming methods. In particular, a point-point representation is proposed for characterizing and exploiting the user-grouping. A balanced grouping method is designed to achieve a desired user grouping with low complexity. Numerical results demonstrate the substantial performance gains achievable through optimal deployment design.

eess.SY↗

arXiv2024

Morphological stability of electrostrictive thin films

A large electric field is typically present in anodic or passive oxide films. Stresses induced by such a large electric field are critical in understanding the breakdown mechanism of thin oxide films and improving their corrosion resistance. In this work, we consider electromechanical coupling through the electrostrictive effect. A continuum model incorporating lattice misfit and electric field-induced stresses is developed. We perform a linear stability analysis of the full coupled model and show that, for typical oxides, neglecting electrostriction underestimates the film's instability, especially in systems with a large electric field. Moreover, a region where electrostriction can potentially provide a stabilizing effect is identified, allowing electrostriction to enhance corrosion resistance. We identified an equilibrium electric field intrinsic to the system and the corresponding equilibrium film thickness. The film's stability is very sensitive to the electric field: a 40 percent deviation from the equilibrium electric field can change the maximum growth rate by nearly an order of magnitude. Moreover, our model reduces to classical morphological instability models in the limit of misfit-only, electrostatic-only, and no-electrostriction cases. Finally, the effect of various parameters on the film's stability is studied.

cond-mat.mtrl-sci↗

arXiv2024

Transforming the Synthesis of Carbon Nanotubes with Machine Learning Models and Automation

Carbon-based nanomaterials (CBNs) are showing significant potential in various fields, such as electronics, energy, and mechanics. However, their practical applications face synthesis challenges stemming from the complexities of structural control, large-area uniformity, and high yield. Current research methodologies fall short in addressing the multi-variable, coupled interactions inherent to CBNs production. Machine learning methods excel at navigating such complexities. Their integration with automated synthesis platforms has demonstrated remarkable potential in accelerating chemical synthesis research, but remains underexplored in the nanomaterial domain. Here we introduce Carbon Copilot (CARCO), an artificial intelligence (AI)-driven platform that integrates transformer-based language models tailored for carbon materials, robotic chemical vapor deposition (CVD), and data-driven machine learning models, empowering accelerated research of CBNs synthesis. Employing CARCO, we demonstrate innovative catalyst discovery by predicting a superior Titanium-Platinum bimetallic catalyst for high-density horizontally aligned carbon nanotube (HACNT) array synthesis, validated through over 500 experiments. Furthermore, with the assistance of millions of virtual experiments, we achieved an unprecedented 56.25% precision in synthesizing HACNT arrays with predetermined densities in the real world. All were accomplished within just 43 days. This work not only advances the field of HACNT arrays but also exemplifies the integration of AI with human expertise to overcome the limitations of traditional experimental approaches, marking a paradigm shift in nanomaterials research and paving the way for broader applications.

physics.app-ph↗

arXiv2024

A modularized algorithmic framework for interface related optimization problems using characteristic functions

In this paper, we consider the algorithms and convergence for a general optimization problem, which has a wide range of applications in image segmentation, topology optimization, flow network formulation, and surface reconstruction. In particular, the problem focuses on interface related optimization problems where the interface is implicitly described by characteristic functions of the corresponding domains. Under such representation and discretization, the problem is then formulated into a discretized optimization problem where the objective function is concave with respect to characteristic functions and convex with respect to state variables. We show that under such structure, the iterative scheme based on alternative minimization can converge to a local minimizer. Extensive numerical examples are performed to support the theory.

math.OC↗

arXiv2024

X-Ray Polarization Variability of High Spectral Peak BL Lacertaes: Cases of 1ES 1959+650 and PKS 2155-304

The high-energy-peaked BL Lacertae objects (HBLs) are the main targets of the Imaging X-ray Polarimetry Explorer (IXPE) for investigating the mechanisms of radiation and particle acceleration in jets. In this paper, we report the first IXPE observations of two HBLs, 1ES 1959+650 and PKS 2155--304. Both sources exhibit X-ray polarization with a confidence level exceeding 99\%, as well as significant variability in polarization across different time intervals and energy ranges. Notably, PKS 2155--304 demonstrates the highest X-ray polarization among all blazars detected by IXPE within its entire energy band (2--8 keV), with a polarization degree of $Π_{\rm X}=21.9\%\pm1.9\%$ (MDP$_{99}\sim$6.0\%). An even higher polarization is observed in the 3--4 keV band, reaching $Π_{\rm X}=28.6\%\pm2.7\%$ (MDP$_{99}\sim$8.1\%) with a confidence level of 10.8$σ$. Furthermore, no polarization is detected above 5 keV energy band. For 1ES 1959+650, the highest detected polarization degree in the 2--8 keV band is $Π_{\rm X}=12.4\%\pm0.7\%$ (MDP$_{99}\sim$2.2\%), with an electric vector position angle (EVPA) of $ψ_{\rm X}=19.7^{\circ}\pm1.6^{\circ}$. The X-ray polarization of 1ES 1959+650 exhibits evident variability, accompanied by the variations of $ψ_{\rm X}$, flux, spectrum, and energy bin. We discuss possible implications of these observational findings, including the variability in polarization, rotation of EVPA, and transition between synchrotron and synchrotron-self-Compton. We speculate that the X-rays observed during different IXPE observations originate from distinct regions in the jet and may involve diverse mechanisms for particle acceleration.

astro-ph.HE↗

arXiv2024

Symmetry Breaking in an Extended O(2) Model

Motivated by attempts to quantum simulate lattice models with continuous Abelian symmetries using discrete approximations, we study an extended-O(2) model in two dimensions that differs from the ordinary O(2) model by the addition of an explicit symmetry breaking term $-h_q\cos(qφ)$. Its coupling $h_q$ allows to smoothly interpolate between the O(2) model ($h_q=0$) and a $q$-state clock model ($h_q\rightarrow\infty$). In the latter case, a $q$-state clock model can also be defined for noninteger values of $q$. Thus, such a limit can also be considered as an analytic continuation of an ordinary $q$-state clock model to noninteger $q$. In previous work, we established the phase diagram for noninteger $q$ in the infinite coupling limit ($h_q\rightarrow\infty$). We showed that there is a second-order phase transition at low temperature and a crossover at high temperature. In this work, we seek to establish the phase diagram at finite values of the coupling using Monte Carlo and tensor methods. We show that for noninteger $q$, the second-order phase transition at low temperature and crossover at high temperature persist to finite coupling. For integer $q=2,3,4$, we know there is a second-order phase transition at infinite coupling (i.e. the well-known clock models). At finite coupling, we find that the critical exponents for $q=3,4$ vary with the coupling, and for $q=4$ the transition may turn into a BKT transition at small coupling. We comment on the similarities and differences of the phase diagrams with those of quantum simulators of the Abelian-Higgs model based on ladder-shaped arrays of Rydberg atoms.

hep-lat↗

arXiv2024

Fermi Large Area Telescope Detection of Gamma-Rays from NGC 6251 Radio Lobe

We report on the detection of extended $γ$-ray emission from lobes in the radio galaxy NGC 6251 using observation data of Fermi Large Area Telescope (Fermi-LAT). The maximum likelihood analysis results show that a radio morphology template provides a better fit than a point-like source description for the observational data at a confidence level of 8.1$σ$, and the contribution of lobes accounts for more than 50\% of the total $γ$-ray flux. Furthermore, the $γ$-ray energy spectra show a significant disparity in shape between the core and lobe regions, with a curved log-parabola shape observed in core region and a power-law form observed in lobes. Neither the core region nor the northwest lobe displays the significant flux variations in the long-term $γ$-ray light curves. The broadband spectral energy distributions of both core region and northwest lobe can be will explained with a single-zone leptonic model. The $γ$-rays of core region are due to the synchrotron-self-Compton process while the $γ$-rays from northwest lobe are interpreted as inverse Compton emission of the cosmic microwave background.

astro-ph.HE↗

arXiv2024

Supercloseness of the DDG method for a singularly perturbed convection diffusion problem on Shishkin mesh

This paper investigates the supercloseness of a singularly perturbed convection diffusion problem using the direct discontinuous Galerkin (DDG) method on a Shishkin mesh. The main technical difficulties lie in controlling the diffusion term inside the layer, the convection term outside the layer, and the inter element jump term caused by the discontinuity of the numerical solution. The main idea is to design a new composite interpolation, in which a global projection is used outside the layer to satisfy the interface conditions determined by the selection of numerical flux, thereby eliminating or controlling the troublesome terms on the unit interface; and inside the layer, Gauß Lobatto projection is used to improve the convergence order of the diffusion term. On the basis of that, by selecting appropriate parameters in the numerical flux, we obtain the supercloseness result of almost $k+1$ order under an energy norm. Numerical experiments support our main theoretical conclusion.

math.NA↗

arXiv2024

Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm

This paper presents a new approach and algorithm for solving a class of constrained Bi-Level Optimization (BLO) problems in which the lower-level problem involves constraints coupling both upper-level and lower-level variables. Such problems have recently gained significant attention due to their broad applicability in machine learning. However, conventional gradient-based methods unavoidably rely on computationally intensive calculations related to the Hessian matrix. To address this challenge, we begin by devising a smooth proximal Lagrangian value function to handle the constrained lower-level problem. Utilizing this construct, we introduce a single-level reformulation for constrained BLOs that transforms the original BLO problem into an equivalent optimization problem with smooth constraints. Enabled by this reformulation, we develop a Hessian-free gradient-based algorithm-termed proximal Lagrangian Value function-based Hessian-free Bi-level Algorithm (LV-HBA)-that is straightforward to implement in a single loop manner. Consequently, LV-HBA is especially well-suited for machine learning applications. Furthermore, we offer non-asymptotic convergence analysis for LV-HBA, eliminating the need for traditional strong convexity assumptions for the lower-level problem while also being capable of accommodating non-singleton scenarios. Empirical results substantiate the algorithm's superior practical performance.

cs.LG↗

arXiv2024

Critical behavior of lattice gauge theory Rydberg simulators from effective Hamiltonians

We consider multileg ladders of Rydberg atoms which have been proposed as quantum simulators for the compact Abelian Higgs model (CAHM) in 1+1 dimensions [Y. Meurice, Phys. Rev. D 104, 094513 (2021)] and modified versions of theses simulators such as triangular prisms. Starting with the physical Hamiltonian for the analog simulator, we construct translation-invariant effective Hamiltonians by integrating over the simulator high-energy states produced by the blockade mechanism when some of the atoms are sufficiently close to each others. Remarkably, for all the simulators considered, the effective Hamiltonians have the three types of terms present for the CAHM (Electric field, matter charge and currents energies) but, in addition, terms quartic in the electric field. For the two leg ladder, these additional terms cannot be removed by fine-tuning the adjustable parameters of currently available devices. For positive detuning, the new terms create highly-degenerate vacua resulting in a very interesting phase diagram. Using numerical methods, we demonstrate the close correspondence between the physical simulator and the effective description for the ground state energy and real-time evolution. We discuss the phase diagram at fixed geometry with variable Rabi frequency and detuning and show that a rich variety of phases can be reached with potential interest in the context of QCD at finite density. We illustrate how the effective description can be used to design simulators with desirable properties from the point of view of constructing hybrid event generators.

quant-ph↗

arXiv2024

Moreau Envelope Based Difference-of-weakly-Convex Reformulation and Algorithm for Bilevel Programs

Bilevel programming has emerged as a valuable tool for hyperparameter selection, a central concern in machine learning. In a recent study by Ye et al. (2023), a value function-based difference of convex algorithm was introduced to address bilevel programs. This approach proves particularly powerful when dealing with scenarios where the lower-level problem exhibits convexity in both the upper-level and lower-level variables. Examples of such scenarios include support vector machines and $\ell_1$ and $\ell_2$ regularized regression. In this paper, we significantly expand the range of applications, now requiring convexity only in the lower-level variables of the lower-level program. We present an innovative single-level difference of weakly convex reformulation based on the Moreau envelope of the lower-level problem. We further develop a sequentially convergent Inexact Proximal Difference of Weakly Convex Algorithm (iP-DwCA). To evaluate the effectiveness of the proposed iP-DwCA, we conduct numerical experiments focused on tuning hyperparameters for kernel support vector machines on simulated data.

math.OC↗