arXiv Science⌕ Search

arXiv subjects

Jie Ma

Publications and source records attributed to Jie Ma.

At least 163 records · Page 9Linked to original sources

SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentation

Image segmentation plays an important role in vision understanding. Recently, the emerging vision foundation models continuously achieved superior performance on various tasks. Following such success, in this paper, we prove that the Segment Anything Model 2 (SAM2) can be a strong encoder for U-shaped segmentation models. We propose a simple but effective framework, termed SAM2-UNet, for versatile image segmentation. Specifically, SAM2-UNet adopts the Hiera backbone of SAM2 as the encoder, while the decoder uses the classic U-shaped design. Additionally, adapters are inserted into the encoder to allow parameter-efficient fine-tuning. Preliminary experiments on various downstream tasks, such as camouflaged object detection, salient object detection, marine animal segmentation, mirror detection, and polyp segmentation, demonstrate that our SAM2-UNet can simply beat existing specialized state-of-the-art methods without bells and whistles. Project page: \url{https://github.com/WZH0120/SAM2-UNet}.

cs.CV↗

Kohayakawa-Nagle-R{ö}dl-Schacht conjecture for subdivisions

In this paper, we study the well-known Kohayakawa-Nagle-R{ö}dl-Schacht (KNRS) conjecture, with a specific focus on graph subdivisions. The KNRS conjecture asserts that for any graph $H$, locally dense graphs contain asymptotically at least the number of copies of $H$ found in a random graph with the same edge density. We prove the following results about $k$-subdivisions of graphs (obtained by replacing edges with paths of length $k+1$): (1). If $H$ satisfies the KNRS conjecture, then its $(2k-1)$-subdivision satisfies Sidorenko's conjecture, extending a prior result of Conlon, Kim, Lee and Lee; (2). If $H$ satisfies the KNRS conjecture, then its $2k$-subdivision satisfies a constant-fraction version of the KNRS conjecture; (3). If $H$ is regular and satisfies the KNRS conjecture, then its $2k$-subdivision also satisfies the KNRS conjecture. These findings imply that all balanced subdivisions of cliques satisfy the KNRS conjecture, improving upon a recent result of Bradač, Sudakov and Wigerson. Our work provides new insights into this pivotal conjecture in extremal graph theory.

math.CO↗

Exact results on traces of sets

For non-negative integers $n$, $m$, $a$ and $b$, we write $\left( n,m \right) \rightarrow \left( a,b \right)$ if for every family $\mathcal{F}\subseteq 2^{[n]}$ with $|\mathcal{F}|\geqslant m$ there is an $a$-element set $T\subseteq [n]$ such that $\left| \mathcal{F}_{\mid T} \right| \geqslant b$, where $\mathcal{F}_{\mid T}=\{ F \cap T : F \in \mathcal{F} \}$. A longstanding problem in extremal set theory asks to determine $m(s)=\lim_{n\rightarrow +\infty}\frac{m(n,s)}{n}$, where $m(n,s)$ denotes the maximum integer $m$ such that $\left( n,m \right) \rightarrow \left( n-1,m-s \right)$ holds for non-negatives $n$ and $s$. In this paper, we establish the exact value of $m(2^{d-1}-c)$ for all $1\leqslant c\leqslant d$ whenever $d\geqslant 50$, thereby solving an open problem posed by Piga and Schülke. To be precise, we show that $$m(n,2^{d-1}-c)=\frac{2^{d}-c}{d}n \mbox{ for } 1\leq c\leq d-1 \mbox{ and } d\mid n, \mbox{ and } m(n,2^{d-1}-d)=\frac{2^{d}-d-0.5}{d}n \mbox{ for } 2d\mid n $$ holds for $d\geq 50$. Furthermore, we provide a proof that confirms a conjecture of Frankl and Watanabe from 1994, demonstrating that $m(11)=5.3$.

math.CO↗

Finding irregular subgraphs via local adjustments

For a graph $H$, let $m(H,k)$ denote the number of vertices of degree $k$ in $H$. A conjecture of Alon and Wei states that for any $d\geq 3$, every $n$-vertex $d$-regular graph contains a spanning subgraph $H$ satisfying $|m(H,k)-\frac{n}{d+1}|\leq 2$ for every $0\leq k \leq d$. This holds easily when $d\leq 2$. An asymptotic version of this conjecture was initially established by Frieze, Gould, Karoński and Pfender, subsequently improved by Alon and Wei, and most recently enhanced by Fox, Luo and Pham, approaching its complete range. All of these approaches relied on probabilistic methods. In this paper, we provide a novel framework to study this conjecture, based on localized deterministic techniques which we call local adjustments. We prove two main results. Firstly, we show that every $n$-vertex $d$-regular graph contains a spanning subgraph $H$ satisfying $|m(H,k)-\frac{n}{d+1}|\leq 2d^2$ for all $0\leq k \leq d$, which provides the first bound independent of the value of $n$. Secondly, we confirm the case $d=3$ of the Alon-Wei Conjecture in a strong form. Both results can be generalized to multigraphs and yield efficient algorithms for finding the desired subgraphs $H$. Furthermore, we explore a generalization of the Alon-Wei Conjecture for multigraphs and its connection to the Faudree-Lehel Conjecture concerning irregularity strength.

math.CO↗

Observation of higher-order time-dislocation topological modes

Topological dislocation modes resulting from the interplay between spatial dislocations and momentum-space topology have recently attracted significant interest. Here, we theoretically and experimentally demonstrate time-dislocation topological modes which are induced by the interplay between temporal dislocations and Floquet-band topology. By utilizing an extra physical dimension to represent the frequency-space lattice, we implement a two-dimensional Floquet higher-order topological phase and observe time-dislocation induced $π$-mode topological corner modes in a three-dimensional circuit metamaterial. Intriguingly, the realized time-dislocation topological modes exhibit spatial localization at the temporal dislocation, despite homogeneous in-plane lattice couplings across it. Our study opens a new avenue to explore the topological phenomena enabled by the interplay between real-space, time-space and momentum-space topology.

cond-mat.mes-hall↗

AlignSAM: Aligning Segment Anything Model to Open Context via Reinforcement Learning

Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class agnostic and heavily relies on user-provided prompts to segment objects of interest. Adapting this method to diverse tasks is crucial for accurate target identification and to avoid suboptimal segmentation results. In this paper, we propose a novel framework, termed AlignSAM, designed for automatic prompting for aligning SAM to an open context through reinforcement learning. Anchored by an agent, AlignSAM enables the generality of the SAM model across diverse downstream tasks while keeping its parameters frozen. Specifically, AlignSAM initiates a prompting agent to iteratively refine segmentation predictions by interacting with the foundational model. It integrates a reinforcement learning policy network to provide informative prompts to the foundational models. Additionally, a semantic recalibration module is introduced to provide fine-grained labels of prompts, enhancing the model's proficiency in handling tasks encompassing explicit and implicit semantics. Experiments conducted on various challenging segmentation tasks among existing foundation models demonstrate the superiority of the proposed AlignSAM over state-of-the-art approaches. Project page: \url{https://github.com/Duojun-Huang/AlignSAM-CVPR2024}.

cs.CV↗

Diffusion-RSCC: Diffusion Probabilistic Model for Change Captioning in Remote Sensing Images

Remote sensing image change captioning (RSICC) aims at generating human-like language to describe the semantic changes between bi-temporal remote sensing image pairs. It provides valuable insights into environmental dynamics and land management. Unlike conventional change captioning task, RSICC involves not only retrieving relevant information across different modalities and generating fluent captions, but also mitigating the impact of pixel-level differences on terrain change localization. The pixel problem due to long time span decreases the accuracy of generated caption. Inspired by the remarkable generative power of diffusion model, we propose a probabilistic diffusion model for RSICC to solve the aforementioned problems. In training process, we construct a noise predictor conditioned on cross modal features to learn the distribution from the real caption distribution to the standard Gaussian distribution under the Markov chain. Meanwhile, a cross-mode fusion and a stacking self-attention module are designed for noise predictor in the reverse process. In testing phase, the well-trained noise predictor helps to estimate the mean value of the distribution and generate change captions step by step. Extensive experiments on the LEVIR-CC dataset demonstrate the effectiveness of our Diffusion-RSCC and its individual components. The quantitative results showcase superior performance over existing methods across both traditional and newly augmented metrics. The code and materials will be available online at https://github.com/Fay-Y/Diffusion-RSCC.

cs.CV↗

General Purpose Verification for Chain of Thought Prompting

Many of the recent capabilities demonstrated by Large Language Models (LLMs) arise primarily from their ability to exploit contextual information. In this paper, we explore ways to improve reasoning capabilities of LLMs through (1) exploration of different chains of thought and (2) validation of the individual steps of the reasoning process. We propose three general principles that a model should adhere to while reasoning: (i) Relevance, (ii) Mathematical Accuracy, and (iii) Logical Consistency. We apply these constraints to the reasoning steps generated by the LLM to improve the accuracy of the final generation. The constraints are applied in the form of verifiers: the model itself is asked to verify if the generated steps satisfy each constraint. To further steer the generations towards high-quality solutions, we use the perplexity of the reasoning steps as an additional verifier. We evaluate our method on 4 distinct types of reasoning tasks, spanning a total of 9 different datasets. Experiments show that our method is always better than vanilla generation, and, in 6 out of the 9 datasets, it is better than best-of N sampling which samples N reasoning chains and picks the lowest perplexity generation.

cs.CL↗

Generalized Aubry-Andre-Harper Models in Optical Superlattices

Ultracold atoms trapped in optical superlattices provide a simple platform for realizing the seminal Aubry-André-Harper (AAH) model. However, the periodic modulations on the nearest-neighbour hoppings have been ignored in this model. In this paper, we find that optical superlattice system actually can be approximately described by a generalized AAH model in the case of $V_1\gg V_2$, with periodic modulations on both on-site energies and nearest-neighbour hoppings, supporting much richer topological properties that are absent in the standard AAH model. Specifically, by calculating Chern numbers and topological edge states, we show that the generalized AAH model possesses multifarious topological phases and topological phase transitions, as compared to the standard AAH model only supporting a single topological phase. Our findings can open up more opportunities for using optical superlattices to study topological and localization physics.

cond-mat.quant-gas↗

Topological optical Raman superlattices

Topological phases of ultracold atoms recently have been intensively studied both in optical superlattices and Raman lattices. However, the topological features induced by the interplay between such two lattices remain largely unexplored. Here, we present an optical Raman superlattice system that incorporates an optical superlattice and a Raman superlattice. The Raman superlattice presented here supports tunable dimerized spin-orbit couplings and staggered on-site spin flips. We find that such system respects a spin-rotation symmetry and has much richer topological properties. Specifically, we show that various topological phases could emerge in the optical Raman superlattice, such as four different chiral topological insulator phases and two different quantum spin Hall insulator phases, identified by spin winding and spin Chern numbers respectively. We also demonstrate that the spin-dependent topological invariants could be directly measured by quench dynamics.

cond-mat.quant-gas↗

A hypergraph bipartite Turán problem with odd uniformity

In this paper, we investigate the hypergraph Turán number $ex(n,K^{(r)}_{s,t})$. Here, $K^{(r)}_{s,t}$ denotes the $r$-uniform hypergraph with vertex set $\left(\cup_{i\in [t]}X_i\right)\cup Y$ and edge set $\{X_i\cup \{y\}: i\in [t], y\in Y\}$, where $X_1,X_2,\cdots,X_t$ are $t$ pairwise disjoint sets of size $r-1$ and $Y$ is a set of size $s$ disjoint from each $X_i$. This study was initially explored by Erdős and has since received substantial attention in research. Recent advancements by Bradač, Gishboliner, Janzer and Sudakov have greatly contributed to a better understanding of this problem. They proved that $ex(n,K_{s,t}^{(r)})=O_{s,t}(n^{r-\frac{1}{s-1}})$ holds for any $r\geq 3$ and $s,t\geq 2$. They also provided constructions illustrating the tightness of this bound if $r\geq 4$ is {\it even} and $t\gg s\geq 2$. Furthermore, they proved that $ex(n,K_{s,t}^{(3)})=O_{s,t}(n^{3-\frac{1}{s-1}-\varepsilon_s})$ holds for $s\geq 3$ and some $ε_s>0$. Addressing this intriguing discrepancy between the behavior of this number for $r=3$ and the even cases, Bradač et al. post a question of whether \begin{equation*} \mbox{$ex(n,K_{s,t}^{(r)})= O_{r,s,t}(n^{r-\frac{1}{s-1}- \varepsilon})$ holds for odd $r\geq 5$ and any $s\geq 3$.} \end{equation*} In this paper, we provide an affirmative answer to this question, utilizing novel techniques to identify regular and dense substructures. This result highlights a rare instance in hypergraph Turán problems where the solution depends on the parity of the uniformity.

math.CO↗

Benchmarking reconstructive spectrometer with multi-resonant cavities

Recent years have seen the rapid development of miniaturized reconstructive spectrometers (RSs), yet they still confront a range of technical challenges, such as bandwidth/resolution ratio, sensing speed, and/or power efficiency. Reported RS designs often suffer from insufficient decorrelation between sampling channels, which results in limited compressive sampling efficiency, in essence, due to inadequate engineering of sampling responses. This in turn leads to poor spectral-pixel-to-channel ratios (SPCRs), typically restricted at single digits. So far, there lacks a general guideline for manipulating RS sampling responses for the effectiveness of spectral information acquisition. In this study, we shed light on a fundamental parameter from the compressive sensing theory - the average mutual correlation coefficient v - and provide insight into how it serves as a critical benchmark in RS design with regards to the SPCR and reconstruction accuracy. To this end, we propose a novel RS design with multi-resonant cavities, consisting of a series of partial reflective interfaces. Such multi-cavity configuration offers an expansive parameter space, facilitating the superlative optimization of sampling matrices with minimized v. As a proof-of-concept demonstration, a single-shot, dual-band RS is implemented on a SiN platform, tailored for capturing signature spectral shapes across different wavelength regions, with customized photonic crystal nanobeam mirrors. Experimentally, the device demonstrates an overall operation bandwidth of 270 nm and a <0.5 nm resolution with only 15 sampling channels per band, leading to a record high SPCR of 18.0. Moreover, the proposed multi-cavity design can be readily adapted to various photonic platforms. For instance, we showcase that by employing multi-layer coatings, an ultra-broadband RS can be optimized to exhibit a 700 nm bandwidth with an SPCR of over 100.

physics.optics↗

Multi-band reflectance and shadowing of RX J1604.3-2130 protoplanetary disk in scattered light

Context.Spatially-resoved cicrumstellar disk spectrum and composition can provide valuable insights into the bulk composition of forming planets, as well as the mineralogical signatures that emerge during and after planet formation. Aims. We aim to systemically extract the RX~J1604.3-213010 (J1604 hereafter) protoplanetary disk in high-contrast imaging observations, and obtain its multi-band reflectance in visible to near-infrared wavelengths. Methods. We obtained coronagraphic observations of J1604 from the Keck Observatory's NIRC2 instrument, and archival data from the Very Large Telescope's SPHERE instrument. Using archival images to remove star light and speckles, we recovered the J1604 disk and obtained its surface brightness using forward modeling. Together with polarization data, we obtained the relative reflectance of the disk in $R$, $J$, $H$ ($H2$ and $H3$), $K$ ($K1$ and $K2$), and $L'$ bands spanning two years. Results. Relative to the J1604 star, the resolved disk has a reflectance of ${\sim}10^{-1}$~arcsec$^{-2}$ in $R$ through $H$ bands and ${\sim}10^{-2}$~arcsec$^{-2}$ in $K$ and $L'$ bands, showing a blue color. Together with other systems, we summarized the multi-band reflectance for 9 systems. We also identified varying disk geometry structure, and a shadow that vanished between June and August in 2015. Conclusions. Motivated by broad-band observations, the deployment of cutting-edge technologies could yield higher-resolution reflection spectra, thereby informing the dust composition of disks in scattered light in the future. With multi-epoch observations, variable shadows have the potential to deepen insights into the dynamic characteristics of inner disk regions.

astro-ph.EP↗

Robust Visual Question Answering: Datasets, Methods, and Future Challenges

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to memorize biases present in the training data rather than learning proper behaviors, such as grounding images before predicting answers. Therefore, these methods usually achieve high in-distribution but poor out-of-distribution performance. In recent years, various datasets and debiasing methods have been proposed to evaluate and enhance the VQA robustness, respectively. This paper provides the first comprehensive survey focused on this emerging fashion. Specifically, we first provide an overview of the development process of datasets from in-distribution and out-of-distribution perspectives. Then, we examine the evaluation metrics employed by these datasets. Thirdly, we propose a typology that presents the development process, similarities and differences, robustness comparison, and technical features of existing debiasing methods. Furthermore, we analyze and discuss the robustness of representative vision-and-language pre-training models on VQA. Finally, through a thorough review of the available literature and experimental analysis, we discuss the key areas for future research from various viewpoints.

cs.CV↗

Weak rainbow saturation numbers of graphs

For a fixed graph $H$, we say that an edge-colored graph $G$ is \emph{weakly $H$-rainbow saturated} if there exists an ordering $e_1, e_2, \ldots, e_m$ of $E\left(\overline{G}\right)$ such that, for any list $c_1, c_2, \ldots, c_m$ of pairwise distinct colors from $\mathbb{N}$, the non-edges $e_i$ in color $c_i$ can be added to $G$, one at a time, so that every added edge creates a new rainbow copy of $H$. The \emph{weak rainbow saturation number} of $H$, denoted by $rwsat(n,H)$, is the minimum number of edges in a weakly $H$-rainbow saturated graph on $n$ vertices. In this paper, we show that for any non-empty graph $H$, the limit $\lim_{n\to \infty} \frac{rwsat(n, H)}{n}$ exists. This answers a question of Behague, Johnston, Letzter, Morrison and Ogden [{\it SIAM J. Discrete Math.} (2023)]. We also provide lower and upper bounds on this limit, and in particular, we show that this limit is nonzero if and only if $H$ contains no pendant edges.

math.CO↗

Counting triangles in regular graphs

In this paper, we investigate the minimum number of triangles, denoted by $t(n,k)$, in $n$-vertex $k$-regular graphs, where $n$ is an odd integer and $k$ is an even integer. The well-known Andrásfai-Erdős-Sós Theorem has established that $t(n,k)>0$ if $k>\frac{2n}{5}$. In a striking work, Lo has provided the exact value of $t(n,k)$ for sufficiently large $n$, given that $\frac{2n}{5}+\frac{12\sqrt{n}}{5}<k<\frac{n}{2}$. Here, we bridge the gap between the aforementioned results by determining the precise value of $t(n,k)$ in the entire range $\frac{2n}{5}<k<\frac{n}{2}$. This confirms a conjecture of Cambie, de Joannis de Verclos, and Kang for sufficiently large $n$.

math.CO↗

Static magnetic order with strong quantum fluctuations in spin-1/2 honeycomb magnet Na2Co2TeO6

Kitaev interactions, arising from the interplay of frustration and bond anisotropy, can lead to strong quantum fluctuations and, in an ideal case, to a quantum-spin-liquid state. However, in many nonideal materials, spurious non-Kitaev interactions typically promote a zigzag antiferromagnetic order in the d-orbital transition metal compounds. By combining neutron scattering with muon-spin rotation and relaxation techniques, we provide new insights into the exotic properties of Na2Co2TeO6, a candidate Kitaev material. Below TN, the zero-field muon-spin relaxation rate becomes almost constant (at 0.45 us-1). We attribute this temperature-independent muon-spin relaxation rate to the strong quantum fluctuations, as well as to the frustrated Kitaev interactions. As the magnetic field increases, neutron scattering data indicate a much broader spin-wave-excitation gap at the K-point. Therefore, quantum fluctuations seem not only robust, but are even enhanced by the applied magnetic field. Our findings provide valuable hints for understanding the onset of the quantum-spin-liquid state in Kitaev materials.

cond-mat.str-el↗

Laser frequency stabilization and photoacoustic detection based on the tapered fiber coupled crystalline resonator

We demonstrate laser frequency stabilization using a high-Q MgF2 crystalline whispering gallery mode resonator coupled with a tapered fiber. We discovered that the tapered fiber, acting as a microcantilever, exhibits mechanical resonance characteristics that is capable of transmitting acoustic perturbations to the frequency locking loop. Both experimental and theoretical investigations into the influence of external acoustic waves on the coupling system were conducted. After acoustic isolation, the locked laser exhibits a minimum frequency noise of 0.4Hz2/Hz at 7kHz and an integral linewidth of 68Hz (0.1s integration time). Benefiting from the ultralow frequency noise of the stabilized laser, it achieves a minimum noise equivalent acoustic signal level of 4.76*10-4 Pa/Hz1/2. Our results not only facilitate the realization of ultralow noise lasers but also serves as a novel and sensitive photoacoustic detector.

physics.optics↗