arXiv subjects

Ke Zhang

Publications and source records attributed to Ke Zhang.

At least 163 records · Page 9Linked to original sources

arXiv2025

MoMuSE: Momentum Multi-modal Target Speaker Extraction for Real-time Scenarios with Impaired Visual Cues

Audio-visual Target Speaker Extraction (AV-TSE) aims to isolate the speech of a specific target speaker from an audio mixture using time-synchronized visual cues. In real-world scenarios, visual cues are not always available due to various impairments, which undermines the stability of AV-TSE. Despite this challenge, humans can maintain attentional momentum over time, even when the target speaker is not visible. In this paper, we introduce the Momentum Multi-modal target Speaker Extraction (MoMuSE), which retains a speaker identity momentum in memory, enabling the model to continuously track the target speaker. Designed for real-time inference, MoMuSE extracts the current speech window with guidance from both visual cues and dynamically updated speaker momentum. Experimental results demonstrate that MoMuSE exhibits significant improvement, particularly in scenarios with severe impairment of visual cues.

cs.SD↗

arXiv2025

MedCL: Learning Consistent Anatomy Distribution for Scribble-supervised Medical Image Segmentation

Curating large-scale fully annotated datasets is expensive, laborious, and cumbersome, especially for medical images. Several methods have been proposed in the literature that make use of weak annotations in the form of scribbles. However, these approaches require large amounts of scribble annotations, and are only applied to the segmentation of regular organs, which are often unavailable for the disease species that fall in the long-tailed distribution. Motivated by the fact that the medical labels have anatomy distribution priors, we propose a scribble-supervised clustering-based framework, called MedCL, to learn the inherent anatomy distribution of medical labels. Our approach consists of two steps: i) Mix the features with intra- and inter-image mix operations, and ii) Perform feature clustering and regularize the anatomy distribution at both local and global levels. Combined with a small amount of weak supervision, the proposed MedCL is able to segment both regular organs and challenging irregular pathologies. We implement MedCL based on SAM and UNet backbones, and evaluate the performance on three open datasets of regular structure (MSCMRseg), multiple organs (BTCV) and irregular pathology (MyoPS). It is shown that even with less scribble supervision, MedCL substantially outperforms the conventional segmentation methods. Our code is available at https://github.com/BWGZK/MedCL.

cs.CV↗

arXiv2025

A Multi-line Analysis of the Distribution and Excitation of CS and H$_2$CS in the HD 163296 Disk

The abundance and distribution of sulfur-bearing molecules in protoplanetary disks directly influences the composition and potential habitability of nascent planets in addition to providing powerful probes of the physical gas conditions in the disks themselves. Here, we present new and archival ALMA and SMA observations of CS and H$_2$CS, and their C$^{34}$S and H$_2$C$^{34}$S isotopologues, at high-angular resolution (${\approx}$0."2-0."4; 20-40 au) in the HD 163296 disk, which reveal a central cavity and multi-ringed emission structure. These observations comprise the most comprehensive, multi-line CS data in a planet-forming disk to date, spanning a wide range of excitation conditions from E$_{\rm{u}}$=7.1 K to 129.3 K, and include new detections of C$^{34}$S, H$_2$CS, and H$_2$C$^{34}$S in this system. Using these data, we derive spatially-resolved rotational temperature and column density profiles for all species. We find a column density ratio N(H$_2$CS)/N(CS) $\approx$ 0.5, which is comparable to that of the similar MWC 480 disk and suggests that organic sulfur compounds may constitute a large fraction of the volatile sulfur reservoir in disks around Herbig stars generally. We derive $^{32}$S/$^{34}$S ratios of ${\approx}$5 (CS/C$^{34}$S) and ${\approx}$2 (H$_2$CS/H$_2$C$^{34}$S) based on disk-averaged and spatially-resolved analyses. Both values are consistent across these two pairs of optically-thin molecules and are well-below the expected ISM ratio of ${\approx}$22, suggesting significant sulfur fractionation. We also constrain the CS emitting layer ($z/r\lesssim 0.1$) using the vertical separations of the disk surfaces in the channel maps and based on the known 2D gas structure of the HD 163296 disk combined with our excitation analysis.

astro-ph.EP↗

arXiv2025

LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents

Automated testing for REST APIs has become essential for ensuring the correctness and reliability of modern web services. While existing approaches primarily focus on detecting server crashes and error codes, they often overlook logical issues that arise due to evolving business logic and domain-specific requirements. To address this limitation, we propose LogiAgent, a novel approach for logical testing of REST systems. Built upon a large language model (LLM)-driven multi-agent framework, LogiAgent integrates a Test Scenario Generator, API Request Executor, and API Response Validator to collaboratively generate, execute, and validate API test scenarios. Unlike traditional testing methods that focus on status codes like 5xx, LogiAgent incorporates logical oracles that assess responses based on business logic, ensuring more comprehensive testing. The system is further enhanced by an Execution Memory component that stores historical API execution data for contextual consistency. We conduct extensive experiments across 12 real-world REST systems, demonstrating that LogiAgent effectively identifies 234 logical issues with an accuracy of 66.19%. Additionally, it basically excels in detecting server crashes and achieves superior test coverage compared to four state-of-the-art REST API testing tools. An ablation study confirms the significant contribution of LogiAgent's memory components to improving test coverage.

cs.SE↗

arXiv2025

A Survey on Foundation-Model-Based Industrial Defect Detection

As industrial products become abundant and sophisticated, visual industrial defect detection receives much attention, including two-dimensional and three-dimensional visual feature modeling. Traditional methods use statistical analysis, abnormal data synthesis modeling, and generation-based models to separate product defect features and complete defect detection. Recently, the emergence of foundation models has brought visual and textual semantic prior knowledge. Many methods are based on foundation models (FM) to improve the accuracy of detection, but at the same time, increase model complexity and slow down inference speed. Some FM-based methods have begun to explore lightweight modeling ways, which have gradually attracted attention and deserve to be systematically analyzed. In this paper, we conduct a systematic survey with comparisons and discussions of foundation model methods from different aspects and briefly review non-foundation model (NFM) methods recently published. Furthermore, we discuss the differences between FM and NFM methods from training objectives, model structure and scale, model performance, and potential directions for future exploration. Through comparison, we find FM methods are more suitable for few-shot and zero-shot learning, which are more in line with actual industrial application scenarios and worthy of in-depth research.

cs.CV↗

arXiv2025

Hedgehog-like spin texture in Sb-doped MnBi$_2$Te$_4$

We employ spin- and angle-resolved photoemission spectroscopy and circular-dichroism ARPES to systematically investigate the spin texture of Sb-doped MnBi$_2$Te$_4$. Our results display a hedgehog-like spin texture in this system which is signified by reversed-orienting out-of-plane spins at the Dirac gap. Our finding reveals the presence of time-reversal symmetry breaking, implying the possibility for realization of high-temperature quantum anomalous Hall effect.

cond-mat.mtrl-sci↗

arXiv2025

Emission from multiple molecular isotopologues in a high-inclination protoplanetary disk

We present a MIRI-MRS spectrum of the high-inclination protoplanetary disk around the solar-mass (K0) star MY Lup, obtained as part of the JWST Disk Infrared Spectral Chemistry Survey (JDISCS). The spectrum shows an unusually weak water emission spectrum for a disk around a star of its spectral type, but strong emission from CO$_2$, HCN, and isotopologues of both molecules. This includes the first ever detection of C$^{18}$O$^{16}$O and H$^{13}$CN in an inner disk, as well as tentative detections of C$^{17}$O$^{16}$O and HC$^{15}$N. Slab modeling provides molecular temperatures, column densities and emitting areas of the detected molecules. The emitting molecular gas is cold compared to that of other observed protoplanetary disk spectra. We estimate the isotopologue ratios of CO$_2$ and HCN, albeit with significant uncertainty. We suggest that the unusual spectrum of MY Lup arises from a combination of inner disk clearing, which removes emission from warm water, and its nearly edge-on inclination, which enhances line-of-sight column densities, although unusual chemistry may also be required. MY Lup's spectrum highlights the potential to detect and measure trace isotopologues to study isotopic fractionation in protoplanetary disks; observations at higher spectral resolving power is needed to constrain the isotopologue ratios to greater precision.

astro-ph.SR↗

arXiv2025

Smuggling unnoticed: Towards a 2D view of water and dust delivery to the inner regions of protoplanetary discs

Infrared spectroscopy, e.g., with JWST, provides a glimpse into the chemical inventory of the innermost region of protoplanetary discs, where terrestrial planets eventually form. The chemical make-up of regions inside snowlines is connected to the material drifting from the outer regions, which can be modeled with dust evolution models. However, infrared observations are limited by the high dust extinction in the inner disc, and only probes the abundances of gaseous species in the disc surface layers. As a result, the bulk mass of delivered volatiles is not directly relatable to what is measured through infrared spectra. In this paper, we investigate how the delivery of dust and ice after prolonged pebble drift affects the observable reservoir of water vapor in the inner disc. We develop a 1+1D approach based on dust evolution models to determine the delivery and distribution of vapor compared to the height of the $τ= 1$ surface in the dust continuum. We find that the observable column density of water vapor at wavelengths probed by JWST spans many orders of magnitude over time, exhibiting different radial profiles depending on dust properties, drift rate, and local processing. In the presence of a traffic-jam effect inside the snowline, the observable vapor reservoir appears constant in time despite the ongoing delivery by pebble drift, such that water is effectively smuggled unnoticed. Differences in measured column densities then originate not only from variations in bulk vapor content, but also from differences in the properties and distribution of dust particles.

astro-ph.EP↗

arXiv2024

The First JWST View of a 30-Myr-old Protoplanetary Disk Reveals a Late-stage Carbon-rich Phase

We present a JWST MIRI/MRS spectrum of the inner disk of WISE J044634.16$-$262756.1B (hereafter J0446B), an old ($\sim$34 Myr) M4.5 star but with hints of ongoing accretion. The spectrum is molecule-rich and dominated by hydrocarbons. We detect 14 molecular species (H$_2$, CH$_3$, CH$_4$, C$_2$H$_2$, $^{13}$CCH$_2$, C$_2$H$_4$, C$_2$H$_6$, C$_3$H$_4$, C$_4$H$_2$, C$_6$H$_6$, HCN, HC$_3$N, CO$_2$ and $^{13}$CO$_2$) and 2 atomic lines ([Ne II] and [Ar II]), all observed for the first time in a disk at this age. The detection of spatially unresolved H$_2$ and Ne gas strongly supports that J0446B hosts a long-lived primordial disk, rather than a debris disk. The marginal H$_2$O detection and the high C$_2$H$_2$/CO$_2$ column density ratio indicate that the inner disk of J0446B has a very carbon-rich chemistry, with a gas-phase C/O ratio $\gtrsim$2, consistent with what have been found in most primordial disks around similarly low-mass stars. In the absence of significant outer disk dust substructures, inner disks are expected to first become water-rich due to the rapid inward drift of icy pebbles, and evolve into carbon-rich as outer disk gas flows inward on longer timescales. The faint millimeter emission in such low-mass star disks implies that they may have depleted their outer icy pebble reservoir early and already passed the water-rich phase. Models with pebble drift and volatile transport suggest that maintaining a carbon-rich chemistry for tens of Myr likely requires a slowly evolving disk with $α-$viscosity $\lesssim10^{-4}$. This study represents the first detailed characterization of disk gas at $\sim$30 Myr, strongly motivating further studies into the final stages of disk evolution.

astro-ph.EP↗

arXiv2024

V-MIND: Building Versatile Monocular Indoor 3D Detector with Diverse 2D Annotations

The field of indoor monocular 3D object detection is gaining significant attention, fueled by the increasing demand in VR/AR and robotic applications. However, its advancement is impeded by the limited availability and diversity of 3D training data, owing to the labor-intensive nature of 3D data collection and annotation processes. In this paper, we present V-MIND (Versatile Monocular INdoor Detector), which enhances the performance of indoor 3D detectors across a diverse set of object classes by harnessing publicly available large-scale 2D datasets. By leveraging well-established monocular depth estimation techniques and camera intrinsic predictors, we can generate 3D training data by converting large-scale 2D images into 3D point clouds and subsequently deriving pseudo 3D bounding boxes. To mitigate distance errors inherent in the converted point clouds, we introduce a novel 3D self-calibration loss for refining the pseudo 3D bounding boxes during training. Additionally, we propose a novel ambiguity loss to address the ambiguity that arises when introducing new classes from 2D datasets. Finally, through joint training with existing 3D datasets and pseudo 3D bounding boxes derived from 2D datasets, V-MIND achieves state-of-the-art object detection performance across a wide range of classes on the Omni3D indoor dataset.

cs.CV↗

arXiv2024

Generic global diffusion for analytic uncoupled a priori unstable systems

We show that given a general uncoupled a priori unstable Hamiltonian \[ \frac12 p^2 + V(q) + G(I) + εh(p, q, I, φ, t), \] where $h$ is a generic Mañé analytic function and $ε$ is small enough, there is an orbit for which the momentum $I$ changes by any arbitrarily prescribed value. We call this phenomenon as global diffusion since the size of the change in $I$ is independent of both $ε$ and $h$. The fact that the pendulum and rotor variables are uncoupled is used essentially in our proof. The proof is based on simple and constructive geometrical methods, carefully studying the reduced Poincaré functions of the problem which generate the corresponding scattering maps.

math.DS↗

arXiv2024

Multi-Level Speaker Representation for Target Speaker Extraction

Target speaker extraction (TSE) relies on a reference cue of the target to extract the target speech from a speech mixture. While a speaker embedding is commonly used as the reference cue, such embedding pre-trained with a large number of speakers may suffer from confusion of speaker identity. In this work, we propose a multi-level speaker representation approach, from raw features to neural embeddings, to serve as the speaker reference cue. We generate a spectral-level representation from the enrollment magnitude spectrogram as a raw, low-level feature, which significantly improves the model's generalization capability. Additionally, we propose a contextual embedding feature based on cross-attention mechanisms that integrate frame-level embeddings from a pre-trained speaker encoder. By incorporating speaker features across multiple levels, we significantly enhance the performance of the TSE model. Our approach achieves a 2.74 dB improvement and a 4.94% increase in extraction accuracy on Libri2mix test set over the baseline.

eess.AS↗

arXiv2024

AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix

Adaptive optimizers, such as Adam, have achieved remarkable success in deep learning. A key component of these optimizers is the so-called preconditioning matrix, providing enhanced gradient information and regulating the step size of each gradient direction. In this paper, we propose a novel approach to designing the preconditioning matrix by utilizing the gradient difference between two successive steps as the diagonal elements. These diagonal elements are closely related to the Hessian and can be perceived as an approximation of the inner product between the Hessian row vectors and difference of the adjacent parameter vectors. Additionally, we introduce an auto-switching function that enables the preconditioning matrix to switch dynamically between Stochastic Gradient Descent (SGD) and the adaptive optimizer. Based on these two techniques, we develop a new optimizer named AGD that enhances the generalization performance. We evaluate AGD on public datasets of Natural Language Processing (NLP), Computer Vision (CV), and Recommendation Systems (RecSys). Our experimental results demonstrate that AGD outperforms the state-of-the-art (SOTA) optimizers, achieving highly competitive or significantly better predictive performance. Furthermore, we analyze how AGD is able to switch automatically between SGD and the adaptive optimizer and its actual effects on various scenarios. The code is available at https://github.com/intelligent-machine-learning/atorch/tree/main/atorch/optimizers.

cs.LG↗

arXiv2024

Water in protoplanetary disks with JWST-MIRI: spectral excitation atlas and radial distribution from temperature diagnostic diagrams and Doppler mapping

This work aims at providing fundamental general tools for the analysis of water spectra as observed in protoplanetary disks with JWST-MIRI. We analyze 25 high-quality spectra from the JDISC Survey reduced with asteroid calibrators as presented in Pontoppidan et al. (2024). First, we present a spectral atlas to illustrate the clustering of H$_2$O transitions from different upper level energies ($E_u$) and identify single (un-blended) transitions that provide the most reliable measurements. With that, we demonstrate two important excitation effects: the opacity saturation of ortho-para line pairs that overlap, and the non-LTE excitation of $v=1-1$ lines scattered across the $v=0-0$ rotational band. Second, we define a shorter list of fundamental lines spanning $E_u=$ 1500-6000 K to develop simple line-ratio diagnostic diagrams for the radial temperature distribution of water in inner disks, which can be interpreted using discrete temperature components or a radial gradient. Third, we report the detection of disk-rotation Doppler broadening of molecular lines, which confirms the radial distribution of water emission including, for the first time, the radially-extended $\approx$ 170-220 K reservoir close to the snowline. The combination of measured line ratios and broadening suggests that drift-dominated disks have shallower temperature gradients with an extended cooler disk surface enriched by ice sublimation. We also report the first detection of a H$_2$O-rich inner disk wind from narrow blue-shifted absorption in the ro-vibrational lines. We summarize these findings and tools into a general recipe to make the study of water in planet-forming regions reliable, effective, and sustainable for samples of $> 100$ disks.

astro-ph.EP↗

arXiv2024

Sharpness-Aware Minimization Revisited: Weighted Sharpness as a Regularization Term

Deep Neural Networks (DNNs) generalization is known to be closely related to the flatness of minima, leading to the development of Sharpness-Aware Minimization (SAM) for seeking flatter minima and better generalization. In this paper, we revisit the loss of SAM and propose a more general method, called WSAM, by incorporating sharpness as a regularization term. We prove its generalization bound through the combination of PAC and Bayes-PAC techniques, and evaluate its performance on various public datasets. The results demonstrate that WSAM achieves improved generalization, or is at least highly competitive, compared to the vanilla optimizer, SAM and its variants. The code is available at https://github.com/intelligent-machine-learning/atorch/tree/main/atorch/optimizers.

cs.LG↗

arXiv2024

Mono-drive single-sideband modulation via optical delay lines on thin-film lithium niobate

Optical single-sideband (SSB) modulation features high spectral efficiency, substantial dispersion tolerance, and straightforward detection, making it a versatile technology for applications in optical communications, microwave photonics, optical sensing, satellite communication, etc. However, conventional SSB generators typically require two radio-frequency (RF) signals with a 90° phase difference to drive a pair of parallel phase or amplitude modulators, resulting in high system complexity and low power efficiency. In this paper, we propose and realize a simplified SSB generation scheme necessitating only a single RF drive, by achieving effective RF phase shift using on-chip optical delay lines. This approach not only reduces system complexity and saves energy consumption by 3 dB, but also enables easy scalability to higher frequencies. We demonstrate both full-carrier SSB (FC-SSB) and carrier-suppressed SSB (CS-SSB) modulation on thin-film lithium niobate platform. For FC-SSB, we show a maximum sideband suppression of 22.1 dB at 50 GHz and apply it to address the frequency-selective power fading problem in optical communication systems. For CS-SSB, we show a maximum sideband suppression of 22.5 dB and a sideband-to-carrier suppression of 16.9 dB at 50 GHz, which can act as an optical frequency shifter by sweeping the modulation frequencies. Moreover, the shifted optical frequency can be transferred back to the electrical domain by beating with a reference signal generated via a phase modulator on the same chip, achieving broadband RF frequency shifting from a maximum of 50 GHz down to 1 GHz. Our simple, power-efficient, and low-cost SSB modulation scheme could provide an effective solution for future high-frequency direct detection-based communication systems, frequency-modulated continuous wave radar/LiDAR, optical vector network analyzers, and microwave photonics systems.

physics.optics↗

arXiv2024

MA^2: A Self-Supervised and Motion Augmenting Autoencoder for Gait-Based Automatic Disease Detection

Ground reaction force (GRF) is the force exerted by the ground on a body in contact with it. GRF-based automatic disease detection (ADD) has become an emerging medical diagnosis method, which aims to learn and identify disease patterns corresponding to different gait pressures based on deep learning methods. Although existing ADD methods can save doctors time in making diagnoses, training deep models still struggles with the cost caused by the labeling engineering for a large number of gait diagnostic data for subjects. On the other hand, the accuracy of the deep model under the unified benchmark GRF dataset and the generalization ability on scalable gait datasets need to be further improved. To address these issues, we propose MA2, a GRF-based self-supervised and motion augmenting auto-encoder, which models the ADD task as an encoder-decoder paradigm. In the encoder, we introduce an embedding block including the 3-layer 1D convolution for extracting the token and a mask generator to randomly mask out the sequence of tokens to maximize the model's potential to capture high-level, discriminative, intrinsic representations. whereafter, the decoder utilizes this information to reconstruct the pixel sequence of the origin input and calculate the reconstruction loss to optimize the network. Moreover, the backbone of an auto-encoder is multi-head self-attention that can consider the global information of the token from the input, not just the local neighborhood. This allows the model to capture generalized contextual information. Extensive experiments demonstrate MA2 has SOTA performance of 90.91% accuracy on 1% limited pathological GRF samples with labels, and good generalization ability of 78.57% accuracy on scalable Parkinson disease dataset.

physics.bio-ph↗

arXiv2024

DFabric: Scaling Out Data Parallel Applications with CXL-Ethernet Hybrid Interconnects

Emerging interconnects, such as CXL and NVLink, have been integrated into the intra-host topology to scale more accelerators and facilitate efficient communication between them, such as GPUs. To keep pace with the accelerator's growing computing throughput, the interconnect has seen substantial enhancement in link bandwidth, e.g., 256GBps for CXL 3.0 links, which surpasses Ethernet and InfiniBand network links by an order of magnitude or more. Consequently, when data-intensive jobs, such as LLM training, scale across multiple hosts beyond the reach limit of the interconnect, the performance is significantly hindered by the limiting bandwidth of the network infrastructure. We address the problem by proposing DFabric, a two-tier interconnect architecture. We address the problem by proposing DFabric, a two-tier interconnect architecture. First, DFabric disaggregates rack's computing units with an interconnect fabric, i.e., CXL fabric, which scales at rack-level, so that they can enjoy intra-rack efficient interconnecting. Second, DFabric disaggregates NICs from hosts, and consolidates them to form a NIC pool with CXL fabric. By providing sufficient aggregated capacity comparable to interconnect bandwidth, the NIC pool bridges efficient communication across racks or beyond the reach limit of interconnect fabric. However, the local memory accessing becomes the bottleneck when enabling each host to utilize the NIC pool efficiently. To the end, DFabric builds a memory pool with sufficient bandwidth by disaggregating host local memory and adding more memory devices. We have implemented a prototype of DFabric that can run applications transparently. We validated its performance gain by running various microbenchmarks and compute-intensive applications such as DNN and graph.

cs.DC↗