arXiv subjects

Ke Zhang

Publications and source records attributed to Ke Zhang.

At least 217 records · Page 12Linked to original sources

arXiv2024

PPS-QMIX: Periodically Parameter Sharing for Accelerating Convergence of Multi-Agent Reinforcement Learning

Training for multi-agent reinforcement learning(MARL) is a time-consuming process caused by distribution shift of each agent. One drawback is that strategy of each agent in MARL is independent but actually in cooperation. Thus, a vertical issue in multi-agent reinforcement learning is how to efficiently accelerate training process. To address this problem, current research has leveraged a centralized function(CF) across multiple agents to learn contribution of the team reward for each agent. However, CF based methods introduce joint error from other agents in estimation of value network. In so doing, inspired by federated learning, we propose three simple novel approaches called Average Periodically Parameter Sharing(A-PPS), Reward-Scalability Periodically Parameter Sharing(RS-PPS) and Partial Personalized Periodically Parameter Sharing(PP-PPS) mechanism to accelerate training of MARL. Agents share Q-value network periodically during the training process. Agents which has same identity adapt collected reward as scalability and update partial neural network during period to share different parameters. We apply our approaches in classical MARL method QMIX and evaluate our approaches on various tasks in StarCraft Multi-Agent Challenge(SMAC) environment. Performance of numerical experiments yield enormous enhancement, with an average improvement of 10\%-30\%, and enable to win tasks that QMIX cannot. Our code can be downloaded from https://github.com/ColaZhang22/PPS-QMIX

cs.AI↗

arXiv2024

Deep Efficient Private Neighbor Generation for Subgraph Federated Learning

Behemoth graphs are often fragmented and separately stored by multiple data owners as distributed subgraphs in many realistic applications. Without harming data privacy, it is natural to consider the subgraph federated learning (subgraph FL) scenario, where each local client holds a subgraph of the entire global graph, to obtain globally generalized graph mining models. To overcome the unique challenge of incomplete information propagation on local subgraphs due to missing cross-subgraph neighbors, previous works resort to the augmentation of local neighborhoods through the joint FL of missing neighbor generators and GNNs. Yet their technical designs have profound limitations regarding the utility, efficiency, and privacy goals of FL. In this work, we propose FedDEP to comprehensively tackle these challenges in subgraph FL. FedDEP consists of a series of novel technical designs: (1) Deep neighbor generation through leveraging the GNN embeddings of potential missing neighbors; (2) Efficient pseudo-FL for neighbor generation through embedding prototyping; and (3) Privacy protection through noise-less edge-local-differential-privacy. We analyze the correctness and efficiency of FedDEP, and provide theoretical guarantees on its privacy. Empirical results on four real-world datasets justify the clear benefits of proposed techniques.

cs.LG↗

arXiv2024

High-contrast JWST-MIRI spectroscopy of planet-forming disks for the JDISC Survey

The JWST Disk Infrared Spectral Chemistry Survey (JDISCS) aims to understand the evolution of the chemistry of inner protoplanetary disks using the Mid-InfraRed Instrument (MIRI) on the James Webb Space Telescope (JWST). With a growing sample of >30 disks, the survey implements a custom method to calibrate the MIRI Medium Resolution Spectrometer (MRS) to contrasts of better than 1:300 across its 4.9-28 micron spectral range. This is achieved using observations of Themis-family asteroids as precise empirical reference sources. High spectral contrast enables precise retrievals of physical parameters, searches for rare molecular species and isotopologues, and constraints on the inventories of carbon- and nitrogen-bearing species. JDISCS also offers significant improvements to the MRS wavelength and resolving power calibration. We describe the JDISCS calibrated data and demonstrate its quality using observations of the disk around the solar-mass young star FZ Tau. The FZ Tau MIRI spectrum is dominated by strong emission from warm water vapor. We show that the water and CO line emission originates from the disk surface and traces a range of gas temperatures of ~500-1500 K. We retrieve parameters for the observed CO and H2O lines, and show that they are consistent with a radial distribution represented by two temperature components. A high water abundance of n(H2O)~10^-4 fills the disk surface at least out to the 350 K isotherm at 1.5 au. We search the FZ Tau environs for extended emission detecting a large (radius of ~300 au) ring of emission from H2 gas surrounding FZ Tau, and discuss its origin.

astro-ph.EP↗

arXiv2024

GMLake: Efficient and Transparent GPU Memory Defragmentation for Large-scale DNN Training with Virtual Memory Stitching

Large-scale deep neural networks (DNNs), such as large language models (LLMs), have revolutionized the artificial intelligence (AI) field and become increasingly popular. However, training or fine-tuning such models requires substantial computational power and resources, where the memory capacity of a single acceleration device like a GPU is one of the most important bottlenecks. Owing to the prohibitively large overhead (e.g., $10 \times$) of GPUs' native memory allocator, DNN frameworks like PyTorch and TensorFlow adopt a caching allocator that maintains a memory pool with a splitting mechanism for fast memory (de)allocation. Unfortunately, the caching allocator's efficiency degrades quickly for popular memory reduction techniques such as recomputation, offloading, distributed training, and low-rank adaptation. The primary reason is that those memory reduction techniques introduce frequent and irregular memory (de)allocation requests, leading to severe fragmentation problems for the splitting-based caching allocator. To mitigate this fragmentation problem, we propose a novel memory allocation framework based on low-level GPU virtual memory management called GPU memory lake (GMLake). GMLake employs a novel virtual memory stitching (VMS) mechanism, which can fuse or combine non-contiguous memory blocks with a virtual memory address mapping. GMLake can reduce an average of 9.2 GB (up to 25 GB) GPU memory usage and 15% (up to 33% ) fragmentation among eight LLM models on GPU A100 with 80 GB memory. GMLake is completely transparent to the DNN models and memory reduction techniques and ensures the seamless execution of resource-intensive deep-learning tasks. We have open-sourced GMLake at https://github.com/intelligent-machine-learning/glake/tree/main/GMLake.

cs.DC↗

arXiv2024

Integrated lithium niobate microwave photonic processing engine

Integrated microwave photonics is an intriguing field that leverages integrated photonic technologies for the generation, transmission, and manipulation of microwave signals in chip-scale optical systems. In particular, ultrafast processing and computation of analog electronic signals in the optical domain with high fidelity and low latency could enable a variety of applications such as MWP filters, microwave signal processing, and image recognition. An ideal photonic platform for achieving these integrated MWP processing tasks shall simultaneously offer an efficient, linear and high-speed electro-optic modulation block to faithfully perform microwave-optic conversion at low power, and a low-loss functional photonic network that can be configured for a variety of signal processing tasks, as well as large-scale, low-cost manufacturability to monolithically integrate the two building blocks on the same chip. In this work, we demonstrate such an integrated MWP processing engine based on a thin-film lithium niobate platform capable of performing multi-purpose processing and computation tasks of analog signals up to 92 giga samples per second at CMOS-compatible voltages. We demonstrate high-speed analog computation, i.e., first- and second-order temporal integration and differentiation with computing accuracies up to 98.1 %, and deploy these functions to showcase three proof-of-concept applications, namely, ordinary differential equation solving, ultra-wideband signal generation and high-speed edge detection of images. We further leverage the image edge detector to enable a photonic-assisted image segmentation model that could effectively outline the boundaries of melanoma lesion in medical diagnostic images, achieving orders of magnitude faster processing speed and lower power consumption than conventional electronic processors.

physics.optics↗

arXiv2024

Spectral engineering of optical microresonators in anisotropic lithium niobate crystal

On-chip optical microresonators are essential building blocks in integrated optics. The ability to arbitrarily engineer their resonant frequencies is crucial for exploring novel physics in synthetic frequency dimensions and practical applications like nonlinear optical parametric processes and dispersion-engineered frequency comb generation. Photonic crystal ring (PhCR) resonators are a versatile tool for such arbitrary frequency engineering, by controllably creating mode splitting at selected resonances. To date, these PhCRs have mostly been demonstrated in isotropic photonic materials, while such engineering could be significantly more complicated in anisotropic platforms that often offer more fruitful optical properties. Here, we realize the spectral engineering of chip-scale optical microresonators in the anisotropic lithium niobate (LN) crystal by a gradient design that precisely compensates for variations in both refractive index and perturbation strength. We experimentally demonstrate controllable frequency splitting at single and multiple selected resonances in LN PhCR resonators with different sizes, while maintaining high Q-factors up to 1 million. Moreover, we experimentally construct a sharp boundary in the synthetic frequency dimension based on an actively modulated x-cut LN gradient-PhCR, opening up new paths toward the arbitrary control of electro-optic comb spectral shapes and exploration of novel physics in the frequency degree of freedom.

physics.optics↗

arXiv2023

TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrieval

Text-to-shape retrieval is an increasingly relevant problem with the growth of 3D shape data. Recent work on contrastive losses for learning joint embeddings over multimodal data has been successful at tasks such as retrieval and classification. Thus far, work on joint representation learning for 3D shapes and text has focused on improving embeddings through modeling of complex attention between representations, or multi-task learning. We propose a trimodal learning scheme over text, multi-view images and 3D shape voxels, and show that with large batch contrastive learning we achieve good performance on text-to-shape retrieval without complex attention mechanisms or losses. Our experiments serve as a foundation for follow-up work on building trimodal embeddings for text-image-shape.

cs.CV↗

arXiv2023

ReCLIP: Refine Contrastive Language Image Pre-Training with Source Free Domain Adaptation

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits to many tasks that have no labeled data. However, while applying CLIP to a downstream target domain, the presence of visual and text domain gaps and cross-modality misalignment can greatly impact the model performance. To address such challenges, we propose ReCLIP, the first source-free domain adaptation method for vision-language models, which does not require any source data or target labeled data. ReCLIP first learns a projection space to mitigate the misaligned visual-text embeddings and learns pseudo labels, and then deploys cross-modality self-training with the pseudo labels, to update visual and text encoders, refine labels and reduce domain gaps and misalignments iteratively. With extensive experiments, we demonstrate ReCLIP reduces the average error rate of CLIP from 30.17% to 25.06% on 22 image classification benchmarks. Code available at https://github.com/michiganleon/ReCLIP_WACV.

cs.CV↗

arXiv2023

Water-Rich Disks around Late M-stars Unveiled: Exploring the Remarkable Case of Sz114

We present an analysis of the JDISC JWST/MIRI-MRS spectrum of Sz~114, an accreting M5 star surrounded by a large dust disk with a shallow gap at $\sim 39$ au. The spectrum is molecular-rich: we report the detection of water, CO, CO$_2$, HCN, C$_2$H$_2$, and H$_2$. The only identified atomic/ionic transition is from [NeII] at 12.81 micron. A distinct feature of this spectrum is the forest of water lines with the 17.22 micron emission surpassing that of most mid-to-late M-star disks by an order of magnitude in flux and aligning instead with disks of earlier-type stars. Moreover, flux ratios of C$_2$H$_2$/H$_2$O and HCN/H$_2$O in Sz~114 also resemble those of earlier-type disks, with a slightly elevated CO$_2$/H$_2$O ratio. While accretional heating can boost all infrared lines, the unusual properties of Sz~114 could be explained by the young age of the source, its formation under unusual initial conditions (a large massive disk), and the presence of dust substructures. The latter delays the inward drift of icy pebbles and help preserve a lower C/O ratio over an extended period. In contrast, mid-to-late M-star disks--which are typically faint, small in size, and likely lack significant substructures--may have more quickly depleted the outer icy reservoir and already evolved out of a water-rich inner disk phase. Our findings underscore the unexpected diversity within mid-infrared spectra of mid-to-late M-star disks, highlighting the need to expand the observational sample for a comprehensive understanding of their variations and thoroughly test pebble drift and planet formation models.

astro-ph.EP↗

arXiv2023

Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training

In recent years, the growing demand for medical imaging diagnosis has placed a significant burden on radiologists. As a solution, Medical Vision-Language Pre-training (Med-VLP) methods have been proposed to learn universal representations from medical images and reports, benefiting downstream tasks without requiring fine-grained annotations. However, existing methods have overlooked the importance of cross-modal alignment in joint image-text reconstruction, resulting in insufficient cross-modal interaction. To address this limitation, we propose a unified Med-VLP framework based on Multi-task Paired Masking with Alignment (MPMA) to integrate the cross-modal alignment task into the joint image-text reconstruction framework to achieve more comprehensive cross-modal interaction, while a Global and Local Alignment (GLA) module is designed to assist self-supervised paradigm in obtaining semantic representations with rich domain knowledge. Furthermore, we introduce a Memory-Augmented Cross-Modal Fusion (MA-CMF) module to fully integrate visual information to assist report reconstruction and fuse the multi-modal representations adequately. Experimental results demonstrate that the proposed unified approach outperforms previous methods in all downstream tasks, including uni-modal, cross-modal, and multi-modal tasks.

cs.CV↗

arXiv2023

JWST reveals excess cool water near the snowline in compact disks, consistent with pebble drift

Previous analyses of mid-infrared water spectra from young protoplanetary disks observed with the Spitzer-IRS found an anti-correlation between water luminosity and the millimeter dust disk radius observed with ALMA. This trend was suggested to be evidence for a fundamental process of inner disk water enrichment, used to explain properties of the Solar System 40 years ago, in which icy pebbles drift inward from the outer disk and sublimate after crossing the snowline. Previous analyses of IRS water spectra, however, were uncertain due to the low spectral resolution that blended lines together. We present new JWST-MIRI spectra of four disks, two compact and two large with multiple radial gaps, selected to test the scenario that water vapor inside the snowline is regulated by pebble drift. The higher spectral resolving power of MIRI-MRS now yields water spectra that separate individual lines, tracing upper level energies from 900 K to 10,000 K. These spectra clearly reveal excess emission in the low-energy lines in compact disks, compared to the large disks, demonstrating an enhanced cool component with $T \approx$ 170-400 K and equivalent emitting radius $R_{\rm{eq}}\approx$ 1-10 au. We interpret the cool water emission as ice sublimation and vapor diffusion near the snowline, suggesting that there is indeed a higher inwards mass flux of icy pebbles in compact disks. Observation of this process opens up multiple exciting prospects to study planet formation chemistry in inner disks with JWST.

astro-ph.EP↗

arXiv2023

ImGeoNet: Image-induced Geometry-aware Voxel Representation for Multi-view 3D Object Detection

We propose ImGeoNet, a multi-view image-based 3D object detection framework that models a 3D space by an image-induced geometry-aware voxel representation. Unlike previous methods which aggregate 2D features into 3D voxels without considering geometry, ImGeoNet learns to induce geometry from multi-view images to alleviate the confusion arising from voxels of free space, and during the inference phase, only images from multiple views are required. Besides, a powerful pre-trained 2D feature extractor can be leveraged by our representation, leading to a more robust performance. To evaluate the effectiveness of ImGeoNet, we conduct quantitative and qualitative experiments on three indoor datasets, namely ARKitScenes, ScanNetV2, and ScanNet200. The results demonstrate that ImGeoNet outperforms the current state-of-the-art multi-view image-based method, ImVoxelNet, on all three datasets in terms of detection accuracy. In addition, ImGeoNet shows great data efficiency by achieving results comparable to ImVoxelNet with 100 views while utilizing only 40 views. Furthermore, our studies indicate that our proposed image-induced geometry-aware representation can enable image-based methods to attain superior detection accuracy than the seminal point cloud-based method, VoteNet, in two practical scenarios: (1) scenarios where point clouds are sparse and noisy, such as in ARKitScenes, and (2) scenarios involve diverse object classes, particularly classes of small objects, as in the case in ScanNet200.

cs.CV↗

arXiv2023

How large is a disk -- what do protoplanetary disk gas sizes really mean?

It remains unclear what mechanism is driving the evolution of protoplanetary disks. Direct detection of the main candidates, either turbulence driven by magnetorotational instability or magnetohydrodynamical disk winds, has proven difficult, leaving the time evolution of the disk size as one of the most promising observables able to differentiate between these two mechanisms. But to do so successfully, we need to understand what the observed gas disk size actually traces. We studied the relation between $R_{\rm CO,\ 90\%}$, the radius that encloses 90% of the $^{12}$CO flux, and $R_c$, the radius that encodes the physical disk size, in order to provide simple prescriptions for conversions between these two sizes. For an extensive grid of thermochemical models we calculate $R_{\rm CO,\ 90\%}$ from synthetic observations and relate properties measured at this radius, such as the gas column density, to bulk disk properties, such as $R_c$ and the disk mass $M_{\rm disk}$. We found an empirical correlation between the gas column density at $R_{\rm CO,\ 90\%}$ and disk mass: $N_{\rm gas}(R_{\rm CO,\ 90\%}) \approx 3.73\times10^{21}(M_{\rm disk}/\mathrm{M}_{\odot})^{0.34}\ \mathrm{cm}^{-2}$. Using this correlation we derive an analytical prescription of $R_{\rm CO,\ 90\%}$ that only depends on $R_c$ and $M_{\rm disk}$. We derive $R_c$ for disks in Lupus, Upper Sco, Taurus and DSHARP, finding that disks in the older Upper Sco region are significantly smaller ($\langle R_c \rangle$ = 4.8 au) than disks in the younger Lupus and Taurus regions ($\langle R_c \rangle$ = 19.8 and 20.9 au, respectively). This temporal decrease in $R_c$ goes against predictions of both viscous and wind-driven evolution, but could be a sign of significant external photoevaporation having truncated disks in Upper Sco.

astro-ph.EP↗

arXiv2023

Spatio-Temporal Classification of Lung Ventilation Patterns using 3D EIT Images: A General Approach for Individualized Lung Function Evaluation

The Pulmonary Function Test (PFT) is an widely utilized and rigorous classification test for lung function evaluation, serving as a comprehensive tool for lung diagnosis. Meanwhile, Electrical Impedance Tomography (EIT) is a rapidly advancing clinical technique that visualizes conductivity distribution induced by ventilation. EIT provides additional spatial and temporal information on lung ventilation beyond traditional PFT. However, relying solely on conventional isolated interpretations of PFT results and EIT images overlooks the continuous dynamic aspects of lung ventilation. This study aims to classify lung ventilation patterns by extracting spatial and temporal features from the 3D EIT image series. The study uses a Variational Autoencoder network with a MultiRes block to compress the spatial distribution in a 3D image into a one-dimensional vector. These vectors are then concatenated to create a feature map for the exhibition of temporal features. A simple convolutional neural network is used for classification. Data collected from 137 subjects were finally used for training. The model is validated by ten-fold and leave-one-out cross-validation first. The accuracy and sensitivity of normal ventilation mode are 0.95 and 1.00, and the f1-score is 0.94. Furthermore, we check the reliability and feasibility of the proposed pipeline by testing it on newly recruited nine subjects. Our results show that the pipeline correctly predicts the ventilation mode of 8 out of 9 subjects. The study demonstrates the potential of using image series for lung ventilation mode classification, providing a feasible method for patient prescreening and presenting an alternative form of PFT.

eess.IV↗

arXiv2023

BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics

The proliferation of automatic faithfulness metrics for summarization has produced a need for benchmarks to evaluate them. While existing benchmarks measure the correlation with human judgements of faithfulness on model-generated summaries, they are insufficient for diagnosing whether metrics are: 1) consistent, i.e., indicate lower faithfulness as errors are introduced into a summary, 2) effective on human-written texts, and 3) sensitive to different error types (as summaries can contain multiple errors). To address these needs, we present a benchmark of unfaithful minimal pairs (BUMP), a dataset of 889 human-written, minimally different summary pairs, where a single error is introduced to a summary from the CNN/DailyMail dataset to produce an unfaithful summary. We find BUMP complements existing benchmarks in a number of ways: 1) the summaries in BUMP are harder to discriminate and less probable under SOTA summarization models, 2) unlike non-pair-based datasets, BUMP can be used to measure the consistency of metrics, and reveals that the most discriminative metrics tend not to be the most consistent, and 3) unlike datasets containing generated summaries with multiple errors, BUMP enables the measurement of metrics' performance on individual error types.

cs.CL↗

arXiv2023

Substructures in Compact Disks of the Taurus Star-forming Region

Observations of substructure in protoplanetary disks have largely been limited to the brightest and largest disks, excluding the abundant population of compact disks which are likely sites of planet formation. Here, we reanalyze ~0.1'', 1.33 mm ALMA continuum observations of 12 compact protoplanetary disks in the Taurus star-forming region. By fitting visibilities directly, we identify substructures in 6 of the 12 compact disks. We then compare the substructures identified in the full Taurus sample of 24 disks in single star systems and the ALMA DSHARP survey, differentiating between compact (R_eff,90% < 50 au) and extended (R_eff,90% > 50 au) disk sources. We find that substructures are detected at nearly all radii in both small and large disks. Tentatively, we find fewer wide gaps in intermediate-sized disks with R_eff,90% between 30 and 90 au. We perform a series of planet-disk interaction simulations to constrain the sensitivity of our visibility-fitting approach. Under an assumption of planet-disk interaction, we use the gap widths and common disk parameters to calculate potential planet masses within the Taurus sample. We find that the young planet occurrence rate peaks near Neptune masses, similar to the DSHARP sample. For 0.01 $M_J/M_\odot$ $\lesssim$ $M_p/M_*$ $\lesssim$ 0.1 $M_J/M_\odot$, the rate is 17.4$\pm$8.3%; for 0.1 $M_J/M_\odot$ $\lesssim$ $M_p/M_*$ $\lesssim$ 1 $M_J/M_\odot$, it is 27.8$\pm$8.3%. Both of them are consistent with microlensing surveys. For gas giants more massive than 5 $M_J$, the occurrence rate is 4.2$\pm$4.2%, consistent with direct imaging surveys.

astro-ph.EP↗

arXiv2023

Predict NAS Multi-Task by Stacking Ensemble Models using GP-NAS

Accurately predicting the performance of architecture with small sample training is an important but not easy task. How to analysis and train dataset to overcome overfitting is the core problem we should deal with. Meanwhile if there is the mult-task problem, we should also think about if we can take advantage of their correlation and estimate as fast as we can. In this track, Super Network builds a search space based on ViT-Base. The search space contain depth, num-heads, mpl-ratio and embed-dim. What we done firstly are pre-processing the data based on our understanding of this problem which can reduce complexity of problem and probability of over fitting. Then we tried different kind of models and different way to combine them. Finally we choose stacking ensemble models using GP-NAS with cross validation. Our stacking model ranked 1st in CVPR 2022 Track 2 Challenge.

cs.LG↗

arXiv2023

Adjust factor with volatility model using MAXFLAT low-pass filter and construct portfolio in China A share market

In the field of quantitative finance, volatility models, such as ARCH, GARCH, FIGARCH, SV, EWMA, play the key role in risk and portfolio management. Meanwhile, factor investing is more and more famous since mid of 20 century. CAPM, Fama French three factor model, Fama French five-factor model, MSCI Barra factor model are mentioned and developed during this period. In this paper, we will show why we need adjust group of factors by our MAXFLAT low-pass volatility model. All of our experiments are under China's CSI 300 and CSI 500 universe which represent China's large cap stocks and mid-small cap stocks. Our result shows adjust factors by MAXFLAT volatility model have better performance in both large cap and small cap universe than original factors or other risk adjust factors in China A share. Also the portfolio constructed by MAXFLAT risk adjust factors have continuous excess return and lower beta compare with benchmark index.

q-fin.RM↗