arXiv subjects
Publications and source records attributed to Tao Wang.
We present an analysis of ALMA multi-band dust-continuum observations for 28 spectroscopically-confirmed bright Lyman-break galaxies at $5 80\,{\rm K}$ observed in a galaxy at $z=8.3$.
Overparameterized large-scale language models have impressive generalization performance of in-context few-shot learning. However, most language models allocate the same amount of parameters or computation to each token, disregarding the complexity or importance of the input data. We argue that in language model pretraining, a variable amount of computation should be assigned to different tokens, and this can be efficiently achieved via a simple routing mechanism. Different from conventional early stopping techniques where tokens can early exit at only early layers, we propose a more general method that dynamically skips the execution of a layer (or module) for any input token with a binary router. In our extensive evaluation across 24 NLP tasks, we demonstrate that the proposed method can significantly improve the 1-shot performance compared to other competitive baselines only at mild extra cost for inference.
Adversarial examples generated from surrogate models often possess the ability to deceive other black-box models, a property known as transferability. Recent research has focused on enhancing adversarial transferability, with input transformation being one of the most effective approaches. However, existing input transformation methods suffer from two issues. Firstly, certain methods, such as the Scale-Invariant Method, employ exponentially decreasing scale invariant parameters that decrease the adaptability in generating effective adversarial examples across multiple scales. Secondly, most mixup methods only linearly combine candidate images with the source image, leading to reduced features blending effectiveness. To address these challenges, we propose a framework called Uniform Scale and Mix Mask Method (US-MM) for adversarial example generation. The Uniform Scale approach explores the upper and lower boundaries of perturbation with a linear factor, minimizing the negative impact of scale copies. The Mix Mask method introduces masks into the mixing process in a nonlinear manner, significantly improving the effectiveness of mixing strategies. Ablation experiments are conducted to validate the effectiveness of each component in US-MM and explore the effect of hyper-parameters. Empirical evaluations on standard ImageNet datasets demonstrate that US-MM achieves an average of 7% better transfer attack success rate compared to state-of-the-art methods.
Cloth-changing Person Re-Identification (CC-ReID) is a challenging task that aims to retrieve the target person across multiple surveillance cameras when clothing changes might happen. Despite recent progress in CC-ReID, existing approaches are still hindered by the interference of clothing variations since they lack effective constraints to keep the model consistently focused on clothing-irrelevant regions. To address this issue, we present a Semantic-aware Consistency Network (SCNet) to learn identity-related semantic features by proposing effective consistency constraints. Specifically, we generate the black-clothing image by erasing pixels in the clothing area, which explicitly mitigates the interference from clothing variations. In addition, to fully exploit the fine-grained identity information, a head-enhanced attention module is introduced, which learns soft attention maps by utilizing the proposed part-based matching loss to highlight head information. We further design a semantic consistency loss to facilitate the learning of high-level identity-related semantic features, forcing the model to focus on semantically consistent cloth-irrelevant regions. By using the consistency constraint, our model does not require any extra auxiliary segmentation module to generate the black-clothing image or locate the head region during the inference stage. Extensive experiments on four cloth-changing person Re-ID datasets (LTCC, PRCC, Vc-Clothes, and DeepChange) demonstrate that our proposed SCNet makes significant improvements over prior state-of-the-art approaches. Our code is available at: https://github.com/Gpn-star/SCNet.
ChatGPT has shown its great power in text processing, including its reasoning ability from text reading. However, there has not been any direct comparison between human readers and ChatGPT in reasoning ability related to text reading. This study was undertaken to investigate how ChatGPTs (i.e., ChatGPT and ChatGPT Plus) and Chinese senior school students as ESL learners exhibited their reasoning ability from English narrative texts. Additionally, we compared the two ChatGPTs in the reasoning performances when commands were updated elaborately. The whole study was composed of three reasoning tests: Test 1 for commonsense inference, Test 2 for emotional inference, and Test 3 for causal inference. The results showed that in Test 1, the students outdid the two ChatGPT versions in local-culture-related inferences but performed worse than the chatbots in daily-life inferences. In Test 2, ChatGPT Plus excelled whereas ChatGPT lagged behind in accuracy. In association with both accuracy and frequency of correct responses, the students were inferior to the two chatbots. Compared with ChatGPTs' better performance in positive emotions, the students showed their superiority in inferring negative emotions. In Test 3, the students demonstrated better logical analysis, outdoing both chatbots. In updating command condition, ChatGPT Plus displayed good causal reasoning ability while ChatGPT kept unchanged. Our study reveals that human readers and ChatGPTs have their respective advantages and disadvantages in drawing inferences from text reading comprehension, unlocking a complementary relationship in text-based reasoning.
Supervised learning algorithms based on Convolutional Neural Networks have become the benchmark for medical image segmentation tasks, but their effectiveness heavily relies on a large amount of labeled data. However, annotating medical image datasets is a laborious and time-consuming process. Inspired by semi-supervised algorithms that use both labeled and unlabeled data for training, we propose the PLGDF framework, which builds upon the mean teacher network for segmenting medical images with less annotation. We propose a novel pseudo-label utilization scheme, which combines labeled and unlabeled data to augment the dataset effectively. Additionally, we enforce the consistency between different scales in the decoder module of the segmentation network and propose a loss function suitable for evaluating the consistency. Moreover, we incorporate a sharpening operation on the predicted results, further enhancing the accuracy of the segmentation. Extensive experiments on three publicly available datasets demonstrate that the PLGDF framework can largely improve performance by incorporating the unlabeled data. Meanwhile, our framework yields superior performance compared to six state-of-the-art semi-supervised learning methods. The codes of this study are available at https://github.com/ortonwang/PLGDF.
The \ion{H}{I}-rich ultra-diffuse galaxies (HUDGs) offer a unique case for studies of star formation laws (SFLs) as they host low star formation efficiency (SFE) and low-metallicity environments where gas is predominantly atomic. We collect a sample of six HUDGs in the field and investigate their location in the extended Schmidt law($Σ_{\text {SFR }} \propto \left(Σ_{\text{star}}^{0.5} Σ_{\text{gas}}\right)^{1.09}$). They are consistent with this relationship well (with deviations of only 1.1 sigma). Furthermore, we find that HUDGs follow the tight correlation between the hydrostatic pressure in the galaxy mid-plane and the quantity on the x-axis ($\rm log(Σ_{star}^{0.5}Σ_{gas})$) of the extended Schmidt law. This result indicates that these HUDGs can be self-regulated systems that reach the dynamical and thermal equilibrium. In this framework, the stellar gravity compresses the disk vertically and counteracts the gas pressure in the galaxy mid-plane to regulate the star formation as suggested by some theoretical models.
The general covariant Fokker-Planck equations associated with the two different versions of covariant Langevin equation in Part I of this series of work are derived, both lead to the same reduced Fokker-Planck equation for the non-normalized one particle distribution function (1PDF). The relationship between various distribution functions is clarified in this process. Several macroscopic quantities are introduced by use of the 1PDF, and the results indicate an intimate connection with the description in relativistic kinetic theory. The concept of relativistic equilibrium state of the heat reservoir is also clarified, and, under the working assumption that the Brownian particle should approach the same equilibrium distribution as the heat reservoir in the long time limit, a general covariant version of Einstein relation arises.
A graph is $(\mathcal{I}, \mathcal{F})$-colorable if its vertex set can be partitioned into two subsets, one of which is an independent set, and the other induces a forest. In this paper, we prove that every planar graph without $5^{-}$-cycles at distance less than $3$ is $(\mathcal{I}, \mathcal{F})$-colorable.
Dvořák and Postle introduced the concept of DP-coloring to overcome some difficulties in list coloring. Sittitrai and Nakprasit combined DP-coloring and defective list coloring to define a new coloring -- relaxed DP-coloring. For relaxed DP-coloring, Sribunhung et al. proved that planar graphs without 4- and 7-cycles are DP-(0, 2, 2)-colorable. Li et al. proved that planar graphs without 4, 8-cycles or 4, 9-cycles are DP-(1, 1, 1)-colorable. Lu and Zhu proved that planar graphs without 4, 5-cycles, or 4, 6-cycles, or 4, 7-cycles are DP-(1, 1, 1)-colorable. In this paper, we show that planar graphs without 4, 6-cycles or 4, 8-cycles are DP-(0, 2, 2)-colorable.
We study the Dirichlet problem of the following discrete infinity Laplace equation on a subgraph with finite width $$Δ_{\infty} u(x) = \inf_{y \sim x}u(y)+\sup_{y \sim x}u(y)-2u(x) = f(x).$$ We say that a subgraph has finite width if the distances from all vertices to the boundary are uniformly bounded. By Perron's method, we show the existence of bounded solutions. We also prove the uniqueness if $f$ is nonnegative by establishing a comparison result, and hence obtain the existence of game values for corresponding tug-of-war games introduced by Peres, Schramm, Sheffield, and Wilson (2009). As an application we show a strong Liouville property for infinity harmonic functions. By an argument of Arzela-Ascoli, we prove the convergence of solutions of $\varepsilon$-tug-of-war games as $\varepsilon$ tends to 0. Correspondingly, we obtain the existence of bounded solutions to normalized infinity Laplace equations on Euclidean domains with finite width.
This work investigated the single pixel color modulation in a composite structure of yarn muscles graphene mechanical system and photonic crystal multimode microcavity. The position of graphene in the microcavity is modified by changing the yarn muscles stretching using different current levels. This helps in adjusting the light absorption of graphene to different colors. Hence, red, green, blue, and their mixed colors can be displayed using a single pixel; color gamut of this system can reach 96.5% of RGB. The proposed system can avoid the spontaneous oscillation caused by large strain energy. This solution can provide insights into the design of low power, ultrahigh resolution, and ultrawide color gamut interferometric modulator display technologies.
Due to the inevitable presence of quality problems, quality inspection of remote sensing images is indeed an indispensable step between the acquisition and the application of them. However, traditional manual inspection suffers from low efficiency. Hence, we propose a novel deep learning-based two-step intelligent system consisting of multiple advanced computer vision models, which first performs image classification by SwinV2 and then accordingly adopts the most appropriate method, such as semantic segmentation by Segformer, to localize the quality problems. Results demonstrate that the proposed method exhibits excellent performance and efficiency, surpassing traditional methods. Furthermore, we conduct an initial exploration of applying multimodal models to remote sensing image quality inspection.
Policy gradient lies at the core of deep reinforcement learning (RL) in continuous domains. Despite much success, it is often observed in practice that RL training with policy gradient can fail for many reasons, even on standard control problems with known solutions. We propose a framework for understanding one inherent limitation of the policy gradient approach: the optimization landscape in the policy space can be extremely non-smooth or fractal for certain classes of MDPs, such that there does not exist gradient to be estimated in the first place. We draw on techniques from chaos theory and non-smooth analysis, and analyze the maximal Lyapunov exponents and Hölder exponents of the policy optimization objectives. Moreover, we develop a practical method that can estimate the local smoothness of objective function from samples to identify when the training process has encountered fractal landscapes. We show experiments to illustrate how some failure cases of policy optimization can be explained by such fractal landscapes.
Current point cloud registration methods are mainly based on local geometric information and usually ignore the semantic information contained in the scenes. In this paper, we treat the point cloud registration problem as a semantic instance matching and registration task, and propose a deep semantic graph matching method (DeepSGM) for large-scale outdoor point cloud registration. Firstly, the semantic categorical labels of 3D points are obtained using a semantic segmentation network. The adjacent points with the same category labels are then clustered together using the Euclidean clustering algorithm to obtain the semantic instances, which are represented by three kinds of attributes including spatial location information, semantic categorical information, and global geometric shape information. Secondly, the semantic adjacency graph is constructed based on the spatial adjacency relations of semantic instances. To fully explore the topological structures between semantic instances in the same scene and across different scenes, the spatial distribution features and the semantic categorical features are learned with graph convolutional networks, and the global geometric shape features are learned with a PointNet-like network. These three kinds of features are further enhanced with the self-attention and cross-attention mechanisms. Thirdly, the semantic instance matching is formulated as an optimal transport problem, and solved through an optimal matching layer. Finally, the geometric transformation matrix between two point clouds is first estimated by the SVD algorithm and then refined by the ICP algorithm. Experimental results conducted on the KITTI Odometry dataset demonstrate that the proposed method improves the registration performance and outperforms various state-of-the-art methods.
This report outlines our team's participation in VCL Challenges B Continual Test_time Adaptation, focusing on the technical details of our approach. Our primary focus is Testtime Adaptation using bi_level adaptations, encompassing image_level and detector_level adaptations. At the image level, we employ adjustable parameterbased image filters, while at the detector level, we leverage adjustable parameterbased mean teacher modules. Ultimately, through the utilization of these bi_level adaptations, we have achieved a remarkable 38.3% mAP on the target domain of the test set within VCL Challenges B. It is worth noting that the minimal drop in mAP, is mearly 4.2%, and the overall performance is 32.5% mAP.
The coexistence of electric dipoles and itinerant electrons in a solid was postulated decades ago, before being experimentally established in several 'polar metals' during the last decade. Here, we report a concentration-driven polar-to-nonpolar phase transition in electron-doped BaTiO_3. Comparing our case with other polar metals, we find a particular threshold concentration (n*) linked to the dipole density (n_d). The universal ratio n_d/n*=8(0.6) suggests a common mechanism across different polar systems, possibly explained by a dipolar Ruderman-Kittel-Kasuya-Yosida theory. Moreover, in BaTiO_3, we observe enhanced thermopower and upturn on resistivity at low temperatures near n*, resembling the Kondo effect. We argue that local electric dipoles act as two-level-systems, whose fluctuations couple with surrounding electron clouds, giving rise to a potential dipolar-counterpart of the Kondo effect. Our findings unveil a mostly uncharted territory for exploring emerging physics associated with electron-dipole correlations, encouraging further theoretical work on dipolar-RKKY and Kondo interactions.
Timing observations are crucial for determining the basic parameters of newly discovered pulsars. Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST) with the L-band 19-beam receiver covering the frequency range of 1.0--1.5 GHz, the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey has discovered more than 600 faint pulsars with flux densities of only a few or a few tens of $μ$Jy at 1.25 GHz. To obtain accurate position, spin parameters and dispersion measure of a pulsar, and to calculate derived parameters such as the characteristic age and surface magnetic field, we collect available FAST pulsar data obtained either through targeted follow-up observations or through coincidental survey observations with one of the 19 beams of the receiver. From these data we obtain time of arrival (TOA) measurements for 30 newly discovered pulsars as well as for 13 known pulsars. We demonstrate that the TOA measurements acquired by the FAST from any beams of the receiver in any observation mode (e.g. the tracking mode or the snapshot mode) can be combined to get timing solutions. We update the ephemerides of 13 previously known pulsars and obtain the first phase-coherent timing results for 30 isolated pulsars discovered in the FAST GPPS Survey. Notably, PSR J1904+0853 is an isolated millisecond pulsar, PSR J1906+0757 is a disrupted recycled pulsar, and PSR J1856+0211 has a long period of 9.89 s that can constrain pulsar death lines. Based on these timing solutions, all available FAST data have been added together to obtain the best pulse profiles for these pulsars.