arXiv Science⌕ Search

arXiv subjects

Shi Chen

Publications and source records attributed to Shi Chen.

At least 91 records · Page 5Linked to original sources

HSRMamba: Contextual Spatial-Spectral State Space Model for Single Image Hyperspectral Super-Resolution

Mamba has demonstrated exceptional performance in visual tasks due to its powerful global modeling capabilities and linear computational complexity, offering considerable potential in hyperspectral image super-resolution (HSISR). However, in HSISR, Mamba faces challenges as transforming images into 1D sequences neglects the spatial-spectral structural relationships between locally adjacent pixels, and its performance is highly sensitive to input order, which affects the restoration of both spatial and spectral details. In this paper, we propose HSRMamba, a contextual spatial-spectral modeling state space model for HSISR, to address these issues both locally and globally. Specifically, a local spatial-spectral partitioning mechanism is designed to establish patch-wise causal relationships among adjacent pixels in 3D features, mitigating the local forgetting issue. Furthermore, a global spectral reordering strategy based on spectral similarity is employed to enhance the causal representation of similar pixels across both spatial and spectral dimensions. Finally, experimental results demonstrate our HSRMamba outperforms the state-of-the-art methods in quantitative quality and visual results. Code is available at: https://github.com/Tomchenshi/HSRMamba.

cs.CV↗

AI Delivers Creative Output but Struggles with Thinking Processes

A key objective in artificial intelligence (AI) development is to create systems that match or surpass human creativity. Although current AI models perform well across diverse creative tasks, it remains unclear whether these achievements reflect genuine creative thinking. This study examined whether AI models (GPT-3.5-turbo, GPT-4, and GPT-4o) engage in creative thinking by comparing their performance with humans across various creative tasks and core cognitive processes. Results showed that AI models outperformed humans in divergent thinking, convergent thinking, and insight problem-solving, but underperformed in creative writing. Compared to humans, AI generated lower forward flow values in both free and chain association tasks and showed lower accuracy in the representational change task. In creative evaluation, AI exhibited no significant correlation between the weights of novelty and appropriateness when predicting creative ratings, suggesting the absence of a human-like trade-off strategy. AI also had higher decision error scores in creative selection, suggesting difficulty identifying the most creative ideas. These findings suggest that while AI can mimic human creativity, its strong performance in creative tasks is likely driven by non-creative mechanisms rather than genuine creative thinking.

cs.HC↗

Degenerate Domain Walls in Supersymmetric Theories

In supersymmetric Yang-Mills theories (SYM) tension-degenerate domain walls are typical. Adding matter fields in fundamental representation we arrive at supersymmetric QCD (SQCD) supporting similar walls. We demonstrate that the degenerate domain walls can belong to one of two classes: (i) locally distinguishable, i.e. those which differ from each other locally (which could be detected in local measurements); and (ii) those which have identical local structure and are differentiated only topologically, through a judicially chosen compactification of $\mathbb{R}^4$. Depending on the number of flavors $F$ and the pattern of Higgsing both classes can coexists among SQCD $k$ walls interpolating between the vacua $n$ and $n+k$. We prove that the overall multiplicity of the domain walls obtained after accounting for both classes is $ν_{N,k}^\text{walls}= N!/\big[(N-k)!k!\big]$, as was discovered previously in limiting cases. (Here $N$ is the number of colors.) Thus, $ν_{N,k}^\text{walls}$ is a peculiar index. For the locally distinguishable degenerate domain walls we observe two-wall junctions, a phenomenon specific for supersymmetry with central extensions. This phenomenon does not exist for topological replicas.

hep-th↗

Comparative Analysis of Pre-trained Deep Learning Models and DINOv2 for Cushing's Syndrome Diagnosis in Facial Analysis

Cushing's syndrome is a condition caused by excessive glucocorticoid secretion from the adrenal cortex, often manifesting with moon facies and plethora, making facial data crucial for diagnosis. Previous studies have used pre-trained convolutional neural networks (CNNs) for diagnosing Cushing's syndrome using frontal facial images. However, CNNs are better at capturing local features, while Cushing's syndrome often presents with global facial features. Transformer-based models like ViT and SWIN, which utilize self-attention mechanisms, can better capture long-range dependencies and global features. Recently, DINOv2, a foundation model based on visual Transformers, has gained interest. This study compares the performance of various pre-trained models, including CNNs, Transformer-based models, and DINOv2, in diagnosing Cushing's syndrome. We also analyze gender bias and the impact of freezing mechanisms on DINOv2. Our results show that Transformer-based models and DINOv2 outperformed CNNs, with ViT achieving the highest F1 score of 85.74%. Both the pre-trained model and DINOv2 had higher accuracy for female samples. DINOv2 also showed improved performance when freezing parameters. In conclusion, Transformer-based models and DINOv2 are effective for Cushing's syndrome classification.

cs.LG↗

Characterization and Optimization of a Cryogenic Pure CsI Detector with Remarkable Light Yield and Unprecedented Energy Resolution for CLOVERS Experiment

In this study, we comprehensively characterized and optimized a cryogenic pure CsI (pCsI) detector. We utilized a {$\SI{2}{cm}\times\SI{2}{cm}\times\SI{2}{cm}$} cube crystal coupled with a HAMAMATSU R11065 photomultiplier tube, achieving a remarkable light yield of \SI{35.2}{PE/\keV_{ee}} and an unprecedented energy resolution of \SI{6.9}{\%} at {\SI{59.54}{\keV}}. Additionally, we measured the scintillation decay time of pCsI, which was significantly shorter than that of CsI(Na) at room temperature. Furthermore, we investigated the impact of temperature, surface treatment, and crystal shape on light yield. Notably, the light yield peaked at approximately \SI{20}{\K} and remained stable within the range of \SI{70}--\SI{100}{\K}. The light yield of the polished crystals was approximately 1.5 times greater than that of the ground crystals, whereas the crystal shape exhibited minimal influence on the light yield. These results are crucial for the design of the \SI{10}{\kg} pCsI detector for the future CLOVERS (Coherent eLastic neutrinO(V)-nucleus scattERing at China Spallation Neutron Source (CSNS)) experiment.`

physics.ins-det↗

Detecting Defective Wafers Via Modular Networks

The growing availability of sensors within semiconductor manufacturing processes makes it feasible to detect defective wafers with data-driven models. Without directly measuring the quality of semiconductor devices, they capture the modalities between diverse sensor readings and can be used to predict key quality indicators (KQI, \textit{e.g.}, roughness, resistance) to detect faulty products, significantly reducing the capital and human cost in maintaining physical metrology steps. Nevertheless, existing models pay little attention to the correlations among different processes for diverse wafer products and commonly struggle with generalizability issues. To enable generic fault detection, in this work, we propose a modular network (MN) trained using time series stage-wise datasets that embodies the structure of the manufacturing process. It decomposes KQI prediction as a combination of stage modules to simulate compositional semiconductor manufacturing, universally enhancing faulty wafer detection among different wafer types and manufacturing processes. Extensive experiments demonstrate the usefulness of our approach, and shed light on how the compositional design provides an interpretable interface for more practical applications.

cs.LG↗

Residual connections provably mitigate oversmoothing in graph neural networks

Graph neural networks (GNNs) have achieved remarkable empirical success in processing and representing graph-structured data across various domains. However, a significant challenge known as "oversmoothing" persists, where vertex features become nearly indistinguishable in deep GNNs, severely restricting their expressive power and practical utility. In this work, we analyze the asymptotic oversmoothing rates of deep GNNs with and without residual connections by deriving explicit convergence rates for a normalized vertex similarity measure. Our analytical framework is grounded in the multiplicative ergodic theorem. Furthermore, we demonstrate that adding residual connections effectively mitigates or prevents oversmoothing across several broad families of parameter distributions. The theoretical findings are strongly supported by numerical experiments.

cs.LG↗

New Insights on Gamma-Ray Burst Radiation Mechanisms from Multiwavelength Observations

The study of high-energy gamma-ray emission from gamma-ray bursts (GRBs) involves complex synchrotron radiation and synchrotron self-Compton scattering (SSC) mechanisms with multiple parameters exhibiting a wide distribution. Recent advancements in GRB research, particularly the observation of very high energy (VHE, $\rm >100~GeV$) radiation, have ushered in a new era of multiwavelength exploration, offering fresh perspectives and limitations for understanding GRB radiation mechanisms. This study aimed to leverage VHE observations to refine constraints on synchrotron + SSC radiation from electrons accelerated by forward shocks. By analyzing two external environments - the uniform interstellar medium and stratified stellar wind medium, we conducted spectral and variability fitting for five specific bursts (GRB~180720B, GRB~190114C, GRB~190829A, GRB~201216C, and GRB~221009A) to identify the optimal parameters characterizing these events. A comparative analysis of model parameter distributions with and without VHE radiation observations reveals that the magnetic energy equipartition factor $ε_B$ is more concentrated with VHE emissions. This suggests that VHE emissions may offer greater constraints on this microphysical parameter. Additionally, we found that the energy budget between VHE and keV-MeV $γ$-ray emissions under the SSC radiation exhibits an almost linear relationship, which may serve as a tool to differentiate radiation mechanisms. We anticipate future statistical analyses of additional VHE bursts to validate our findings.

astro-ph.HE↗

Cheshire $θ$ terms, Aharonov-Bohm effects, and axions

We discuss unusual $θ$ terms that can appear in field theories that allow global vortices. These `Cheshire $θ$ terms' induce Aharonov-Bohm effects for some particles that move around vortices. For example, a Cheshire $θ$ term can appear in QCD coupled to an axion and induces Aharonov-Bohm effects for baryons and leptons moving around axion strings.

hep-th↗

Accelerating optimization over the space of probability measures

The acceleration of gradient-based optimization methods is a subject of significant practical and theoretical importance, particularly within machine learning applications. While much attention has been directed towards optimizing within Euclidean space, the need to optimize over spaces of probability measures in machine learning motivates exploration of accelerated gradient methods in this context too. To this end, we introduce a Hamiltonian-flow approach analogous to momentum-based approaches in Euclidean space. We demonstrate that, in the continuous-time setting, algorithms based on this approach can achieve convergence rates of arbitrarily high order. We complement our findings with numerical examples.

math.OC↗

Inhomogeneous confinement and chiral symmetry breaking induced by imaginary angular velocity

We investigate detailed properties of imaginary rotating matter with gluons and quarks at high temperature. Previously, we showed that imaginary rotation induces perturbative confinement of gluons at the rotation center. We perturbatively calculate the Polyakov loop potential and find inhomogeneous confinement above a certain threshold of imaginary angular velocity. We also evaluate the quark contribution to the Polyakov loop potential and confirm that spontaneous chiral symmetry breaking occurs in the perturbatively confined phase.

hep-ph↗

An Animation-based Augmentation Approach for Action Recognition from Discontinuous Video

Action recognition, an essential component of computer vision, plays a pivotal role in multiple applications. Despite significant improvements brought by Convolutional Neural Networks (CNNs), these models suffer performance declines when trained with discontinuous video frames, which is a frequent scenario in real-world settings. This decline primarily results from the loss of temporal continuity, which is crucial for understanding the semantics of human actions. To overcome this issue, we introduce the 4A (Action Animation-based Augmentation Approach) pipeline, which employs a series of sophisticated techniques: starting with 2D human pose estimation from RGB videos, followed by Quaternion-based Graph Convolution Network for joint orientation and trajectory prediction, and Dynamic Skeletal Interpolation for creating smoother, diversified actions using game engine technology. This innovative approach generates realistic animations in varied game environments, viewed from multiple viewpoints. In this way, our method effectively bridges the domain gap between virtual and real-world data. In experimental evaluations, the 4A pipeline achieves comparable or even superior performance to traditional training approaches using real-world data, while requiring only 10% of the original data volume. Additionally, our approach demonstrates enhanced performance on In-the-wild videos, marking a significant advancement in the field of action recognition.

cs.CV↗

Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training

3D human pose estimation is a vital task in computer vision, involving the prediction of human joint positions from images or videos to reconstruct a skeleton of a human in three-dimensional space. This technology is pivotal in various fields, including animation, security, human-computer interaction, and automotive safety, where it promotes both technological progress and enhanced human well-being. The advent of deep learning significantly advances the performance of 3D pose estimation by incorporating temporal information for predicting the spatial positions of human joints. However, traditional methods often fall short as they primarily focus on the spatial coordinates of joints and overlook the orientation and rotation of the connecting bones, which are crucial for a comprehensive understanding of human pose in 3D space. To address these limitations, we introduce Quater-GCN (Q-GCN), a directed graph convolutional network tailored to enhance pose estimation by orientation. Q-GCN excels by not only capturing the spatial dependencies among node joints through their coordinates but also integrating the dynamic context of bone rotations in 2D space. This approach enables a more sophisticated representation of human poses by also regressing the orientation of each bone in 3D space, moving beyond mere coordinate prediction. Furthermore, we complement our model with a semi-supervised training strategy that leverages unlabeled data, addressing the challenge of limited orientation ground truth data. Through comprehensive evaluations, Q-GCN has demonstrated outstanding performance against current state-of-the-art methods.

cs.CV↗

EvenNICER-SLAM: Event-based Neural Implicit Encoding SLAM

The advancement of dense visual simultaneous localization and mapping (SLAM) has been greatly facilitated by the emergence of neural implicit representations. Neural implicit encoding SLAM, a typical example of which is NICE-SLAM, has recently demonstrated promising results in large-scale indoor scenes. However, these methods typically rely on temporally dense RGB-D image streams as input in order to function properly. When the input source does not support high frame rates or the camera movement is too fast, these methods often experience crashes or significant degradation in tracking and mapping accuracy. In this paper, we propose EvenNICER-SLAM, a novel approach that addresses this issue through the incorporation of event cameras. Event cameras are bio-inspired cameras that respond to intensity changes instead of absolute brightness. Specifically, we integrated an event loss backpropagation stream into the NICE-SLAM pipeline to enhance camera tracking with insufficient RGB-D input. We found through quantitative evaluation that EvenNICER-SLAM, with an inclusion of higher-frequency event image input, significantly outperforms NICE-SLAM with reduced RGB-D input frequency. Our results suggest the potential for event cameras to improve the robustness of dense SLAM systems against fast camera motion in real-world scenarios.

cs.CV↗

Generalized BKT Transitions and Persistent Order on the Lattice

The BKT transition in low-dimensional systems with a $U(1)$ global symmetry separates a gapless conformal phase from a trivially gapped, disordered phase, and is driven by vortex proliferation. Recent developments in modified Villain discretizations provide a class of lattice models which have a $\mathbb{Z}_W$ global symmetry that counts vortices mod W, mixed 't Hooft anomalies, and persistent order even at finite lattice spacing. While there is no fully-disordered phase (except in the original BKT limit $W=1$) there is still a phase boundary which separates gapped ordered phases from gapless phases. I'll describe a numerical Monte Carlo exploration of these phenomena.

hep-lat↗

Detecting Misinformation in Multimedia Content through Cross-Modal Entity Consistency: A Dual Learning Approach

The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single modalities or text-image combinations, leaving a gap in detecting multimodal misinformation. While the concept of entity consistency holds promise in detecting multimodal misinformation, simplifying the representation to a scalar value overlooks the inherent complexities of high-dimensional representations across different modalities. To address these limitations, we propose a Multimedia Misinformation Detection (MultiMD) framework for detecting misinformation from video content by leveraging cross-modal entity consistency. The proposed dual learning approach allows for not only enhancing misinformation detection performance but also improving representation learning of entity consistency across different modalities. Our results demonstrate that MultiMD outperforms state-of-the-art baseline models and underscore the importance of each modality in misinformation detection. Our research provides novel methodological and technical insights into multimodal misinformation detection.

cs.MM↗

Hallu-PI: Evaluating Hallucination in Multi-modal Large Language Models within Perturbed Inputs

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable performance on various visual-language understanding and generation tasks. However, MLLMs occasionally generate content inconsistent with the given images, which is known as "hallucination". Prior works primarily center on evaluating hallucination using standard, unperturbed benchmarks, which overlook the prevalent occurrence of perturbed inputs in real-world scenarios-such as image cropping or blurring-that are critical for a comprehensive assessment of MLLMs' hallucination. In this paper, to bridge this gap, we propose Hallu-PI, the first benchmark designed to evaluate Hallucination in MLLMs within Perturbed Inputs. Specifically, Hallu-PI consists of seven perturbed scenarios, containing 1,260 perturbed images from 11 object types. Each image is accompanied by detailed annotations, which include fine-grained hallucination types, such as existence, attribute, and relation. We equip these annotations with a rich set of questions, making Hallu-PI suitable for both discriminative and generative tasks. Extensive experiments on 12 mainstream MLLMs, such as GPT-4V and Gemini-Pro Vision, demonstrate that these models exhibit significant hallucinations on Hallu-PI, which is not observed in unperturbed scenarios. Furthermore, our research reveals a severe bias in MLLMs' ability to handle different types of hallucinations. We also design two baselines specifically for perturbed scenarios, namely Perturbed-Reminder and Perturbed-ICL. We hope that our study will bring researchers' attention to the limitations of MLLMs when dealing with perturbed inputs, and spur further investigations to address this issue. Our code and datasets are publicly available at https://github.com/NJUNLP/Hallu-PI.

cs.CV↗

Bayesian sampling using interacting particles

Bayesian sampling is an important task in statistics and machine learning. Over the past decade, many ensemble-type sampling methods have been proposed. In contrast to the classical Markov chain Monte Carlo methods, these new methods deploy a large number of interactive samples, and the communication between these samples is crucial in speeding up the convergence. To justify the validity of these sampling strategies, the concept of interacting particles naturally calls for the mean-field theory. The theory establishes a correspondence between particle interactions encoded in a set of coupled ODEs/SDEs and a PDE that characterizes the evolution of the underlying distribution. This bridges numerical algorithms with the PDE theory used to show convergence in time. Many mathematical machineries are developed to provide the mean-field analysis, and we showcase two such examples: The coupling method and the compactness argument built upon the martingale strategy. The former has been deployed to show the convergence of ensemble Kalman sampler and ensemble Kalman inversion, and the latter will be shown to be immensely powerful in proving the validity of the Vlasov-Boltzmann simulator.

math.NA↗