arXiv subjects

Xiaojun Wu

Publications and source records attributed to Xiaojun Wu.

At least 73 records · Page 4Linked to original sources

arXiv2024

RMLR: Extending Multinomial Logistic Regression into General Geometries

Riemannian neural networks, which extend deep learning techniques to Riemannian spaces, have gained significant attention in machine learning. To better classify the manifold-valued features, researchers have started extending Euclidean multinomial logistic regression (MLR) into Riemannian manifolds. However, existing approaches suffer from limited applicability due to their strong reliance on specific geometric properties. This paper proposes a framework for designing Riemannian MLR over general geometries, referred to as RMLR. Our framework only requires minimal geometric properties, thus exhibiting broad applicability and enabling its use with a wide range of geometries. Specifically, we showcase our framework on the Symmetric Positive Definite (SPD) manifold and special orthogonal group, i.e., the set of rotation matrices. On the SPD manifold, we develop five families of SPD MLRs under five types of power-deformed metrics. On rotation matrices we propose Lie MLR based on the popular bi-invariant metric. Extensive experiments on different Riemannian backbone networks validate the effectiveness of our framework.

cs.LG↗

arXiv2024

Generalised Lelong-Poincaré formula in complex Bott-Chern cohomology

In this note, we present a topological proof of the generalized Lelong-Poincaré formula. More precisely, when the zero locus of a section has a pure codimension equal to the rank of a holomorphic vector bundle, the top Chern class of the vector bundle corresponds to the cycle class of the schematic zero locus of the section in complex Bott-Chern cohomology.

math.AG↗

arXiv2024

Dynamic Subframe Splitting and Spatio-Temporal Motion Entangled Sparse Attention for RGB-E Tracking

Event-based bionic camera asynchronously captures dynamic scenes with high temporal resolution and high dynamic range, offering potential for the integration of events and RGB under conditions of illumination degradation and fast motion. Existing RGB-E tracking methods model event characteristics utilising attention mechanism of Transformer before integrating both modalities. Nevertheless, these methods involve aggregating the event stream into a single event frame, lacking the utilisation of the temporal information inherent in the event stream.Moreover, the traditional attention mechanism is well-suited for dense semantic features, while the attention mechanism for sparse event features require revolution. In this paper, we propose a dynamic event subframe splitting strategy to split the event stream into more fine-grained event clusters, aiming to capture spatio-temporal features that contain motion cues. Based on this, we design an event-based sparse attention mechanism to enhance the interaction of event features in temporal and spatial dimensions. The experimental results indicate that our method outperforms existing state-of-the-art methods on the FE240 and COESOT datasets, providing an effective processing manner for the event data.

cs.CV↗

arXiv2024

One-dimensional Photonic Crystal Structure Enhanced External-Magnetic-Field-Free Spintronic Terahertz High-Field Emitter

Intense terahertz (THz) radiation in free space offers multifaceted capabilities for accelerating electron, understanding the mesoscale architecture in (bio)materials, elementary excitation and so on. Recently popularized spintronic THz emitters (STEs) with their versatility such as ultra-broadband, cost-effectiveness, large-size and ease for-integration have become one of the most promising alternative for the next generation of intense THz sources. Nevertheless, the typical W| Co20Fe60B20 | Pt necessitates an external-magnetic-field to saturate magnetization for stable operation, limiting its scalability for achieving higher THz field with uniform distribution over larger sample areas. Here we demonstrate the methodologies of enhancing the high-field THz radiation of external-magnetic-field-free IrMn3 | Co20Fe60B20 |W heterostructure via optimizing the substrate with superior thermal conductivity and integrating a one-dimensional photonic crystal (PC) structure to maximize the radiation efficiency. Under the excitation of a Ti: sapphire femtosecond laser amplifier with central wavelength of 800 nm, pulse duration of 35 fs, and repetition rate of 1 kHz and maximum single pulse energy of 5.5 mJ, we successfully generate intense THz radiation with focal peak electric field up to 1.1 MV/cm with frequency range covering 0.1-10 THz without external-magnetic-fields. These high-field STEs will also enable other applications such as ultra-broadband high-field THz spectroscopy and polarization-based large-size strong-field THz imaging.

physics.optics↗

arXiv2024

Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support

Recent advancements in text-to-image models have significantly enhanced image generation capabilities, yet a notable gap of open-source models persists in bilingual or Chinese language support. To address this need, we present Taiyi-Diffusion-XL, a new Chinese and English bilingual text-to-image model which is developed by extending the capabilities of CLIP and Stable-Diffusion-XL through a process of bilingual continuous pre-training. This approach includes the efficient expansion of vocabulary by integrating the most frequently used Chinese characters into CLIP's tokenizer and embedding layers, coupled with an absolute position encoding expansion. Additionally, we enrich text prompts by large vision-language model, leading to better images captions and possess higher visual quality. These enhancements are subsequently applied to downstream text-to-image models. Our empirical results indicate that the developed CLIP model excels in bilingual image-text retrieval.Furthermore, the bilingual image generation capabilities of Taiyi-Diffusion-XL surpass previous models. This research leads to the development and open-sourcing of the Taiyi-Diffusion-XL model, representing a notable advancement in the field of image generation, particularly for Chinese language applications. This contribution is a step forward in addressing the need for more diverse language support in multimodal research. The model and demonstration are made publicly available at \href{https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-XL-3.5B/}, fostering further research and collaboration in this domain.

cs.CL↗

arXiv2024

CoMoFusion: Fast and High-quality Fusion of Infrared and Visible Image with Consistency Model

Generative models are widely utilized to model the distribution of fused images in the field of infrared and visible image fusion. However, current generative models based fusion methods often suffer from unstable training and slow inference speed. To tackle this problem, a novel fusion method based on consistency model is proposed, termed as CoMoFusion, which can generate the high-quality images and achieve fast image inference speed. In specific, the consistency model is used to construct multi-modal joint features in the latent space with the forward and reverse process. Then, the infrared and visible features extracted by the trained consistency model are fed into fusion module to generate the final fused image. In order to enhance the texture and salient information of fused images, a novel loss based on pixel value selection is also designed. Extensive experiments on public datasets illustrate that our method obtains the SOTA fusion performance compared with the existing fusion methods.

cs.CV↗

arXiv2024

Ziya2: Data-centric Learning is All LLMs Need

Various large language models (LLMs) have been proposed in recent years, including closed- and open-source ones, continually setting new records on multiple benchmarks. However, the development of LLMs still faces several issues, such as high cost of training models from scratch, and continual pre-training leading to catastrophic forgetting, etc. Although many such issues are addressed along the line of research on LLMs, an important yet practical limitation is that many studies overly pursue enlarging model sizes without comprehensively analyzing and optimizing the use of pre-training data in their learning process, as well as appropriate organization and leveraging of such data in training LLMs under cost-effective settings. In this work, we propose Ziya2, a model with 13 billion parameters adopting LLaMA2 as the foundation model, and further pre-trained on 700 billion tokens, where we focus on pre-training techniques and use data-centric optimization to enhance the learning process of Ziya2 on different stages. We define three data attributes and firstly establish data-centric scaling laws to illustrate how different data impacts LLMs. Experiments show that Ziya2 significantly outperforms other models in multiple benchmarks especially with promising results compared to representative open-source ones. Ziya2 (Base) is released at https://huggingface.co/IDEA-CCNL/Ziya2-13B-Base and https://modelscope.cn/models/Fengshenbang/Ziya2-13B-Base/summary.

cs.CL↗

arXiv2024

Ueda foliation problem for complex tori

We consider an embedded general complex torus $C_n$ into a complex manifold $M_{n+d}$ with a unitary flat normal bundle $N_C$. We show the existence of (non-singular) holomorphic foliation in a neighborhood of $C$ in $M$ having $C$ as leaf under some conditions.

math.CV↗

arXiv2024

Riemannian Multinomial Logistics Regression for SPD Neural Networks

Deep neural networks for learning Symmetric Positive Definite (SPD) matrices are gaining increasing attention in machine learning. Despite the significant progress, most existing SPD networks use traditional Euclidean classifiers on an approximated space rather than intrinsic classifiers that accurately capture the geometry of SPD manifolds. Inspired by Hyperbolic Neural Networks (HNNs), we propose Riemannian Multinomial Logistics Regression (RMLR) for the classification layers in SPD networks. We introduce a unified framework for building Riemannian classifiers under the metrics pulled back from the Euclidean space, and showcase our framework under the parameterized Log-Euclidean Metric (LEM) and Log-Cholesky Metric (LCM). Besides, our framework offers a novel intrinsic explanation for the most popular LogEig classifier in existing SPD networks. The effectiveness of our method is demonstrated in three applications: radar recognition, human action recognition, and electroencephalography (EEG) classification. The code is available at https://github.com/GitZH-Chen/SPDMLR.git.

cs.LG↗

arXiv2024

Albanese map for Kähler manifolds with nef anticanonical bundle

We study the structure of the Albanese map for Kähler manifolds with nef anticanonical bundle. First, we give a result for fourfolds whose Albanse torus is an elliptic curve. In the general case of any dimension, we look at two cases: The general fiber of the Albanese map is a Calabi-Yau manifold or a projective space. In the first case, we show that the manifold itself must be Calabi-Yau. In the second case, we give a more topological proof of a result by Cao and Höring which says that the manifold must be a projectivization of a numerically flat vector bundle.

math.AG↗

arXiv2024

Hermite--Einstein metrics in singular settings

In this article we pursue the following main goals. In the first place, we establish the existence of "estimable" Hermite--Einstein metrics for stable reflexive coherent sheaves on compact normal Kähler spaces. If moreover the background variety has klt singularities, we obtain a much more precise result.

math.DG↗

arXiv2024

Many-body hybrid Excitons in Organic-Inorganic van der Waals Heterostructures

The coherent many-body interaction at the organic-inorganic interface can give rise to intriguing hybrid excitons that combine the advantages of the Wannier-Mott and Frenkel excitons simultaneously. Unlike the 2D inorganic heterostructures that suffer from moment mismatch, the hybrid excitons formed at the organic-inorganic interface have a momentum-direct nature, which have yet to be explored. Here, we report hybrid excitons at the copper phthalocyanine/molybdenum diselenide (CuPc/MoSe2) interface with strong molecular orientation dependence using low-temperature photoluminescence spectroscopy. The new emission peaks observed in the CuPc/MoSe2 heterostructure indicate the formation of interfacial hybrid excitons. The density functional theory (DFT) calculation confirms the strong hybridization between the lowest unoccupied molecular orbital (LUMO) of CuPc and the conduction band minimum (CBM) of MoSe2, suggesting that the hybrid excitons consist of electrons extended in both layers and holes confined in individual layers. The temperature-dependent measurements show that the hybrid excitons can gain the signatures of the Frenkel excitons of CuPc and the Wannier-Mott excitons of MoSe2 simultaneously. The out-of-plane molecular orientation is used to tailor the interfacial hybrid exciton states. Our results reveal the hybrid excitons at the CuPc/MoSe2 interface with tunability by molecular orientation, which suggests that the emerging organic-inorganic heterostructure can be a promising platform for many-body exciton physics.

physics.optics↗

arXiv2023

On compact Kähler manifold with strongly pseudo-effective tangent bundle

In the first part of this note, we discuss the compact Kähler manifold with a strongly pseudo-effective tangent bundle. In the second part, we give new proof of the fact that the only projective manifolds with the big tangent bundle are the projective spaces. In the third part, we give a characterisation of nef vector bundle.

math.DG↗

arXiv2023

BusReF: Infrared-Visible images registration and fusion focus on reconstructible area using one set of features

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more precise fusion results, as a way to improve the performance of downstream high-level vision tasks. In order to relax this assumption, one can attempt to register images first. However, the existing methods for registering multiple modalities have limitations, such as complex structures and reliance on significant semantic information. This paper aims to address the problem of image registration and fusion in a single framework, called BusRef. We focus on Infrared-Visible image registration and fusion task (IVRF). In this framework, the input unaligned image pairs will pass through three stages: Coarse registration, Fine registration and Fusion. It will be shown that the unified approach enables more robust IVRF. We also propose a novel training and evaluation strategy, involving the use of masks to reduce the influence of non-reconstructible regions on the loss functions, which greatly improves the accuracy and robustness of the fusion task. Last but not least, a gradient-aware fusion network is designed to preserve the complementary information. The advanced performance of this algorithm is demonstrated by

cs.CV↗

arXiv2023

iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character portraits, etc. However, there are few specialized models in certain domains, such as interior design, which is attributed to the complex textual descriptions and detailed visual elements inherent in design, alongside the necessity for adaptable resolution. Therefore, text-to-image models for interior design are required to have outstanding prompt-following capabilities, as well as iterative collaboration with design professionals to achieve the desired outcome. In this paper, we collect and optimize text-image data in the design field and continue training in both English and Chinese on the basis of the open-source CLIP model. We also proposed a fine-tuning strategy with curriculum learning and reinforcement learning from CLIP feedback to enhance the prompt-following capabilities of our approach so as to improve the quality of image generation. The experimental results on the collected dataset demonstrate the effectiveness of the proposed approach, which achieves impressive results and outperforms strong baselines.

cs.CV↗

arXiv2023

Ziya-Visual: Bilingual Large Vision-Language Model via Multi-Task Instruction Tuning

Recent advancements enlarge the capabilities of large language models (LLMs) in zero-shot image-to-text generation and understanding by integrating multi-modal inputs. However, such success is typically limited to English scenarios due to the lack of large-scale and high-quality non-English multi-modal resources, making it extremely difficult to establish competitive counterparts in other languages. In this paper, we introduce the Ziya-Visual series, a set of bilingual large-scale vision-language models (LVLMs) designed to incorporate visual semantics into LLM for multi-modal dialogue. Composed of Ziya-Visual-Base and Ziya-Visual-Chat, our models adopt the Querying Transformer from BLIP-2, further exploring the assistance of optimization schemes such as instruction tuning, multi-stage training and low-rank adaptation module for visual-language alignment. In addition, we stimulate the understanding ability of GPT-4 in multi-modal scenarios, translating our gathered English image-text datasets into Chinese and generating instruction-response through the in-context learning method. The experiment results demonstrate that compared to the existing LVLMs, Ziya-Visual achieves competitive performance across a wide range of English-only tasks including zero-shot image-text retrieval, image captioning, and visual question answering. The evaluation leaderboard accessed by GPT-4 also indicates that our models possess satisfactory image-text understanding and generation capabilities in Chinese multi-modal scenario dialogues. Code, demo and models are available at ~\url{https://huggingface.co/IDEA-CCNL/Ziya-BLIP2-14B-Visual-v1}.

cs.CL↗

arXiv2023

Turning non-magnetic two-dimensional molybdenum disulfide into room temperature magnets by the synergistic effect of strain engineering and charge injection

The development of two-dimensional (2D) room temperature magnets is of great significance to the practical application of spintronic devices. However, the number of synthesized intrinsic 2D magnets is limited and the performances of them are not satisfactory, e.g. typically with low Curie temperature and poor environmental stability. Magnetic modulation based on developed 2D materials, especially non-magnetic 2D materials, can bring us new breakthroughs. Herein, we report room temperature ferromagnetism in halogenated MoS2 monolayer under the synergistic effect of strain engineering and charge injection, and the combined implementation of these two processes is based on the halogenation of MoS2. The adsorbed halogen atoms X (X = F, Cl, and Br) on the surface leads to lattice superstretching and hole injection, resulting in MoS2 monolayer exhibiting half-metallic properties, with one spin channel being gapless in the band structure. The Curie temperature of halogenated MoS2 monolayer is 513~615 K, which is much higher than the room temperature. In addition, large magnetic anisotropy energy and good environmental stability make halogenated MoS2 display great advantages in practical spintronic nanodevices.

cond-mat.mtrl-sci↗

arXiv2023

Edge Based Oriented Object Detection

In the field of remote sensing, we often utilize oriented bounding boxes (OBB) to bound the objects. This approach significantly reduces the overlap among dense detection boxes and minimizes the inclusion of background content within the bounding boxes. To enhance the detection accuracy of oriented objects, we propose a unique loss function based on edge gradients, inspired by the similarity measurement function used in template matching task. During this process, we address the issues of non-differentiability of the function and the semantic alignment between gradient vectors in ground truth (GT) boxes and predicted boxes (PB). Experimental results show that our proposed loss function achieves $0.6\%$ mAP improvement compared to the commonly used Smooth L1 loss in the baseline algorithm. Additionally, we design an edge-based self-attention module to encourage the detection network to focus more on the object edges. Leveraging these two innovations, we achieve a mAP increase of 1.3% on the DOTA dataset.

cs.CV↗